stx_PatchPal - A opticalflow based warper,patcher and stabilizer

statixvfx
Posts: 31
Joined: Mon Aug 07, 2017 10:00 am

stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#1

Post by statixvfx » Tue Jan 30, 2018 1:59 pm

Heya,

I've put together a somewhat simplified version of Nuke's smart vectors. It uses the Optical Flow node to calculate motion vectors and then accumulates them based on a reference frame. Its quite slow to calculate, but quite fast once its cached as you can change your input patch with ease. It has two modes, one to track a patch on, and one to stabilize the BG.

Works best on plates with small and slow movements, any large movements will most certainly fail. Its NOT as good as Nuke's SmartVectors; yet :) But have saved my butt once or twice already.

Original, stabilized and warped.
ImageImageImage
(img from Hollywood Camera works)

Requirements : Fusion Studio, the FrameAverage.Fuse installed.

Get it through Reactor (best option!) or download directly here :
https://github.com/statixVFX/stx_tools/

Its a v0.1 so if anyone wants to build upon it I would be happy to make it a community effort.

User avatar
andromeda_girl
Fusionista
Posts: 320
Joined: Sun Feb 21, 2016 6:25 am
Been thanked: 1 time

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#2

Post by andromeda_girl » Thu Apr 12, 2018 6:31 am

...depending on what you're doing with nuke's smart vectors, it rarely gives satisfactory results either. it really does have limited applications and is just good on 'ideal' footage, just as i am sure it will be the same in fusion.
great you made this thing though... :)

User avatar
SecondMan
Site Admin
Posts: 3346
Joined: Thu Jul 31, 2014 5:31 pm
Answers: 1
Location: Vancouver, Canada
Been thanked: 64 times
Contact:

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#3

Post by SecondMan » Thu Apr 12, 2018 10:20 am

andromeda_girl wrote:
Thu Apr 12, 2018 6:31 am
depending on what you're doing with nuke's smart vectors, it rarely gives satisfactory results either

I beg to differ. In the right hands it's absolutely amazing. But it needs a lot of handholding/mixing tracks and patches etc. A bit like when you use a combo of 2D trackers and patchwork to fit something in a freehand camera shot.

Not that there isn't room for improvement - there is tons, like manual vector control etc, but perhaps Fusion could shine there...

sillycalvin
Posts: 1
Joined: Tue Apr 17, 2018 9:36 am

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#4

Post by sillycalvin » Tue Apr 17, 2018 9:38 am

Hello, I installed this and I would love to see some sort of tutorial on how to use it and I'm sort of a newbie at using fusion, thanks!

edenexposito
Posts: 29
Joined: Fri Mar 23, 2018 2:36 am

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#5

Post by edenexposito » Thu Aug 16, 2018 5:51 am

sillycalvin wrote:
Tue Apr 17, 2018 9:38 am
Hello, I installed this and I would love to see some sort of tutorial on how to use it and I'm sort of a newbie at using fusion, thanks!
+10

Someone know how to use it?

Thanks

tekgecko
Posts: 13
Joined: Sat May 11, 2019 11:56 am

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#6

Post by tekgecko » Thu May 30, 2019 1:24 am

Fantastic job! Are you still working on this?