Welcome to WSL!

New to the forum? Please read this and this.

stx_PatchPal - A opticalflow based warper,patcher and stabilizer

User avatar
statixvfx
Posts: 35
Joined: Mon Aug 07, 2017 10:00 am
Answers: 1
Been thanked: 1 time

stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#1

Post by statixvfx »

Heya,

I've put together a somewhat simplified version of Nuke's smart vectors. It uses the Optical Flow node to calculate motion vectors and then accumulates them based on a reference frame. Its quite slow to calculate, but quite fast once its cached as you can change your input patch with ease. It has two modes, one to track a patch on, and one to stabilize the BG.

Works best on plates with small and slow movements, any large movements will most certainly fail. Its NOT as good as Nuke's SmartVectors; yet :) But have saved my butt once or twice already.

Original, stabilized and warped.
ImageImageImage
(img from Hollywood Camera works)

Requirements : Fusion Studio, the FrameAverage.Fuse installed.

Get it through Reactor (best option!) or download directly here :
https://github.com/statixVFX/stx_tools/

Its a v0.1 so if anyone wants to build upon it I would be happy to make it a community effort.

User avatar
andromeda_girl
Fusionista
Posts: 578
Joined: Sun Feb 21, 2016 6:25 am
Been thanked: 3 times

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#2

Post by andromeda_girl »

...depending on what you're doing with nuke's smart vectors, it rarely gives satisfactory results either. it really does have limited applications and is just good on 'ideal' footage, just as i am sure it will be the same in fusion.
great you made this thing though... :)

User avatar
SecondMan
Site Admin
Posts: 4828
Joined: Thu Jul 31, 2014 5:31 pm
Answers: 31
Location: Vancouver, Canada
Been thanked: 39 times
Contact:

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#3

Post by SecondMan »

andromeda_girl wrote: Thu Apr 12, 2018 6:31 amdepending on what you're doing with nuke's smart vectors, it rarely gives satisfactory results either

I beg to differ. In the right hands it's absolutely amazing. But it needs a lot of handholding/mixing tracks and patches etc. A bit like when you use a combo of 2D trackers and patchwork to fit something in a freehand camera shot.

Not that there isn't room for improvement - there is tons, like manual vector control etc, but perhaps Fusion could shine there...

User avatar
sillycalvin
Posts: 2
Joined: Tue Apr 17, 2018 9:36 am

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#4

Post by sillycalvin »

Hello, I installed this and I would love to see some sort of tutorial on how to use it and I'm sort of a newbie at using fusion, thanks!

User avatar
edenexposito
Posts: 29
Joined: Fri Mar 23, 2018 2:36 am

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#5

Post by edenexposito »

sillycalvin wrote: Tue Apr 17, 2018 9:38 am Hello, I installed this and I would love to see some sort of tutorial on how to use it and I'm sort of a newbie at using fusion, thanks!
+10

Someone know how to use it?

Thanks

User avatar
tekgecko
Posts: 41
Joined: Sat May 11, 2019 11:56 am

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#6

Post by tekgecko »

Fantastic job! Are you still working on this?

User avatar
SecondMan
Site Admin
Posts: 4828
Joined: Thu Jul 31, 2014 5:31 pm
Answers: 31
Location: Vancouver, Canada
Been thanked: 39 times
Contact:

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#7

Post by SecondMan »

edenexposito wrote: Thu Aug 16, 2018 5:51 amSomeone know how to use it?
I finally get to this. It's actually very simple, but perhaps easier to show with a quick example (it's so quick that the aspect ratio couldn't keep up).

Image

In this example, I'm using the Warped Patch output, to track a little ellipse over the lady's mouth (please don't ask me why). The Reference Frame is set to 0, which means all deformations are calculated relative to this frame (and consequently, the warping done to the patch on this frame would be zero). Other than that all other settings are the tool's defaults.

Image

The plate used in this example can be found on the Hollywood Camera Work website for free. Look for the green screen plate called "hair detail".

Download the comp file here:
PatchPal_Setup.comp

PS. Holy moly. The rendertimes for this are way, WAY shorter in Fu16 than they were in Fu9. Impressive stuff! Thanks devs! :cheer:
You do not have the required permissions to view the files attached to this post.

User avatar
PolygonS
Posts: 1
Joined: Tue May 09, 2017 4:12 am

Re: stx_PatchPal - A opticalflow based warper,patcher and stabilizer

#8

Post by PolygonS »

Hey,
I'm so sorry for this super dummy question but... where do I have to put the "stx_tools-master" I just unzipped ?
I'm indeed very interested by this tool, but should i put the whole folder in Settings or Macros in the Me > Library > AppSupport > BMD > Fusion on my mac ?

Edit : ah sorry, drop that, I didn't read that Reactor was a choice, I'll do this ;)
THX anyway