Eyeon:Manual/Fusion 6/Tracker

From VFXPedia

Jump to: navigation, search
Tracker

[ Main Manual Page ]


  • Tracker

Tracker [Tra]

Image:Icon_Tracker.png

The Tracker is used to detect and follow one or more pixel patterns across frames in moving video. The tracking data can then be used to control the position or values of other tools in the composition (for example, the center of a Drip). Additionally, trackers can be used to stabilize an image, or to apply de-stabilization to one image based on the motion of another. Please also refer to the Tracking Explained section in the Appendices.


There is no limit to the number of trackers that can be used in one flow, or in the number of connections that can be made to a tracker. This chapter serves as a reference for the various controls in the Tracker, but we strongly suggest you read the more general information about using the tracker in the Tracking chapter.

The Tracker can be employed in two forms; as a tool in the Flow, or as a modifier attached to a control. When the Tracker is used as a tool in the Flow, the image tracked comes from the input to the Tracker tool. There is no limit to the number of patterns that can be tracked by a single Tracker tool.

When the Tracker is used as a modifier, its controls appear in the Modifier tab for any tool with a control connected to that modifier. Only one pattern can be tracked in by a Tracker Modifier, but the image source can come from anywhere in the composition. This technique is generally used when tracking a quick position for a control.

Contents


X/Y Paths By default the Tracker applies a Displacement Path to the tracked points. To apply an XY Path to the tracked points go to

Preferences -> Globals -> Splines
and set Tracker Path to XY Splines.



Trackers Tab


Track Buttons

There are four buttons used to initiate tracking, and one in the middle used to stop a track in progress. These buttons can track the current pattern forward or backward in time. Hold the mouse pointer over each button for a moment and a tooltip with the name of the button will appear.

The buttons operate as follows :


Image:F61_Tool_Tracker_Icon_Reverse.png

Track Reverse

Clicking on this button will cause all Active trackers to begin tracking their patterns, starting at the end of the render range and moving backward through time until the beginning of the render range.

Image:F61_Tool_Tracker_Icon_Reverse_CT.png

Track Reverse From Current Time

Clicking on this button will cause all Active trackers to begin tracking their patterns, starting at the current frame and moving backward through time until the beginning of the render range.

Image:F61_Tool_Tracker_Icon_Stop.png

Stop Tracking

Clicking on this button will Stop the tracking process immediately. This can also be achieved by pressing ESC. This button will only be active when tracking is in process.

Image:F61_Tool_Tracker_Icon_Forward_CT.png

Track Forward From Current Time

Clicking on this button will cause all Active trackers to begin tracking their patterns, starting at the current frame and moving forward through time until the end of the render range.

Image:F61_Tool_Tracker_Icon_Forward.png

Track Forward

Clicking on this button will cause all Active trackers to begin tracking their patterns, starting at the first frame in the render range and moving forward through time until the end of the render range.


Frames Per Path Point

This value of the slider determines how often the Tracker sets a Keyframe on the Path. The normal default is 1, which sets a Keyframe on the tracked path at every frame. Increasing the value of this slider will cause the tracked path to be less accurate. This may be desirable if the track is returning fluctuating results, but under normal circumstances this control should be left at its default value.


If the project is field rendered, a value of 1 sets a Keyframe on every field. Since the tracker is extremely accurate, this will result in a slight up-and-down jittering due to the position of the tracked pattern fields. For fielded footage tracked in field mode you will get better results setting this slider to a value of 2, which will result in one keyframe per frame of your footage.


Adaptive Mode

Fusion is capable of re-acquiring the tracked pattern as needed, to help with complex tracks. This button array determines what mode of Adaptive tracking is employed.


None

If selected, Fusion searches only for the pattern originally selected in each single frame.


Every Frame

If selected, Fusion re-acquires the pattern every frame. This helps the tracker compensate for gradual changes in profile and lighting over time.


Best Match

If selected, the Tracker will compare the pattern acquired at each frame and compare it to the original selected pattern. If the variation between the two patterns exceeds the threshold amount defined by the Match Tolerance control, Fusion will not re-acquire the pattern on that frame. This helps to avoid tracker drift caused by transient artifacts that cross the pattern's path (such as a shadow).


Path Center

The two buttons in this button array determine how the Tracker behaves when re-positioning a pattern. These controls are used when switching a path from one pattern to another, which happens when a pattern leaves the frame, or changes so significantly it can no longer be tracked.


Pattern Center

When Pattern Center is the Active mode, the tracked path continues from the center of the new path. This is appropriate when replacing an existing path entirely, but when trying to append to a path using a new pattern, this will cause a discontinuity.


Track Center (append)

When Track Center (append) is selected, the path tracked by a new pattern will be appended to the existing path. The Path created is automatically offset by the required amount. This technique will work best if the new pattern is located close to the position of the old pattern to avoid any problems with parallax or lens distortion. This mode can also be used to virtually continue the tracking of patterns that move out of the frame or get obstructed by other objects.


Add / Delete Tracker

Use these to add or delete Trackers from your Tracker List.


Add

Add a new Tracker


Delete

Delete the tracker that is currently selected in the Tracker List.


Tracker List

The Tracker List shows the names of all of the patterns created on this tracker. It is also used to add new trackers. The Tracker tool is capable of hosting a virtually unlimited number of tracker patterns.

Click on the Add button immediately above the list to add a new tracker pattern. Each pattern appears in the list by name, next to a small checkbox. Clicking on the name of the pattern will select that pattern. The controls below the list will change to affect that pattern only. Click once on a selected pattern to rename the pattern to something more descriptive. Clicking on the checkbox changes the state of the Tracker.


Tracker States


Enabled
(Black Checkbox)

Image:F61_Tool_Tracker_List_Enabled.png
An Enabled pattern will re-track each time the track is initiated. Its path data is available for use by other tools, and the data is available for Stabilization and Corner Positioning.


Suspended
(Grey Checkbox)

Image:F61_Tool_Tracker_List_Suspended.png
A Suspended pattern does not re-track when the track is initiated. The data is locked to prevent additional changes. The data from the Path is still available for other tools, and the data is available for advanced tracking modes like Stabilization and Corner Positioning.


Disabled
(Clear)

Image:F61_Tool_Tracker_List_Disabled.png
A Disabled pattern does not create a path when tracking is initialized, and its data is not available to other tools, or for advanced tracking operations like Stabilization and Corner Positioning.


Show

These two buttons determine what controls are displayed in the tool controls. They have no effect on the operation of the Tracker, they only affect the interface.


Selected Tracker Details

When Selected Tracker Details is selected, the controls displayed pertain only to the currently selected tracker. You will have access to the Pattern Window and the Offset sliders.


All Trackers

When All Trackers is selected, the pattern window for each of the trackers is displayed simultaneously below the Tracker List.

Pattern Display : Selected Pattern

Image:F61_Tool_Tracker_PatternDisplay.png


Left Pattern Display

The Pattern Display has two image windows next to each other, and a series of status bars. The window on the left shows the pattern initially selected, while the one on the right shows a real-time display of the current pattern as tracking progresses.

As the onscreen controls are moved for a pattern, the display in the leftmost window will update to show the pattern. As the pattern is moved, the clarity and contrast of the image channels is indicated by the vertical bars immediately to the right of the image display.

The channel, or channels, with the best clarity are automatically selected for tracking. These channels have a white background in the vertical bar representing that channel. The automatic tracking can be allowed to stand, or you can override the automatic selection and choose the channel used for tracking by disabling the button labelled with a question mark, and selecting the button beneath the channel to track.

Under normal circumstances, the channel selected is indicated in the Pattern Display. If the selected channel is blue, then a greyscale representation of the blue channel for the pattern appears. The image is only represented in full color if all three channels are selected for tracking.

Override this behavior by selecting the Show Full Color button beneath the Pattern Display, instead of the Show Selected Channel button.


As Fusion looks for the channel with the highest contrast automatically, you might end up tracking the boue channel, especially on scanned film material. Unfortunately the blue channel on most filmstock contains the most grain as well, which naturally leads to unclean tracks. Before tracking it's always a good idea to zoom into your footage and check the RGB channels individually.


Right Pattern Display

The Pattern Display on the right indicates the actual pattern acquired for tracking. This display is clear until the first time the selected pattern is actually tracked. The Pattern Display becomes active during tracking, displaying the pattern that Fusion acquires from frame to frame.

As the tracking occurs, the pattern from each frame is accumulated into a Flipbook, which can be played back in the pattern window after tracking by using the transport controls at the bottom of the window.

While the track is progressing, the vertical bar immediately to the right of the pattern shows how confident Fusion is that the current pattern matches the originally selected pattern. A green bar indicates a high degree of confidence that the current pattern matches the original. A yellow bar indicates less certainty, and a red bar indicates that Fusion has detected extreme variations in the current pattern, and is no longer certain of its accuracy.

After tracking, the pattern display will show a small flipbook of the track for that pattern, overlaid with a frame number to help identify problem frames for the track


Pattern Width And Height

Image:F61_Tool_Tracker_WidthHeight.png

Use these controls to adjust the width and height of the selected tracker pattern manually. The size of the tracker pattern can also be adjusted in the display view, which is the normal method, but small adjustments are often easier to accomplish with the precision of manual controls.


Search Width And Height

The search area defines how far Fusion will look in the image from frame to frame to re-acquire the pattern during tracking. As with the Pattern Width and Height, the Search Area can be adjusted in the display views, but you may want to make small adjustments manually using these controls.


Tracked Center

This positional control indicates the position of the tracker's center. To remove a path from a tracker pattern, right-click on this control and select Remove Path from the context menu.


X And Y Offset

You will often need to track the position of an object in the scene, but that object does not provide for a very reliable pattern. The Offsets permit the tracking of something close to the intended object instead. Use these Offsets to adjust the reported position of the Tracker so that the data is reported for the intended pattern instead of the actual one. File:F6 Tool Tracker Icon Offset.png
The Offset can also be adjusted directly in the view by activating the "allow moving the positioner's offsets" icon next to your view.





Operation Tab


The Tracker tool is capable of performing a wide variety of functions, from match moving an object into a moving scene, smoothing out in a shaky camera movement, or replacing the content of a sign.

Use the options and buttons in the Operation tab to select the function performed by the Tracker tool.

Please also refer to the Tracking Explained section in the Appendices.


Operation Buttons

These four buttons select the exact function performed by the Tracker. The remaining controls in this tab fine tune the result of the Operation.


None

The Tracker performs no additional operation on the image beyond simply locating and tracking the chosen pattern. This is the default mode, used to create a path that will then drive another control in Fusion.


Match Move

This mode is used when stabilizing an image, or when matching the position, rotation and scaling of the layer for match moving another element into the scene. Stabilizing requires a minimum of one tracker to determine position, and two or more to determine scaling and rotation in the sequence.


Corner Positioning

The Corner Positioning mode is used to track the four corners of a rectangular object, and replace the contents with a new image. A minimum of four trackers is required for this mode, and if there are not enough trackers, new ones will be created until the total equals four.


Perspective Positioning

This mode is similar to the Corner Positioner but, rather than replacing the contents of the rectangle, the four tracked corners are mapped to the four corners of the image. This is generally used to remove Perspective from an image. Like the Corner Positioner, this mode requires four trackers, which will be created if there are not already that many.


Merge

The Merge control determines what is done (if anything) with the image provided to the foreground input of the Tracker. This array of buttons appears when the operation is set to anything other than None.


BG Only

The foreground input is ignored, only the Background is affected. This is used primarily when Stabilizing an image sequence.


FG Only

The Foreground input is transformed to match the movement in the background, and this transformed image is passed through the Tracker's output. This Merge technique is used when match moving one layer's motion to another's.


FG Over BG

The Foreground image is merged over the Background image, using the Merge method described by the Apply Mode control that appears.


BG Over FG

The Background is merged over the Foreground. This technique is often used when tracking a layer with an Alpha channel so that a more static background can be applied behind it.


Apply Mode

This drop-down menu provides a variety of options to determine how the two layers should be combined. The options in this menu are explained in more detail in the reference chapter for the Merge tool.


Subtractive - Additive

This determines whether the foreground layer is placed over the background in using Additive or Subtractive merging techniques. This control is explained in more detail in the documentation for the Merge tool.


Edges Match Move

This button array only appears if the Operation mode is set to Match Move. The various options select how the revealed edges are handled when the image is moved to match position and scaling.


Black Edges

Out of frame edges revealed by Stabilization are left black.


Wrap

Portions of the image moved off frame to one side are used to fill edges that are revealed on the opposite side.


Duplicate

The last valid pixel on an edge is repeated to the edge of the frame.


Position, Rotation, And Scaling Checkboxes

The Position, Rotation and Scaling checkboxes only appear when the mode is set to Match Move. They determine what components of motion that stabilization will attempt to correct in the image. For example, if only the Position checkbox is selected, no attempt will be made to correct for Rotation and Scaling in the image.


Flatten Transformation

This checkbox only appears when the mode is set to Match Move. Like most transformations in Fusion, Stabilization is concatenated with other sequential transformations by default. Selecting this checkbox will flatten the transform, breaking any concatenation taking place and applying the transform immediately.


Mapping Type

The Mapping Type control only appears in the Corner Positioning mode. There are two options in the button array.


Bi-Linear

The first method is Bi-Linear where the FG image is mapped into the BG without any attempt to correct for perspective distortion. This is identical to how previous versions of Fusion operated, and the Classic mode is included pretty much for compatibility reasons only.


Perspective

The preferred setting for this control is True Perspective.


Corner Selector

When the operation of the Tracker is set to either Corner or Perspective Positioner modes, these four drop-down menus appear. They are used to select which trackers map to each of the four corners of the rectangle used by these modes. This is useful when a tracker has more than four patterns selected, and you must choose which are used by the positioners.


Rotate Buttons

These controls only appear when the operation of the Tracker is set to either Corner or Perspective Positioner modes. They are used to rotate the FG image by 90 degrees before it is applied to the BG.


Stabilize Settings

The Tracker tool automatically outputs several steady and unsteady position outputs to which other controls in the Flow can be connected. The Stable Position output provides X and Y coordinates to match or reverse motion in a sequence. These controls are available even when the operation is not set to Match Move, since the Stable Position output is always available for connection to other tools.

See the Tracking page for details.


Axis Type (Stabilize Setting)

Under virtually all circumstances, the axis for any stabilization should be the average position of all trackers on that frame, however, the rare occasion arises when the tracker's axis must be elsewhere.

This array of buttons allows for the selection of an axis for the Stabilization based on the position of a single tracker, or a manual position.


Reference (Stabilize Setting)

The Reference controls are used to set the `snapshot frame' for Stabilization. When you stabilize an image, there must be a position that is considered correct, to which all subsequent movement is detected, and corrected.


Select Time

The Select Time Reference mode determines the `snapshot frame' based on the frame where the pattern is first selected. All Stabilization is intended to return the image back to that reference.


Start

The snapshot frame is determined to be the first frame in the tracked path. All Stabilization is intended to return the image back to that reference.


Start And End

The Start and End Reference mode is somewhat different from all other Reference modes. Where the others are intended to take a snapshot frame to which all stabilization returns, immobilizing the image, the Start and End mode is intended to smooth existing motion, without removing it. This mode averages the motion between the Start and End of the path, drawing a straight line between those points.

When this mode is Active, it reveals the Reference Intermediate Points control. Increasing the value of this control increases the number of points in the path used by the Reference, smoothing the motion from a straight line between start and end without making it wholly linear.


End

The snapshot frame is determined to be the last frame in the tracked path. All Stabilization is intended to return the image back to that Reference.






Onscreen Controls


Each pattern in the tracker has its own set of onscreen controls, used to select the pixels in the image to be tracked. These controls are visible in the display views whenever a tracker is selected in a flow.
Image:F6_Tool_Tracker_Onscreen_Normal.png
The onscreen control is indicated by a red rectangle with a handle in the top left corner. This rectangle indicates the position of the pattern in the image. Every pixel within the rectangle is considered to be part of the pattern used for tracking. Resize the pattern by clicking and dragging on the rectangles borders.

Image:F6_Tool_Tracker_Onscreen_Over.png
Whenever the mouse moves over the pattern rectangle, a second rectangle with a dashed outline appears. This represents the search area, which determines how far away from the current pattern the Tracker looks on the next frame. This should always be larger than the pattern, and it should be large enough to encompass the largest frame-to-frame movement in the scene. Faster moving objects require larger search areas and slower moving objects can get away with smaller search areas. The larger the search area, the longer it will take to track, so try not to make the search area larger than necessary.

Image:F6_Tool_Tracker_Onscreen_Move.png
Click-dragging on the handle repositions the pattern. While repositioning the pattern, a thumbnail window with an enlarged view of the pattern is displayed in the views, to assist with precise positioning of the pattern. This thumbnail disappears when the mouse button is released. The magnification ratio can be adjusted in the options tab. If the selected tracker has a custom name, the name of that tracker will be displayed as a label at the bottom right of the search area rectangle.





Options Tab


Show Pattern Names in Preview

This option defines if the Tracker's name will be displayed in the view. Switch it off to see just the Pattern Rectangle instead.


Show Enlarged Pattern On Dragging

This option defines if there is an enlarged view on positioning the Pattern Rectangle or not.


Enlargement Scale

The Zoom factor that is used on positioning the Pattern Rectangle when the above option is on.





Tips for Tracker (edit)

The outputs of a tracker (seen in the connect to... menu) can also be used by scripts. They are:

SteadyPosition:        Steady Position
UnsteadyPosition:      Unsteady Position
SteadyAxis:            Steady Axis
SteadySize:            Steady Size
UnsteadySize:          Unsteady Size
SteadyAngle:           Steady Angle
UnsteadyAngle:         Unsteady Angle
Position1:             Tracker 1: Offset position
PerspectivePosition1:  Tracker 1: Perspective Offset position
PositionX1:            Tracker 1: Offset X position (3D Space)
PositionY1:            Tracker 1: Offset Y position (3D Space)
PerspectivePositionX1: Tracker 1: Perspective Offset X position (3D Space)
PerspectivePositionY1: Tracker 1: Perspective Offset Y position (3D Space)
SteadyPosition1:       Tracker 1: Steady Position
UnsteadyPosition1:     Tracker 1: Unsteady Position

(similarly for the 2nd, 3rd and so on)



The contents of this page are copyright by eyeon Software.