Matte Assist ML

Description

Generates evolving mattes over time using machine learning-based object segmentation and propagation. You can start with any combination of inputs: Mask ML, Roto, EZ Mask, or Input Alpha--whether from an alpha-embedded source or a node that generates alpha.

Matte Assist ML generates a binary matte. To create a more natural edge with partial opacity, you can use Matte Assist ML in conjunction with Edge Refine ML.

Go to the Matte Assist ML tutorial to see how it works.

Node Group

AI/ML, Key.

Controls

Create Mask ML, EZ Mask, Roto Node

Automatically creates a Mask ML, EZ Mask, or Roto Node node before Matte Assist ML with their Data output connected to the Data input.

Create Mask ML Node

Automatically sets the Mask Source to Cryptomatte (data port).

Create EZ Mask Node

Reference Frames is automatically set to Keyframes (data port).

Create Roto Node

Automatically sets the Mask Source to Roto (data port).

Mask Source

Cryptomatte

Generates a matte across the sequence using Cryptomatte enabled nodes--such as Mask ML--when connected to the Data input port. Objects and their corresponding keyframes are processed and tracked separately.

Input Alpha

Generates a matte throughout the sequence using single or multiple input alpha reference frames from any node or keyframes from the Mask ML, EZ Mask or Paint nodes. Input Alpha is meant to be used for matting a single object. For matting multiple objects use the Cryptomatte or Roto Mask Source options.

Roto

Generates a matte across the sequence using keyframes from Roto objects--such as Shapes and Layers--when connected to the Data input port. Each top-level item (shape or layer) in the Object List is treated as a distinct object and processed and output separately.

Note: For best performance when using multiple shapes for one object, place the shapes within a layer.

Reference Frames

Available with Mask Source > Input Alpha selected, choose from Frame, Markers or Keyframes options as the matte generation reference.

Frame

A matte is generated based on a single specified frame.

Markers

A matte is generated based on Markers.

See Marker for more information.

Keyframes

With either Mask ML, EZ Mask, or Paint Data outputs connected to the Data input port, a matte is generated based on the input node’s keyframes.

Notes:

• For faster performance and better edge quality, add a DOD node before Matte Assist ML and set the boundary around the object to be matted. It is OK to animate the DOD, but on Linux, animation of the DOD’s size is not supported.

• If you jump to another point in time, please be aware that Matte Assist ML always calculates the matte from frame 1, so it can take some time to update depending on the length of the sequence.

Propagation Mode

Controls at what frame matte propagation starts which can be both forward and backward from a frame.

Auto

Matte propagation starts with the first keyframe.

Custom

Matte propagation starts with the frame defined in Start Frame.

Start Frame

Sets the matte propagation start frame when in Custom mode and defaults to frame 1.

Node Outputs

Output

Outputs the foreground input and generated matte.

Data

When either the Mask Source > Cryptomatte or Roto options are selected and multiple objects are present in the Roto and Mask ML nodes, each object is output separately as Cryptomatte data. When the Data output is connected to the Data input of an Output Multi-Part node, the objects are written into their own EXR channels at render. The mattes in the rendered Cryptomatte EXR file can then be selectively turned on or off in Silhouette’s Cryptomatte node or other products that support Cryptomatte like Nuke and After Effects.