Masking and feathering

Pixotope provides several ways to control how video and 3D graphics blend together. Use masking to block or cut out parts of the video, and feathering to create soft transitions at the edges.

Which tools you use depends on your production type:

AR

AR Holdouts and AR Translucent Holdouts

AR Holdouts define areas where video should show through virtual content, for example, to let a real-world desk appear in front of a virtual background.

You can turn any 3D object into an AR holdout.

  • The render layer for this object is changed to AR Holdout or AR Translucent Holdout

  • An AR Holdout or AR Translucent Holdout material is assigned

The AR Translucent Holdout material allows to control the feather.

Screenshot 2026-02-17 at 13.42.57.png
How to set up a custom linear gradient
  1. Right click the 3D object and click "Convert object to Translucent Holdout"

  2. Create a copy of the "ARTranslucentHoldout" material in your project

  3. Open the copied material

  4. Add a "TextureCoordinate" and a "BreakOutFloat2Components" node and chain them into "Emissive Color" connector of the material

    2020-11-26 11_16_27-ARTranslucentHoldout.png


  5. To continue the holdout, just put an "Opaque Holdout" next to it

    TranslucentHoldout.jpg


For debugging

  1. Go to "World Settings" → "Pixotope World"

  2. Set the "Visualization Mode" to "Feathering Mask"

Multiple AR Holdouts composite correctly with each other, so you can place several holdout regions side by side without blending artifacts.

Learn more about how to Set up an AR level or Set up an AR+VS level

VS

VS Internal Compositing Plane feathering

Each VS Internal Compositing Plane has per-plane feathering controls in its which can be accessed via

  • Director: PRODUCTION > Composite > Plane specific

Learn more about how to Adjust composite

  • Editor: Details panel, under the Feather section

    Screenshot 2026-02-17 at 13.50.58.png

Learn more about the Compositing Plane

Learn more about how to Set up a VS level or Set up an AR+VS level

Feathering Garbage Matte

This actor masks out parts of the video feed with soft, adjustable edges.

Screenshot 2026-02-17 at 13.51.18.png

Mask out video using a feather pass

How to use feather pass to mask out video
  1. Add a plane or any mesh acting as a garbage matte plane

  2. Create a new material

    1. Set the blend mode to Translucent

    2. Enable "Render in Pixotope Feather Pass"

      01b777bb-abe9-4c70-8cb1-f9ef42962723#media-blob-url=true&id=c7328db3-b749-41c1-8b80-d3d48e0b7fa8&contextId=54762&collection=


  3. Assign this material to the plane via its Details panel

  4. Disable the following options under Rendering > Advanced

    • Render in Main Pass

    • Render in Depth Pass

    • Render CustomDepth Pass

      Screenshot 2022-09-05 at 16.31.20.png


To make it work with Cast shadow on VS or Light up VS plane enabled also do the following:

  1. On the VS Internal Compositing Plane

    1. Enable Feather

    2. Set Feather Near to 1

    3. Set Feather Far to 1

      Screenshot 2022-09-05 at 16.34.03.png


XR

XR Holdouts (Digital Twin)

For every body of a Digital Twin XR actor an XR Holdout is dynamically created. It prevents AR extensions from occluding the LED volume in that area.

As they have to be applied to the machines rendering the set extension (AR), the XR Holdouts are not rendered on machines with the the Render group set to XR.

Learn more about how to Create holdouts - Digital Twin XR

Screen space holdout blur

For opaque holdouts (such as a physical desk in front of an XR wall), you can apply a screen space blur to soften the holdout boundary in the final output. The blur is applied to

  • AR holdouts/AR translucent holdouts

  • XR holdouts

  • Feathering garbage mattes

  • VS Internal Compositing planes

and controlled via the console variable: Pixotope.Compositing.BlurFeather

Learn more about Useful console commands