Set up an AR+VS level

Introduction

AR+VS is designed to allow using a VS Internal Compositing Plane in an AR scene so we can put virtual elements behind the talent.

Screenshot 2024-10-08 at 12.54.59.png
AR+VS scene

In a normal AR scene, every virtual element is in front of the AR backplane (the camera video input). We can use AR holdouts or Shadow/Reflection catchers to block virtual elements so they appear behind the real world objects. This requires an exact 3D replica of the real world object and precise positioning.

image-20250410-025847.png
AR scene

However if we want our talent to be in front of AR elements, it will be impossible to do in a normal AR scene. That’s where AR+VS comes in. In AR+VS compositing mode, the AR backplane is still the camera input video, but in addition you are able to use VS Internal Compositing Planes. This way you can have virtual elements in between the AR backplane and the keyed camera input.

image-20250410-033339.png
AR+VS scene
image-20250410-034638.png
Use the chroma keyer on a football field to put virtual elements underneath players.
Screenshot 2024-10-08 at 11.53.30.png
Transition between a green screen and a real studio set.

Prerequisite

To make AR+VS work, “Unified compositing” needs to be enabled in project settings.

Unified Compositing in Project Settings > Pixotope - General is now enabled by default.

Changing this setting will require to reconvert any AR holdout object.

  1. Right click the object which is used as AR holdout

  2. Select "Convert … to AR Holdout" to convert it again

Green screen based

Use when integrating people who transition between the real and the virtual world using a green screen.

Screenshot 2024-10-08 at 11.53.30.png

Set up same as VS level

Follow the example on how to Set up a VS level

Enable AR+VS

  1. In Director: Add the machine to the "AR+VS" Render group in SETUP > Configure > Machines

Update the Chroma Screen actor

  1. Set Feather on the Chroma Screen Parametric & Plane actor to 0

    Screenshot 2024-05-27 at 16.13.39.png


  2. While keeping Mask only with Chroma Screen of the attached compositing plane set to true

    Screenshot 2024-05-27 at 16.14.24.png