Frame accurate syncing is essential in multi-machine setups.
Configure
-
Set up a primary timecode source
Learn more about how to Configure timecode (LTC) -
Set Multi-machine syncing to "Timecode" in SETUP > Show > Show settings > Base settings
-
Launch levels on all machines
-
Check if
-
timecode is available on all machines, by clicking on “Get all timecodes” in
-
SETUP > Calibration > Syncing
-
OR in the Status panel
-
-
A level needs to be running as the timecode is reported by the engine.
In case Multi-machine syncing is enabled and NO timecode is available:
-
All messages will still be processed, but they will not be in sync
Calibrate
-
Go to SETUP > Calibration > Syncing
For AR/VS
-
Calibrate the camera systems video and tracking delay for every machine separately
-
Learn more about how to Calibrate syncing between video and tracking
-
-
If using triggers, adjust the Execution time to sync the triggering across machines
-
Check if the output delays need to be adjusted
-
Hardware differences might require slightly different delays
-
For AR/VS with camera input switching
-
Calibrate each camera systems video and tracking delay for every machine
-
Learn more about how to Calibrate syncing between video and tracking
-
-
Calibrate the camera systems between each other
-
Use a real or AR/VS frame counter and switch between the cameras to see that no frames are dropped or duplicated
-
If they are not in sync, on the faster machine increase both tracking and video delay the same amount until both machines are in sync
-
-
If using triggers, you might have to adjust the Execution time to sync the triggering across machines
-
Check if the output delays need to be adjusted
-
Hardware differences might require slightly different delays
-
For XR with virtual set extension
When working with virtual set extensions, the time between filming the LED screen and displaying the rendered content should ideally be 0. As this is physically not possible we have to
-
reduce latency for XR machines
-
mitigate the remaining time difference between XR and set extension using a Set extension delay
This latency optimization has to be done in addition to calibrating syncing.
Calibrate syncing
-
Calibrate the camera systems video and tracking delay on the AR machine
-
Use AR and the real world for calibration - DO NOT USE THE LED SCREEN!
-
Learn more about how to Calibrate syncing between video and tracking
-
-
To reduce latency, decrease the delay
-
on the XR machines
-
tracking input
-
video output
-
-
on the AR machine
-
tracking input relative to the video input
-
-
-
Calibrate the Set extension delay to mitigate the remaining time difference
-
Learn more about how to Calibrate delays between AR and XR
-
Optionally, switch the reprojection method and disable Tracking extrapolation
-
-
If using triggers, you might have to adjust the Execution time to sync the triggering across machines
For XR with virtual set extension and camera input switching
-
Calibrate each camera systems video and tracking delay on the AR machine separately
-
Use AR and the real world for calibration - DO NOT USE THE LED SCREEN!
-
Learn more about how to Calibrate syncing between video and tracking
-
-
Calibrate the camera systems between each other
-
Use a real or AR frame counter and switch between the cameras to see that no frames are dropped or duplicated.
-
If they are not in sync, on the faster machine increase both tracking and video delay the same amount until both machines are in sync
-
-
Add the relative difference of the camera’s tracking delays onto the XR machine
-
To reduce latency, decrease the delays relative to all delays
-
on the XR machines
-
tracking input
-
video output
-
-
on the AR machine
-
tracking input relative to the video input
-
-
-
-
Calibrate the Set extension delay to mitigate the remaining time difference
-
Learn more about how to Calibrate delays between AR and XR
-
Optionally, switch the reprojection method and disable Tracking extrapolation
-
-
If using triggers, you might have to adjust the Execution time to sync the triggering across machines. For AR machines, the correct value will usually be the same one set for set extension delay
|
Set extension delay |
Add a delay to compensate for the time difference between XR and set extension rendering. |
|---|---|
|
Video reprojection |
|
|
Scene reprojection |
|
|
Tracking extrapolation |
Extrapolates tracking to reduce the potential artifacts introduced by the latency compensation. |
Set up timecode synchronized levels
Learn more about how to Set up timecode synchronized levels