Breadcrumbs

Use automatic delay detection

Looking for Automatic AR/XR delay detection?

Our automatic delay detection compares the input video's optical flow with the expected optical flow calculated from the tracking input. The basic workflow is

  1. Start detection

  2. Move the camera

  3. Apply the delay

Preparation

  1. Make sure

    • the camera systems are configured correctly

    • the tracked and virtual camera move correctly, though tracking does not necessarily have to be calibrated yet

    • the frame matching method is set correctly

    • in XR, when moving the camera in front of the LED wall

      • Set the XR display mode to "Identify" or "Pattern" (if available)

  2. Go to the Delays panel

  3. On the machine you would like to calibrate the active camera of

    1. Launch a level (LIVE or Preview Live)

    2. Point the camera towards areas with trackable features,
      but ensure that the input video does not have its own movement

Run delay detection

  1. Click on "Start delay detection" shown when hovering over the machine

    Screenshot 2024-05-10 at 15.06.15.png


  2. Rapidly move the camera in changing directions until notified

The detection duration varies based on confidence, but usually takes around 10 seconds. To improve accuracy/confidence

  • move the camera in changing speeds and directions

    • do not zoom in and out

  • make sure

    • there are enough trackable features seen by the camera at all times

    • to use an aperture which shows no/low motion blur

Screenshot 2024-05-10 at 14.39.31.png

  1. The detected difference between tracking and video is shown

    image-20240510-124213.png


  2. Click "Adjust delay"

    • The difference between tracking and video is applied as tracking delay

    • We do not change the video delay unless the tracking delay would become negative

Run transform and lens delay detection separately

  1. Click on the Break icon next to tracking delay

  2. Detect the transform delay the same way as described above

  3. Then click "Start lens delay detection"

    Screenshot 2024-05-10 at 15.19.58.png


  4. Randomly zoom in and out until notified

To improve accuracy/confidence

  • zoom the camera in and out in changing speeds

    • do not move the camera, but only change the zoom

  • make sure

    • there are enough trackable features seen by the camera at all times

    • to use an aperture which shows no/low motion blur

  1. The detected difference between tracking and video is shown

    image-20240510-132531.png


  2. Click "Adjust lens delay"

    • The difference of the delay is applied as tracking delay