Skip to main content
Skip table of contents

Using Cloud tools (experimental)

A Cloud Tools addon/license is needed

  • for result generation

For using the results no license is needed.

If in a multi-machine setup, add the Cloud Tools license on the Server machine.

The Cloud tools panel represents a collection of tools to make your virtual production life easier. We make recent algorithms available to you and integrate them into our workflow. The general workflow would look something like this:

  1. You provide a video, an image or a prompt depending on the chosen tool

  2. Our cloud does the calculations and notifies you when the results are ready to be used

As a first version we are starting with a tool that generates a 3D mesh from video.

Want to try it out?

How to get a trial license
  1. Click the "Contact us" button on the SETUP > Tools > Cloud tools panel

    Screenshot 2024-10-01 at 10.55.37.png

  2. Submit the form

    Screenshot 2024-10-01 at 11.00.59.png

  3. Our customer support team will be in touch

Handle the license

How to handle the Cloud tools license

After a license has been assigned to your admin, go to Pixotope Cloud and assign it to the one who will use it.

Learn more about how to Manage users and licenses

In Director

  1. Click on "Change license type" in the User menu on the top right

  2. Choose the Cloud Tools add-on

    Screenshot 2024-10-01 at 11.34.22.png

  3. The tool is now activate

If in a multi-machine setup, add the Cloud Tools license on the Server machine.

3D mesh from video

We start off with an experimental version of a tool allowing you to create a "3D mesh from video". While you record a video of your studio, we grab frames and send them up to the cloud, calculating a rough 3D mesh. This you can then import and use to align your scene.

This is a 4 step process:

  1. Record your studio

  2. Upload and generate

  3. Import the result

Record your studio

  1. Click the tool in the SETUP > Tools > Cloud tools panel

    Screenshot 2024-10-01 at 11.27.17.png

  2. Select the camera system with which you record

  3. Optionally: Change the number of images to capture

    • A higher number increases

      • the area you can cover

      • but also increases the recording and processing time

  4. Start the recording

    • We are capturing frames and choose the ones with the least amount of motion blur

Recording best practices

  • Cover the studio from different angles

    • Do not just rotate the camera, but move it!

  • Aim for a steady and not too fast camera motion to allow for sufficient overlap between captured images

  • Use a high shutter speed, avoid motion blur

  • Avoid reflections

Upload and generate

  1. Optionally: Check the captured images via the file explorer by clicking the icon next to the path

  2. Click the "Upload and generate" button

    Screenshot 2024-10-01 at 15.22.54.png

  3. The images are uploaded and the request for 3D mesh generation is queued

    • Time to completion is a very rough estimate based on

      • your place in the queue

      • an average processing time of ~4 minutes (for 30 images)

        Screenshot 2024-10-01 at 15.24.17.png

  4. We notify you when it is done

Import that result

  1. Select a level to import it to

  2. Click the "Open Editor and import" button

    Screenshot 2024-10-01 at 15.36.49.png

  3. This opens the selected level in the Editor and imports the mesh

View generated results

To view all generated results

  1. click "View results" in the Cloud tools panel

Screenshot 2024-10-01 at 15.43.52.png

Manually import the mesh

How to manually import the mesh
  1. Click "View results" in the Cloud tools panel

    • ...\Pixotope\[Version number]\Synced Config\CloudTools\3D mesh from video\Results

  2. Unzip the files content

  3. Open the Pixotope Editor

  4. In the Content Browser navigate to a folder you want to import the content to

  5. Select all files and drag them into the Content Browser

    Screenshot 2024-10-01 at 15.49.14.png
  6. For the Material just click "Import"

    Screenshot 2024-10-01 at 15.50.32.png

  7. For the Asset change

    • Offset Rotation X to 90

    • Offset Uniform Scale to 100.0

      Screenshot 2024-10-01 at 15.51.16.png

  8. A Mesh with a Material and its Texture are created

    Screenshot 2024-10-01 at 15.51.40.png

  9. Open the Material

    1. change its Shading Model to "Unlit"

      Screenshot 2024-10-01 at 15.56.46.png

    2. Plug the Multiply node into the Emissive Color

      Screenshot 2024-10-01 at 15.58.15.png

    3. Apply the changes and Save the material

  10. Drag the Mesh into the level and rotate as needed

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.