Camera Tracking

Create a control device

In an XR or AR project, Smode needs to know the position of your camera in real-time. This allows Smode to synchronize the movement of the virtual camera in 3D space, ensuring that the image on the LED screens is consistent from the camera's perspective.
To obtain real-time information about the camera's position, you need to use a tracking system.

To establish a connection between your tracking system and Smode for real-time data retrieval, you must create a Control Device Use any external controllers such as MIDI or OSC, DMX, and ArtNet Read More in the Preferences Smode Preferences panel Read More panel. Click the Add button to create a new Control Device, and select the type of tracker you are using from the list.
In this example, we will use a Stype Tracking Device.
Configure the address and port of the device. If another application needs to access the data of this device , check "Reuse local port".
Once your device is configured, you should see incoming data in the Devices Panel Visualize and manage audio/video inputs/outputs, clocks, and controllers connected to Smode Read More :

Create a tracking System

In the Stage 3D modeling of the real-world video setup Read More , create a Tracking System To visualize tracked points using a tracking device Read More and place it above other stage elements . Select the tracking Control Device Use any external controllers such as MIDI or OSC, DMX, and ArtNet Read More you created from the list of devices in the tracking system's settings.
A Tracker a Tracker represent a real tracker and is part of a Tracking System Read More will be created in your tracking system.

Create a physical Camera

Create a Physical Camera A camera that simulate a real-one Read More . It is a specific camera designed to simulate a real one. By default, it's placement is of the Link To Tracker Placement relative to tracker Read More type.
Select the Tracker a Tracker represent a real tracker and is part of a Tracking System Read More associated with your camera.
Place the camera in a Stage Elements Group Group multiple stage elements together Read More and position it in between the tracking system and the LED screens.

Layers order

At this point, all the necessary Stage Element An element inside the Stage Read More have been created. To ensure your calibration works, please follow this order of layers:

1. Tracking System
2. Physical Camera
3. Floor LED screen
4. First LED screen wall
5. Second LED screen wall

Example:

• Correct:
  
• Correct: the positions of the LED screen walls are interchangeable:
  
• Not correct: the tracking system isn't in first position in the tree:
  
• Not correct: the Camera isn't in second position in the tree:
  
• Not correct: the Floor isn't the first LED screen: