XR - Latency Calibration

1) Theory

This step calculate a frame number of delay between the content broadcast in the Screens and the reception of it in the camera. It set a Frame Delay Travel an x number of frames into the past Read More according to the result. Indeed, there is delay between the moment Smode is broadcasting a content in the screens and the moment this pictures is actually get back as video input. This is the close loop latency.
The main objective of this part is to count the number of frames that there is between these 2 moments. In order to do it, Smode will a broadcast a White Glitch in each screens and will wait to see it in the video input.
The difference in time between the moment of emission and reception is equals to the delay you will have to apply on the set extension and content broadcasted in the screens.
The example below is a simplified illustration of a XR set-up with 6 frames of delay.

2) Before Starting a Latency Calibration

Before launching the latency calibration, you must ensure that:

1. Your Smode is fully optimized in graphical performances. Use the Profiling Enable/Disable performance profiling Read More feature if needed.
2. The frame rate is stable. If not, it might be because your set-up isn't fully genlocked
3. You are filming every impacted screens
4. the camera does not move
5. Alert people not to pass in front of the camera

Once you ensure the previous points, you can start a calibration.

3) UI Check-out

1) Viewport : Display the stream of the XR Calibrator A specific tool for XR calibration Read More Video Input Extract the image from a Video Input Device Read More
2) Tracker information : Display the current position orientation of the Tracker a Tracker represent a real tracker and is part of a Tracking System Read More of the Physical Camera A camera that simulate a real-one Read More such as the deviation. A positive value of Position Deviation and Orientation Deviation means that your tracker is currently moving.
3) Added delay : (Frame) delay added for each screen in result of the XR - Latency Calibration Automatically evaluate the amount of frame delay between sending a picture to the stage and receiving it back through the camera. Read More , if some of your screen are faster than other.( if not all screen are at 0 Added delay you may have to check your setup, and look for some hardware that add delay on some of the screen)
4) Delay in frames : (Frame) delay calculated by the algorithm.
5) Delay Mean : (ms) Average time between the emission of a white content and its reception.
6) Delay Standard Deviation : actual difference between the delay mean (which is an average) and the actual time between emission and reception. If this value is not 0 your setup is probably not genlocked

4) Calibration process

To launch this calibration part, simply press "calibrate" on the XR Calibrator Editor Editor panel for XR Calibrator Read More
and this is what should happen:
Once you have the Delay you can apply it into your Extension and AR in the VFX processor, as explained here: XR - Extended and augmented reality Final VFX processor for compositing the camera with the set extension and AR Read More

TroubleShoots

If you have a Standard Deviation not at 0 for all screen:

• Your setup is not genlocked ?
• Check the EDIDs of each screens.
• Smode is dropping ?
  
• Smode is not optimized, use the Profiling Enable/Disable performance profiling Read More feature
• First of all you must ensure you camera and led screen are at same refreshRate
• Smode requested Frame-rate is the same as your screen refreshRate