XR - Broadcasting 3D content on the LED screens

XR - Broadcasting 3D content on the LED screens

Utilize your LED screens as windows into a 3D world.

XR projects require a specific XR/AR license. If you'd like to try out these features to decide whether you want to purchase an XR/AR license, please contact us.

The goal of this step is to display 3D content on the LED screens through a mapping method that creates the illusion of these screens acting as windows into a virtual world.

Setting Up the pipeline

Content Map distortion

Create a Content Map This section describes how to set up your content maps and use Content Area Read More with a minimum image resolution equal to or greater than the resolution of your camera stream. For example, if your camera stream is in Full HD, ensure that the Content Map This section describes how to set up your content maps and use Content Area Read More is at least Full HD. Set the Content Map Current Camera A specific camera that pull it's View and Transform form a Content Map Read More parameter of your Content Map This section describes how to set up your content maps and use Content Area Read More to the tracked Physical Camera A camera that simulate a real-one Read More .
Drag and drop this Content Map This section describes how to set up your content maps and use Content Area Read More inside the internal processor of each Led Screen Screens with a pitch and a luminosity Read More .
Set their renderer type to Warp to Geometry Warp the Content Map onto a Stage Geometry according to a perspective point of view. Read More .
This renderer will apply a distortion of the Content Map This section describes how to set up your content maps and use Content Area Read More to warp the content onto the LED screens, according to the perspective point of view of a camera. As you have set the Content Map Current Camera A specific camera that pull it's View and Transform form a Content Map Read More parameter of your Content Map This section describes how to set up your content maps and use Content Area Read More to the tracked Physical Camera A camera that simulate a real-one Read More , the deformation will be applied according to the perspective of the Physical Camera. The deformation will be adjusted in real-time as the camera moves.
Since this Content Map is going to be used to display the background, you can rename it 'back'.

Broadcast content on the LED screens

Smode Compos

In the Show Contains all the video content of the project Read More , create a Compo Composite 2D Layer, Shape layer and 3D Layer together. [Ctrl] + [Shift] + [N] to create a new composition after opening Smode Read More that will be used for the background content and select the 'back' Content Map This section describes how to set up your content maps and use Content Area Read More as target.
Since the content will be a 3D scene, you need a camera to choose the point of view from which you are looking at the scene. Therefore, create a Content Map Current Camera A specific camera that pull it's View and Transform form a Content Map Read More and select your Content Map This section describes how to set up your content maps and use Content Area Read More in its settings.
Then set the Compo Composite 2D Layer, Shape layer and 3D Layer together. [Ctrl] + [Shift] + [N] to create a new composition after opening Smode Read More 's Current Camera to the Content Map Current Camera A specific camera that pull it's View and Transform form a Content Map Read More .

Unreal Content

If you want to use Unreal Content, please read the topic: Unreal Device The Unreal Device hosts the connection with Unreal Read More and follow: How-To Unreal In Smode How to integrate your Unreal content inside Smode Read More .

Notch Content

If you want to use Notch Content, please follow: How-To-Notch-XR Using Notch Content for a XR setup Read More

You can now proceed to the next step: XR - Extended and augmented reality Final VFX processor for compositing the camera with the set extension and AR Read More .

See Also: