Skip to main content
Version: Reality 5.4 SP1

Green Screen Virtual Studio

Real-time Green Screen Virtual Studio is a specialized production setup used in film, television, and other media industries. It involves shooting a subject or scene against a cyclorama, which is replaced with your real-time rendered image by Reality 5.4 SP1 using RealityKeyer.

Process​

  • Select the Example Project from the Renderers section inside the Reality Hub Launcher module.

Launch With Option

  • Select Reality 5 in the Launch With section as illustrated above.
  • Click on the Launch button.

Engines on Node Details Panel

  • Go to the Engines tab, drag and drop the UE5 node into the Nodegraph canvas.

Engine Functions

  • Select the UE5 in the nodegraph canvas.
  • Click on the UE5 in the Nodes section.
  • Click on the Spawn Reality Camera and Spawn Reality Projection Cube buttons as illustrated above.

AJA Nodes

  • Add AJAIn and AJAOut nodes to the Nodegraph canvas.
  • Right-click on the AJAIn node and select an input channel from Node Context Menu.
  • Right-click on the AJAOut node and select an output channel.
  • Connect the corresponding SingleLink output pin of the AJAIn node to SingleLink input of the AJAOut node. (In our example we utilized SingleLink 2 and SingleLink 3)

  • Right click on the SingleLink 2 and utilize APM.
  • Add a Tracking Node (in our example it is the Xync node) into canvas.

  • Go to the Xync node property, click on the Enable checkbox.

Changing the Transform Mapping​

Xync Node | Transform Mapping Property Group

Depending on your studio setup, you may be required to change the Transform Mapping property group settings.

In our example, we have to change the NegateX, NegateZ, CoordinateSystem, and NegatePan properties, as illustrated above.

Breaking Track​

In order to get Lens Distortion data, you need to use the Break Track node.

Break Track Node

  • Create a Break Track node.
  • Connect the Xync node's Track Output pin to the Break Track node's Input pin.

Cyclorama Node Connections

  • Create an Undistort node.
info

Undistorting the image taken by your studio camera is necessary because almost every camera lens has some degree of optical distortion. On the other hand, the Cyclorama node creates a 3D shape that isn't affected by lens distortions. To make sure the Cyclorama and camera image match up correctly, it's crucial to use the undistortion process.

  • Go to the Properties of the Undistort node.
  • Right-click on the Distortion property and select the "Show as Input" option.
  • Connect the Lens Distortion output of the Break Track node to the Distortion input pin of the Undistort node.
  • Connect the SingeLink output pin of the AJAIn node to the In input pin of the Undistort node.
  • Connect the Out output pin of the Undistort node to Video input of the Cyclorama node.
  • Connect the Track output pin of the Xync node to Track input of the Cyclorama node.

RealityKeyer Node Connections

  • Create a RealityKeyer node and two Distort nodes.
  • Right-click on each Distort node's Distortion property and select the "Show as Input" option.
  • Connect the Render output pin of the Cyclorama node to the In input pin of the Distort node.
  • Connect the Mask output pin of the Cyclorama node to the In input pin of the second Distort node.
  • Connect the Lens Distortion output pin of the Break Track node to the Distortion input pin of the first Distort node.
  • Connect the Lens Distortion output pin of the Break Track node to the Distortion input pin of the second Distort node.
  • Connect the Out output pin of the first Distort node to the Clean Plate input of the RealityKeyer node.
  • Connect the Out output pin of the second Distort node to the Clean Plate Mask the input of the RealityKeyer node.
  • Connect the SingleLink 2 output pin of the AJAIn node to the Input input pin of the RealityKeyer node.

Utilizing Portal Ping and Routing Features​

At this stage, by its nature, the nodegraph gets complicated and hard to read as illustrated above. To overcome such issues, you can utilize a Portal Pin and Reroute feature.

Adding Portal Pin

  • Right-click on the SingleLink 2 output pin of the AJAIn node and select the "Copy Pin" option
  • Right-click on an empty space inside the Nodegraph Canvas and select & paste the previously copied pin as a portal pin as illustrated above.

Portal Pin Example

The AJAIn node's SingleLink 1 output pin becomes a Portal as illustrated above and can be used anywhere inside the nodegraph with the same functionality. Portal Pin also inherits any changes in the main node.

Node Network Example with Pin Portal and Reroute Features

  • Connect the SingleLink 2 portal pin to In input pin of the Undistort node.
  • Right-click on an empty space in the nodegraph canvas and paste the SingleLink 2 portal pin again.
  • Connect the second SingleLink 2 portal pin to the Sync input pin of the Xync node.
  • By following the previous behavior, convert the Lens Distortion output pin of the Break Track node into the portal pin.
  • Paste and connect the Lens Distortion portal pin to the corresponding input pins of nodes.
  • Add Rerouting between node connections you desire.

Green Screen Virtual Studio Pipeline Example

  • Add a second Undistort node to nodegraph.
  • Right-click on the Distortion property and select the "Show as Input" option.
  • Connect the Lens Distortion output pin of the Break Track node to the Distortion input pin of the Undistort node or create another Lens Distortion portal pin and connect it to the Distortion input pin of the Undistort node.
  • Connect the Output pin of the RealityKeyer node to the In input pin of the Undistort node.
  • Connect the Out output pin of the Undistort node to the Projection Cube Video Input input of the UE5 node.
  • Create another Xync Track portal pin and connect it to the Reality Camera Track input of the UE5 node.
  • Create a Composite Passes node.
  • Connect the RealityKeyer node's Output pin to Video input pin of the Composite Passes node.
  • Create another Xync Track portal pin and connect it to the Track input pin of the Composite Passes node.
  • Connect the RealityCamera Scene output pin of the RE5 node to the Render input of the Composite Passes node.
  • Connect the Output output pin of the Composite Passes node to SingleLink input pin of the AJAOut node.

Image Courtesy of Brand Mind Live Virtual Studio

Image Courtesy of BETV - Dreamwall