SONY VPT-CDP1 Virtual Production Tool Set Camera and Display Plugin User Guide

SONY VPT-CDP1 Virtual Production Tool Set Camera and Display Plugin

Specifications

• Product Name: Camera and Display Plugin
• Software Version: 1.0
• Compatibility: Sony VENICE (CineAltaV) series cameras, Crystal LED B-series, Crystal LED VERONA (VP-series) displays

Product Information

1. Introduction

Overview: The Camera and Display Plugin is a tool set designed for virtual production, specifically for in-camera VFX shooting using Unreal Engine. It includes the Virtual VENICE actor for pre-vis process, On-set Camera component, and Camera Control Panel for on-set shooting.

2. Preparation

Setup: To install the Camera and Display Plugin, an Internet connection is required for the initial launch to access the license server. The plugin remains enabled for 14 days after accessing the server. It’s necessary to reconnect to the Internet and access the server every 14 days when working offline.

3. Basic Operation

• Pre-Vis Process Operations: Utilize the Virtual VENICE actor for pre-visualization tasks.
• On-Set (Shooting) Process Operations: Use the Camera Control Panel and On-set Camera component for shooting processes in virtual production.

4. Settings

This section allows users to configure various settings related to camera control, display options, and shooting parameters.

5. Appendix

Troubleshooting: Troubleshoot any issues that may arise during the usage of the Camera and Display Plugin.

FAQs

• What are the system requirements for using the Camera and Display Plugin?
  • The plugin requires an Internet connection for initial setup and access to the license server. It is compatible with Sony VENICE series cameras and Crystal LED displays.
• How often do I need to connect to the license server when working offline?
  • To keep the plugin enabled, you need to reconnect to the Internet and access the license server every 14 days when working offline.

“`

Virtual Production Tool Set
Camera and Display Plugin
User Guide
Software Version 1.0

5-054-938-11 (1)
EN
© 2023 Sony Corporation

Introduction

Overview

About Camera and Display Plugin
“Camera and Display Plugin” is a plugin for Unreal Engine for in-camera VFX shooting used in virtual production. It comprises “Virtual VENICE actor” for the previs process, with “On-set Camera component” and “Camera Control Panel” for the on-set (shooting) process. It is compatible with the Sony “VENICE (CineAltaV) series” of digital cinema cameras and the “Crystal LED B-series” and “Crystal LED VERONA (VP-series)” large, high-definition LED displays.
Virtual VENICE actor
The Virtual VENICE actor is a camera actor for Unreal Engine, designed as a digital twin of the Sony VENICE Digital Cinema Camera series. Virtual VENICE reproduces the characteristics of VENICE, including the Look, by performing signal processing equivalent to that of a real VENICE camera. In the pre-vis process, it is possible to create images in the same way as when using a VENICE camera. The camera settings also correspond to the same items as a VENICE camera. You can quickly reproduce the image creation of a real VENICE camera in the pre-vis process by transferring Virtual VENICE settings to an actual VENICE camera using the Camera Control Panel in the on-set (shooting) process. In addition, a moiré alert function can predict the occurrence of moiré, even in the pre-vis process, where there is no real camera or LED display.

On-set Camera component
The On-set Camera component is an Unreal Engine component that adds the necessary functions for virtual production by associating it with the Unreal Engine standard Cine Camera actor. You can also calibrate the color characteristics of the camera and LED display to reproduce colors as intended using the Camera Control Panel, for configuring camera settings over a network, and the “Color Calibrator” application (option). The On-set Camera component functions facilitate efficient color workflows during the on-set (shooting) process. In addition, the moiré alert function can predict the occurrence of moiré in shooting environments where it would be difficult to see.
Camera Control Panel
The Camera Control Panel is a function for checking and changing settings on a real VENICE camera from Unreal Engine via a network. The image creation from the pre-vis process can be reproduced in the on-set (shooting) process by transferring Virtual VENICE settings to a real VENICE camera. You can also transfer settings from a real VENICE camera to Virtual VENICE to restart the pre-vis process using the same settings. Sharing settings between the pre-vis process and the on-set (shooting) process helps improve the work efficiency in each process.

4 1. Introduction: Overview

Camera and Display Plugin Structure
Pre-vis process
Virtual VENICE actor
[Functions] · Configure the camera device and LED display
used on-set to reproduce the color and framing in the output video · Export Virtual VENICE configuration to a file · Predict the occurrence of moiré
Export configuration
VENICE series configuration file

On-set (shooting) process

Camera Control Panel
[Functions] · Control and configure VENICE series via web
remote control · Import configuration file and apply to VENICE
series

On-set Camera component
[Functions] · Perform color calibration of camera device
and LED display · Predict the occurrence of moiré

Import configuration

Link to camera actor

Apply settings to real camera device

Cine Camera actor (Unreal Engine standard virtual cinema camera)
Display as camera for in-camera VFX

Display chart for color calibration Apply 3D LUT

VENICE series

Shooting

LED display

5 1. Introduction
Usage Precautions

Software Usage

Security

This manual or the software described herein, in whole or in part, may not be reproduced, translated or reduced to any machine readable form without prior written approval from Sony Corporation.
© 2023 Sony Corporation

SONY WILL NOT BE LIABLE FOR DAMAGES OF ANY KIND RESULTING FROM A FAILURE TO IMPLEMENT PROPER SECURITY MEASURES ON TRANSMISSION DEVICES, UNAVOIDABLE DATA LEAKS RESULTING FROM TRANSMISSION SPECIFICATIONS, OR SECURITY PROBLEMS OF ANY KIND.

SONY CORPORATION PROVIDES NO WARRANTY WITH REGARD TO THIS MANUAL, THE SOFTWARE OR OTHER INFORMATION CONTAINED HEREIN AND HEREBY EXPRESSLY DISCLAIMS ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE WITH REGARD TO THIS MANUAL, THE SOFTWARE OR SUCH OTHER INFORMATION. IN NO EVENT SHALL SONY CORPORATION BE LIABLE FOR ANY INCIDENTAL, CONSEQUENTIAL OR SPECIAL DAMAGES, WHETHER BASED ON TORT, CONTRACT, OR OTHERWISE, ARISING OUT OF OR IN CONNECTION WITH THIS MANUAL, THE SOFTWARE OR OTHER INFORMATION CONTAINED HEREIN OR THE USE THEREOF.

This software may only be used with the specified device.

Sony Corporation reserves the right to make any modification to this manual or the information contained herein at any time without notice.

6 1. Introduction
About This Manual

Trademarks

About the Display Screen

· Windows and DirectX are trademarks or registered trademarks of Microsoft Corporation in the U.S. and/or other countries.
· Unreal Engine is a trademark or registered trademark of Epic Games, Inc. in the United States of America and elsewhere.
· AMD is a trademark of Advanced Micro Devices, Inc.
· Intel is a trademark or registered trademark of Intel Corporation or its subsidiaries.
All system names, product names, and company names appearing in this document are registered trademarks or trademarks of their respective owners. Trademarked items are not indicated by ® or TM symbols in this document.

The displayed screen may vary from that shown in this document, depending on the computer and operating environment.

Preparation Setup

This section describes how to install Camera and Display Plugin and enable the plugin in Unreal Engine.
Operating Environment
Operating conditions
To use the plugin, an Internet connection is required when launched for the first time to access the license server. The proxy server for Internet connection uses the Windows OS proxy settings. [Note] The plugin is enabled for 14 days after accessing the license server. Note that when working offline, you will need to connect to the Internet and access the license server every 14 days.
Recommended operating environment
OS: Windows 10 version 22H2 (64-bit)
CPU: Quad core Intel or AMD, 2.5 GHz or higher
Memory: 8 GB RAM or higher
Graphics card: DirectX 11 or DirectX 12 compatible graphics card
For in-camera VFX shooting
You must prepare an operating environment that is recommended by Epic Games, Inc. For details, visit the Unreal Engine site by Epic Games, Inc.

Installing Camera and Display
Plugin
This section describes how to install Camera and Display Plugin using the “CameraAndDisplayPlugin_xxxxx_yyyyy.msi” installer. “xxxxx” in the file name indicates the version of the plugin and “yyyyy” indicates the version of Unreal Engine.
1 Run “CameraAndDisplayPluginxxxxx
yyyyy.msi.” The setup wizard launches. The software end user license agreement appears. Check the contents and place a check mark in [I accept the terms in the License Agreement] to proceed.
2 Specify the installation destination folder.
Specify the folder in which to install the plugin on the installation destination folder selection screen. If Unreal Engine is installed, by default the plugin will be installed directly in Unreal Engine. “Unreal Engine installation folderEngine Plugins” is displayed as the installation destination folder.
To install in an arbitrary folder Change the folder on the installation destination folder selection screen. If the plugin is installed in an arbitrary folder, copy the installation folder of the plugin to “Project_folderPlugins” to reference the plugin from your project.
[Notes] · Even if Unreal Engine is installed, the Unreal
Engine installation folder may not be detected properly. In this case, enter the folder path manually.

· If you install the plugin directly into Unreal Engine and then copy the installation folder of the plugin to a project folder, the copy of the plugin in the project folder takes precedence.
3 Follow the on-screen instructions to
complete the installation.
Uninstalling
Run “CameraAndDisplayPlugin_xxxxx_yyyyy. msi.” The setup wizard launches. Follow the onscreen instructions to uninstall the plugin.

Enabling Camera and Display Plugin
This section describes how to enable Camera and Display Plugin using the Unreal Engine editor (Unreal Editor) after installing the plugin. You can enable/disable the plugin for each project.
1 Select [Edit] > [Plugins] from the Unreal
Editor menu bar. The [Plugins] window appears.
2 Select [INSTALLED].
A list of the installed plugins is displayed.
3 Place a check mark in [Camera and
Display Plugin]. A message appears prompting you to restart Unreal Editor.
To disable the plugin Clear the check mark from [Camera and Display Plugin].
4 Restart Unreal Editor when prompted.
The plugin is enabled.
To check the installation/enabled status
When the plugin is installed and enabled correctly, [Sony Virtual VENICE] is displayed on the [Place Actors] panel of Unreal Editor.

Basic Operation

Pre-Vis Process Operations

This section describes how to use the Virtual VENICE actor of this plugin in pre-vis process operations. You must instantiate a Virtual VENICE actor using the Unreal Engine editor (Unreal Editor) and configure the instance for scouting and image creation. The basic operations and workflow in the previs process are shown below.
Instantiating a Virtual VENICE actor using Unreal Editor

Configuring Virtual VENICE actor camera device/LED display

Configuring virtual scouting and image creation

Configuring the moiré alert function (required if using moiré alert function)

Exporting a Virtual VENICE actor configuration file (required if creating a configuration file)

Exporting image files using Movie Render Queue (required if rendering image files)
Instantiating a Virtual VENICE actor using Unreal Editor
Place a Virtual VENICE actor into a level in the same way as the Unreal Engine standard camera actor using Unreal Editor to make it available for use. For details about operation, see “Instantiating a Virtual VENICE Actor” (page 9).

Configuring Virtual VENICE actor camera device/LED display
Select the Virtual VENICE actor placed into a level and configure each item on the [Details] panel. In addition to the same configuration items for a Cine Camera actor, the [Details] panel shows the configuration items for the Virtual VENICE actor in the [Sony Virtual VENICE] section. Configure your camera device in [Camera Settings] > [Camera Type], the imager mode in [Imager Mode], and other camera settings, such as [Project Frame Rate], [Base ISO], and [Anamo. Desqueeze], as required. Also, set your LED display and the color space of the input signal in [LED Settings]. For details about configuration items, see “[Sony Virtual VENICE] Section Configuration Items” (page 16) and refer to the manual for the camera device.
Working color space
The plugin supports the following [Working Color Space] settings in an Unreal Engine project. · sRGB / Rec709 · Rec2020 · ACES AP0 · ACES AP1 / ACEScg · P3DCI · P3D65

Configuring virtual scouting and image creation
After configuring a camera device, configure settings for virtual scouting and image creation. In 3D assets, place the Virtual VENICE actor in an appropriate position and adjust the lens settings. You can also link the camera device position and the lens settings using a position tracker and lens tracker. The Virtual VENICE actor also supports the Unreal Engine sequencer function. You can place a Virtual VENICE actor in a created level sequence and save some of the settings of the Virtual VENICE actor as a key frame, allowing you to preview the output video from the camera device while managing multiple shots with different settings in the sequencer. For details about configuration items, see “[Sony Virtual VENICE] Section Configuration Items” (page 16) and refer to the manual for the camera device. For details about using a tracker, refer to the manual for the tracker. For details about the sequencer function, visit the Unreal Engine site by Epic Games, Inc.
[Note] The property names added to a level sequence may differ from the item names in the [Details] panel for the Virtual VENICE actor. For example, the value of the “EI for VENICE 2 8K – ISO 800” property displayed in the sequencer may not be applied if [Camera Type] is set to [VENICE 2 6K] or if [Base ISO] is set to [3200]. You can add properties that correspond to the settings of the current Virtual VENICE actor to a level sequence by adding properties from the [Details] panel.
Configuring the moiré alert function
In virtual production using an LED display, moiré (a phenomenon such as striped patterns and color shifts on the screen) may occur when the camera lens focus is close to

the display surface. You can enable the moiré alert function that can predict the occurrence of moiré during the pre-vis process. For details about configuring, see “Moiré Alert Function” (page 24).
[Note] If the current camera position/orientation and lens settings information cannot be acquired correctly, the moiré alert function will not produce correct results. For details, see “Configuring a Camera and Lens” (page 24).
Exporting a Virtual VENICE actor configuration file
You can export the settings configured for Virtual VENICE actor to a file. This allows you to reproduce the same image creation in the on-set (shooting) process as the virtual scouting performed in the pre-vis process by using the created configuration file on a real camera device and LED display. You can also import a camera device configuration file created using the Camera Control Panel during the on-set (shooting) process into a Virtual VENICE actor. For details about operation, see “Exporting a Configuration File” (page 9) and “Importing a Configuration File” (page 10).
Exporting image files using Movie Render Queue
You can export a preview video of a level sequence created with the sequencer function as a sequence of still image files (.jpg, .png, *.bmp, etc.) using the Movie Render Queue function of Unreal Engine. When rendering images using the Movie Render Queue function, configure the OCIO settings for the Virtual VENICE actor so that the images are output with the appropriate color.

9 3. Basic Operation: Pre-Vis Process Operations

For details about configuring OCIO, see “Configuring OCIO Settings for Movie Render Queue” (page 10). For details about the Movie Render Queue function, visit the Unreal Engine site by Epic Games, Inc.

Instantiating a Virtual VENICE Actor
Placing a Virtual VENICE actor into a level in Unreal Editor creates an instance.
1 Select [Sony Virtual VENICE] in the [Place
Actors] panel of Unreal Editor.
2 Drag & drop [Sony Virtual VENICE] into the
viewport.

Exporting a Configuration File
You can export the settings configured for Virtual VENICE actor to a file. You can import a created camera device configuration file into a real camera device using the Camera Control Panel. You can reproduce the same image creation as the pre-vis process during the on-set (shooting) process by applying the pre-vis process settings to the camera device. For details about importing a configuration file in the on-set (shooting) process, see “Importing a Configuration File (applying settings to a camera device)” (page 14).
1 Click the [Export Config File] button in the
[Sony Virtual VENICE] section in the [Details] panel for the Virtual VENICE actor.

on-set (shooting) process by transferring both the configuration file and the User 3D LUT CUBE file (*.cube) to the on-set (shooting) process. Only VENICE 2 supports the transfer of CUBE files via a network. For VENICE, transfer CUBE files using an SD card.
[Note] If transferring CUBE files over a network with VENICE 2, the CUBE files must be saved in the “Project_folder PluginsSonyCameraAndDisplayResourcesUser3DLUT” folder for User 3D LUTs or in the same folder as the configuration file.

A settings information confirmation dialog appears.
2 Check the settings information and click
the [OK] button.
3 Specify a folder and file name, then save
the file. A configuration file (*.vcfg) is created.
[Note] You cannot save to the Content folder or subfolders within the Content folder in your Unreal Engine project folder. Specify a different folder.
When using User 3D LUT
When [Shooting] > [Look] is set to [User 3D LUT], you can use the same User 3D LUT settings for both the pre-vis process and the

10 3. Basic Operation: Pre-Vis Process Operations

Importing a Configuration File
You can import a camera device configuration file created using the Camera Control Panel into a Virtual VENICE actor. This allows you to resume a pre-vis process workflow with the same settings as the on-set (shooting) process by applying the real camera device settings to the Virtual VENICE actor. For details about exporting a configuration file in the on-set (shooting) process, see “Exporting a Configuration File (saving camera device settings)” (page 15). You can also re-import a configuration file created using the [Export Config File] button of the Virtual VENICE actor.
1 Click the [Import Config File] button in the
[Sony Virtual VENICE] section in the [Details] panel for the Virtual VENICE actor.
2 Select the configuration file (*.vcfg) to
import. The settings are applied to the Virtual VENICE actor.

Configuring OCIO Settings for
Movie Render Queue
You can export a preview video of a level sequence as image files using the Movie Render Queue function. To export image files, configure the OCIO settings for the Virtual VENICE actor in the [Movie Render Queue] window in Unreal Editor. For details, visit the Unreal Engine site by Epic Games, Inc.
1 Display the rendering settings window for
the target level sequence.
2 Click [+ Setting] and select [Color Output].
[Color Output] settings are added to the rendering settings window. Configure OCIO in [Color Output] > [OCIO Configuration].
3 Place a check mark in [Is Enabled].
[OCIO Configuration] is enabled.
4 Select [Sony_VP_OCIO] in [Configuration
Source]. Click the input field of [Configuration Source] and select [Sony_VP_OCIO].
If [Sony_VP_OCIO] is not displayed Click the (Settings) icon and enable [Show Plugin Content] and [Show Engine Content]. [Sony_VP_OCIO] appears in the list and can be selected.
5 Select [Source for Bypass] in [Transform
Source].
6 Select [Destination for Bypass] in
[Transform Destination].

7 Configure other rendering settings, as
required. When finished, click the [Accept] button to apply the settings.
8 Execute rendering.

11 3. Basic Operation
On-Set (Shooting) Process Operations

The on-set (shooting) process workflow uses the On-set Camera component provided by the plugin and the Camera Control Panel. In the Unreal Engine editor (Unreal Editor), add the On-set Camera component to the Cine Camera actor and configure the camera device and LED display. You can also launch the Camera Control Panel and perform camera device and configuration file operations via a network. The basic operations and workflow in the onset (shooting) process are shown below.
Adding a component to a camera actor using Unreal Editor

Configuring On-set Camera component camera device/LED display

Configuring OCIO for nDisplay

Calibrating color of a camera device and LED display

Importing a configuration file into a camera device (required if applying a configuration file)

Configuring the moiré alert function (required if using moiré alert function)

Conducting on-set shooting

Adding a component to a camera actor using Unreal Editor
You can add the On-set Camera component to the Unreal Engine standard Cine Camera actor or camera actors that have a Cine Camera component. For details about operation, see “Adding the On-set Camera Component” (page 12).
[Notes] · Some camera actors may not support the On-set
Camera component even though they have a Cine Camera component. · A Virtual VENICE actor can only be used in the pre-vis process. A Virtual VENICE actor cannot be used by adding the On-set Camera component to the actor.
Configuring On-set Camera component camera device/LED display
Select the On-set Camera component in the [Details] panel of the camera actor, and set each item in [Camera Settings] in the [Sony On Set Camera] section. Configure your camera device in [Camera Type], the imager mode in [Imager Mode], and other camera settings, such as [Anamo. Desqueeze], as required. Also, set your LED display and the color space of the input signal in [LED Settings]. For details about configuration items, see “[Sony On Set Camera] Section Configuration Items” (page 20) and refer to the manual for the camera device.

Working color space
The plugin supports the following [Working Color Space] settings in an Unreal Engine project. · sRGB / Rec709 · Rec2020 · ACES AP0 · ACES AP1 / ACEScg · P3DCI · P3D65
Configuring OCIO for nDisplay
Depending on the color space of the input signal of the LED display, configure the OCIO settings of the nDisplay outer frustum and inner frustum associated with the camera actor with the attached On-set Camera component. For details about configuring, see “Configuring OCIO for nDisplay” (page 13).
Calibrating color of a camera device and LED display
Select the On-set Camera component in the [Details] panel of the camera actor, and configure the color calibration items in [Calibration] in the [Sony On Set Camera] section. You can calibrate the color characteristics of the camera device and LED display using a color chart or 3D LUT. For details about configuration items, see “[Sony On Set Camera] Section Configuration Items” (page 20). For details about configuring, see “Calibrating Color” (page 12) and refer to the manual for Color Calibrator.

Importing a configuration file into a camera device
You can import a configuration file created by a Virtual VENICE actor into a real camera device using the Camera Control Panel. This allows you to reproduce the same image creation in the on-set (shooting) process as the virtual scouting performed in the previs process by applying Virtual VENICE actor settings to a camera device. You can also prepare multiple configuration files for switching the camera device settings according to the environment or other conditions. You can also export the settings of a camera device used during the on-set (shooting) process to a file. For details about operation, see “Importing a Configuration File (applying settings to a camera device)” (page 14) and “Exporting a Configuration File (saving camera device settings)” (page 15).
Configuring the moiré alert function
You can enable the moiré alert function that can predict the occurrence of moiré that may be difficult to see in the on-set shooting environment. For details about configuring, see “Moiré Alert Function” (page 24).
[Note] If the current camera position/orientation and lens settings information cannot be acquired correctly, the moiré alert function will not produce correct results. For details, see “Configuring a Camera and Lens” (page 24).
Conducting on-set shooting
Launch nDisplay and conduct on-set shooting. Operations using the plugin are supported, even after launching nDisplay, using the multiuser editing function of Unreal Engine.

12 3. Basic Operation: On-Set (Shooting) Process Operations

You can also configure and operate a real camera device using the web remote control in the Camera Control Panel. For details about launching the Camera Control Panel, see “Launching the Camera Control Panel” (page 13).

Adding the On-set Camera Component

3 Select [Sony On Set Camera] from the list
of components.

You can add the On-set Camera component to the Unreal Engine standard Cine Camera actor or camera actors that have a Cine Camera component.
[Notes] · Some camera actors may not support the On-set
Camera component even though they have a Cine Camera component. · A Virtual VENICE actor can only be used in the pre-vis process. A Virtual VENICE actor cannot be used by adding the On-set Camera component to the actor.
1 Select the target camera actor to
configure in the [Outliner] panel of Unreal Editor.

The On-set Camera component is added to the camera actor.

2 Click the [+ Add] button in the [Details] panel of the camera actor.
A list of components that can be selected is displayed.

Calibrating Color
You can calibrate the color of the camera device and LED display using the Color Calibrator application (option). For details, refer to the manual for Color Calibrator.
1 Select the On-set Camera component in
the [Details] panel of the camera actor.
2 Place a check mark in [Display Chart] in
[Calibration] in the [Sony On Set Camera] section. [Display Chart] is enabled and a color calibration chart is displayed in the nDisplay inner frustum.
3 Set [Chart Type] and [Chart Scale] in
[Calibration] by referring to the Color Calibrator manual.
[Note] When setting [Calibration], disable [Calibration LUT].
4 Shoot the chart using the camera device
to generate a 3D LUT CUBE file (*.cube) using Color Calibrator.
5 Click the [Add] button for [LUT Filename] in [Calibration LUT] and select the CUBE
file generated in step 4.
The selected CUBE file is added to the [LUT Filename] drop-down list.
6 Select the CUBE file added in step 5 from
the [LUT Filename] drop-down list in [Calibration LUT].

13 3. Basic Operation: On-Set (Shooting) Process Operations

7 Place a check mark in [Enable] in
[Calibration LUT]. [Calibration LUT] is enabled and the settings for the selected CUBE file are applied.
8 Copy the CUBE file to the render node
folder.
The CUBE file added in step 5 is saved in
the “Project_folderPlugins SonyCameraAndDisplayResources Calibration_LUT” folder. Copy the CUBE file to the same folder of the render node.
[Note] If the CUBE file is not copied correctly to the render node, the inner frustum image that is output by the render node will be displayed in grayscale when [Calibration LUT] is enabled.
If LED display controller settings are changed after a CUBE file is generated
When [LED Type] is set to [Crystal LED B-series], you can adjust the [Contrast], [Brightness], [Light Output], and [Color Temperature] items of [Crystal LED B-series Settings] in [Calibration LUT]. You can apply color calibration without regenerating a CUBE file by setting [Crystal LED B-series Settings] to the same values as the changed settings. When [LED Type] is set to other than [Crystal LED B-series] and [Input Color Space] is SDR ([SDR (sRGB/G2.4)] or [SDR (sRGB/G2.2)]), color shifts may occur if you change the peak luminance of the LED display controller to a value different from when color calibration was performed, depending on the type of LED display controller. It is recommended that you perform color calibration again with the new peak luminance setting. When [LED Type] is set to other than [Crystal LED B-series] and [Input Color Space] is HDR ([HDR (Rec.2020/PQ)] or [HDR (ACEScg/PQ)]),

it will be necessary to regenerate a CUBE file each time you change the LED display controller settings.
Configuring OCIO for nDisplay
Configure the OCIO settings of the nDisplay outer frustum and inner frustum associated with the camera actor with the attached Onset Camera component. When OCIO settings are executed, appropriate values are applied automatically according to the color space of the LED display input signal.
1 Select the On-set Camera component in
the [Details] panel of the camera actor.
2 Click the [nDisplay OCIO Setting] button in
[LED Settings] > [Input Color Space] in the [Sony On Set Camera] section.
The [nDisplay OCIO Setting] dialog appears. When OCIO settings are executed, each item is set to the following values. · Status:
“Enabled” nDisplay Root actor > [Enable Viewport OCIO] and ICVFX Camera > [Enable Inner Frustum OCIO] are set to [Enabled]. · OCIO Asset: “Sony_VP_OCIO” · Source: Sets the same value as the [Working Color Space] setting in the Unreal Engine project.

The On-set Camera component supports the following [Working Color Space] settings. ­ sRGB / Rec709 ­ Rec2020 ­ ACES AP0 ­ ACES AP1 / ACEScg ­ P3DCI ­ P3D65 · Destination: Sets the color space of the LED display input signal ([Input Color Space] setting). · Setting execution target: A check mark is automatically inserted for any nDisplay instances whose current settings differ from the values above to select them as a target for execution.
[Note] If you clear the check mark for a setting execution target nDisplay, the color of the output video may vary from the expected color.
3 Click the [Overwrite] button.
4 Click the [OK] button in the confirmation
message. The OCIO settings are executed.

Launching the Camera Control Panel
Open the Camera Control Panel from Unreal Editor and log in to the camera device. After logging in, the camera device is connected and the web remote control and settings information of the camera device are displayed. [Note] The Camera Control Panel is intended to be connected to a camera device on a local network. The proxy settings in Windows OS cannot be used.
1 Open the Camera Control Panel.
Open the Camera Control Panel using one of the following methods. When you open the Camera Control Panel, the [Sony Camera Control Panel] window appears. · Select the On-set Camera component
in the [Details] panel of the camera actor, and click the [Camera Settings] > [Camera Control Panel] button in the [Sony On Set Camera] section.
· Select [Window] > [Sony Camera Control Panel] from the Unreal Editor menu bar.

14 3. Basic Operation: On-Set (Shooting) Process Operations

2 Enter the IP address of your camera
device in [Camera IP Address] and click the [Connect] button.
3 Enter the user name and password of the
camera device and click the [Login] button. Enter the user name configured for the camera device in [Username] and the password in [Password]. After logging in, the web remote control of the camera device is displayed on the [Camera] tab. You can check the settings information of the camera device on the [Details] tab.
For details, see “[Sony Camera Control Panel] Window” (page 22).

For details about operation using the web remote control, refer to the manual for the camera device.
To disconnect a camera device
Click the [Disconnect] button.

Importing a Configuration File
(applying settings to a camera
device)
You can import a configuration file created by a Virtual VENICE actor into a real camera device. This allows you to reproduce the same image creation in the on-set (shooting) process as in the pre-vis process by applying Virtual VENICE actor settings to a real camera device. For details about exporting a configuration file in the pre-vis process, see “Exporting a Configuration File” (page 9). You can also re-import a configuration file created using the [Save Configuration] button in the Camera Control Panel.
1 Launch the Camera Control Panel.
For details about operation, see “Launching the Camera Control Panel” (page 13).
2 Click the [Configure Camera] button in the
[Sony Camera Control Panel] window.
3 Select the configuration file (*.vcfg) to
import. The [Configure Camera] dialog appears in which you can check the settings information. For details, see “[Configure Camera] dialog” (page 23).
4 Click the [OK] button in the [Configure
Camera] dialog.
5 Click the [Yes] button in the confirmation
message. The settings are applied to the camera device.

[Notes] · Some items, such as lens settings and LED
display settings, cannot be set automatically. Items that cannot be set are displayed in a list after the configuration file is imported. Configure each device manually as required. Only VENICE 2 supports ASC CDL configuration via a network. For VENICE, create an ASC CDL file (*.cdl) using the [Generate CDL file] button and configure for the camera device using an SD card. For details, see “[Configure Camera] dialog” (page 23). · To use a User 3D LUT, only VENICE 2 supports the transfer of CUBE files via a network. For VENICE, transfer CUBE files using an SD card. CUBE files for transfer must be saved in the “Project_folderPlugins SonyCameraAndDisplayResourcesUser3DLUT” folder for User 3D LUTs or in the same folder as the configuration file. You can open the folder for User 3D LUTs using the [Open User 3D LUT folder] button in the [Configure Camera] dialog. · When a configuration file is imported, the configuration file settings are applied to “Input Color Space” and “Look” on the camera device, but “LUT Select” is not configured automatically. You can reproduce the color specified in the configuration file by changing “LUT Select” to “Look” for the outputs of the camera device (SDI 1/2, for example). Settings such as “Input Color Space,” “Look,” and “ASC CDL Process” applied to a camera device may differ from the values displayed in the [Configure Camera] dialog, but the signal processing that is applied will be equivalent.

15 3. Basic Operation: On-Set (Shooting) Process Operations

Displaying a list of the configuration file settings information
You can display the configuration items saved in the configuration file. When settings cannot be applied to a camera or other device via a network, you can configure the device manually while browsing the display.
1 Select the On-set Camera component in
the [Details] panel of the camera actor.
2 Click the [Camera Settings] > [Preview
Config File] button in the [Sony On Set Camera] section.
3 Select the configuration file (*.vcfg) to
display. The [Preview Configuration File] dialog appears. You can check the value of each item saved in the configuration file. To close the [Preview Configuration File] dialog, click the [OK] button.

Exporting a Configuration File
(saving camera device settings)
You can export the settings of a camera device used during the on-set (shooting) process to a file. You can import a created configuration file into a Virtual VENICE actor. This allows you to resume a pre-vis process workflow with the same settings as the onset (shooting) process by applying the on-set (shooting) process settings to the Virtual VENICE actor. For details about importing a configuration file in the pre-vis process, see “Importing a Configuration File” (page 10).
1 Launch the Camera Control Panel.
For details about operation, see “Launching the Camera Control Panel” (page 13).
2 Click the [Save Configuration] button in
the [Sony Camera Control Panel] window. A settings information confirmation dialog appears.
3 Check the settings information and click
the [OK] button.
4 Specify a folder and file name, then save
the file. A configuration file (*.vcfg) is created.
[Note] You cannot save to the Content folder or subfolders within the Content folder in your Unreal Engine project folder. Specify a different folder.

Settings

Virtual VENICE Actor Settings

The [Details] panel for a Virtual VENICE actor displays a [Sony Virtual VENICE] section in addition to the Cine Camera actor settings. Configure the items for the Virtual VENICE actor in the [Sony Virtual VENICE] section.
[Sony Virtual VENICE] Section Configuration Items
You can import/export configuration files, configure camera devices, configure the moiré alert function, and configure LED displays in the [Sony Virtual VENICE] section of the [Details] panel.
[Import Config File] button
Imports a camera device configuration file into a Virtual VENICE actor. You can import an on-set (shooting) process configuration file created using the Camera Control Panel or a configuration file created using the [Export Config File] button of a Virtual VENICE actor. For details about operation, see “Importing a Configuration File” (page 10).
[Export Config File] button
Exports a Virtual VENICE actor configuration file. You can import a created camera device configuration file into a real camera device using the Camera Control Panel. For details about operation, see “Exporting a Configuration File” (page 9).
[Camera Settings] Configures a camera device. For details, see “[Camera Settings] configuration items” (page 16).
[Moiré Alert] Configures the moiré alert function. For details, see “[Moiré Alert] Configuration Items” (page 25).
[LED Settings] Configures an LED display. For details, see “[LED Settings] configuration items” (page 18).
[Camera Settings] configuration items
Select the model of your camera device to configure the Lens, Project, and Shooting items. For configuration items that are common to your camera device, you can set the same values as on the camera device. For details about settings, refer to the manual for the camera device.

Item Camera Type

Description
Sets the model of the camera device. The Virtual VENICE actor supports the following models. · VENICE (CineAltaV) · VENICE 2 6K (CineAltaV 2 6K) · VENICE 2 8K (CineAltaV 2 8K)

Lens Configures settings related to lenses.

Item

Description

Optical Filter

Set the light attenuation (percentage of light transmission) by the polarization filter. Set value: Value in the range 0.00 to 1.00

Iris (Current Aperture)

Sets the aperture of the lens. Can also be configured automatically using the [Auto-Adjust] button.

[Auto-Adjust] button

Automatically sets the appropriate aperture according to the shutter, FPS, and ISO settings.

Current Focal Length (mm)

Sets the focal length of the lens.

Current Focus Distance

Sets the focus distance of the lens.

Lens Distortion and Vignetting

Sets whether to apply lens distortion and vignetting.

Lens Type

Sets the type of the lens.

Enable Distortion

Enables/disables distortion.

Enable Vignetting

Enables/disables vignetting.

[Note] To apply the vignetting effect correctly, place a check mark in [Vignette Intensity] under [Post Process] > [Lens] > [Image Effects] and set it to “0.0” in the [Details] panel of the Virtual VENICE actor.

Project Configures basic settings for a project. Corresponds to the Project menu of the camera device. For details about items and settings in the Project menu, refer to the manual for the camera device.

Item

Description

Imager Mode

Sets the imager mode. The imager mode setting sets the appropriate filmback of the Cine Camera component.

[Note] Depending on the imager mode, a warning message may appear indicating that a software license must be installed on the camera device, but Virtual VENICE Actor functions are always available for use.

17 4. Settings: Virtual VENICE Actor Settings

Project Configures basic settings for a project. Corresponds to the Project menu of the camera device. For details about items and settings in the Project menu, refer to the manual for the camera device.

Item

Description

Project Frame Rate

Sets the project frame rate.

Input Color Space Base ISO Anamo. Desqueeze
User

[Note] A frame rate of 47.95p is not supported.
Sets the color space of the input signal.
Sets the base sensitivity.
Sets the de-squeeze ratio when using an anamorphic lens. Selecting [User] allows you to set an arbitrary value that is different from your camera device.
Displayed when [Anamo. Desqueeze] is set to [User]. Sets the de-squeeze ratio. Set value: Value in the range 1.0 to 2.0 [Note] When [User] is selected, the de-squeeze ratio setting is not applied to the camera device.

Shooting Configures settings related to shooting. Corresponds to the Shooting menu of the camera device. For details about items and settings in the Shooting menu, refer to the manual for the camera device.

Item

Description

FPS

Displays the same value as [Project] > [Project Frame Rate].

Shutter

Sets the electronic shutter.

Mode

Sets the operating mode of the electronic shutter. Set value: Angle / Speed

Angle

Displayed when [Mode] is set to [Angle]. Sets the opening angle of the electronic shutter. Selecting [User] allows you to set an arbitrary value.

User

Displayed when [Angle] is set to [User]. Sets the opening angle of the electronic shutter (equivalent to the setting when the electronic shutter operation is set to “Continuous” on your camera device).

Shooting Configures settings related to shooting. Corresponds to the Shooting menu of the camera device. For details about items and settings in the Shooting menu, refer to the manual for the camera device.

Item

Description

Speed

Displayed when [Mode] is set to [Speed]. Sets the speed of the electronic shutter. Selecting [User] allows you to set an arbitrary value.

User (inverse)

Displayed when [Speed] is set to [User]. Sets the speed of the electronic shutter (equivalent to the setting when the electronic shutter operation is set to “Continuous” on your camera device).

ND

Sets the ND filter position.

Exposure Index

Sets the EI value.

White Balance

Sets the white balance.

Color Temp.

Sets the color temperature. Set value: 3200K / 4300K / 5500K / 6500K / User Selecting [User] allows you to set an arbitrary value.

User

Displayed when [Color Temp.] is set to [User]. Sets the color temperature. Set value: Integer in the range 2000 to 15000

Tint

Sets the tint value.

Set value: Integer in the range ­99 to 99

Look

Sets the look. When [User 3D LUT] is selected, you can load any CUBE file (*.cube) to use settings other than the preset Look settings for your camera device.

User 3D LUT

Sets the CUBE file when [Look] is set to [User 3D LUT]. Select the CUBE file to load from the drop-down list. For details about CUBE files that can be loaded, refer to the manual for the camera device.

[Add] button

Adds a CUBE file to the [User 3D LUT] drop-down list.

[Delete] button ASC CDL
Process [Note] Up to 32 CUBE files can be displayed in the drop-down list.
Deletes the CUBE file selected in [User 3D LUT].
Sets the ASC CDL.
Sets whether to apply ASC CDL to the output video. When applying ASC CDL, set the ASC CDL processing sequence. · CDL Off: Do not apply ASC CDL to the output video. · Look -> CDL: Apply CDL after applying Look. · CDL -> Look: Apply CDL before applying Look.

18 4. Settings: Virtual VENICE Actor Settings

Shooting Configures settings related to shooting. Corresponds to the Shooting menu of the camera device. For details about items and settings in the Shooting menu, refer to the manual for the camera device.

Item

Description

[Import CDL File] button

Loads an ASC CDL file (*.cdl) and applies the [Slope], [Offset], [Power], and [Saturation] parameters.

[Export CDL File] button

Writes the [Slope], [Offset], [Power], and [Saturation] parameters to an ASC CDL file (*.cdl).

Slope Offset Power Saturation

[Note] The [Export CDL File] button function is used to export the ASC CDL parameter values configured by a Virtual VENICE actor to third-party applications. To apply the ASC CDL settings to your camera device, use a configuration file created using the [Export Config File] button. ASC CDL parameter values are included in configuration files.
Sets the slope (R, G, B). Set value: Value in the range 0.000 to 3.999
Sets the offset (R, G, B). Set value: Value in the range ­1.000 to 1.000
Sets the power (R, G, B). Set value: Value in the range 0.400 to 4.000
Sets the saturation. Set value: Value in the range 0.000 to 3.999 [LED Settings] configuration items

Select the model of your LED display and configure the color space of the input signal. If using the Crystal LED B-series, configure the LED display (Crystal LED B-series Settings) items.

Item LED Type Input Color Space

Description Sets the model of the LED display. Sets the color space of the input signal of the LED display. Set value: SDR / HDR / HDR (Rec.2020/PQ)

Sensitivity Simulation Luminance Adjustment

[Note] The values that can be selected for [Input Color Space] will vary depending on the [LED Type] setting.
Sets the operating mode for luminance management. · Mode A: Operating mode that reflects the deviation in
optical luminance that occurs between the LED display and camera device. The brightness of the output video changes depending on the display selected in [LED Type], similar to the actual shooting environment. · Mode B: Operating mode that does not reflect the deviation in optical luminance that occurs between the LED display and camera device. The brightness of the output video does not change depending on the display selected in [LED Type]. The type of color calibration varies depending on the selected operating mode. For details, refer to the manual for Color Calibrator.
Displayed when [Mode A] is selected in [Sensitivity Simulation]. Adjusts the luminance of the output video. Set value: Value in the range 0.50 to 1.50

Peak Luminance (Nit)

[Note] The higher the value, the brighter the image.
Displayed when a display other than [Crystal LED B-series] is selected in [LED Type]. Sets the peak luminance. Set value: Integer in the range 0 to 2000 [Note] [Peak Luminance (Nit)] can be configured only when [Input Color Space] is set to [SDR].

19 4. Settings: Virtual VENICE Actor Settings

Crystal LED B-series Settings Configures Crystal LED B-series display settings. For details about settings, refer to the manual for the Crystal LED B-series.

[Note] [Crystal LED B-series Settings] is displayed only when [Crystal LED B-series] is selected in [LED Type].

Item

Description

Contrast

Sets the contrast of the LED display.

Brightness

Sets the brightness of the LED display.

Light Output

Sets the optical output of the LED display.

Color Temperature

Sets the color temperature of the LED display. Selecting [User] allows you to set an arbitrary value for each parameter.

R Gain G Gain

Displayed when [Color Temperature] is set to [User]. Sets the RGB gain.

B Gain

R Bias G Bias

Displayed when [Color Temperature] is set to [User]. Sets the RGB bias.

B Bias

20 4. Settings
On-set Camera Component Settings

These settings configure the functions required for virtual production shooting for a camera actor with an attached On-set Camera component. Select the On-set Camera component in the [Details] panel of the camera actor, and set items in the [Sony On Set Camera] section.

[Sony On Set Camera] Section Configuration Items

You can open the Camera Control Panel, display configuration file information, configure camera devices, configure LED displays, configure color calibration, and configure the moiré alert function in the [Sony On Set Camera] section of the [Details] panel.

[Camera Settings] Configures a camera device, opens the Camera Control Panel, and displays configuration file information. For details, see “[Camera Settings] configuration items” (page 20). [LED Settings] Configures an LED display and the OCIO settings for nDisplay. For details, see “[LED Settings] configuration items” (page 20). [Calibration] Configures color calibration settings of a camera device and LED display. For details, see “[Calibration] configuration items” (page 21). [Moiré Alert] Configures the moiré alert function. For details, see “[Moiré Alert] Configuration Items” (page 25). [Camera Settings] configuration items

Select the model of your camera device and configure the imager mode and other settings. You can also open the Camera Control Panel and display configuration file information. For configuration items that are common to your camera device, you can set the same values as on the camera device. For details about settings, refer to the manual for the camera device.

Item [Camera Control Panel] button

Description
Opens the Camera Control Panel. For details, see “Launching the Camera Control Panel” (page 13).

Item [Preview Config File] button
Camera Type
Imager Mode Anamo. Desqueeze User

Description
Displays a list of settings information for a selected camera device configuration file. You can select a configuration file created using the [Export Config File] button of a Virtual VENICE actor or the [Save Configuration] button of the Camera Control Panel. When settings cannot be applied to a camera or other device via a network, you can configure the device manually while browsing the display.
Sets the model of your camera device. The following models are supported by the On-set Camera component. · VENICE (CineAltaV) · VENICE 2 6K (CineAltaV 2 6K) · VENICE 2 8K (CineAltaV 2 8K)
Sets the imager mode. The imager mode setting sets the appropriate filmback of the Cine Camera component.
Sets the de-squeeze ratio when using an anamorphic lens. Selecting [User] allows you to set an arbitrary value that is different from your camera device.
Displayed when [Anamo. Desqueeze] is set to [User]. Sets the de-squeeze ratio. Set value: Value in the range 1.0 to 2.0

[LED Settings] configuration items

Select the model of your LED display and configure the color space of the input signal. Also, configure the OCIO settings for nDisplay according to the color space of the input signal.

Item LED Type Input Color Space

Description
Sets the model of the LED display.
Sets the color space of the input signal of the LED display. Set value: SDR (sRGB/G2.4) / SDR (sRGB/G2.2) / HDR
(Rec.2020/PQ) / HDR (ACEScg/PQ)

[Note] The values that can be selected for [Input Color Space] will vary depending on the [LED Type] setting.
[nDisplay OCIO Setting] button Configures the OCIO settings of the nDisplay outer frustum and inner frustum associated with the camera actor with the attached On-set Camera component. Clicking the [nDisplay OCIO Setting] button will display the [nDisplay OCIO Setting] dialog. For details, see “Configuring OCIO for nDisplay” (page 13).

21 4. Settings: On-set Camera Component Settings

[Calibration] configuration items

Configure color calibration settings using a color chart (Calibration Chart) or 3D LUT (Calibration LUT).

Calibration Chart Configures settings for the color chart used for color calibration by the Color Calibrator application (option). For details, refer to the manual for Color Calibrator.

Item

Description

Display Chart

Shows/hides the color chart.

Chart Type

Sets the type of the color chart.

Chart Scale

Sets the size of the color chart.

Calibration LUT Configures 3D LUT settings used for color calibration.

Item

Description

LUT Filename

Sets the CUBE file (*.cube) of the 3D LUT. Select the CUBE file to load from the drop-down list.

[Add] button

Adds a CUBE file to the [LUT Filename] drop-down list.

[Delete] button Enable [Note] Up to 32 CUBE files can be displayed in the drop-down list.
Deletes the CUBE file selected in [LUT Filename]. Enables/disables 3D LUT operation. [Note] When calibrating color by displaying a color chart, first disable [Calibration LUT].

Calibration LUT Configures 3D LUT settings used for color calibration.

Item

Description

Crystal LED B-series Settings

Displayed when [Crystal LED B-series] is selected in [LED Settings] > [LED Type]. Use when changing the color of a Crystal LED B-series display after a CUBE file is generated. For details, see “If LED display controller settings are changed after a CUBE file is generated” (page 13). For details about settings, refer to the manual for the Crystal LED B-series.

Contrast

Sets the contrast of the LED display.

Brightness

Sets the brightness of the LED display.

Light Output

Sets the optical output of the LED display.

Color Temperature

Sets the color temperature of the LED display. Selecting [User] allows you to set an arbitrary value for each parameter.

R Gain G Gain

Displayed when [Color Temperature] is set to [User]. Sets the RGB gain.

B Gain

R Bias G Bias

Displayed when [Color Temperature] is set to [User]. Sets the RGB bias.

B Bias

22 4. Settings
Camera Control Panel

You can connect a real camera device, and perform camera device operations and display settings information via a network using the Camera Control Panel. For details about launching the Camera Control Panel, see “Launching the Camera Control Panel” (page 13).
[Sony Camera Control Panel] Window
When you log in to a real camera device using the Camera Control Panel, the web remote control and settings of the camera device are displayed in the [Sony Camera Control Panel] window.

1. Camera IP Address
Displays the IP address of the camera device.

2. [Camera] tab
Displays the web remote control of the camera device. For details about operation using the web remote control, refer to the manual for the camera device.

3. [Configure Camera] button
Imports a camera device configuration file into a real camera device. You can import a pre-vis process configuration file created using the [Export Config File] button of a Virtual VENICE actor or a configuration file created using the [Save Configuration] button of the Camera Control Panel. Click the [Configure Camera] button to display the [Configure Camera] dialog. Check the settings information in the [Configure Camera] dialog and then start importing. For details about operation, see “Importing a Configuration File (applying settings to a camera device)” (page 14).
4. [Save Configuration] button
Exports the settings of a real camera device to a file. You can import a created file into a Virtual VENICE actor. For details about operation, see “Exporting a Configuration File (saving camera device settings)” (page 15).
5. [Details] tab
Displays settings information for a camera device and lens. For details, refer to the manual for the camera device.
6. Time and model of camera device
Displays the time configured on the camera device and the model of the camera device.
7. [Connect] button / [Disconnect] button
Connects to a camera device. The [Connect] button is displayed when not connected to a camera device. Disconnects from a camera device. The [Disconnect] button is displayed when connected to a camera device.

23 4. Settings: Camera Control Panel

[Configure Camera] dialog
When importing a configuration file into a camera device, the [Configure Camera] dialog appears in which you can check the settings information.

Importing a configuration file
Click the [OK] button in the [Configure Camera] dialog, then click the [Yes] button in the confirmation message. Importing starts and the set values in the configuration file are applied to the camera device. After importing, a dialog appears which displays a list of items that could not be applied automatically For items that could not be applied, configure manually on the camera device. If you are using VENICE as the camera device, ASC CDL files (.cdl) and User 3D LUT CUBE files (.cube) must be transferred to the camera device via an SD card. · You can create an ASC CDL file (*.cdl) using
the [Generate CDL file] button displayed in the dialog. You can apply the settings by loading the created ASC CDL file into VENICE via an SD card. · You can open the “Project_folderPlugins SonyCameraAndDisplayResources User3DLUT” folder for User 3D LUTs using the [Open User 3D LUT folder] button displayed in the dialog. You can apply the settings by loading a CUBE file saved in the folder into VENICE via an SD card.

The following information is displayed in the [Configure Camera] dialog. · Camera Type: Model of camera device · Setting: Configuration item · Configuration File: Set value in configuration
file · Device: Current set value of a camera device The [Configuration File] set value is displayed highlighted if the configuration file and current

setting of the camera device are different. For items with “>” displayed between the [Configuration File] set value and the [Device] set value, the configuration file set value will be applied to the camera device upon importing. For items where “>” is not displayed, even if the display is highlighted, the setting will not be applied automatically upon importing.

24 4. Settings
Moiré Alert Function

In virtual production, moiré may occur on the LED display, depending on the distance and angle between the LED display and the camera, and the settings of the camera lens. The plugin has a moiré alert function that can be used in both the pre-vis process and on-set (shooting) process. When the moiré alert function is enabled, it can predict the occurrence of moiré, even in the pre- vis process where there is no real camera or LED display. In addition, the moiré alert function can predict the occurrence of moiré in on-set shooting environments where it would be difficult to see.
Configuring a Camera and Lens
The camera position/orientation information and lens information (focal length, aperture, focus distance) required by the moiré alert function must be configured correctly in the camera actor. You can report the correct values by using a position tracker, for example.
Pre-vis process
Set the camera and lens information, [Camera Type], and [Anamo. Desqueeze] correctly in the Virtual VENICE actor.
On-set (shooting) process
Configure settings so that the camera and lens information is reflected in the camera actor with an attached On-set Camera component, and set [Camera Type] and [Anamo. Desqueeze] of the On-set Camera component correctly. On-set, operation in a configuration that does not reflect the lens information of a real camera device on the camera actor for nDisplay rendering is also possible. In this case, configure a camera actor dedicated to

the moiré alert function and add the On-set Camera component to the camera actor. Configure settings so that the camera and lens information is reflected in the camera actor dedicated to the moiré alert function, and set [Camera Type] and [Anamo. Desqueeze] of the On-set Camera component correctly. The moiré alert function operates in Unreal Editor, so camera and lens information must be reported to Unreal Editor, not to the render node.
[Note] A Virtual VENICE actor can only be used in the pre-vis process. It is not necessary to add an On-set Camera component to a Virtual VENICE actor.
Configuring the Moiré Alert Function
You can configure the moiré alert function of a Virtual VENICE actor or the On-set Camera component. When the moiré alert function is enabled, you can check if there is a risk of moiré occurring by the color displayed on the target LED display.
Pre-vis process
Select a Virtual VENICE actor and configure using the following procedure in the [Sony Virtual VENICE] section of the [Details] panel.
On-set (shooting) process
Select the On-set Camera component in the [Details] panel of the camera actor, and configure using the following procedure in the [Sony On Set Camera] section.

1 Click the [Moiré Alert] > [Add Display] button.
The [Moiré Alert Setup] dialog appears. For details, see “[Moiré Alert Setup] dialog” (page 26).
2 Select the target nDisplay actor to set in
the [Moiré Alert Setup] dialog. Placing a check mark in [Show nDisplays Only] will display the nDisplay actors only. If an nDisplay actor is not available, you can also use a Static Mesh actor that mimics the display shape.
3 Select meshes to construct an LED
display. Place a check mark in the target mesh to set. Select only a mesh that constitutes a single display. If there are multiple LED displays in an
nDisplay actor, repeat steps 1 to 7 to
configure each display. Example: If there are four LED displays (front view (1), right (2), left (3), ceiling (4)), repeat
steps 1 to 7 for displays (1) to (4).

[Note] You can register up to six LED displays using the [Add Display] button.
4 Select your LED display in [Display Panel
Type Preset]. If you select [Other], set the pitch size in [LED Pitch Size].
5 Select the calculation interval for moiré
generation in [Sampling Distance].
6 Click the [Add] button.
7 Click the [OK] button in the confirmation
message. The display is registered.
8 Place a check mark in [Moiré Alert] >
[Enable Moiré Alert]. The moiré alert function is enabled. A colored tile mesh is attached to the
mesh selected in step 3 to show the moiré
occurrence level.
Moiré alert display color
The selected mesh will be displayed in the following colors according to the moiré occurrence level. Green: Possibility of visible moiré is low. Yellow: Moiré may be visible, depending on
the shooting and viewing conditions. Red: Possibility of visible moiré is high. Purple: The moiré alert function cannot be
used because the focus position is behind the LED display.
[Note] This function does not guarantee that moiré will not occur when green is displayed.

25 4. Settings: Moiré Alert Function

Editing/deleting moiré alert function settings
A list of the registered displays is displayed in [Moiré Alert] > [Displays]. You can click the [Edit] button for a target display to display the [Moiré Alert Setup] dialog and edit the display settings. Clicking the [Delete] button for a target display will delete the display. You can also place a check mark in [Show Moiré Alert] for a target display to show/hide the moiré alert color.

[Moiré Alert] Configuration Items

In the pre-vis process, configure the moiré alert function in [Moiré Alert] in the [Sony Virtual VENICE] section of the [Details] panel. In the on-set (shooting) process, configure the moiré alert function in [Moiré Alert] in the [Sony On Set Camera] section of the [Details] panel.

Item Enable Moiré Alert

Description
Enables/disables the moiré alert function for a display registered using [Add Display].

Show Low Level Alert / Display Meshes Show Out of Range Alert Exposure of Alert Color Opacity of Alert Color Overall Moiré Alert Level
[Add Display] button

[Note] When using the moiré alert function with multiple camera actors, only the camera actor on which the moiré alert function was last enabled is itself enabled. The moiré alert function is disabled on all other camera actors.
Sets whether to show/hide the moire alert function in green color (possibility of moiré occurrence is low) and display mesh (displayed in gray). Clear the check mark to not display the green color and display mesh.
Sets whether to show/hide the moire alert function in purple (moiré alert function out of range). Clear the check mark to not display purple.
Sets the exposure of the moiré alert function display color. Set value: Value in the range ­8.0 to 8.0
Sets the opacity of the moiré alert function display color. Set value: Value in the range 0.0 to 1.0
Displays the moiré occurrence level. If the level varies depending on the mesh, it is displayed in the following order of priority. · High: Possibility of visible moiré is high. · Middle: Moiré may be visible, depending on the shooting
and viewing conditions. · Out of Range: The moiré alert function is out of range
because the focus position is behind the LED display. · Low: Possibility of visible moiré is low. · N/A: The moiré alert function is disabled.
Adds a display for the moiré alert function. Clicking the [Add Display] button displays the [Moiré Alert Setup] dialog. For details, see “[Moiré Alert Setup] dialog” (page 26).

26 4. Settings: Moiré Alert Function

Item Displays
Show Moiré Alert [Edit] button
[Delete] button

Description
Displays a list of the registered displays. [Show Moiré Alert], [Edit] button, and [Delete] button are displayed for each display.
Displays the color of the moiré alert for a display. Clear the check mark to not display the moiré alert color.
Edits the settings of the display. Clicking the [Edit] button displays the [Moiré Alert Setup] dialog. For details, see “[Moiré Alert Setup] dialog” (page 26).
Deletes the display.

[Moiré Alert Setup] dialog
The [Moiré Alert Setup] dialog is used to add and edit displays that are the target of the moiré alert function.
1

2

3 4

5

6

1. Actor (display) selection area
Displays the actors within the project. Select the actors targeted by the moiré alert function. Placing a check mark in [Show nDisplays Only] will display the nDisplay actors only in the actor selection area.
[Note] If you display the [Moiré Alert Setup] dialog using the [Edit] button in the list of displays, the actor selection area is not displayed.

2. Mesh selection area
Displays the meshes used to construct the selected actor. Select the meshes targeted by the moiré alert function. Clicking the [Select All] button will select all of the displayed meshes. Clicking the [Deselect All] button will deselect all of the displayed meshes.
[Note] If there are multiple LED displays in an nDisplay actor, add the LED displays one at a time. Select only a mesh that constitutes a single LED display and then configure settings. For details, see “Configuring the Moiré Alert Function” (page 24).

27 4. Settings: Moiré Alert Function
3. Display Panel Type Preset
Sets the model of the display. If you select [Other], set the pitch size in [LED Pitch Size]. [Note] [LED Pitch Size] is displayed only when [Other] is selected.
4. Sampling Distance
Sets the interval for calculating the moiré occurrence level. [Note] If you set the [Sampling Distance] to a shorter interval, the moiré occurrence level can be viewed in more detail, but the calculation overhead will increase and the frame rate may drop. There is no drop in the frame rate on the render node side, as there is no computation involved.
5. [Add] button / [Edit] button
Registers displays. If you display the [Moiré Alert Setup] dialog using the [Edit] button in the list of displays, the [Edit] button is displayed instead of the [Add] button.
6. [Cancel] button
Closes the [Moiré Alert Setup] dialog without registering/editing a display.

28 5. Appendix

Troubleshooting

Camera output color varies between pre-vis process and on-set (shooting) process
Review the following items if the output video color of a Virtual VENICE actor and the output video color of a real camera device are different.

Cause Camera settings of a Virtual VENICE actor and a real camera device are different.
Lens settings of a Virtual VENICE actor and the camera device are different.
Virtual VENICE actor and real LED display controller settings are different.
On-set Camera component and real LED display controller settings are different.

Solution
Check that the camera settings of the Virtual VENICE actor and the real camera device are the same. You can import a Virtual VENICE actor configuration file using the Camera Control Panel and apply the camera settings of the Virtual VENICE actor to the camera device (page 14). When you import a configuration file, the [Configure Camera] dialog is displayed. You can compare the Virtual VENICE actor settings with the camera device settings in the dialog (page 23).
Check that the lens settings used by a Virtual VENICE actor and the real camera device are the same. Lens settings must be configured manually or by using a lens tracker. Unlike camera settings, lens settings cannot be applied to a camera device by importing a configuration file using the Camera Control Panel.
Check that [LED Settings] of the Virtual VENICE actor and the real LED display controller have the same settings. If using the Crystal LED B-series, [Crystal LED B-series Settings] must have the same settings as the real LED display controller. If using an LED display other than the Crystal LED B-series, a standard HDR signal/SDR signal must be output from the LED display. Also, for SDR, the peak luminance settings must match.
Check that [LED Settings] of the On-set Camera component and the real LED display controller have the same settings. If [LED Settings] > [Input Color Space] or the Unreal Engine project [Working Color Space] is changed, the OCIO settings must be configured again using the [nDisplay OCIO Setting] button. If using the Crystal LED B-series, [Calibration LUT] > [Crystal LED B-series Settings] must have the same settings as the real LED display controller.

Cause In Unreal Editor, the post process settings or post process volume settings of a camera actor are different for the pre-vis process and on-set (shooting) process.
A Virtual VENICE actor in Unreal Editor and the Cine Camera actor with On-set Camera component on a render node are not shooting the same thing.
OCIO is configured for the output video of a Virtual VENICE actor used in the pre-vis process.
“RM/RCP Paint Control” is set to “On” on the real camera device.

Solution
In Unreal Editor, match the post process/post process volume settings of the Virtual VENICE actor and the on-set (shooting) process Cine Camera actor. Specifically, the [Bloom], [Exposure], [Vignette Intensity], [Expand Gamut], and [Tone Curve Amount] settings must match. Note that camera actors other than the Unreal Engine standard Cine Camera actor may have different default values.
Check that the Virtual VENICE actor in Unreal Editor and the Cine Camera actor with the attached On-set Camera component on a render node are shooting the same thing. Different settings, such as sublevels, lighting visibility, and camera position, may not output the same color.
Similarly to a real camera device, a Virtual VENICE actor controls the color of the output video using the [Project] > [Input Color Space] and [Shooting] > [Look] settings, so there is no need to configure OCIO. Also, you can output Log video as-is, such as S-Gamut3.Cine/SLog3 selected using [Input Color Space], by setting [Look] to [Log].
The Virtual VENICE actor does not support the paint functions of a remote control unit. Set “RM/RCP Paint Control” to “Off” on the real camera device.

Color calibration is not applied to the nDisplay inner frustum display
Check the following causes if color is not calibrated correctly.

Cause The CUBE file specified in [LUT Filename] of [Calibration LUT] in Unreal Editor was not transferred to the nDisplay render node.
[Camera Options] > [Post Process Blend Weight] of the camera actor with an attached On-set Camera component is set to a value other than 1.0.

Solution
Transfer the contents of the “Project_folder PluginsSonyCameraAndDisplayResources” folder from the computer running Unreal Editor to the nDisplay render node.
When using a color calibration chart display and the color calibration function, set [Post Process Blend Weight] to 1.0.

29 5. Appendix: Troubleshooting

Moiré alert is not displayed correctly
Review the following items if the moiré alert function does not operate correctly.

Cause Meshes belonging to different displays, such as the front view and ceiling, were registered at the same time using the [Add Display] button.
Unreal Engine is running on a remote desktop.

Solution
Moiré alerts will not be displayed correctly if you register meshes belonging to different displays at the same time using a single [Add Display] button operation. For multiple displays, perform an [Add Display] button operation for each display (page 24).
Moiré alerts are not displayed correctly with the default viewport settings when running Unreal Engine on a remote desktop. Moiré alerts can be displayed by executing [Disable Realtime Override] in the viewport options and then enabling [Realtime].

Read User Manual Online (PDF format)

Read User Manual Online (PDF format)  >>

Download This Manual (PDF format)

Download this manual  >>