SONY VPT-CDP1 Virtual Production Tool Set Camera and Display Plugin User Guide
- June 1, 2024
- Sony
Table of Contents
SONY VPT-CDP1 Virtual Production Tool Set Camera and Display Plugin
Specifications
- Product Name: Camera and Display Plugin
- Software Version: 1.0
- Compatibility: Sony VENICE (CineAltaV) series cameras, Crystal LED B-series, Crystal LED VERONA (VP-series) displays
Product Information
1. Introduction
Overview: The Camera and Display Plugin is a tool set designed for virtual production, specifically for in-camera VFX shooting using Unreal Engine. It includes the Virtual VENICE actor for pre-vis process, On-set Camera component, and Camera Control Panel for on-set shooting.
2. Preparation
Setup: To install the Camera and Display Plugin, an Internet connection is required for the initial launch to access the license server. The plugin remains enabled for 14 days after accessing the server. It’s necessary to reconnect to the Internet and access the server every 14 days when working offline.
3. Basic Operation
- Pre-Vis Process Operations: Utilize the Virtual VENICE actor for pre-visualization tasks.
- On-Set (Shooting) Process Operations: Use the Camera Control Panel and On-set Camera component for shooting processes in virtual production.
4. Settings
This section allows users to configure various settings related to camera control, display options, and shooting parameters.
5. Appendix
Troubleshooting: Troubleshoot any issues that may arise during the usage of the Camera and Display Plugin.
FAQs
- What are the system requirements for using the Camera and Display Plugin?
- The plugin requires an Internet connection for initial setup and access to the license server. It is compatible with Sony VENICE series cameras and Crystal LED displays.
- How often do I need to connect to the license server when working offline?
- To keep the plugin enabled, you need to reconnect to the Internet and access the license server every 14 days when working offline.
“`
Virtual Production Tool Set
Camera and Display Plugin
User Guide
Software Version 1.0
5-054-938-11 (1)
EN
© 2023 Sony Corporation
Introduction
Overview
About Camera and Display Plugin
“Camera and Display Plugin” is a plugin for Unreal Engine for in-camera VFX
shooting used in virtual production. It comprises “Virtual VENICE actor” for
the previs process, with “On-set Camera component” and “Camera Control Panel”
for the on-set (shooting) process. It is compatible with the Sony “VENICE
(CineAltaV) series” of digital cinema cameras and the “Crystal LED B-series”
and “Crystal LED VERONA (VP-series)” large, high-definition LED displays.
Virtual VENICE actor
The Virtual VENICE actor is a camera actor for Unreal Engine, designed as a
digital twin of the Sony VENICE Digital Cinema Camera series. Virtual VENICE
reproduces the characteristics of VENICE, including the Look, by performing
signal processing equivalent to that of a real VENICE camera. In the pre-vis
process, it is possible to create images in the same way as when using a
VENICE camera. The camera settings also correspond to the same items as a
VENICE camera. You can quickly reproduce the image creation of a real VENICE
camera in the pre-vis process by transferring Virtual VENICE settings to an
actual VENICE camera using the Camera Control Panel in the on-set (shooting)
process. In addition, a moiré alert function can predict the occurrence of
moiré, even in the pre-vis process, where there is no real camera or LED
display.
On-set Camera component
The On-set Camera component is an Unreal Engine component that adds the
necessary functions for virtual production by associating it with the Unreal
Engine standard Cine Camera actor. You can also calibrate the color
characteristics of the camera and LED display to reproduce colors as intended
using the Camera Control Panel, for configuring camera settings over a
network, and the “Color Calibrator” application (option). The On-set Camera
component functions facilitate efficient color workflows during the on-set
(shooting) process. In addition, the moiré alert function can predict the
occurrence of moiré in shooting environments where it would be difficult to
see.
Camera Control Panel
The Camera Control Panel is a function for checking and changing settings on a
real VENICE camera from Unreal Engine via a network. The image creation from
the pre-vis process can be reproduced in the on-set (shooting) process by
transferring Virtual VENICE settings to a real VENICE camera. You can also
transfer settings from a real VENICE camera to Virtual VENICE to restart the
pre-vis process using the same settings. Sharing settings between the pre-vis
process and the on-set (shooting) process helps improve the work efficiency in
each process.
4 1. Introduction: Overview
Camera and Display Plugin Structure
Pre-vis process
Virtual VENICE actor
[Functions] · Configure the camera device and LED display
used on-set to reproduce the color and framing in the output video · Export
Virtual VENICE configuration to a file · Predict the occurrence of moiré
Export configuration
VENICE series configuration file
On-set (shooting) process
Camera Control Panel
[Functions] · Control and configure VENICE series via web
remote control · Import configuration file and apply to VENICE
series
On-set Camera component
[Functions] · Perform color calibration of camera device
and LED display · Predict the occurrence of moiré
Import configuration
Link to camera actor
Apply settings to real camera device
Cine Camera actor (Unreal Engine standard virtual cinema camera)
Display as camera for in-camera VFX
Display chart for color calibration Apply 3D LUT
VENICE series
Shooting
LED display
5 1. Introduction
Usage Precautions
Software Usage
Security
This manual or the software described herein, in whole or in part, may not be
reproduced, translated or reduced to any machine readable form without prior
written approval from Sony Corporation.
© 2023 Sony Corporation
SONY WILL NOT BE LIABLE FOR DAMAGES OF ANY KIND RESULTING FROM A FAILURE TO IMPLEMENT PROPER SECURITY MEASURES ON TRANSMISSION DEVICES, UNAVOIDABLE DATA LEAKS RESULTING FROM TRANSMISSION SPECIFICATIONS, OR SECURITY PROBLEMS OF ANY KIND.
SONY CORPORATION PROVIDES NO WARRANTY WITH REGARD TO THIS MANUAL, THE SOFTWARE OR OTHER INFORMATION CONTAINED HEREIN AND HEREBY EXPRESSLY DISCLAIMS ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE WITH REGARD TO THIS MANUAL, THE SOFTWARE OR SUCH OTHER INFORMATION. IN NO EVENT SHALL SONY CORPORATION BE LIABLE FOR ANY INCIDENTAL, CONSEQUENTIAL OR SPECIAL DAMAGES, WHETHER BASED ON TORT, CONTRACT, OR OTHERWISE, ARISING OUT OF OR IN CONNECTION WITH THIS MANUAL, THE SOFTWARE OR OTHER INFORMATION CONTAINED HEREIN OR THE USE THEREOF.
This software may only be used with the specified device.
Sony Corporation reserves the right to make any modification to this manual or the information contained herein at any time without notice.
6 1. Introduction
About This Manual
Trademarks
About the Display Screen
· Windows and DirectX are trademarks or registered trademarks of Microsoft
Corporation in the U.S. and/or other countries.
· Unreal Engine is a trademark or registered trademark of Epic Games, Inc. in
the United States of America and elsewhere.
· AMD is a trademark of Advanced Micro Devices, Inc.
· Intel is a trademark or registered trademark of Intel Corporation or its
subsidiaries.
All system names, product names, and company names appearing in this document
are registered trademarks or trademarks of their respective owners.
Trademarked items are not indicated by ® or TM symbols in this document.
The displayed screen may vary from that shown in this document, depending on the computer and operating environment.
Preparation Setup
This section describes how to install Camera and Display Plugin and enable the
plugin in Unreal Engine.
Operating Environment
Operating conditions
To use the plugin, an Internet connection is required when launched for the
first time to access the license server. The proxy server for Internet
connection uses the Windows OS proxy settings. [Note] The plugin is enabled
for 14 days after accessing the license server. Note that when working
offline, you will need to connect to the Internet and access the license
server every 14 days.
Recommended operating environment
OS: Windows 10 version 22H2 (64-bit)
CPU: Quad core Intel or AMD, 2.5 GHz or higher
Memory: 8 GB RAM or higher
Graphics card: DirectX 11 or DirectX 12 compatible graphics card
For in-camera VFX shooting
You must prepare an operating environment that is recommended by Epic Games,
Inc. For details, visit the Unreal Engine site by Epic Games, Inc.
Installing Camera and Display
Plugin
This section describes how to install Camera and Display Plugin using the
“CameraAndDisplayPlugin_xxxxx_yyyyy.msi” installer. “xxxxx” in the file name
indicates the version of the plugin and “yyyyy” indicates the version of
Unreal Engine.
1 Run “CameraAndDisplayPluginxxxxx
yyyyy.msi.” The setup wizard launches. The software end user license agreement
appears. Check the contents and place a check mark in [I accept the terms in
the License Agreement] to proceed.
2 Specify the installation destination folder.
Specify the folder in which to install the plugin on the installation
destination folder selection screen. If Unreal Engine is installed, by default
the plugin will be installed directly in Unreal Engine. “Unreal Engine
installation folderEngine Plugins” is displayed as the installation
destination folder.
To install in an arbitrary folder Change the folder on the installation
destination folder selection screen. If the plugin is installed in an
arbitrary folder, copy the installation folder of the plugin to
“Project_folderPlugins” to reference the plugin from your project.
[Notes] · Even if Unreal Engine is installed, the Unreal
Engine installation folder may not be detected properly. In this case, enter
the folder path manually.
· If you install the plugin directly into Unreal Engine and then copy the
installation folder of the plugin to a project folder, the copy of the plugin
in the project folder takes precedence.
3 Follow the on-screen instructions to
complete the installation.
Uninstalling
Run “CameraAndDisplayPlugin_xxxxx_yyyyy. msi.” The setup wizard launches.
Follow the onscreen instructions to uninstall the plugin.
Enabling Camera and Display Plugin
This section describes how to enable Camera and Display Plugin using the
Unreal Engine editor (Unreal Editor) after installing the plugin. You can
enable/disable the plugin for each project.
1 Select [Edit] > [Plugins] from the Unreal
Editor menu bar. The [Plugins] window appears.
2 Select [INSTALLED].
A list of the installed plugins is displayed.
3 Place a check mark in [Camera and
Display Plugin]. A message appears prompting you to restart Unreal Editor.
To disable the plugin Clear the check mark from [Camera and Display Plugin].
4 Restart Unreal Editor when prompted.
The plugin is enabled.
To check the installation/enabled status
When the plugin is installed and enabled correctly, [Sony Virtual VENICE] is
displayed on the [Place Actors] panel of Unreal Editor.
Basic Operation
Pre-Vis Process Operations
This section describes how to use the Virtual VENICE actor of this plugin in
pre-vis process operations. You must instantiate a Virtual VENICE actor using
the Unreal Engine editor (Unreal Editor) and configure the instance for
scouting and image creation. The basic operations and workflow in the previs
process are shown below.
Instantiating a Virtual VENICE actor using Unreal Editor
Configuring Virtual VENICE actor camera device/LED display
Configuring virtual scouting and image creation
Configuring the moiré alert function (required if using moiré alert function)
Exporting a Virtual VENICE actor configuration file (required if creating a configuration file)
Exporting image files using Movie Render Queue (required if rendering image
files)
Instantiating a Virtual VENICE actor using Unreal Editor
Place a Virtual VENICE actor into a level in the same way as the Unreal Engine
standard camera actor using Unreal Editor to make it available for use. For
details about operation, see “Instantiating a Virtual VENICE Actor” (page 9).
Configuring Virtual VENICE actor camera device/LED display
Select the Virtual VENICE actor placed into a level and configure each item on
the [Details] panel. In addition to the same configuration items for a Cine
Camera actor, the [Details] panel shows the configuration items for the
Virtual VENICE actor in the [Sony Virtual VENICE] section. Configure your
camera device in [Camera Settings] > [Camera Type], the imager mode in [Imager
Mode], and other camera settings, such as [Project Frame Rate], [Base ISO],
and [Anamo. Desqueeze], as required. Also, set your LED display and the color
space of the input signal in [LED Settings]. For details about configuration
items, see “[Sony Virtual VENICE] Section Configuration Items” (page 16) and
refer to the manual for the camera device.
Working color space
The plugin supports the following [Working Color Space] settings in an Unreal
Engine project. · sRGB / Rec709 · Rec2020 · ACES AP0 · ACES AP1 / ACEScg ·
P3DCI · P3D65
Configuring virtual scouting and image creation
After configuring a camera device, configure settings for virtual scouting and
image creation. In 3D assets, place the Virtual VENICE actor in an appropriate
position and adjust the lens settings. You can also link the camera device
position and the lens settings using a position tracker and lens tracker. The
Virtual VENICE actor also supports the Unreal Engine sequencer function. You
can place a Virtual VENICE actor in a created level sequence and save some of
the settings of the Virtual VENICE actor as a key frame, allowing you to
preview the output video from the camera device while managing multiple shots
with different settings in the sequencer. For details about configuration
items, see “[Sony Virtual VENICE] Section Configuration Items” (page 16) and
refer to the manual for the camera device. For details about using a tracker,
refer to the manual for the tracker. For details about the sequencer function,
visit the Unreal Engine site by Epic Games, Inc.
[Note] The property names added to a level sequence may differ from the item
names in the [Details] panel for the Virtual VENICE actor. For example, the
value of the “EI for VENICE 2 8K – ISO 800” property displayed in the
sequencer may not be applied if [Camera Type] is set to [VENICE 2 6K] or if
[Base ISO] is set to [3200]. You can add properties that correspond to the
settings of the current Virtual VENICE actor to a level sequence by adding
properties from the [Details] panel.
Configuring the moiré alert function
In virtual production using an LED display, moiré (a phenomenon such as
striped patterns and color shifts on the screen) may occur when the camera
lens focus is close to
the display surface. You can enable the moiré alert function that can predict
the occurrence of moiré during the pre-vis process. For details about
configuring, see “Moiré Alert Function” (page 24).
[Note] If the current camera position/orientation and lens settings
information cannot be acquired correctly, the moiré alert function will not
produce correct results. For details, see “Configuring a Camera and Lens”
(page 24).
Exporting a Virtual VENICE actor configuration file
You can export the settings configured for Virtual VENICE actor to a file.
This allows you to reproduce the same image creation in the on-set (shooting)
process as the virtual scouting performed in the pre-vis process by using the
created configuration file on a real camera device and LED display. You can
also import a camera device configuration file created using the Camera
Control Panel during the on-set (shooting) process into a Virtual VENICE
actor. For details about operation, see “Exporting a Configuration File” (page
9) and “Importing a Configuration File” (page 10).
Exporting image files using Movie Render Queue
You can export a preview video of a level sequence created with the sequencer
function as a sequence of still image files (.jpg, .png, *.bmp, etc.) using
the Movie Render Queue function of Unreal Engine. When rendering images using
the Movie Render Queue function, configure the OCIO settings for the Virtual
VENICE actor so that the images are output with the appropriate color.
9 3. Basic Operation: Pre-Vis Process Operations
For details about configuring OCIO, see “Configuring OCIO Settings for Movie Render Queue” (page 10). For details about the Movie Render Queue function, visit the Unreal Engine site by Epic Games, Inc.
Instantiating a Virtual VENICE Actor
Placing a Virtual VENICE actor into a level in Unreal Editor creates an
instance.
1 Select [Sony Virtual VENICE] in the [Place
Actors] panel of Unreal Editor.
2 Drag & drop [Sony Virtual VENICE] into the
viewport.
Exporting a Configuration File
You can export the settings configured for Virtual VENICE actor to a file. You
can import a created camera device configuration file into a real camera
device using the Camera Control Panel. You can reproduce the same image
creation as the pre-vis process during the on-set (shooting) process by
applying the pre-vis process settings to the camera device. For details about
importing a configuration file in the on-set (shooting) process, see
“Importing a Configuration File (applying settings to a camera device)” (page
14).
1 Click the [Export Config File] button in the
[Sony Virtual VENICE] section in the [Details] panel for the Virtual VENICE
actor.
on-set (shooting) process by transferring both the configuration file and the
User 3D LUT CUBE file (*.cube) to the on-set (shooting) process. Only VENICE 2
supports the transfer of CUBE files via a network. For VENICE, transfer CUBE
files using an SD card.
[Note] If transferring CUBE files over a network with VENICE 2, the CUBE files
must be saved in the “Project_folder
PluginsSonyCameraAndDisplayResourcesUser3DLUT” folder for User 3D LUTs or in
the same folder as the configuration file.
A settings information confirmation dialog appears.
2 Check the settings information and click
the [OK] button.
3 Specify a folder and file name, then save
the file. A configuration file (*.vcfg) is created.
[Note] You cannot save to the Content folder or subfolders within the Content
folder in your Unreal Engine project folder. Specify a different folder.
When using User 3D LUT
When [Shooting] > [Look] is set to [User 3D LUT], you can use the same User 3D
LUT settings for both the pre-vis process and the
10 3. Basic Operation: Pre-Vis Process Operations
Importing a Configuration File
You can import a camera device configuration file created using the Camera
Control Panel into a Virtual VENICE actor. This allows you to resume a pre-vis
process workflow with the same settings as the on-set (shooting) process by
applying the real camera device settings to the Virtual VENICE actor. For
details about exporting a configuration file in the on-set (shooting) process,
see “Exporting a Configuration File (saving camera device settings)” (page
15). You can also re-import a configuration file created using the [Export
Config File] button of the Virtual VENICE actor.
1 Click the [Import Config File] button in the
[Sony Virtual VENICE] section in the [Details] panel for the Virtual VENICE
actor.
2 Select the configuration file (*.vcfg) to
import. The settings are applied to the Virtual VENICE actor.
Configuring OCIO Settings for
Movie Render Queue
You can export a preview video of a level sequence as image files using the
Movie Render Queue function. To export image files, configure the OCIO
settings for the Virtual VENICE actor in the [Movie Render Queue] window in
Unreal Editor. For details, visit the Unreal Engine site by Epic Games, Inc.
1 Display the rendering settings window for
the target level sequence.
2 Click [+ Setting] and select [Color Output].
[Color Output] settings are added to the rendering settings window. Configure
OCIO in [Color Output] > [OCIO Configuration].
3 Place a check mark in [Is Enabled].
[OCIO Configuration] is enabled.
4 Select [Sony_VP_OCIO] in [Configuration
Source]. Click the input field of [Configuration Source] and select
[Sony_VP_OCIO].
If [Sony_VP_OCIO] is not displayed Click the (Settings) icon and enable [Show
Plugin Content] and [Show Engine Content]. [Sony_VP_OCIO] appears in the list
and can be selected.
5 Select [Source for Bypass] in [Transform
Source].
6 Select [Destination for Bypass] in
[Transform Destination].
7 Configure other rendering settings, as
required. When finished, click the [Accept] button to apply the settings.
8 Execute rendering.
11 3. Basic Operation
On-Set (Shooting) Process Operations
The on-set (shooting) process workflow uses the On-set Camera component
provided by the plugin and the Camera Control Panel. In the Unreal Engine
editor (Unreal Editor), add the On-set Camera component to the Cine Camera
actor and configure the camera device and LED display. You can also launch the
Camera Control Panel and perform camera device and configuration file
operations via a network. The basic operations and workflow in the onset
(shooting) process are shown below.
Adding a component to a camera actor using Unreal Editor
Configuring On-set Camera component camera device/LED display
Configuring OCIO for nDisplay
Calibrating color of a camera device and LED display
Importing a configuration file into a camera device (required if applying a configuration file)
Configuring the moiré alert function (required if using moiré alert function)
Conducting on-set shooting
Adding a component to a camera actor using Unreal Editor
You can add the On-set Camera component to the Unreal Engine standard Cine
Camera actor or camera actors that have a Cine Camera component. For details
about operation, see “Adding the On-set Camera Component” (page 12).
[Notes] · Some camera actors may not support the On-set
Camera component even though they have a Cine Camera component. · A Virtual
VENICE actor can only be used in the pre-vis process. A Virtual VENICE actor
cannot be used by adding the On-set Camera component to the actor.
Configuring On-set Camera component camera device/LED display
Select the On-set Camera component in the [Details] panel of the camera actor,
and set each item in [Camera Settings] in the [Sony On Set Camera] section.
Configure your camera device in [Camera Type], the imager mode in [Imager
Mode], and other camera settings, such as [Anamo. Desqueeze], as required.
Also, set your LED display and the color space of the input signal in [LED
Settings]. For details about configuration items, see “[Sony On Set Camera]
Section Configuration Items” (page 20) and refer to the manual for the camera
device.
Working color space
The plugin supports the following [Working Color Space] settings in an Unreal
Engine project. · sRGB / Rec709 · Rec2020 · ACES AP0 · ACES AP1 / ACEScg ·
P3DCI · P3D65
Configuring OCIO for nDisplay
Depending on the color space of the input signal of the LED display, configure
the OCIO settings of the nDisplay outer frustum and inner frustum associated
with the camera actor with the attached On-set Camera component. For details
about configuring, see “Configuring OCIO for nDisplay” (page 13).
Calibrating color of a camera device and LED display
Select the On-set Camera component in the [Details] panel of the camera actor,
and configure the color calibration items in [Calibration] in the [Sony On Set
Camera] section. You can calibrate the color characteristics of the camera
device and LED display using a color chart or 3D LUT. For details about
configuration items, see “[Sony On Set Camera] Section Configuration Items”
(page 20). For details about configuring, see “Calibrating Color” (page 12)
and refer to the manual for Color Calibrator.
Importing a configuration file into a camera device
You can import a configuration file created by a Virtual VENICE actor into a
real camera device using the Camera Control Panel. This allows you to
reproduce the same image creation in the on-set (shooting) process as the
virtual scouting performed in the previs process by applying Virtual VENICE
actor settings to a camera device. You can also prepare multiple configuration
files for switching the camera device settings according to the environment or
other conditions. You can also export the settings of a camera device used
during the on-set (shooting) process to a file. For details about operation,
see “Importing a Configuration File (applying settings to a camera device)”
(page 14) and “Exporting a Configuration File (saving camera device settings)”
(page 15).
Configuring the moiré alert function
You can enable the moiré alert function that can predict the occurrence of
moiré that may be difficult to see in the on-set shooting environment. For
details about configuring, see “Moiré Alert Function” (page 24).
[Note] If the current camera position/orientation and lens settings
information cannot be acquired correctly, the moiré alert function will not
produce correct results. For details, see “Configuring a Camera and Lens”
(page 24).
Conducting on-set shooting
Launch nDisplay and conduct on-set shooting. Operations using the plugin are
supported, even after launching nDisplay, using the multiuser editing function
of Unreal Engine.
12 3. Basic Operation: On-Set (Shooting) Process Operations
You can also configure and operate a real camera device using the web remote control in the Camera Control Panel. For details about launching the Camera Control Panel, see “Launching the Camera Control Panel” (page 13).
Adding the On-set Camera Component
3 Select [Sony On Set Camera] from the list
of components.
You can add the On-set Camera component to the Unreal Engine standard Cine
Camera actor or camera actors that have a Cine Camera component.
[Notes] · Some camera actors may not support the On-set
Camera component even though they have a Cine Camera component. · A Virtual
VENICE actor can only be used in the pre-vis process. A Virtual VENICE actor
cannot be used by adding the On-set Camera component to the actor.
1 Select the target camera actor to
configure in the [Outliner] panel of Unreal Editor.
The On-set Camera component is added to the camera actor.
2 Click the [+ Add] button in the [Details] panel of the camera actor.
A list of components that can be selected is displayed.
Calibrating Color
You can calibrate the color of the camera device and LED display using the
Color Calibrator application (option). For details, refer to the manual for
Color Calibrator.
1 Select the On-set Camera component in
the [Details] panel of the camera actor.
2 Place a check mark in [Display Chart] in
[Calibration] in the [Sony On Set Camera] section. [Display Chart] is enabled
and a color calibration chart is displayed in the nDisplay inner frustum.
3 Set [Chart Type] and [Chart Scale] in
[Calibration] by referring to the Color Calibrator manual.
[Note] When setting [Calibration], disable [Calibration LUT].
4 Shoot the chart using the camera device
to generate a 3D LUT CUBE file (*.cube) using Color Calibrator.
5 Click the [Add] button for [LUT Filename] in [Calibration LUT] and select
the CUBE
file generated in step 4.
The selected CUBE file is added to the [LUT Filename] drop-down list.
6 Select the CUBE file added in step 5 from
the [LUT Filename] drop-down list in [Calibration LUT].
13 3. Basic Operation: On-Set (Shooting) Process Operations
7 Place a check mark in [Enable] in
[Calibration LUT]. [Calibration LUT] is enabled and the settings for the
selected CUBE file are applied.
8 Copy the CUBE file to the render node
folder.
The CUBE file added in step 5 is saved in
the “Project_folderPlugins SonyCameraAndDisplayResources Calibration_LUT”
folder. Copy the CUBE file to the same folder of the render node.
[Note] If the CUBE file is not copied correctly to the render node, the inner
frustum image that is output by the render node will be displayed in grayscale
when [Calibration LUT] is enabled.
If LED display controller settings are changed after a CUBE file is generated
When [LED Type] is set to [Crystal LED B-series], you can adjust the
[Contrast], [Brightness], [Light Output], and [Color Temperature] items of
[Crystal LED B-series Settings] in [Calibration LUT]. You can apply color
calibration without regenerating a CUBE file by setting [Crystal LED B-series
Settings] to the same values as the changed settings. When [LED Type] is set
to other than [Crystal LED B-series] and [Input Color Space] is SDR ([SDR
(sRGB/G2.4)] or [SDR (sRGB/G2.2)]), color shifts may occur if you change the
peak luminance of the LED display controller to a value different from when
color calibration was performed, depending on the type of LED display
controller. It is recommended that you perform color calibration again with
the new peak luminance setting. When [LED Type] is set to other than [Crystal
LED B-series] and [Input Color Space] is HDR ([HDR (Rec.2020/PQ)] or [HDR
(ACEScg/PQ)]),
it will be necessary to regenerate a CUBE file each time you change the LED
display controller settings.
Configuring OCIO for nDisplay
Configure the OCIO settings of the nDisplay outer frustum and inner frustum
associated with the camera actor with the attached Onset Camera component.
When OCIO settings are executed, appropriate values are applied automatically
according to the color space of the LED display input signal.
1 Select the On-set Camera component in
the [Details] panel of the camera actor.
2 Click the [nDisplay OCIO Setting] button in
[LED Settings] > [Input Color Space] in the [Sony On Set Camera] section.
The [nDisplay OCIO Setting] dialog appears. When OCIO settings are executed,
each item is set to the following values. · Status:
“Enabled” nDisplay Root actor > [Enable Viewport OCIO] and ICVFX Camera >
[Enable Inner Frustum OCIO] are set to [Enabled]. · OCIO Asset: “Sony_VP_OCIO”
· Source: Sets the same value as the [Working Color Space] setting in the
Unreal Engine project.
The On-set Camera component supports the following [Working Color Space]
settings. sRGB / Rec709 Rec2020 ACES AP0 ACES AP1 / ACEScg P3DCI
P3D65 · Destination: Sets the color space of the LED display input signal
([Input Color Space] setting). · Setting execution target: A check mark is
automatically inserted for any nDisplay instances whose current settings
differ from the values above to select them as a target for execution.
[Note] If you clear the check mark for a setting execution target nDisplay,
the color of the output video may vary from the expected color.
3 Click the [Overwrite] button.
4 Click the [OK] button in the confirmation
message. The OCIO settings are executed.
Launching the Camera Control Panel
Open the Camera Control Panel from Unreal Editor and log in to the camera
device. After logging in, the camera device is connected and the web remote
control and settings information of the camera device are displayed. [Note]
The Camera Control Panel is intended to be connected to a camera device on a
local network. The proxy settings in Windows OS cannot be used.
1 Open the Camera Control Panel.
Open the Camera Control Panel using one of the following methods. When you
open the Camera Control Panel, the [Sony Camera Control Panel] window appears.
· Select the On-set Camera component
in the [Details] panel of the camera actor, and click the [Camera Settings] >
[Camera Control Panel] button in the [Sony On Set Camera] section.
· Select [Window] > [Sony Camera Control Panel] from the Unreal Editor menu
bar.
14 3. Basic Operation: On-Set (Shooting) Process Operations
2 Enter the IP address of your camera
device in [Camera IP Address] and click the [Connect] button.
3 Enter the user name and password of the
camera device and click the [Login] button. Enter the user name configured for
the camera device in [Username] and the password in [Password]. After logging
in, the web remote control of the camera device is displayed on the [Camera]
tab. You can check the settings information of the camera device on the
[Details] tab.
For details, see “[Sony Camera Control Panel] Window” (page 22).
For details about operation using the web remote control, refer to the manual
for the camera device.
To disconnect a camera device
Click the [Disconnect] button.
Importing a Configuration File
(applying settings to a camera
device)
You can import a configuration file created by a Virtual VENICE actor into a
real camera device. This allows you to reproduce the same image creation in
the on-set (shooting) process as in the pre-vis process by applying Virtual
VENICE actor settings to a real camera device. For details about exporting a
configuration file in the pre-vis process, see “Exporting a Configuration
File” (page 9). You can also re-import a configuration file created using the
[Save Configuration] button in the Camera Control Panel.
1 Launch the Camera Control Panel.
For details about operation, see “Launching the Camera Control Panel” (page
13).
2 Click the [Configure Camera] button in the
[Sony Camera Control Panel] window.
3 Select the configuration file (*.vcfg) to
import. The [Configure Camera] dialog appears in which you can check the
settings information. For details, see “[Configure Camera] dialog” (page 23).
4 Click the [OK] button in the [Configure
Camera] dialog.
5 Click the [Yes] button in the confirmation
message. The settings are applied to the camera device.
[Notes] · Some items, such as lens settings and LED
display settings, cannot be set automatically. Items that cannot be set are
displayed in a list after the configuration file is imported. Configure each
device manually as required. Only VENICE 2 supports ASC CDL configuration via
a network. For VENICE, create an ASC CDL file (*.cdl) using the [Generate CDL
file] button and configure for the camera device using an SD card. For
details, see “[Configure Camera] dialog” (page 23). · To use a User 3D LUT,
only VENICE 2 supports the transfer of CUBE files via a network. For VENICE,
transfer CUBE files using an SD card. CUBE files for transfer must be saved in
the “Project_folderPlugins SonyCameraAndDisplayResourcesUser3DLUT” folder for
User 3D LUTs or in the same folder as the configuration file. You can open the
folder for User 3D LUTs using the [Open User 3D LUT folder] button in the
[Configure Camera] dialog. · When a configuration file is imported, the
configuration file settings are applied to “Input Color Space” and “Look” on
the camera device, but “LUT Select” is not configured automatically. You can
reproduce the color specified in the configuration file by changing “LUT
Select” to “Look” for the outputs of the camera device (SDI 1/2, for example).
Settings such as “Input Color Space,” “Look,” and “ASC CDL Process” applied to
a camera device may differ from the values displayed in the [Configure Camera]
dialog, but the signal processing that is applied will be equivalent.
15 3. Basic Operation: On-Set (Shooting) Process Operations
Displaying a list of the configuration file settings information
You can display the configuration items saved in the configuration file. When
settings cannot be applied to a camera or other device via a network, you can
configure the device manually while browsing the display.
1 Select the On-set Camera component in
the [Details] panel of the camera actor.
2 Click the [Camera Settings] > [Preview
Config File] button in the [Sony On Set Camera] section.
3 Select the configuration file (*.vcfg) to
display. The [Preview Configuration File] dialog appears. You can check the
value of each item saved in the configuration file. To close the [Preview
Configuration File] dialog, click the [OK] button.
Exporting a Configuration File
(saving camera device settings)
You can export the settings of a camera device used during the on-set
(shooting) process to a file. You can import a created configuration file into
a Virtual VENICE actor. This allows you to resume a pre-vis process workflow
with the same settings as the onset (shooting) process by applying the on-set
(shooting) process settings to the Virtual VENICE actor. For details about
importing a configuration file in the pre-vis process, see “Importing a
Configuration File” (page 10).
1 Launch the Camera Control Panel.
For details about operation, see “Launching the Camera Control Panel” (page
13).
2 Click the [Save Configuration] button in
the [Sony Camera Control Panel] window. A settings information confirmation
dialog appears.
3 Check the settings information and click
the [OK] button.
4 Specify a folder and file name, then save
the file. A configuration file (*.vcfg) is created.
[Note] You cannot save to the Content folder or subfolders within the Content
folder in your Unreal Engine project folder. Specify a different folder.
Settings
Virtual VENICE Actor Settings
The [Details] panel for a Virtual VENICE actor displays a [Sony Virtual
VENICE] section in addition to the Cine Camera actor settings. Configure the
items for the Virtual VENICE actor in the [Sony Virtual VENICE] section.
[Sony Virtual VENICE] Section Configuration Items
You can import/export configuration files, configure camera devices, configure
the moiré alert function, and configure LED displays in the [Sony Virtual
VENICE] section of the [Details] panel.
[Import Config File] button
Imports a camera device configuration file into a Virtual VENICE actor. You
can import an on-set (shooting) process configuration file created using the
Camera Control Panel or a configuration file created using the [Export Config
File] button of a Virtual VENICE actor. For details about operation, see
“Importing a Configuration File” (page 10).
[Export Config File] button
Exports a Virtual VENICE actor configuration file. You can import a created
camera device configuration file into a real camera device using the Camera
Control Panel. For details about operation, see “Exporting a Configuration
File” (page 9).
[Camera Settings] Configures a camera device. For details, see “[Camera
Settings] configuration items” (page 16).
[Moiré Alert] Configures the moiré alert function. For details, see “[Moiré
Alert] Configuration Items” (page 25).
[LED Settings] Configures an LED display. For details, see “[LED Settings]
configuration items” (page 18).
[Camera Settings] configuration items
Select the model of your camera device to configure the Lens, Project, and
Shooting items. For configuration items that are common to your camera device,
you can set the same values as on the camera device. For details about
settings, refer to the manual for the camera device.
Item Camera Type
Description
Sets the model of the camera device. The Virtual VENICE actor supports the
following models. · VENICE (CineAltaV) · VENICE 2 6K (CineAltaV 2 6K) · VENICE
2 8K (CineAltaV 2 8K)
Lens Configures settings related to lenses.
Item
Description
Optical Filter
Set the light attenuation (percentage of light transmission) by the polarization filter. Set value: Value in the range 0.00 to 1.00
Iris (Current Aperture)
Sets the aperture of the lens. Can also be configured automatically using the [Auto-Adjust] button.
[Auto-Adjust] button
Automatically sets the appropriate aperture according to the shutter, FPS, and ISO settings.
Current Focal Length (mm)
Sets the focal length of the lens.
Current Focus Distance
Sets the focus distance of the lens.
Lens Distortion and Vignetting
Sets whether to apply lens distortion and vignetting.
Lens Type
Sets the type of the lens.
Enable Distortion
Enables/disables distortion.
Enable Vignetting
Enables/disables vignetting.
[Note] To apply the vignetting effect correctly, place a check mark in [Vignette Intensity] under [Post Process] > [Lens] > [Image Effects] and set it to “0.0” in the [Details] panel of the Virtual VENICE actor.
Project Configures basic settings for a project. Corresponds to the Project menu of the camera device. For details about items and settings in the Project menu, refer to the manual for the camera device.
Item
Description
Imager Mode
Sets the imager mode. The imager mode setting sets the appropriate filmback of the Cine Camera component.
[Note] Depending on the imager mode, a warning message may appear indicating that a software license must be installed on the camera device, but Virtual VENICE Actor functions are always available for use.
17 4. Settings: Virtual VENICE Actor Settings
Project Configures basic settings for a project. Corresponds to the Project menu of the camera device. For details about items and settings in the Project menu, refer to the manual for the camera device.
Item
Description
Project Frame Rate
Sets the project frame rate.
Input Color Space Base ISO Anamo. Desqueeze
User
[Note] A frame rate of 47.95p is not supported.
Sets the color space of the input signal.
Sets the base sensitivity.
Sets the de-squeeze ratio when using an anamorphic lens. Selecting [User]
allows you to set an arbitrary value that is different from your camera
device.
Displayed when [Anamo. Desqueeze] is set to [User]. Sets the de-squeeze ratio.
Set value: Value in the range 1.0 to 2.0 [Note] When [User] is selected, the
de-squeeze ratio setting is not applied to the camera device.
Shooting Configures settings related to shooting. Corresponds to the Shooting menu of the camera device. For details about items and settings in the Shooting menu, refer to the manual for the camera device.
Item
Description
FPS
Displays the same value as [Project] > [Project Frame Rate].
Shutter
Sets the electronic shutter.
Mode
Sets the operating mode of the electronic shutter. Set value: Angle / Speed
Angle
Displayed when [Mode] is set to [Angle]. Sets the opening angle of the electronic shutter. Selecting [User] allows you to set an arbitrary value.
User
Displayed when [Angle] is set to [User]. Sets the opening angle of the electronic shutter (equivalent to the setting when the electronic shutter operation is set to “Continuous” on your camera device).
Shooting Configures settings related to shooting. Corresponds to the Shooting menu of the camera device. For details about items and settings in the Shooting menu, refer to the manual for the camera device.
Item
Description
Speed
Displayed when [Mode] is set to [Speed]. Sets the speed of the electronic shutter. Selecting [User] allows you to set an arbitrary value.
User (inverse)
Displayed when [Speed] is set to [User]. Sets the speed of the electronic shutter (equivalent to the setting when the electronic shutter operation is set to “Continuous” on your camera device).
ND
Sets the ND filter position.
Exposure Index
Sets the EI value.
White Balance
Sets the white balance.
Color Temp.
Sets the color temperature. Set value: 3200K / 4300K / 5500K / 6500K / User Selecting [User] allows you to set an arbitrary value.
User
Displayed when [Color Temp.] is set to [User]. Sets the color temperature. Set value: Integer in the range 2000 to 15000
Tint
Sets the tint value.
Set value: Integer in the range 99 to 99
Look
Sets the look. When [User 3D LUT] is selected, you can load any CUBE file (*.cube) to use settings other than the preset Look settings for your camera device.
User 3D LUT
Sets the CUBE file when [Look] is set to [User 3D LUT]. Select the CUBE file to load from the drop-down list. For details about CUBE files that can be loaded, refer to the manual for the camera device.
[Add] button
Adds a CUBE file to the [User 3D LUT] drop-down list.
[Delete] button ASC CDL
Process [Note] Up to 32 CUBE files can be displayed in the drop-down list.
Deletes the CUBE file selected in [User 3D LUT].
Sets the ASC CDL.
Sets whether to apply ASC CDL to the output video. When applying ASC CDL, set
the ASC CDL processing sequence. · CDL Off: Do not apply ASC CDL to the output
video. · Look -> CDL: Apply CDL after applying Look. · CDL -> Look: Apply CDL
before applying Look.
18 4. Settings: Virtual VENICE Actor Settings
Shooting Configures settings related to shooting. Corresponds to the Shooting menu of the camera device. For details about items and settings in the Shooting menu, refer to the manual for the camera device.
Item
Description
[Import CDL File] button
Loads an ASC CDL file (*.cdl) and applies the [Slope], [Offset], [Power], and [Saturation] parameters.
[Export CDL File] button
Writes the [Slope], [Offset], [Power], and [Saturation] parameters to an ASC CDL file (*.cdl).
Slope Offset Power Saturation
[Note] The [Export CDL File] button function is used to export the ASC CDL
parameter values configured by a Virtual VENICE actor to third-party
applications. To apply the ASC CDL settings to your camera device, use a
configuration file created using the [Export Config File] button. ASC CDL
parameter values are included in configuration files.
Sets the slope (R, G, B). Set value: Value in the range 0.000 to 3.999
Sets the offset (R, G, B). Set value: Value in the range 1.000 to 1.000
Sets the power (R, G, B). Set value: Value in the range 0.400 to 4.000
Sets the saturation. Set value: Value in the range 0.000 to 3.999 [LED
Settings] configuration items
Select the model of your LED display and configure the color space of the input signal. If using the Crystal LED B-series, configure the LED display (Crystal LED B-series Settings) items.
Item LED Type Input Color Space
Description Sets the model of the LED display. Sets the color space of the input signal of the LED display. Set value: SDR / HDR / HDR (Rec.2020/PQ)
Sensitivity Simulation Luminance Adjustment
[Note] The values that can be selected for [Input Color Space] will vary
depending on the [LED Type] setting.
Sets the operating mode for luminance management. · Mode A: Operating mode
that reflects the deviation in
optical luminance that occurs between the LED display and camera device. The
brightness of the output video changes depending on the display selected in
[LED Type], similar to the actual shooting environment. · Mode B: Operating
mode that does not reflect the deviation in optical luminance that occurs
between the LED display and camera device. The brightness of the output video
does not change depending on the display selected in [LED Type]. The type of
color calibration varies depending on the selected operating mode. For
details, refer to the manual for Color Calibrator.
Displayed when [Mode A] is selected in [Sensitivity Simulation]. Adjusts the
luminance of the output video. Set value: Value in the range 0.50 to 1.50
Peak Luminance (Nit)
[Note] The higher the value, the brighter the image.
Displayed when a display other than [Crystal LED B-series] is selected in [LED
Type]. Sets the peak luminance. Set value: Integer in the range 0 to 2000
[Note] [Peak Luminance (Nit)] can be configured only when [Input Color Space]
is set to [SDR].
19 4. Settings: Virtual VENICE Actor Settings
Crystal LED B-series Settings Configures Crystal LED B-series display settings. For details about settings, refer to the manual for the Crystal LED B-series.
[Note] [Crystal LED B-series Settings] is displayed only when [Crystal LED B-series] is selected in [LED Type].
Item
Description
Contrast
Sets the contrast of the LED display.
Brightness
Sets the brightness of the LED display.
Light Output
Sets the optical output of the LED display.
Color Temperature
Sets the color temperature of the LED display. Selecting [User] allows you to set an arbitrary value for each parameter.
R Gain G Gain
Displayed when [Color Temperature] is set to [User]. Sets the RGB gain.
B Gain
R Bias G Bias
Displayed when [Color Temperature] is set to [User]. Sets the RGB bias.
B Bias
20 4. Settings
On-set Camera Component Settings
These settings configure the functions required for virtual production shooting for a camera actor with an attached On-set Camera component. Select the On-set Camera component in the [Details] panel of the camera actor, and set items in the [Sony On Set Camera] section.
[Sony On Set Camera] Section Configuration Items
You can open the Camera Control Panel, display configuration file information, configure camera devices, configure LED displays, configure color calibration, and configure the moiré alert function in the [Sony On Set Camera] section of the [Details] panel.
[Camera Settings] Configures a camera device, opens the Camera Control Panel, and displays configuration file information. For details, see “[Camera Settings] configuration items” (page 20). [LED Settings] Configures an LED display and the OCIO settings for nDisplay. For details, see “[LED Settings] configuration items” (page 20). [Calibration] Configures color calibration settings of a camera device and LED display. For details, see “[Calibration] configuration items” (page 21). [Moiré Alert] Configures the moiré alert function. For details, see “[Moiré Alert] Configuration Items” (page 25). [Camera Settings] configuration items
Select the model of your camera device and configure the imager mode and other settings. You can also open the Camera Control Panel and display configuration file information. For configuration items that are common to your camera device, you can set the same values as on the camera device. For details about settings, refer to the manual for the camera device.
Item [Camera Control Panel] button
Description
Opens the Camera Control Panel. For details, see “Launching the Camera Control
Panel” (page 13).
Item [Preview Config File] button
Camera Type
Imager Mode Anamo. Desqueeze User
Description
Displays a list of settings information for a selected camera device
configuration file. You can select a configuration file created using the
[Export Config File] button of a Virtual VENICE actor or the [Save
Configuration] button of the Camera Control Panel. When settings cannot be
applied to a camera or other device via a network, you can configure the
device manually while browsing the display.
Sets the model of your camera device. The following models are supported by
the On-set Camera component. · VENICE (CineAltaV) · VENICE 2 6K (CineAltaV 2
6K) · VENICE 2 8K (CineAltaV 2 8K)
Sets the imager mode. The imager mode setting sets the appropriate filmback of
the Cine Camera component.
Sets the de-squeeze ratio when using an anamorphic lens. Selecting [User]
allows you to set an arbitrary value that is different from your camera
device.
Displayed when [Anamo. Desqueeze] is set to [User]. Sets the de-squeeze ratio.
Set value: Value in the range 1.0 to 2.0
[LED Settings] configuration items
Select the model of your LED display and configure the color space of the input signal. Also, configure the OCIO settings for nDisplay according to the color space of the input signal.
Item LED Type Input Color Space
Description
Sets the model of the LED display.
Sets the color space of the input signal of the LED display. Set value: SDR
(sRGB/G2.4) / SDR (sRGB/G2.2) / HDR
(Rec.2020/PQ) / HDR (ACEScg/PQ)
[Note] The values that can be selected for [Input Color Space] will vary
depending on the [LED Type] setting.
[nDisplay OCIO Setting] button Configures the OCIO settings of the nDisplay
outer frustum and inner frustum associated with the camera actor with the
attached On-set Camera component. Clicking the [nDisplay OCIO Setting] button
will display the [nDisplay OCIO Setting] dialog. For details, see “Configuring
OCIO for nDisplay” (page 13).
21 4. Settings: On-set Camera Component Settings
[Calibration] configuration items
Configure color calibration settings using a color chart (Calibration Chart) or 3D LUT (Calibration LUT).
Calibration Chart Configures settings for the color chart used for color calibration by the Color Calibrator application (option). For details, refer to the manual for Color Calibrator.
Item
Description
Display Chart
Shows/hides the color chart.
Chart Type
Sets the type of the color chart.
Chart Scale
Sets the size of the color chart.
Calibration LUT Configures 3D LUT settings used for color calibration.
Item
Description
LUT Filename
Sets the CUBE file (*.cube) of the 3D LUT. Select the CUBE file to load from the drop-down list.
[Add] button
Adds a CUBE file to the [LUT Filename] drop-down list.
[Delete] button Enable [Note] Up to 32 CUBE files can be displayed in the
drop-down list.
Deletes the CUBE file selected in [LUT Filename]. Enables/disables 3D LUT
operation. [Note] When calibrating color by displaying a color chart, first
disable [Calibration LUT].
Calibration LUT Configures 3D LUT settings used for color calibration.
Item
Description
Crystal LED B-series Settings
Displayed when [Crystal LED B-series] is selected in [LED Settings] > [LED Type]. Use when changing the color of a Crystal LED B-series display after a CUBE file is generated. For details, see “If LED display controller settings are changed after a CUBE file is generated” (page 13). For details about settings, refer to the manual for the Crystal LED B-series.
Contrast
Sets the contrast of the LED display.
Brightness
Sets the brightness of the LED display.
Light Output
Sets the optical output of the LED display.
Color Temperature
Sets the color temperature of the LED display. Selecting [User] allows you to set an arbitrary value for each parameter.
R Gain G Gain
Displayed when [Color Temperature] is set to [User]. Sets the RGB gain.
B Gain
R Bias G Bias
Displayed when [Color Temperature] is set to [User]. Sets the RGB bias.
B Bias
22 4. Settings
Camera Control Panel
You can connect a real camera device, and perform camera device operations and
display settings information via a network using the Camera Control Panel. For
details about launching the Camera Control Panel, see “Launching the Camera
Control Panel” (page 13).
[Sony Camera Control Panel] Window
When you log in to a real camera device using the Camera Control Panel, the
web remote control and settings of the camera device are displayed in the
[Sony Camera Control Panel] window.
1. Camera IP Address
Displays the IP address of the camera device.
2. [Camera] tab
Displays the web remote control of the camera device. For details about
operation using the web remote control, refer to the manual for the camera
device.
3. [Configure Camera] button
Imports a camera device configuration file into a real camera device. You can
import a pre-vis process configuration file created using the [Export Config
File] button of a Virtual VENICE actor or a configuration file created using
the [Save Configuration] button of the Camera Control Panel. Click the
[Configure Camera] button to display the [Configure Camera] dialog. Check the
settings information in the [Configure Camera] dialog and then start
importing. For details about operation, see “Importing a Configuration File
(applying settings to a camera device)” (page 14).
4. [Save Configuration] button
Exports the settings of a real camera device to a file. You can import a
created file into a Virtual VENICE actor. For details about operation, see
“Exporting a Configuration File (saving camera device settings)” (page 15).
5. [Details] tab
Displays settings information for a camera device and lens. For details, refer
to the manual for the camera device.
6. Time and model of camera device
Displays the time configured on the camera device and the model of the camera
device.
7. [Connect] button / [Disconnect] button
Connects to a camera device. The [Connect] button is displayed when not
connected to a camera device. Disconnects from a camera device. The
[Disconnect] button is displayed when connected to a camera device.
23 4. Settings: Camera Control Panel
[Configure Camera] dialog
When importing a configuration file into a camera device, the [Configure
Camera] dialog appears in which you can check the settings information.
Importing a configuration file
Click the [OK] button in the [Configure Camera] dialog, then click the [Yes]
button in the confirmation message. Importing starts and the set values in the
configuration file are applied to the camera device. After importing, a dialog
appears which displays a list of items that could not be applied automatically
For items that could not be applied, configure manually on the camera device.
If you are using VENICE as the camera device, ASC CDL files (.cdl) and User
3D LUT CUBE files (.cube) must be transferred to the camera device via an SD
card. · You can create an ASC CDL file (*.cdl) using
the [Generate CDL file] button displayed in the dialog. You can apply the
settings by loading the created ASC CDL file into VENICE via an SD card. · You
can open the “Project_folderPlugins SonyCameraAndDisplayResources User3DLUT”
folder for User 3D LUTs using the [Open User 3D LUT folder] button displayed
in the dialog. You can apply the settings by loading a CUBE file saved in the
folder into VENICE via an SD card.
The following information is displayed in the [Configure Camera] dialog. ·
Camera Type: Model of camera device · Setting: Configuration item ·
Configuration File: Set value in configuration
file · Device: Current set value of a camera device The [Configuration File]
set value is displayed highlighted if the configuration file and current
setting of the camera device are different. For items with “>” displayed between the [Configuration File] set value and the [Device] set value, the configuration file set value will be applied to the camera device upon importing. For items where “>” is not displayed, even if the display is highlighted, the setting will not be applied automatically upon importing.
24 4. Settings
Moiré Alert Function
In virtual production, moiré may occur on the LED display, depending on the
distance and angle between the LED display and the camera, and the settings of
the camera lens. The plugin has a moiré alert function that can be used in
both the pre-vis process and on-set (shooting) process. When the moiré alert
function is enabled, it can predict the occurrence of moiré, even in the pre-
vis process where there is no real camera or LED display. In addition, the
moiré alert function can predict the occurrence of moiré in on-set shooting
environments where it would be difficult to see.
Configuring a Camera and Lens
The camera position/orientation information and lens information (focal
length, aperture, focus distance) required by the moiré alert function must be
configured correctly in the camera actor. You can report the correct values by
using a position tracker, for example.
Pre-vis process
Set the camera and lens information, [Camera Type], and [Anamo. Desqueeze]
correctly in the Virtual VENICE actor.
On-set (shooting) process
Configure settings so that the camera and lens information is reflected in the
camera actor with an attached On-set Camera component, and set [Camera Type]
and [Anamo. Desqueeze] of the On-set Camera component correctly. On-set,
operation in a configuration that does not reflect the lens information of a
real camera device on the camera actor for nDisplay rendering is also
possible. In this case, configure a camera actor dedicated to
the moiré alert function and add the On-set Camera component to the camera
actor. Configure settings so that the camera and lens information is reflected
in the camera actor dedicated to the moiré alert function, and set [Camera
Type] and [Anamo. Desqueeze] of the On-set Camera component correctly. The
moiré alert function operates in Unreal Editor, so camera and lens information
must be reported to Unreal Editor, not to the render node.
[Note] A Virtual VENICE actor can only be used in the pre-vis process. It is
not necessary to add an On-set Camera component to a Virtual VENICE actor.
Configuring the Moiré Alert Function
You can configure the moiré alert function of a Virtual VENICE actor or the
On-set Camera component. When the moiré alert function is enabled, you can
check if there is a risk of moiré occurring by the color displayed on the
target LED display.
Pre-vis process
Select a Virtual VENICE actor and configure using the following procedure in
the [Sony Virtual VENICE] section of the [Details] panel.
On-set (shooting) process
Select the On-set Camera component in the [Details] panel of the camera actor,
and configure using the following procedure in the [Sony On Set Camera]
section.
1 Click the [Moiré Alert] > [Add Display] button.
The [Moiré Alert Setup] dialog appears. For details, see “[Moiré Alert Setup]
dialog” (page 26).
2 Select the target nDisplay actor to set in
the [Moiré Alert Setup] dialog. Placing a check mark in [Show nDisplays Only]
will display the nDisplay actors only. If an nDisplay actor is not available,
you can also use a Static Mesh actor that mimics the display shape.
3 Select meshes to construct an LED
display. Place a check mark in the target mesh to set. Select only a mesh that
constitutes a single display. If there are multiple LED displays in an
nDisplay actor, repeat steps 1 to 7 to
configure each display. Example: If there are four LED displays (front view
(1), right (2), left (3), ceiling (4)), repeat
steps 1 to 7 for displays (1) to (4).
[Note] You can register up to six LED displays using the [Add Display] button.
4 Select your LED display in [Display Panel
Type Preset]. If you select [Other], set the pitch size in [LED Pitch Size].
5 Select the calculation interval for moiré
generation in [Sampling Distance].
6 Click the [Add] button.
7 Click the [OK] button in the confirmation
message. The display is registered.
8 Place a check mark in [Moiré Alert] >
[Enable Moiré Alert]. The moiré alert function is enabled. A colored tile mesh
is attached to the
mesh selected in step 3 to show the moiré
occurrence level.
Moiré alert display color
The selected mesh will be displayed in the following colors according to the
moiré occurrence level. Green: Possibility of visible moiré is low. Yellow:
Moiré may be visible, depending on
the shooting and viewing conditions. Red: Possibility of visible moiré is
high. Purple: The moiré alert function cannot be
used because the focus position is behind the LED display.
[Note] This function does not guarantee that moiré will not occur when green
is displayed.
25 4. Settings: Moiré Alert Function
Editing/deleting moiré alert function settings
A list of the registered displays is displayed in [Moiré Alert] > [Displays].
You can click the [Edit] button for a target display to display the [Moiré
Alert Setup] dialog and edit the display settings. Clicking the [Delete]
button for a target display will delete the display. You can also place a
check mark in [Show Moiré Alert] for a target display to show/hide the moiré
alert color.
[Moiré Alert] Configuration Items
In the pre-vis process, configure the moiré alert function in [Moiré Alert] in the [Sony Virtual VENICE] section of the [Details] panel. In the on-set (shooting) process, configure the moiré alert function in [Moiré Alert] in the [Sony On Set Camera] section of the [Details] panel.
Item Enable Moiré Alert
Description
Enables/disables the moiré alert function for a display registered using [Add
Display].
Show Low Level Alert / Display Meshes Show Out of Range Alert Exposure of
Alert Color Opacity of Alert Color Overall Moiré Alert Level
[Add Display] button
[Note] When using the moiré alert function with multiple camera actors, only
the camera actor on which the moiré alert function was last enabled is itself
enabled. The moiré alert function is disabled on all other camera actors.
Sets whether to show/hide the moire alert function in green color (possibility
of moiré occurrence is low) and display mesh (displayed in gray). Clear the
check mark to not display the green color and display mesh.
Sets whether to show/hide the moire alert function in purple (moiré alert
function out of range). Clear the check mark to not display purple.
Sets the exposure of the moiré alert function display color. Set value: Value
in the range 8.0 to 8.0
Sets the opacity of the moiré alert function display color. Set value: Value
in the range 0.0 to 1.0
Displays the moiré occurrence level. If the level varies depending on the
mesh, it is displayed in the following order of priority. · High: Possibility
of visible moiré is high. · Middle: Moiré may be visible, depending on the
shooting
and viewing conditions. · Out of Range: The moiré alert function is out of
range
because the focus position is behind the LED display. · Low: Possibility of
visible moiré is low. · N/A: The moiré alert function is disabled.
Adds a display for the moiré alert function. Clicking the [Add Display] button
displays the [Moiré Alert Setup] dialog. For details, see “[Moiré Alert Setup]
dialog” (page 26).
26 4. Settings: Moiré Alert Function
Item Displays
Show Moiré Alert [Edit] button
[Delete] button
Description
Displays a list of the registered displays. [Show Moiré Alert], [Edit] button,
and [Delete] button are displayed for each display.
Displays the color of the moiré alert for a display. Clear the check mark to
not display the moiré alert color.
Edits the settings of the display. Clicking the [Edit] button displays the
[Moiré Alert Setup] dialog. For details, see “[Moiré Alert Setup] dialog”
(page 26).
Deletes the display.
[Moiré Alert Setup] dialog
The [Moiré Alert Setup] dialog is used to add and edit displays that are the
target of the moiré alert function.
1
2
3 4
5
6
1. Actor (display) selection area
Displays the actors within the project. Select the actors targeted by the
moiré alert function. Placing a check mark in [Show nDisplays Only] will
display the nDisplay actors only in the actor selection area.
[Note] If you display the [Moiré Alert Setup] dialog using the [Edit] button
in the list of displays, the actor selection area is not displayed.
2. Mesh selection area
Displays the meshes used to construct the selected actor. Select the meshes
targeted by the moiré alert function. Clicking the [Select All] button will
select all of the displayed meshes. Clicking the [Deselect All] button will
deselect all of the displayed meshes.
[Note] If there are multiple LED displays in an nDisplay actor, add the LED
displays one at a time. Select only a mesh that constitutes a single LED
display and then configure settings. For details, see “Configuring the Moiré
Alert Function” (page 24).
27 4. Settings: Moiré Alert Function
3. Display Panel Type Preset
Sets the model of the display. If you select [Other], set the pitch size in
[LED Pitch Size]. [Note] [LED Pitch Size] is displayed only when [Other] is
selected.
4. Sampling Distance
Sets the interval for calculating the moiré occurrence level. [Note] If you
set the [Sampling Distance] to a shorter interval, the moiré occurrence level
can be viewed in more detail, but the calculation overhead will increase and
the frame rate may drop. There is no drop in the frame rate on the render node
side, as there is no computation involved.
5. [Add] button / [Edit] button
Registers displays. If you display the [Moiré Alert Setup] dialog using the
[Edit] button in the list of displays, the [Edit] button is displayed instead
of the [Add] button.
6. [Cancel] button
Closes the [Moiré Alert Setup] dialog without registering/editing a display.
28 5. Appendix
Troubleshooting
Camera output color varies between pre-vis process and on-set (shooting)
process
Review the following items if the output video color of a Virtual VENICE actor
and the output video color of a real camera device are different.
Cause Camera settings of a Virtual VENICE actor and a real camera device are
different.
Lens settings of a Virtual VENICE actor and the camera device are different.
Virtual VENICE actor and real LED display controller settings are different.
On-set Camera component and real LED display controller settings are
different.
Solution
Check that the camera settings of the Virtual VENICE actor and the real camera
device are the same. You can import a Virtual VENICE actor configuration file
using the Camera Control Panel and apply the camera settings of the Virtual
VENICE actor to the camera device (page 14). When you import a configuration
file, the [Configure Camera] dialog is displayed. You can compare the Virtual
VENICE actor settings with the camera device settings in the dialog (page 23).
Check that the lens settings used by a Virtual VENICE actor and the real
camera device are the same. Lens settings must be configured manually or by
using a lens tracker. Unlike camera settings, lens settings cannot be applied
to a camera device by importing a configuration file using the Camera Control
Panel.
Check that [LED Settings] of the Virtual VENICE actor and the real LED display
controller have the same settings. If using the Crystal LED B-series, [Crystal
LED B-series Settings] must have the same settings as the real LED display
controller. If using an LED display other than the Crystal LED B-series, a
standard HDR signal/SDR signal must be output from the LED display. Also, for
SDR, the peak luminance settings must match.
Check that [LED Settings] of the On-set Camera component and the real LED
display controller have the same settings. If [LED Settings] > [Input Color
Space] or the Unreal Engine project [Working Color Space] is changed, the OCIO
settings must be configured again using the [nDisplay OCIO Setting] button. If
using the Crystal LED B-series, [Calibration LUT] > [Crystal LED B-series
Settings] must have the same settings as the real LED display controller.
Cause In Unreal Editor, the post process settings or post process volume
settings of a camera actor are different for the pre-vis process and on-set
(shooting) process.
A Virtual VENICE actor in Unreal Editor and the Cine Camera actor with On-set
Camera component on a render node are not shooting the same thing.
OCIO is configured for the output video of a Virtual VENICE actor used in the
pre-vis process.
“RM/RCP Paint Control” is set to “On” on the real camera device.
Solution
In Unreal Editor, match the post process/post process volume settings of the
Virtual VENICE actor and the on-set (shooting) process Cine Camera actor.
Specifically, the [Bloom], [Exposure], [Vignette Intensity], [Expand Gamut],
and [Tone Curve Amount] settings must match. Note that camera actors other
than the Unreal Engine standard Cine Camera actor may have different default
values.
Check that the Virtual VENICE actor in Unreal Editor and the Cine Camera actor
with the attached On-set Camera component on a render node are shooting the
same thing. Different settings, such as sublevels, lighting visibility, and
camera position, may not output the same color.
Similarly to a real camera device, a Virtual VENICE actor controls the color
of the output video using the [Project] > [Input Color Space] and [Shooting] >
[Look] settings, so there is no need to configure OCIO. Also, you can output
Log video as-is, such as S-Gamut3.Cine/SLog3 selected using [Input Color
Space], by setting [Look] to [Log].
The Virtual VENICE actor does not support the paint functions of a remote
control unit. Set “RM/RCP Paint Control” to “Off” on the real camera device.
Color calibration is not applied to the nDisplay inner frustum display
Check the following causes if color is not calibrated correctly.
Cause The CUBE file specified in [LUT Filename] of [Calibration LUT] in Unreal
Editor was not transferred to the nDisplay render node.
[Camera Options] > [Post Process Blend Weight] of the camera actor with an
attached On-set Camera component is set to a value other than 1.0.
Solution
Transfer the contents of the “Project_folder
PluginsSonyCameraAndDisplayResources” folder from the computer running Unreal
Editor to the nDisplay render node.
When using a color calibration chart display and the color calibration
function, set [Post Process Blend Weight] to 1.0.
29 5. Appendix: Troubleshooting
Moiré alert is not displayed correctly
Review the following items if the moiré alert function does not operate
correctly.
Cause Meshes belonging to different displays, such as the front view and
ceiling, were registered at the same time using the [Add Display] button.
Unreal Engine is running on a remote desktop.
Solution
Moiré alerts will not be displayed correctly if you register meshes belonging
to different displays at the same time using a single [Add Display] button
operation. For multiple displays, perform an [Add Display] button operation
for each display (page 24).
Moiré alerts are not displayed correctly with the default viewport settings
when running Unreal Engine on a remote desktop. Moiré alerts can be displayed
by executing [Disable Realtime Override] in the viewport options and then
enabling [Realtime].