Microsemi DG0723 SmartFusion2 Imaging and Video Kit MIPI CSI-2 User Guide

: June 9, 2024
: Microsemi

Table of Contents

DG0723 SmartFusion2 Imaging and Video Kit MIPI CSI-2
Revision History
- Revision 1.0
SmartFusion2 Imaging and Video MIPI CSI-2
Documents / Resources

DG0723
Demo Guide
SmartFusion2 Imaging and Video Kit MIPI CSI-2

DG0723 SmartFusion2 Imaging and Video Kit MIPI CSI-2

Microsemi Corporate Headquarters
One Enterprise, Aliso Viejo, CA 92656 USA Within the USA: +1 800-713-4113 Outside the USA: +1 949-380-6100 Fax: +1 949-215-4996 Email: sales.support@microsemi.com www.microsemi.com

© 2017 Microsemi Corporation.
All rights reserved. Microsemi and the Microsemi logo are trademarks of Microsemi Corporation.
All other trademarks and service marks are the property of their respective owners.

Microsemi makes no warranty, representation, or guarantee regarding the information contained herein or the suitability of its products and services for any particular purpose, nor does Microsemi assume any liability whatsoever arising out of the application or use of any product or circuit. The products sold hereunder and any other products sold by Microsemi have been subject to limited testing and should not be used in conjunction with mission-critical equipment or applications. Any performance specifications are believed to be reliable but are not verified, and Buyer must conduct and complete all performance and other testing of the products, alone and together with, or installed in, any end-products. Buyer shall not rely on any data and performance specifications or parameters provided by Microsemi. It is the Buyer’s responsibility to independently determine suitability of any products and to test and verify the same. The information provided by Microsemi hereunder is provided “as is, where is” and with all faults, and the entire risk associated with such information is entirely with the Buyer. Microsemi does not grant, explicitly or implicitly, to any party any patent rights, licenses, or any other IP rights, whether with regard to such information itself or anything described by such information. Information provided in this document is proprietary to Microsemi, and Microsemi reserves the right to make any changes to the information in this document or to any products and services at any time without notice.

About Microsemi
Microsemi Corporation (Nasdaq: MSCC) offers a comprehensive portfolio of semiconductor and system solutions for aerospace & defense, communications, data center and industrial markets. Products include high-performance and radiation-hardened analog mixed-signal integrated circuits, FPGAs, SoCs and ASICs; power management products; timing and synchronization devices and precise time solutions, setting the world’s standard for time; voice processing devices; RF solutions; discrete components; enterprise storage and communication solutions, security technologies and scalable anti-tamper products; Ethernet solutions; Power-over-Ethernet ICs and midspans; as well as custom design capabilities and services. Microsemi is headquartered in Aliso Viejo, California, and has approximately 4,800 employees globally. Learn more at www.microsemi.com.

Revision History

The revision history describes the changes that were implemented in the document. The changes are listed by revision, starting with the most current publication.

Revision 1.0

Revision 1.0 is the first publication of this document.

SmartFusion2 Imaging and Video MIPI CSI-2

The SmartFusion®2 Imaging and Video MIPI CSI-2 demo is based on the SmartFusion2 Advanced Development Kit and SmartFusion2 Imaging and Video MIPI CSI-2 Daughter Card.
Microsemi SmartFusion2 Advanced Development Kit offers a full-featured 150K LE SmartFusion2 system-on-chip (SoC) FPGA. The device integrates reliable flash- based FPGA fabric, a 166 MHz ARM Cortex-M3 processor, advanced data security features, digital signal processing (DSP) blocks, static random-access memory (SRAM), embedded non-volatile memory (envy), and industry-required high- performance communication interfaces–all on a single chip. It also supports all the data security features available in SmartFusion2 devices. For more information, see http://www.microsemi.com/products/fpga-soc/design-resources /dev-kits/smartfusion2/smartfusion2advanced-development-kit.
The video daughter board provides several interfaces for video applications and the circuitry necessary to connect to an FPGA device through an FMC connector, as shown in the following figure.

Figure 1 • MIPI CSI-2 Daughter Card

This demo guide provides the basic information required to set up an environment to demonstrate the video solution, which includes hardware IP blocks and software. It provides details about the hardware setup and the connections required to run the demo design. A fully integrated video solution with an easy-to-use GUI is provided to demonstrate the following functions and to design prototypes quickly:

CFA to RGB conversion
Display timing generator
Alpha blending
Edge detection
Image enhancements (such as sharpening, brightness, contrast, hue, and saturation)

For detailed information about these features, visit: http://www.microsemi.com/products/fpgasoc/imaging#getting-started

Features

HDMI transmitter (ADV7511) chip set and corresponding connector
LVDS 7:1 interface for connecting LCD
Image sensor interface that supports MIPI CSI-2
Low pin count (LPC) FMC connector

Design Requirements

The following table lists the design requirements.

Table 1 • Design Requirements

Design Requirement	Description
Hardware
SmartFusion2 Imaging and Video MIPI-CSI2 Daughter Card	VIDEO-DC-MIPI
SmartFusion2 Advanced Development Kit’	M2S150-ADV-DEV-KIT
Image sensor module	ON Semi AR0330 Image Sensor from Leopard Imaging (LI-

Not shipped with SmartFusion2 Imaging and Video MIPI CSI-2 Daughter Card; must be purchased separately.
Included with SmartFusion2 Advanced Development Kit.
If the display does not support HDMI input, use an adapter that converts the HDMI out from the imaging card to a protocol supported by the display.

The following figure shows the complete setup of the SmartFusion2 Imaging and Video MIPI-CSI2 Daughter Card and the SmartFusion2 Advanced Development Kit.

Figure 2 • Full Setup

Demo Design

The demo programming files are available for download at: http://soc.microsemi.com/download/rsc/?f=m2s_dg0723_pf
The programming files include:

readme.txt file
STAPL programming file The following figure shows the top-level structure of the programming files.

Figure 3 • Demo Programming Files Top-Level Structure

The GUI installers are available for download at: http://soc.microsemi.com/download/rsc/?f=imaging_video_demo_gui

The GUI installer files include:

GUI installer
readme.txt file
The following figure shows the top-level structure of the GUI installer.

Figure 4 • GUI Installer Top-Level Structure

Setting Up the Demo Design

This section describes how to set up the hardware for running the demo design and how to install the demo GUI.

Setting Up the Hardware
The hardware setup for the demo design involves establishing appropriate hardware connections for the SmartFusion2 Imaging and Video MIPI CSI-2 Daughter Card and the SmartFusion2 Advanced Development Kit.
The following figure shows the complete hardware setup for the demo. The following sections show the hardware setup for the Imaging and Video MIPI CSI-2 Daughter Card and the SmartFusion2 Advanced Development Kit separately.

Figure 5 • Hardware Setup

Setting Up the Video Daughter Card

Connect the video daughter board to LPC (J60) FMC connector of SmartFusion2 Advanced Development Kit, as shown in the preceding figure.
Connect one end of the HDMI cable to HDMI Connector (CON2) of video daughter board and the other end to the monitor, as shown in the following figure.
Figure 6 • Video Daughter Card Setup
Connect one end of the image sensor ribbon cable to the image sensor interface (J21) on the video daughter board and the other end to the MIPI sensor (AR0330), as shown in the following figure.
Figure 7 • Camera Ribbon Cable Connection

Setting Up the SmartFusion2 Advance Development Kit

Connect the 12 V power supply brick to J42 to supply power to the board, as shown in Figure 8, page 8.
Close pins 1-2 of J354 to select the core voltage 2.5 V.
Close pins 1-2 of J121 and J124.
Connect a USB cable (mini USB to Type A USB cable) to J33 and the other end of the cable to USB port of the host PC. Connect one end of USB micro connector to P1 and other end of the cable to the host PC.
Make sure the default jumper settings shown in the following table are retained.
Table 2 · Jumper and Resistor Settings for M2S150 ADK Device
** Jumper/Resistor| Setting**
---|---
J116| Short 1-2
J123| Short 2-3
J353| Short 2-3 for 2.5 V
J54| Short 1-2
J32| Short 1-2
J14| Short 1-2
J23| Short 1-2
J11| Short 1-2
J8| Short 1-2
R1217| Mounted
R1216| Unmounted
Switch ON the SW7 power supply switch.
Open the FlashPro software, and program the STAPL file (IDB_AR0330_MIPI_ADK150.stp). For information about how to program using FlashPro, see UG0557: SmartFusion2 SoC FPGA Advanced Development Kit User Guide.

Figure 8 • SmartFusion2 Advanced Development Kit Setup

Installing the Video Demo GUI
The following steps describe how to install the Video Demo GUI:.

Open the folder containing the GUI Installer files, and run setup.exe. Click Yes for any message from User Account Control. The Setup window is displayed with the default locations.
Accept the license agreement, and click Next.
Confirm the installation location in the installation dialog box, and click Next.
A progress bar appears that shows the progress of the installation. Upon successful installation, a confirmation message is displayed.
Click Finish to exit the installation wizard.
Restart the host PC.
After installing the video demo GUI, check the Device Manager to see if the USB drivers are already configured on the host machine. To check if the drivers are configured, after ensuring that the hardware is powered ON and connected to the host PC using a USB cable (P1 on the board), check whether NIVISA USB devices appear in the Device Manager, as shown in Figure 12, page
If they appear, proceed to run the demo design (see Running the Demo Design, page 11).

Configuring the GUI Driver
The following steps describe how to install the GUI driver on a host PC that has Windows 7 or later installed. The downloaded programming file must be programmed on the board before proceeding to driver installation.

Connect the host PC to the P1 connector on the SmartFusion2 Advanced Development Board using a USB A to mini-B USB cable.
Connect the power adapter to the kit, and switch ON the SW7 switch.
Navigate to C:\Windows\inf, and right-click the MSCC UsbHID file, as shown in the following figure.
Figure 9 • MSCC UsbHID File Installation
Click Install, and in the dialog box that asks you to confirm if you want to install the software, click Install again, as shown in the following figure.
Figure 10 • Windows Security Dialog Box for MSCC UsbHID File Installation
The following message appears after the installation is completed.
Figure 11 • Confirmation Message after MSCC_UsbHID File Installation
In the Device Manager, under Network Adapters, check to confirm that N1 Visa USB Devices appears in the list, and that when expanded, it shows the MSCC_UsbHID driver, as shown in the following figure. If the driver does not appear, re-scan the Device Manager for hardware changes or reset the board.
Figure 12 • MSCC_UsbHID File in Device Manager

Running the Demo Design
The following steps describe how to run the demo design using the Video Demo GUI.

Go to Start menu, and select Video_ Demo _GUI to open the GUI, as shown in the following figure.
Figure 13 • SmartFusion2 Video Demo GUI in Windows Start Menu
Click the Connect button on the top right side of the window, as shown in the following figure.
Upon successful connection, the Connect button turns green and the text changes to Connected.
Figure 14 • SmartFusion2 Video Demo GUI Launch Window

The following sections describe the two demos available in the Video Demo GUI:

Camera Sensor Demo
Edge Detection Demo

Camera Sensor Demo
To run the Camera Sensor Demo:

Select the Camera Sensor Demo from the Demo Type Selection drop-down list, as shown in the following figure. The video is displayed on the monitor with the Microsemi logo on it, thus demonstrating the alpha blending feature.

Figure 15 • Camera Sensor Demo Selection
Properties such as brightness, contrast, saturation, hue, and sharpness can be adjusted to enhance the clarity of the video, as shown in the following figure.
Figure 16 • Image Enhancement Features

Edge Detection Demo
To run the Edge Detection Demo:

Select the Edge Detection option from Demo Type Selection drop-down list, as shown in the following figure.

Figure 17 • Edge Detection Demo Selection

****The edges of the image currently appearing on the monitor are highlighted.

The following figures show two regular images and the corresponding edge- detected images.
Figure 18 • Normal Image vs. Edge-Detected Image—Example 1
Figure 19 • Normal Image vs. Edge-Detected Image—Example 2 ****

DG0723 Demo Guide Revision 1.0

Documents / Resources

| Microsemi DG0723 SmartFusion2 Imaging and Video Kit MIPI CSI-2 [pdf] User Guide
DG0723 SmartFusion2 Imaging and Video Kit MIPI CSI-2, DG0723, SmartFusion2 Imaging and Video Kit MIPI CSI-2, Video Kit MIPI CSI-2
---|---