Arduino ASX00026 Portenta Vision Shield User Manual

June 10, 2024
ARDUINO

Arduino ASX00026 Portenta Vision Shield

Description

The Arduino Portenta Vision Shield is an addon board providing machine vision capabilities and additional connectivity to the Portenta family of Arduino boards, designed to meet the needs of industrial automation. The Portenta Vision Shield connects via a high density connector to the Portenta H7 with minimal hardware and software setup.

Target Areas

Industry, surveillance

Features

Note: This board needs the Arduino Portenta H7 to function.

  • Himax HM-01B0 camera module
    • Ultra Low Power Image Sensor designed for Always-on vision devices and applications
    • High sensitivity 3.6μ BrightSenseTM pixel technology
    • window, vertical flip and horizontal mirror readout
    • Programmable black level calibration target, frame size, frame rate, exposure, analog gain (up to 8x) and digital gain (up to 4x)
    • Automatic exposure and gain control loop with support for 50Hz / 60Hz flicker avoidance
    • Motion Detection circuit with programmable ROI and detection threshold with digital output to serve as an interrupt
    • Supported resolutions
    • QQVGA (160×120) at 15, 30, 60 and 120 FPS
    • QVGA (320×240) at 15, 30 and 60 FPS
    • Power
    • <1.1mW QQVGA resolution at 30FPS,
    • < 2mW QVGA resolution at 30FPS
  • 2x MP34DT06JTR MEMS PDM Digital Microphone
    • AOP = 122.5 dBSPL
    • 64 dB signal-to-noise ratio
    • Omnidirectional sensitivity
    • –26 dBFS ± 1 dB sensitivity
  • MIPI 20 pin compatible JTAG Connector
  • Memory
    • Micro SD Card Slot

The Board

The included HM-01B0 camera module has been pre-configured to work with the OpenMV libraries provided by Arduino. Based on the specific application requirements, the Portenta Vision Shield is available in two configurations with either Ethernet or LoRa® connectivity. Ethernet is designed for integration of the Portenta into wired networks and providing high bandwidth. In situations requiring long range operation at low bandwidth, LoRa® connectivity is the way to go. The multi-core processor of the Portenta H7 makes embedded vision possible by minimizing the data bandwidth required.

Note: The Portenta Vision Shield is available in two SKU, Ethernet (ASX00021) and LoRa® (ASX00026)

Application Examples

Thanks to the low power consumption of the Vision Shield, it is well suited for bringing machine learning to a wide range of Industry 4.0 and IoT applications.

  • Industrial production: The included HM-01B0 camera along with the OpenMV libraries allows for quality control of items within a manufacturing or packaging plant. The small footprint, low power consumption and LoRa®/Ethernet connectivity allows for the module to be deployed essentially anywhere so that defects are identified quickly and removed from the production environment.
  • Predictive maintenance: The combination of machine vision and machine learning capabilities of the Vision Shield and the Portenta H7 opens up possibilities for predictive maintenance based on subtle differences in the visual representation of machinery. These capabilities are further enhanced with the two MP34DT05 MEMS microphones included in the Vision Shield.
  • Surveillance: The Vision Shield is able to provide surveillance capabilities in areas with low Wi-Fi penetration (e.g. warehouse) and large areas (e.g. shopping centres). The OpenMV libraries enable the Vision Shield to identify objects and alert the operator via LoRa® while saving a snapshot on the microSD storage slot.
Related Products

The Vision Shield is developed as an add-on shield that requires the Portenta H7.

Ratings

Absolute Maximum
Symbol Description Min Typ Max Unit
VINMax Input voltage from HD Connectors -0.3 3.3 V
PMax Maximum Power Consumption TBC mW
Thermal
Symbol Description Min Typ Max Unit
TST Storage Temperature -30 85 °C
TOP Operating Temperature -40 85 °C

Functional Overview

Board Topology
Ref. Description Ref. Description
U1 Voltage Regulator J3 LoRa® Radio Antenna U.FL Connector (ASX00026 Only)
U2,U3 ST MP34DT06JTR Digital Microphone J7 Ethernet Connector (ASX00021

Only)
M1| Murata CMWX1ZZABZ LoRa® Module (ASX00026 Only)| J9| Micro SD Card Connector
J1, J2| High Density Connectors| CN1| JTAG Connector

Camera Module

The Himax HM-01B0 Module is a very low power camera with 324×324 resolution and a maximum of 60FPS depending on the operating mode. Video data is transferred over a configurable 8-bit interconnect with support for frame and line synchronization. The module delivered with the Vision Shield is the monochrome version. Configuration is achieved via a I2C connection with the Portenta H7.

HM-01B0 offers very low power image acquisition and provides the possibility to perform motion detection without main processor interaction. “Always-on” operation provides the ability to turn on the main processor when movement is detected with minimal power consumption.

Digital Microphones

The dual MP34DT05 digital MEMS microphones are omnidirectional and operate via a capacitive sensing element with a high (64 dB) signal to noise ratio. The microphones have been configured to provide separate left and right audio over a single PDM stream.

The sensing element, capable of detecting acoustic waves, is manufactured using a specialized silicon micromachining process dedicated to produce audio sensors.

Micro SD Card Slot

A micro SD card slot is available under the Vision Shield board. Available libraries allow reading and writing to FAT16/32 formatted cards.

Ethernet (ASX00021 Only)

Ethernet connector allows connecting to 10/100 Base TX networks using the Ethernet PHY available on the Portenta board.

LoRa® Module (ASX00026 Only)

LoRa® connectivity is provided by the Murata CMWX1ZZABZ module. This module contains a STM32L0 processor along with a Semtech SX1276 Radio. The processor is running on Arduino open source firmware based on Semtech code.

Power

The Portenta H7 supplies 3.3V power to the LoRa® module (ASX00026 only), microSD slot and dual microphones via the 3.3V output via the high density connector. An onboard LDO regulator supplies a 2.8V output (300mA) for the camera module.

Board Operation

Getting Started – IDE

If you want to program your Arduino board while offline you need to install the Arduino Desktop IDE [1] To connect the board to your computer, you’ll need a USB cable. This also provides power to the board, as indicated by the LED

Getting Started – Arduino Web Editor (Create)

All Arduino and Genuino boards, including this one, work out-of-the-box on the Arduino Web Editor [2], by just installing a simple plugin.

The Arduino Web Editor is hosted online, therefore it will always be up-to- date with the latest features and support for all boards. Follow [3] to start coding on the browser and upload your sketches onto your board.

Getting Started – Arduino IoT Cloud

All Arduino IoT enabled products are supported on Arduino IoT Cloud which allows you to Log, graph and analyze sensor data, trigger events, and automate your home or business.

Getting Started – OpenMV

**NOTE!
** It is highly recommended that you ensure you have the latest bootloader on your Portenta H7 before loading OpenMV firmware.

Arduino Vision Shield and Portenta H7 are supported under OpenMV. In order to easily use OpenMV download the latest OpenMV IDE [5] set up Portenta H7 in boot mode by double tapping reset and connect via the connection button.

OpenMV connection status

Once connected you will receive a message like the following:

OpenMV connect window

Click on “OK” and the latest OpenMV firmware will be automatically loaded. To open the “Hello World” example, under the File menu select Examples -> Arduino ->_ Basics _and click on helloworld.py.

OpenMV IDE loading “hello world!” example

Click on the green square underneath the connection button to run.

OpenMV Run button

Online Resources

Now that you have gone through the basics of what you can do with the board you can explore the endless possibilities it provides by checking exciting projects on ProjectHub [6], the Arduino Library Reference [7] and the online store [8] where you will be able to complement your board with sensors, actuators and more.

Board Recovery

All Arduino boards have a built-in bootloader which allows flashing the board via USB. In case a sketch locks up the processor and the board is not reachable anymore via USB it is possible to enter bootloader mode by doubletapping the reset button right after power up.

Connector Pinouts

JTAG
Pin Function Type Description
1 VDDIO Power Positive Reference voltage for debug interface
2 SWD I/O Single Wire Debug Data
3,5,9 GND Power Negative reference voltage for debug interface
4 SCK Output Single Wire Debug Clock
6 SWO I/O Single Wire Debug Trace
10 RESET Input CPU Reset
7,11,12,13,14,15,17,18,19,20 NC Not Connected
High Density Connector

High density connector pinout

Mechanical Information

Board Outline

Board dimensions

Mounting Holes

Mounting holes overview
Mounting holes overview

Connector and Component Positions

Connectors positions TOP

Connectors positions BOTTOM

Mounting Instructions

Mounting details

Certifications

Declaration of Conformity CE/RED DoC (EU)

We declare under our sole responsibility that the products above are in conformity with the essential requirements of the following EU Directives and therefore qualify for free movement within markets comprising the European Union (EU) and European Economic Area (EEA).

Declaration of Conformity to EU RoHS & REACH 191 11/26/2018

Arduino boards are in compliance with Directive 2011/65/EU of the European Parliament and Directive 2015/863/EU of the Council of 4 June 2015 on the restriction of the use of certain hazardous substances in electrical and electronic equipment.

Substance Maximum Limit (ppm)
Lead (Pb) 1000
Cadmium (Cd) 100
Mercury (Hg) 1000
Hexavalent Chromium (Cr6+) 1000
Poly Brominated Biphenyls (PBB) 1000
Poly Brominated Diphenyl ethers (PBDE) 1000
Bis(2-Ethylhexyl} phthalate (DEHP) 1000
Benzyl butyl phthalate (BBP) 1000
Dibutyl phthalate (DBP) 1000
Diisobutyl phthalate (DIBP) 1000

Exemptions : No exemptions are claimed.

Arduino Boards are fully compliant with the related requirements of European Union Regulation (EC) 1907 /2006 concerning the Registration, Evaluation, Authorization and Restriction of Chemicals (REACH). We declare none of the SVHCs (https://echa.europa.eu/web/guest/candidate-list-table), the Candidate List of Substances of Very High Concern for authorization currently released by ECHA, is present in all products (and also package) in quantities totaling in a concentration equal or above 0.1%. To the best of our knowledge, we also declare that our products do not contain any of the substances listed on the “Authorization List” (Annex XIV of the REACH regulations) and Substances of Very High Concern (SVHC) in any significant amounts as specified by the Annex XVII of Candidate list published by ECHA (European Chemical Agency) 1907 /2006/EC.

Conflict Minerals Declaration

As a global supplier of electronic and electrical components, Arduino is aware of our obligations with regards to laws and regulations regarding Conflict Minerals, specifically the Dodd-Frank Wall Street Reform and Consumer Protection Act, Section 1502. Arduino does not directly source or process conflict minerals such as Tin, Tantalum, Tungsten, or Gold. Conflict minerals are contained in our products in the form of solder, or as a component in metal alloys. As part of our reasonable due diligence Arduino has contacted component suppliers within our supply chain to verify their continued compliance with the regulations. Based on the information received thus far we declare that our products contain Conflict Minerals sourced from conflict-free areas.

FCC Caution

Any Changes or modifications not expressly approved by the party responsible for compliance could void the user’s authority to operate the equipment. This device complies with part 15 of the FCC Rules. Operation is subject to the following two conditions: (1) This device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation. FCC RF Radiation Exposure Statement:

  1. This Transmitter must not be co-located or operating in conjunction with any other antenna or transmitter.
  2. This equipment complies with RF radiation exposure limits set forth for an uncontrolled environment.
  3. This equipment should be installed and operated with minimum distance 20cm between the radiator& your body.
Antenna manufacturer: Dynaflex
Antenna Model: 2G-3G-4G ADHESIVE MOUNT ANTENNA DIPOLE
Antenna type: External omnidirectional dipole antenna
Antenna gain: -1 dBi

Important: The operating temperature of the EUT can’t exceed 85℃ and shouldn’t be lower than -40℃.

Hereby, Arduino S.r.l. declares that this product is in compliance with essential requirements and other relevant provisions of Directive 201453/EU. This product is allowed to be used in all EU member states.

Frequency bands Maximum Output Power (ERP)
863-870MHz 0.73dBm

Company Information

Company name Arduino S.r.l
Company Address Via Andrea Appiani, 25 20900 MONZA (Italy)

Reference Documentation

Ref Link
Arduino IDE (Desktop) https://www.arduino.cc/en/Main/Software
Arduino IDE (Cloud) https://create.arduino.cc/editor
Cloud IDE Getting Started

https://create.arduino.cc/projecthub/Arduino_Genuino/getting-started-with- arduino- web-editor- 4b3e4a
Forum| http://forum.arduino.cc/
OpenMV IDE| https://openmv.io/pages/download
ProjectHub| https://create.arduino.cc/projecthub?by=part&part_id=11332&sort=trending
Library Reference| https://www.arduino.cc/reference/en/
Arduino Store| https://store.arduino.cc/

Change Log

Date Revision Changes
03/03/2021 1 First Release
13/01/2022 1 Information update

References

Read User Manual Online (PDF format)

Read User Manual Online (PDF format)  >>

Download This Manual (PDF format)

Download this manual  >>

Related Manuals