Infineon PSoC 6 AI Evaluation Kit Instructions
- August 18, 2024
- infineon
Table of Contents
Infineon PSoC 6 AI Evaluation Kit
Specifications
- Cost-effective small form-factor development kit
- Onboard programmer/debugger (KitProg3)
- PDM-PCM digital microphone interface
- Full-Speed USB device
- Two user LEDs
- One user button
- Operating voltages: 1.8 V to 3.3 V for the PSoCTM 6 MCU
- Sensors: 6-axis motion sensor (BMI270), magnetometer (BMM350), barometric pressure sensor (DPS368), RADAR sensor (BGT60TR13C)
Product Usage Instructions
Out-of-box (OOB) Application:
The kit comes pre-programmed with mtb-example-imagimob-streaming-protocol
code example for sensor data collection and storage in Imagimob Studio.
Testing OOB Application with Serial Terminal
- Connect the board to the PC via PSoCTM 6 USB connector (J2) using a Type-C USB cable.
- Check that the power LED (D1) turns ON, indicating the board is powered.
- In the terminal application, open the serial connection to the device with the Type-C USB cable.
- Configure the serial port settings as per specifications.
- Type ‘config?’ and press Enter key to verify the device responds with a JSON structure describing the protocol configuration.
- Type ‘subscribe,1,16000’ to stream audio data and ‘subscribe,2,50’ to stream IMU data. Observe sample collection stops after 5 seconds.
FAQ:
Q: What softwares are required for getting started with the CY8CKIT-
062S2-AI?
A: The required softwares are detailed in the user guide accompanying the kit.
`Getting started with CY8CKIT-062S2-AI: PSoC™ 6 AI Evaluation Kit
Introduction
The PSoC™ 6 AI Evaluation Kit is a cost-effective small form-factor
development kit. It provides the best of Infineon’s solutions to drive
adoption of Imagimob Studio for different use cases of machine learning and
Infineon’s software products.
This kit features a PSoC™ 6 MCU, a AIROC™ CYW43439 Wi-Fi/Bluetooth® combo
module, a 512 Mb NOR flash, an onboard programmer/debugger (KitProg3), PDM-PCM
digital microphone interface, Full-Speed USB device, two user LEDs, and one
user button. The board supports operating voltages from 1.8 V to 3.3 V for the
PSoC™ 6 MCU.
The kit provides various sensors such as 6-axis motion sensor (BMI270),
magnetometer (BMM350), barometric pressure sensor (DPS368), and RADAR sensor
(BGT60TR13C) for data collection and creating the machine learning models.
For more information, see CY8CKIT-062S2-AI.
Kit contents
The kit includes the following:
- PSoC™ 6 AI Evaluation Board
- Inlay card (a printed QR code points to a getting started webpage)
Requirements
Following softwares are required for getting started:
- ModusToolbox™ software v3.1 or later (for developing PSoC™ 6 MCU-based applications)
- Imagimob Studio v 4.6 (for developing machine learning models)
- UART terminal software such as Tera Term or Minicom
Out-of-box (OOB) application
The kit is pre-programmed with mtb-example-imagimob-streaming-protocol code
example, that demonstrates sensor data collection from the USB port and store
the data in the Imagimob Studio ready for labelling and machine learning model
creation.
It is designed to collect the data from the motion sensor (BMI270) at 50 Hz
sample rate, and PDM/PCM audio data at 16 kHz. For more details on
implementation, see README.
Testing OOB application with serial terminal
-
Connect the board to the PC through PSoC™ 6 USB connector (J2) using a Type-C USB cable. This enables a serial port for sensor data collection.
-
Ensure that the power LED (D1) turns ON, indicating the board is powered.
-
In the terminal application, open the serial connection to the device. Connect to this port using Type-C USB cable with the following settings:
- Baud rate: 115200
- Data: 8-bit
- Parity: None
- Stop bit: 1-bit
- Flow control: None
Figure 2 Serial port settings
-
Set the terminal settings as follows:
- Newlines should be transmitted as CR+LF
- Enable local echo
Out-of-box (OOB) application
-
Type config?, and press Enter key (to send CR+LF) and verify that the device responds with a JSON structure describing the protocol configuration.
-
Type subscribe,1,16000 and verify that the device streams audio data. Observe that the sample collection stops after 5 seconds. The garbled text on the terminal is the audio data.
-
Type subscribe,2,50 and verify that the device streams IMU data. Observe that the sample collection stops after 5 seconds. The garbled text on the terminal is the IMU data.
Out-of-box (OOB) application
Note: Currently backspace is not supported in terminal commands. If you
encounter issues such as unable to see commands on the terminal or receiving
unknown command errors, follow the steps below:
- Reset the terminal and clear the buffer
- Reset board to ensure a fresh execution
Testing OOB application with Imagimob Studio
Creating project in Imagimob Studio
-
Open Imagimob Studio and select File> New Project. The New Project window appears.
-
Under Graph UX > Generic, select Empty Project.
-
In New Project Name, enter the name of the project.
-
in Location, specify the location where you want to create the workspace and the project directory.
-
click OK to create the project. The project directory is downloaded to the workspace in IMAGIMOB Studio.
Connecting and setting up Serial Capture and Predefined Labels units
Imagimob Studio provides the functionality to collect and label the real-time
data simultaneously. Set the Serial Capture unit for collecting data and
Predefined unit for labelling data on the canvas.
Setting up the Serial Capture
- Connect the board to the laptop or PC through PSoC™ 6 USB connector (J2) using a Type-C USB cable.
- Expand EmptyProject directory and double-click the Main.imunit to open the canvas.
- Expand Library > Devices and drag and drop the Serial Capture unit onto the canvas.
- Expand Visualization and drag and drop the Data Track unit onto the canvas.
- Goto Serial Capture > Properties and select “USB Serial Device” port. To check the COM port at which the board is connected, open Device Manager > Ports and look for USB Serial Device.
- Click on the red icon in the Serial Capture node and drag over to the gray icon in the Data Track node. This creates a connection between the two nodes.
Out-of-box (OOB) application
- Note: The microphone collects data at a sampling rate of 16000 and an accelerometer collects data at a sampling rate of 50.
- Note: The connection might not establish if the COM port is already in use in Imagimob Studio or another tool.
- After setting up the Serial Capture, you can utilize the same graph to label the real-time data, by adding a Predefined
- Labels unit onto the canvas. Define the classes in the Predefined Labels node for one time and utilize the defined classes to label the data on a click of button.
Setting up the Predefined Labels
- Expand Project and drag and drop the Predefined Labels unit onto the canvas. The Predefined Labels unit displays the default classes.
- Define the classes in Predefined Labels node by entering every class in a new line.
After defining the classes, start collecting and labelling data simultaneously.
Real-time data collection and data labelling
-
Navigate to the toolbar and click the Start button to open the session file (main.imsession). An empty session file opens displaying the pre-defined classes in the Labels bar.
-
Click the Record button to start capturing the real-time data.
-
In the Labels bar, select a class to start adding labels to the streaming data.
-
Deselect the same class to stop adding the labels. Similarly, you can enable or disable the other classes and label the data.
-
Click the Record button to stop collecting the data.
-
Select File > Save to save the session file, data track and label track. The Save New Session window appears.
-
In Location, click the three dot and select the desired location to save the files.
-
In Session Name, enter the name of the session file.
-
Under Track Options, set the following:
- In Wave Format Encoding, select the encoding format for the audio tracks
- In Track Name, double-click the column to edit the track name, if required
- In File Name, double-click the columns to edit the track name, if required
-
Select the save checkbox corresponding to the tracks you want to save.
-
Click OK to save the files.
-
Repeat the instructions from step 2 to collect and save data in multiple session files.
After the required data is collected and labelled, add data to the project in Imagimob Studio and start with the machine learning workflow. To know how to add data, Create Classification project and Add data to project.
Revision history
Document revision | Date | Description of changes |
---|---|---|
** | 2024-05-27 | Initial release |
Trademarks
All referenced product or service names and trademarks are the property of
their respective owners.
The Bluetooth® word mark and logos are registered trademarks owned by
Bluetooth SIG, Inc., and any use of such marks by Infineon is under license.
Edition 2024-05-27 Published by
Infineon Technologies AG
81726 Munich, Germany
© 2024 Infineon Technologies AG. All Rights Reserved.
Do you have a question about this document?
Email: erratum@infineon.com Document reference
002-40023 Rev. **
Important notice
The information given in this document shall in no event be regarded as a
guarantee of conditions or characteristics (“Beschaffenheitsgarantie”).
With respect to any examples, hints or any typical values stated herein and/or
any information regarding the application of the product, Infineon
Technologies hereby disclaims any and all warranties and liabilities of any
kind, including without limitation warranties of non-infringement of
intellectual property rights of any third party.
In addition, any information given in this document is subject to customer’s
compliance with its obligations stated in this document and any applicable
legal requirements, norms and standards concerning customer’s products and any
use of the product of Infineon Technologies in customer’s applications.
The data contained in this document is exclusively intended for technically
trained staff. It is the responsibility of customer’s technical departments to
evaluate the suitability of the product for the intended application and the
completeness of the product information given in this document with respect to
such application.
Warnings
Due to technical requirements products may contain dangerous substances. For
information on the types in question please contact your nearest Infineon
Technologies office.
Except as otherwise explicitly approved by Infineon Technologies in a written
document signed by authorized representatives of Infineon Technologies,
Infineon Technologies’ products may not be used in any applications where a
failure of the product or any consequences of the use thereof can reasonably
be expected to result in personal injury.
References
- Semiconductor & System Solutions - Infineon Technologies
- Semiconductor & System Solutions - Infineon Technologies
- Imagimob Studio documentation
- Imagimob Studio documentation
- mtb-example-imagimob-streaming-protocol/README.md at master · Infineon/mtb-example-imagimob-streaming-protocol · GitHub
- Development Platform for Machine Learning - Edge devices - Imagimob Studio
Read User Manual Online (PDF format)
Read User Manual Online (PDF format) >>