X-LINUX-AI version: v6.1.1

X-LINUX-AI is a free of charge open-source software package dedicated to AI. It is a complete ecosystem that allow developers working with OpenSTLinux to create AI-based application very easily.

• All-in-one AI solutions for the entire STM32MPU series
• Pre-integrated into Linux distribution based on ST environment
• Include AI frameworks to execute Neural Network models
• Include AI model benchmark application tools for MPU
• Easy application prototyping using Python language and AI frameworks Python API
• C++ API for embedded high-performance applications
• Optimized open-source solutions provided with source codes that allow extensive code reuse and time savings

X-LINUX-AI OpenEmbedded meta layer to be integrated into OpenSTLinux distribution. It contains recipes for AI frameworks, tools and application examples for STM32MPx series

The X-LINUX-AI OpenSTLinux Expansion Package v6.1.1 is compatible with the Yocto ProjectTM build system Scarthgap. It is validated over the OpenSTLinux Distribution v6.1.1 https://wiki.st.com/stm32mpu on STM32MP2x and STM32MP1x series.

Since its release v5.0.0, the major versioning of the X-LINUX-AI OpenSTLinux Expansion Package is aligned on the major versioning of the OpenSTLinux Distribution. This prevents painful backward compatibility attempts and makes dependencies straightforward. The X-LINUX-AI generic versioning vx.y.z is built as follows:

• x: major version matching the OpenSTLinux Distribution major version. Each new major version is incompatible with previous OpenSTLinux Distribution versions.
• y: minor version, which is changed when new functionalities are added to the X-LINUX-AI OpenSTLinux Expansion Package in a backward compatible manner.
• z: patch version to introduce bug fixes. A patch version is implemented in a backward compatible manner.

X-LINUX-AI v6.1.1 expansion package:

• AI Frameworks:

  • STAI_MPU Unified API based on OpenVXTM(STM32MP25x and STM32MP23x only), TensorFlowTM Lite, and ONNX RuntimeTM compatible with all STM32MPU series
  • TIM-VXTM 1.22.6 (STM32MP25x and STM32MP23x only)
  • TensorFlowTM Lite 2.18.0 with default delegate activated for CPU execution and VX-delegate External delegate to address STM32MP2 NPU
  • ONNX Runtime 1.19.2 with default execution engine activated for CPU execution and VSINPU Execution provider to address STM32MP2 NPU
  • ONNX 1.16.2 python version for On Device Learning
  • Pytorch 2.3.1 python version for On Device Learning

• Out of the box applications:

  • Image classification :
    • C++ / PythonTM example using STAI_MPU Unified API based on the MobileNet v1 and v2 quantized models
  • Object detection :
    • C++ / PythonTM example using STAI_MPU Unified API based on the SSD MobileNet v1 and v2 quantized models
  • Human pose estimation :
    • PythonTM example using STAI_MPU Unified API based on YoloV8n pose quantized model
  • Semantic segmentation :
    • PythonTM example using STAI_MPU Unified API based on DeepLabV3 quantized model
  • Face recognition:
    • C++ example using STAI_MPU unified API based on the BlazeFace and FaceNet quantized models
  • People Tracking and Heatmap
    • PythonTM example using STAI_MPU Unified API based on the yolov8n quantized model.
  • On Device Learning for Object detection
    • PythonTM example using STAI_MPU Unified API based on SSD MobileNet v2 as student and RT-DETR transformer model as teacher.
    • Step by step JupyterlabTM notebook available for this application.
  • Note: applications are based on Gstreamer 1.22.x, GTK 3.x, OpenCV 4.9.x, Pillow, Python 3

• Utilities:

  • X-LINUX-AI tool suite provides tools for software information, AI packages management and Neural Network models benchmarking.
  • Support wide range of image sensors for ST MPU including IMX335 (5MP) for MP2 with use of internal ISP, GC2145 and OV5640 for STM32MP13x
  • Support for the OpenSTLinux AI package repository allowing the installation of a prebuilt package using apt-*

• Host tools:

  • ST Edge AI tool for NBG generation
  • X-LINUX-AI SDK add-on extending the OpenSTLinux SDK with AI functionality to develop and build an AI application easily. The X-LINUX-AI SDK add-on supports all the above frameworks. It is available from the X-LINUX-AI product page

https://wiki.st.com/stm32mpu/wiki/X-LINUX-AI_Starter_package

https://wiki.st.com/stm32mpu/wiki/X-LINUX-AI_Developer_package

https://wiki.st.com/stm32mpu/wiki/X-LINUX-AI_Distribution_package

https://wiki.st.com/stm32mpu/wiki/Category:AI_-_On_Device_Learning

https://wiki.st.com/stm32mpu/wiki/Category:AI_-_Application_examples