Raspberry Pi launches camera module with Sony image sensor for AI applications



On September 30, 2024, Raspberry Pi released the ' Raspberry Pi AI Camera ', which is equipped with Sony's image sensor with AI processing function.

Buy a Raspberry Pi AI Camera – Raspberry Pi

https://www.raspberrypi.com/products/ai-camera/

Sony Semiconductor Solutions and Raspberry Pi Launch Raspberry Pi AI Camera - Accelerating edge AI solution development - | Press Release | Sony Semiconductor Solutions Group
https://www.sony-semicon.com/ja/news/2024/2024093001.html

Raspberry Pi AI Camera on sale now at $70 - Raspberry Pi
https://www.raspberrypi.com/news/raspberry-pi-ai-camera-on-sale-now/

Raspberry Pi launches camera module for vision-based AI applications | TechCrunch
https://techcrunch.com/2024/09/30/raspberry-pi-launches-camera-module-for-vision-based-ai-applications/

Raspberry Pi AI Camera Review: AI for the masses | Tom's Hardware
https://www.tomshardware.com/raspberry-pi/raspberry-pi-ai-camera-review-ai-for-the-masses

The Raspberry Pi AI Camera is equipped with the Sony Semiconductor Solutions intelligent vision sensor ' IMX500 ', which can perform AI processing on the chip, making it possible to efficiently develop edge AI solutions that utilize vision data on the Raspberry Pi. It also combines the Raspberry Pi's own microcontroller chip ' RP2040 ' with built-in SRAM.

Sony Semiconductor Solutions announced its investment in Raspberry Pi in April 2023, and since then has been working to provide the Raspberry Pi development community with an edge AI solution development platform based on Sony Semiconductor Solutions' technology.

Until now, developing AI solutions that utilize huge amounts of image data required various components other than the camera, such as GPUs and AI accelerators, but with the Raspberry Pi AI Camera, the IMX500 in the camera is responsible for AI processing, making it easy to develop AI solutions. In addition, the Raspberry Pi AI Camera is compatible with all Raspberry Pi models, including the Raspberry Pi Zero, as well as the Raspberry Pi 5 , which was released in 2023.



As for specific use cases for the Raspberry Pi AI Camera, TechCrunch, an overseas media outlet, states, 'The Raspberry Pi AI Camera can be used as a smart city sensor to detect vacant parking spaces or track traffic flow, and in industrial environments, it can perform basic automated quality checks on products that pass under it.'

The maximum resolution of the Raspberry Pi AI Camera is 4056 x 3040 at 10 fps and 2028 x 1520 at 30 fps. The field of view is 78 degrees, and the focus can be adjusted manually. Below is an example of running the object detection neural network model 'MobileNet SSD' at 30 fps and 1080p. It is able to correctly distinguish between people and houseplants.

Raspberry Pi AI Camera - Object detection demo - YouTube


Similarly, when running the pose estimation neural network model 'PoseNet' at 30 fps and 1080p, it looks like this.

Raspberry Pi AI Camera - Pose estimation demo - YouTube


Tom's Hardware, an overseas media outlet that actually used the Raspberry Pi AI Camera, reported that it was able to maintain a stable 30 fps for object detection models, etc. However, there was also a problem that 'since the focus range is from 20 cm to infinity, if you get too close to the camera, the image becomes blurry and the AI model cannot detect the object.'

'We aim to provide a unique development experience to the Raspberry Pi user and developer community,' said Eita Yanagisawa, General Manager of the System Solutions Division at Sony Semiconductor Solutions. 'We are very pleased to be able to provide Sony Semiconductor Solutions' edge AI sensing technology to the world's largest developer community as the first result of our strategic partnership.'

Eben Upton, CEO of Raspberry Pi, also said, 'AI-based image processing is an extremely attractive tool for developers around the world. We have developed the Raspberry Pi AI Camera by combining the technology and expertise of Sony Semiconductor Solutions, a leading image sensor company and long-time partner of ours. We are excited to see what applications the community will create using this AI camera.'



The price of the Raspberry Pi AI Camera is said to be $70 (about 10,000 yen), but at the time of writing, the Japanese distributor is preparing it. In addition, production of the Raspberry Pi AI Camera will continue until 'at least January 2028.'

in Software,   Hardware,   Video, Posted by log1r_ut