Summary of REALITY AI’S AUTOMOTIVE SWS FEATURES SOUND-BASED DETECTION
Reality AI’s Automotive Sound Warning System (SWS) uses microphone arrays and AI to detect and localize emergency vehicles and nearby road users by analyzing sound waves, addressing visibility limitations of cameras, lidar, and radar. The platform includes sample hardware, firmware, and development software for automotive Tier 1/2 suppliers. Reality AI collaborated with Hagiwara and DENSO and now partners with Infineon, using Infineon AEC-Q103 XENSIV MEMS microphones (IM67D130A) interfaced to an Infineon AURIX MCU to enable ASIL D-capable safety performance; microphone placement is flexible, including roof-mounted components.
Parts used in the Automotive SWS:
- Array of microphones
- Infineon AEC-Q103 XENSIV MEMS microphones (IM67D130A)
- Infineon AURIX microcontroller (MCU)
- Sample hardware (development kit components)
- Firmware for the SWS
- Customized development software for Tier 1 and Tier 2 providers
- External microphone arrays mounted on automotive roof/roof supports
Detection through cameras and lidar could be efficient but it has some drawbacks. As it requires visibility of the object within its range, thus detection is difficult for invisible and hidden objects. Radar could be an ideal choice for overcoming these drawbacks but it struggles with distant objects as it is incapable of the corners and long-range detection. Hence Reality AI’s Automotive SWS comes with sound-based detection for addressing these issues.
Automotive SWS focuses on passenger protection in detecting all threats by monitoring sound waves. The sound waves detection occurs through an array of microphones that acts as peripheral for the processor. This enables the system to discover emergency vehicles, cars, motorbikes, bicycles, and other objects. The system alerts the driver and identifies the direction from where the target is approaching.
Reality AI’s system architecture, sample hardware, and firmware for the Automotive SWS come with a customized development software for Automotive Tier 1 and Tier 2 providers for creating their own versions of the system. It uses machine learning and AI algorithms on the data points collected by the external microphone arrays on the automotive.
Infineon Technologies MCU And Microphone In Automotive SWS
Although, the company has worked with Hagiwara Electronics Co Ltd. and DENSO Corporation to build functionalities and features for the system specifically for the automotive market. Now, it is partnering with Infineon Technologies to build a more efficient system. The system features Infineon AEC-Q103 XENSIV™ MEMS microphones (IM67D130A) for enhancing the signal quality for computations and processing in further steps. These microphones work as an interface to the Infineon AURIX™ microcontroller (MCU) to provide efficient safety ASIL D performance.
Discussing further, the MEMS Mic Array is integrated into components or placed on the roof supports flexible geometry and placement to detect sound waves. The earlier version of the system had 4 components placed on the top of the roof. Infineon AURIX™ MCU operates on inexpensive hardware for allowing AI detection and localization.
Read more: REALITY AI’S AUTOMOTIVE SWS FEATURES SOUND-BASED DETECTION
- What problem does Automotive SWS aim to solve?
It addresses detection limitations of cameras, lidar, and radar by using sound-based detection to find invisible or hidden and distant objects. - How does Automotive SWS detect threats?
It monitors sound waves using an array of microphones and applies machine learning and AI algorithms to identify and localize threats. - Which microphones are used in the system?
The system features Infineon AEC-Q103 XENSIV MEMS microphones (IM67D130A). - Which microcontroller interfaces with the microphones?
The Infineon AURIX microcontroller (MCU) interfaces with the MEMS microphones. - Can the microphone placement be changed?
Yes, the MEMS mic array supports flexible geometry and placement, including components placed on roof supports. - Who has Reality AI partnered with for the Automotive SWS?
Reality AI has worked with Hagiwara Electronics and DENSO, and is partnering with Infineon Technologies. - What does the system provide to Tier 1 and Tier 2 suppliers?
It provides system architecture, sample hardware and firmware, and customized development software for creating their own versions. - What types of objects can the system discover?
The system can discover emergency vehicles, cars, motorbikes, bicycles, and other objects by sound.
