PROPHESEE releases a new event vision sensor with ultra-low power consumption and extremely small size to make consumer smart devices more autonomous and safer

PROPHESEE releases a new event vision sensor with ultra-low power consumption and extremely small size to make consumer smart devices more autonomous and safer

Keywords: Prophesee vision sensor GenX320   Source: PROPHESEE

"Prophesee, a leading neuromorphic vision sensing company, today announced the launch of the industry's first Metavision® event vision sensor GenX320, designed specifically for ultra-low power edge vision device integration. This new product is Prophesee's fifth generation Metavision Sensor products, using die sizes of 3x4mm. The launch of GenX320 will broaden the application scope of Prophesee's groundbreaking event vision technology platform to the rapidly growing edge market areas, covering AR/VR devices, wearable devices, games, and robots , laptops and tablets, IoT devices, etc."

Prophesee's new Metavision® event vision sensor GenX320 reaches a new level of performance, providing ultra-low power consumption, low latency, and high flexibility, and is suitable for efficient integration in AR/VR, robots, laptops, IoT, and other fields.

Prophesee Metavision® Event Vision Sensor GenX320

Prophesee, a leading neuromorphic vision sensing company, today announced the launch of the industry’s first Metavision® event vision sensor GenX320, designed specifically for integration in ultra-low-power edge vision devices. This new product is Prophesee's fifth-generation Metavision sensor product, which uses a die with a size of 3x4mm. The launch of GenX320 expands the application scope of Prophesee's groundbreaking event vision technology platform to rapidly growing edge market areas, covering AR/VR devices, wearable devices, games, robots, laptops and tablets, IoT devices, etc.

Prophesee Metavision® Event Vision Sensor GenX320 Die Size

Luca Verre, co-founder and CEO of Prophesee, said: "Event vision sensors have excellent performance and energy efficiency, making them ideal for a wide range of applications in the low-power edge artificial intelligence market. Based on commercial success in other application areas, we have developed This new Metavision event vision sensor is specifically designed to meet the needs of edge system developers. The sensor is easy to integrate, configure and optimize for motion and object detection, presence awareness, gesture recognition, eye tracking, and other high-growth applications. Multiple use cases for the market.”

Building on Prophesee's extensive experience and years of technology accumulation, the GenX320 event vision sensor brings speed, low latency, dynamic range and energy efficiency to a variety of applications. The GenX320 event vision sensor uses BSI stacked technology with a pixel size of 320x320 6.3μm and a miniature 1/5” optical format. Therefore, the GenX320 event vision sensor can be used in embedded edge vision systems where energy, computing and size are constrained. Just in line with its technical requirements for efficient integrated event vision sensing. Even under extremely challenging operating and lighting conditions, GenX320 can still provide stable, high-speed visual perception with ultra-low power consumption.

Benefits of GenX320 include:

• Low-latency event timestamps with microsecond resolution and flexible data formats.

• On-chip intelligent power management mode reduces power consumption to 36uW and supports intelligent wake-up events, while supporting deep sleep and standby modes.

• Easily integrates/connects with standard SoCs with multiple integrated event data pre-processing, filtering and formatting capabilities to minimize external processing overhead.

• MIPI or CPI data output interface provides low-latency connectivity to embedded processing platforms, including low-power microcontrollers and modern neuromorphic processor architectures.

• AI-ready: On-chip histogram output is compatible with multiple AI accelerators.

• Sensor-level privacy protection: Thanks to the inherently sparse frameless event data of event sensors and the static scene removal function, privacy can be protected from the sensor level.

• Natively compatible with Prophesee Metavision Intelligence, the industry’s most comprehensive free event vision software suite with over 10,000 users worldwide.

Potential application scenarios

• High-speed eye tracking for foveated rendering or seamless interaction in AR/VR/XR headsets

• Low-latency, contactless human-computer interaction interface in consumer electronic devices (TVs, PCs, game consoles, smart homes, etc.)

• Intelligent presence detection and people counting in IoT cameras

• Ultra-low power always-on area monitoring system

• Cameras for detecting falls in homes and medical devices

3.png

Prophesee Metavision event vision sensor GenX320, specially developed and designed for ultra-low power edge vision devices

commercially available

GenX320 is available now from Prophesee and its sales partners. GenX320 comes with a comprehensive set of development tools, including a comprehensive evaluation kit equipped with a chip-on-board (COB) GenX320 module or a compact optical flex module, to help developers easily explore and optimize. In addition, Prophesee offers a range of adapter kits that can seamlessly connect to various embedded platforms (such as STM32 MCUs), thereby reducing time-to-market.

Partner

Zinn Labs

"Based on the unique capabilities of Prophesee's Metavision event sensor, Zinn Labs is developing a new generation of gaze tracking systems. Prophesee's new GenX320 sensor can capture changes in eye and gaze movements in milliseconds. Compared to traditional video-based gaze tracking modes, Using the GenX320 sensor, Zinn Labs can track changes in eye characteristics with less power and calculations (the power of the gaze tracking system is less than 20 mW). In addition, due to the smaller package size of the new sensor, event vision sensors can be used for the first time for space-constrained AR/VR headsets. Zinn Labs is excited to partner with Prophesee as we integrate the GenX320 sensor into upcoming customer projects."

Kevin Boyle

Founder and CEO of Zinn Labs

Y

"YunX is a company dedicated to Internet of Things technology and medical applications. With the increasing aging of the global population and the rapid development of medical technology, the care market is facing unprecedented opportunities. How to provide real-time monitoring of the human body while focusing on privacy protection More accurate and reliable AI monitoring analysis has become the most important challenge at present. Based on the Metavision imaging technology of event sensing EVS developed by Prophesee, YunX provides this market with an ideal solution that balances the two needs, and in its Functional verification has been achieved in high-end products. The newly launched fifth-generation GenX320 sensor has achieved major breakthroughs in compactness, low power consumption, edge AI capabilities and cost reduction, while also maintaining a huge advantage in performance through algorithm innovation. .”

Bobo Jun

CEO of YunX

XPERI

“Privacy is always one of the top concerns for consumers whenever vision technology is used in products such as driver monitoring solutions (DMS) and TV services. With Prophesee Metavision event vision technology, we eliminate the need for explicit definition of the scene. Visual representations enable understanding of scenes, taking our Privacy by Design (PbD) principles to a more secure level. By capturing only the changes in each pixel, rather than the entire scene like traditional image sensors, our algorithms content to perceive details in the scene without having to characterize them in detail. We also developed a proof-of-concept demonstration to prove that a driver monitoring solution is completely possible using neuromorphic sensors. Using a 1MP neuromorphic sensor, we can infer Output similar performance to solutions based on active NIR illumination 2MP vision sensors. In the future, we will focus on the GenX320 neuromorphic sensor, which is suitable for privacy-sensitive smart devices and will help us further improve the user experience."

Petronel Bigioi

XPERI Chief Technology Officer

ULTRALEAP

“We’ve seen the benefits of Prophesee Event Vision Sensors in enabling contact-free interactions through high-precision gesture recognition and hand tracking in Ultra Leap’s TouchFree app. Prophesee Event Vision Sensors are able to operate in challenging environmental conditions. , operates at extremely efficient energy consumption levels and low system latency, thereby enhancing the overall user experience and intuitiveness of our touchless user interface (UI). With the launch of the new Genx320 sensor, more applications and devices will be available, including Battery-powered small systems and the growing number of contactless use cases will benefit from the robustness, low power consumption, low latency and high dynamic range of event vision sensors, further improving the convenience and ease of interacting with all types of digital content. Use sex.”

Tom Carter

ULTRALEAP Co-Founder and CEO

About PROPHESEE

Prophesee is the inventor and global market leader of neuromorphic vision systems.

Prophesee develops groundbreaking Event-Based Vision solutions for machine vision. This new vision method can significantly reduce power consumption, latency, and data processing, and can obtain content that traditional frame-based sensors cannot. Prophesee’s patented Metavision sensors and AI algorithms mimic the way the human eye and brain work, significantly improving the efficiency of machine vision in areas such as autonomous vehicles, industrial automation, mobile phones, IoT, and AR/VR.

Prophesee's global headquarters is in Paris and its China headquarters is in Shanghai. The company also has offices in various locations around the world, including Tokyo and Silicon Valley. The company has more than 100 scientific researchers. It has more than 50 international patents and is supported by leading international investors, including Intel, BOSCH, Groupe Renault, Xiaomi, Vail and other strategic investors, as well as the European Investment Bank EIB, Sinovation Ventures, Weihao Innovation, and Prosperity7 Ventures and other industrial investors.