Monday, December 23, 2024

Driver Monitoring System ASIC With Integrated AI Processing Unit

- Advertisement -

Consumes low power, saves board space for processing eye tracking and supports secure boot features to provide cybersecurity

Optimised for entry-level, stand-alone driver monitoring systems (DMS) is the OAX8000, an AI-enabled, automotive application-specific integrated circuit (ASIC).

The OAX8000 uses a stacked-die architecture to provide the DMS processor with on-chip DDR3 SDRAM memory (1 Gb). It also integrates neural processing unit (NPU) and image signal processor (ISP), which provides dedicated processing speeds of up to 1.1 trillion operations per second for eye tracking algorithms. These fast processing speeds with 1K MAC of convolutional neural network (CNN) acceleration, along with integrated SDRAM, enable low power consumption for DMS systems.

- Advertisement -

The on-chip NPU is supported by TensorFlow, Caffe, MXNet and ONNX. Additionally, this ASIC embeds quad Arm Cortex A5 CPU cores with Neon technology for accelerated video encoding/decoding and on-chip video analytics algorithms, along with hardware for image processing, video encoding and RGB/IR processing. Its high dynamic range (HDR) processing capability allows the ASIC to accept input from RBG/IR image sensors and support high-quality output for videos taken during the day or at night. The integrated video encoder accepts up to 5 megapixel captures from OmniVision’s automotive image sensors, and outputs up to 2K resolution video at 30 frames per second (fps).

The OAX8000 consumes just 1 watt in typical conditions. This integration also reduces the board area for the engine control unit (ECU). Boot-up time for the ASIC is significantly fast, which eliminates any delay between ignition and activation of the DMS camera. Additionally, it supports secure boot features to provide cybersecurity.

Other applications include processing occupant detection algorithms, such as distinguishing a baby from a grocery bag and providing alerts when objects are left behind in the vehicle. Additionally, this ASIC can be used in automotive video security systems to perform functions such as FaceID, as well as preset driver-comfort settings (e.g. seat position) that are activated when the DMS scans the driver’s face.

The OAX8000 ASIC is AEC-Q100 Grade 2 qualified and available now from OmniVision Technologies in a BGA196 package.


SHARE YOUR THOUGHTS & COMMENTS

EFY Prime

Unique DIY Projects

Electronics News

Truly Innovative Electronics

Latest DIY Videos

Electronics Components

Electronics Jobs

Calculators For Electronics