The Most Advanced & Comprehensive Neural Networks Portfolio for the Ultimate In-Vehicle Scene Understanding AI

World’s Largest In-Vehicle Data Set

Over the last few years, we’ve amassed remarkable amounts of facial, body, surface and objects data in different environments inside the cabin, under different lighting conditions, and with different camera types and positionings. This data represents different races, genders, ages, emotions, body sizes and orientations, actions, activities…etc. Today, Eyeris hold the world’s largest in-vehicle dataset, and serves as ground truth for training our vision AI portfolio of In-vehicle Scene Understanding algorithms.

Human Behavior Understanding

Eyeris HBU portfolio of DNNs uses state of the art modeling techniques to automatically interpret complex visual behavioral patterns of occupants inside autonomous and highly automated vehicles. These visual behavioral patterns are drawn from body tracking analytics, face analytics and emotion recognition from facial micro-expression along with action and activity recognition for all occupants inside the vehicle.

Body

Detects and tracks occupants’ 10 body keypoints and estimates the corresponding value coordinates of shoulders, elbows, wrists, hips, shoulder base and center of face along with body height, width, size, posture, orientation, contour and positioning.

Face

Detects and tracks occupants’ faces, classifies 7 emotions from facial micro-expressions, predicts gender and estimates age and head pose. Additional behavioral analytics such as attention, distraction and drowsiness can be specifically tailored, through behavioral modeling, according to their respective application and use-case.

Activity Detection

Based on predefined in-vehicle environments and camera setups, we leverage temporal data from articulated upper body motion and, along with object understanding, to model human actions and predict activities of interest. These activities include, eating and drinking, driving, sleeping, using phone or laptop…etc.

Object Localization

Provides detection, classification, size, contour and position of objects inside the cabin. A robust solution for augmenting activity recognition and for cleanliness detection or identifying forgotten objects left behind such as phone, wallet, keys, laptop, bag, bottle, food items...etc.

Class

Detects and classifies pre-trained objects with their corresponding labels and confidence score.

Size

Provides objects size contour along with their corresponding coordinates.

Position

Estimates object position in the cabin along with corresponding coordinates.

Surface Classification

Classifies and positions all in-cabin surfaces from a pixel map along with their shape, including footwells, door panels, center console, etc., relative to the occupants and objects.

Pixel Map

Provides a class label to each surface pixel in the interior by measuring differences between color and texture.

Shape

Provides surface contour and surface region coordinates relative to adjacent in-cabin surfaces, occupants or objects.

Surface Class

Provides a class label to each surface in the interior by measuring differences between color and texture.

Interior Image Segmentation

We believe that every inch of the interior space must be understood with the highest level of confidence in order to maximize safety and comfort. Our patent-ptending methods for Interior Image Segmentation enable us to perceive the in-vehicle environment with a much more robust knowledge than through traditional detection and classification networks. Eyeris Interior Image Segmentation classifies every pixel in the image for a complete 360 degree of in-vehicle scene understanding.

Eyeris Proprietary AI Chip

A production-ready computer vision ASIC, optimized for inferencing the EyerisNet portfolio of Deep Neural Networks (DNNs) from multiple cameras up to 6 simultaneous streams. Eyeris AI chip is automotive AEC-Q100 qualified inside a compact 20mmX20mm assembly package. With a throughput of up to 10TOPS under 7W, Eyeris high performance low-power AI chip is also equipped with best-in-class security features such as OTP for secure boot, TrustZoneTM, and IO virtulization. The chip has a rich array of interfaces including CAN bus, GigE Ethernet, USB, HDMI and a MIPI DSI/SCI 4-lane output.

AI Chip Benefits

 

Automotive Grade

Eyeris AI chip is production-ready and AEC-Q100 automotive-grade qualified, capable to withstand temperatures between -40C and 105C.

Edge Computing

Designed for real-time inference on the edge at high frame rate, Eyeris AI chip provides time-sensitive data without reliance on network connections.

Low Power

Designed with efficiency in mind, Eyeris low-power AI chip consumes less than 7W regardless of the number of Inferenced DNNs or camera streams.

Highest Throughput

With a throughput of up to 10TOPS, Eyeris AI chip is designed to inference the entire portfolio of DNNs in real-time, and from up to 6 camera streams inside the cabin.

 

Any 2D Camera

RGB-IR Sensor
Pellentesque sodales sollicitudin massa vitae ultricies. Nam bibendum sodales dapibus. purus. Cras ut feugiat dolor. Maecenas placerat quam et molestie eleifend. Cras quam Pellentesque sodales sollicitudin massa
2D Camera Agnostic
Pellentesque sodales sollicitudin massa vitae ultricies. Nam bibendum sodales dapibus. purus. Cras ut feugiat dolor. Maecenas placerat quam et molestie eleifend. Cras quam Pellentesque sodales sollicitudin massa
Low Res Requirements
Pellentesque sodales sollicitudin massa vitae ultricies. Nam bibendum sodales dapibus. purus. Cras ut feugiat dolor. Maecenas placerat quam et molestie eleifend. Cras quam Pellentesque sodales sollicitudin massa
Multi Camera Support
Pellentesque sodales sollicitudin massa vitae ultricies. Nam bibendum sodales dapibus. purus. Cras ut feugiat dolor. Maecenas placerat quam et molestie eleifend. Cras quam Pellentesque sodales sollicitudin massa

Flexible Environments

Camera Position Invariant
Pellentesque sodales sollicitudin massa vitae ultricies. Nam bibendum sodales dapibus. purus. Cras ut feugiat dolor. Maecenas placerat quam et molestie eleifend. Cras quam Pellentesque sodales sollicitudin massa
MIPI Interface or Other
Pellentesque sodales sollicitudin massa vitae ultricies. Nam bibendum sodales dapibus. purus. Cras ut feugiat dolor. Maecenas placerat quam et molestie eleifend. Cras quam Pellentesque sodales sollicitudin massa
Field of View Invariant
Pellentesque sodales sollicitudin massa vitae ultricies. Nam bibendum sodales dapibus. purus. Cras ut feugiat dolor. Maecenas placerat quam et molestie eleifend. Cras quam Pellentesque sodales sollicitudin massa
Entirely Customizable
Pellentesque sodales sollicitudin massa vitae ultricies. Nam bibendum sodales dapibus. purus. Cras ut feugiat dolor. Maecenas placerat quam et molestie eleifend. Cras quam Pellentesque sodales sollicitudin massa

Optimized Deep Learning Models

Each vehicle interior presents a unique environment, with a different type of interior space, camera numbers and their placements etc., EyerisNet portfolio of DNNs offers optimized vision AI models though exclusive data collection, model training and optimization processes at our R&D lab in San Jose, CA. Robust results, fast.