Affectiva Automotive AI for Driver Monitoring Solutions

Affectiva’s innovative solution enhances driver safety, builds trust and reimagines the future of in-cabin experience.

The Automotive Problem

Every day, over 1,000 injuries and nine fatalities are caused by distracted driving in the U.S. - and up to 6,000 fatal crashes each year may be caused by drowsy drivers. This indicates a major need for driver monitoring to help improve road safety. While AI in automotive has historically focused on what’s going on outside of the vehicle, OEMs and Tier 1 suppliers are beginning to turn cameras and sensors inwards, using AI to gather insight on what’s going on with the people inside the vehicle. And looking ahead to the evolution of autonomous capabilities, consumers will shift away from assessing a vehicle’s driving performance to focusing on the best in-cabin experience. Whether or not I’m behind the controls, which car can keep me the safest? The most productive? The most entertained? The most relaxed?

The Affectiva Solution

To improve road safety and to offer a stellar transportation experience, there must be a deep understanding of driver and occupant emotions, cognitive states, and reactions to the driving experience. Affectiva Automotive AI unobtrusively measures, in real time, complex and nuanced emotional and cognitive states from face and voice. This next generation in-cabin software enables OEMs and Tier 1s to monitor driver state and measure occupant mood and reactions.

“Affectiva’s new product moves the company into the autonomous vehicles sector, an industry receiving a lot of interest and investment. The decision could help the startup differentiate its business from competitors in emotion-sensing technology, which include EMOSpeech and Vokaturi.”

Bernard Marr

"The future of transportation is AI whether computers do the driving or not. We desperately need to change the way we approach the manufacture and operation of motor vehicles. Over one million people die every year in vehicle collisions. With Automotive AI, it’s possible the roads could become a little safer thanks to Affectiva and other companies working on changing things for the better."

Tristan Greene

“…with the camera pointed at the safety driver, Renovo can then tell whether that person is tired or distracted, and deliver the right prompts or warnings to ensure attention remains on the road ahead. And that’s where Renovo and Affectiva’s collaboration perhaps could have prevented the fatal Uber collision last month.”

Andrew Hawkins

    We are currently working with...

    Porsche Porsche
    Daimler Daimler
    Renovo Auto Renovo Auto
    Autoliv Autoliv
    nvidia nvidia
    intel intel

    Driver Safety Monitoring

    • Monitor levels of driver fatigue and distraction to enable appropriate alerts and interventions that correct dangerous driving. An audio or display alert instructs the driver to remain engaged; the seat belt vibrates to jolt the driver to attention.
    • Address handoff challenge between driver and car in semi-autonomous vehicles. When sensing driver fatigue, anger or distraction, the autonomous AI can determine if the car must take over control. And when the driver is alert and engaged, the vehicle can pass back control.
    • Monitor driver anger to enable interventions or route alternatives that avoid road rage. A virtual assistant guides the driver to take a deep breath, the driver’s preferred soothing playlist comes on, the GPS suggests a stop along the way.
    Learn More

    Occupant Experience Monitoring

    • Adapt environmental conditions, such as lighting and heating, based on levels of comfort and drowsiness. It could also help influence a change of the autonomous driving style if passengers are detected as being anxious or uncomfortable.
    • Understand user frustration or confusion with virtual assistants and conversational interfaces, and design these to be emotion-aware, so they can respond in an appropriate and relevant manner. Imagine if the Human Machine Interface (HMI) in your car sensed it was frustrating you and used that feedback to improve the experience. 
    • Personalize content recommendations, such as video and music, based on the emotions of the passengers; make e-commerce purchase recommendations based on reactions to the content that is served or the route that is taken.
    Learn More

    Cutting Edge AI Powered by Deep Learning and Massive Amounts of Data

    Deep Learning

    Deep learning allows Affectiva to model more complex problems with higher accuracy than other machine learning techniques. It solves a variety of problems such as classification, segmentation and temporal modeling. It also allows for end-to-end learning of one or more complex tasks jointly including: face detection and tracking, speaker diarization, voice-activity detection, and emotion classification from face and voice.

    Automotive Data Set

    Affectiva has already analyzed over 6.5 million faces in 87 countries and has used this data to build its core Emotion AI technology. We also collect large amounts of spontaneous driver and occupant data so we can tune our existing algorithms for automotive environments, and develop new automotive metrics. We are building this large automotive data corpus through in-car data collection, lab simulation environments and data partnerships.

    Real Time, On-Device

    Our deep learning models provide accurate, real time estimates of emotions and cognitive states on mobile devices and embedded systems. Our focus is on building highly efficient models that achieve high accuracy with a minimal footprint. Our approach involves joint-training across a variety of tasks using shared layers between models combined with iterative benchmarking / profiling of on-device performance, and model compression - training compact models from larger models.

    Learn more about deep learning at Affectiva

    Affectiva's Automotive AI is Getting Noticed

    Click below to see who else is as excited about it as we are:

    See All Press

    See Affectiva Automotive AI in Action

    Like what you see? This is just the beginning of a long road trip.

    Contact us to be a part of the emotion-enabled vehicle revolution

    Related Content


    [Press] VentureBeat Covers Affectiva Automotive AI

    VentureBeat covers Affectiva’s Automotive AI launch, which lets creators of autonomous vehicles and other transportation systems track users’ emotional response.

    Read More


    Building Magic Moments with Porsche, and Setting the Mood with DXC

    Affectiva was one of over 500+ startups screened and selected to join the 33 startups accepted into StartUp Autobahn program. We collaborated on 2 separate demos with Porsche and DXC.

    Keep Reading


    [Webcast Recording] Affectiva Automotive AI: Technical Deep Dive

    Learn more about the underlying science behind our innovative in-cabin sensing solution with Affectiva's own Director of Applied AI in this on-demand webcast.

    Watch Recording


    AI Hits the Highway

    Read some of the key trends we’re seeing and hearing in terms of what’s up next for AI in the auto industry.

    Keep Reading


    Emotion AI in the Auto Industry: A World of Possibilities

    The 2017 Emotion AI Summit hosted by Affectiva brought the autonomous vehicle as one of the many thought-provoking topics in which Emotion AI is used today.

    Keep Reading


    3 AI Trends for the Automotive Industry in 2018

    Here are some 2018 automotive AI trends which will transform the future of mobility that may of be particular interest to OEMs and Tier 1 suppliers.

    Keep Reading