Digital Mirror Augmentation for Commercial Vehicles - Revolutionizing Safety and Efficiency

Neonode’s Digital Mirror Augmentation revolutionizes commercial vehicle safety and efficiency. Using head-tracking technology, it delivers intuitive, dynamic mirror views, reducing driver fatigue and enhancing reversing precision, as shared by industry expert, Kent Pålsson.

In the fast-evolving world of commercial vehicle technology, Neonode’s Digital Mirror Augmentation is setting a new standard for driver safety, comfort and operational efficiency. By leveraging advanced MultiSensing® technology, this innovative solution transforms static digital mirrors into dynamic, responsive tools that replicate the intuitive behavior of traditional mirrors while addressing modern challenges. Kent Pålsson, Vice President of Engineering at Neonode, has over 14 years of industry experience and he shares insights on how Neonode’s system solves critical problems for commercial vehicle operators, particularly in complex scenarios like reversing.

A Logical and Intuitive Experience

Digital mirrors are gaining popularity in commercial vehicles, especially in Europe, due to benefits like improved aerodynamics and better fuel efficiency. New trucks from Kenworth, Peterbilt, Volvo, Mercedes-Benz, Iveco, DAF and MAN already feature digital mirror systems, but user adoption has been slow. The experience of viewing a static digital image, though information-rich, is less intuitive than using classic reflective mirrors.

Neonode’s Digital Mirror Augmentation is designed to feel familiar to drivers. “The software works with digital mirror hardware but adjusts the display to behave like real reflective mirrors,” Kent explains. “Neonode’s solution dynamically adjusts the displayed view based on the driver’s head position.” This is achieved through MultiSensing technology, which integrates data from rear-facing cameras and interior sensors to track the driver’s head movements and spatial orientation in real time. The result is a fluid, mirror-like experience where the driver sees “exactly what they want to see, when they want to see it,” says Kent.

This intuitive design is particularly valuable for drivers who frequently switch vehicles, as it aligns with how they’ve been trained to use mirrors while driving. By replicating the natural behavior of physical mirrors, the system reduces the learning curve and minimizes driver fatigue. Kent notes that the prototype’s first impression is striking: “It’s so effective, solving a problem you didn’t know you had.” The system’s ability to provide a fast, expanded view simply by moving one’s head eliminates the need to navigate menus or control pads, allowing drivers to stay focused on the road.

Enhancing Safety Through Smart Integration

Safety is a top priority in commercial vehicle operations and Neonode’s system addresses this through intelligent design and cost-effective integration. Kent highlights that head tracking, rather than eye tracking, is key to reliable performance. “Eye tracking doesn’t work well for this application,” he states. “Instead, Neonode’s head-tracking approach ensures precise adjustments to the mirror’s view, offering a more robust and practical solution.”

A standout feature is the system’s compatibility with existing Driver Monitoring Systems (DMS). Neonode enables smart integration that leverages existing DMS infrastructure, making the solution cost-effective for Original Equipment Manufacturers (OEMs). The augmentation software is also compatible with existing camera solutions, making it an ideal feature to boost adoption and enhance the driver’s experience.

The system’s intelligence lies in its ability to anticipate and deliver what the driver expects. For instance, when reversing, drivers can adjust the mirror’s field of view by simply leaning forward or moving their head, eliminating the need to press buttons or manipulate controls while steering. This seamless interaction is particularly beneficial in high-pressure situations where precision is critical.

Solving the Reversing Challenge

Reversing large commercial vehicles, such as trucks with trailers, is one of the more challenging maneuvers for drivers, according to Kent. Solution providers have attempted to address this by displaying different views in the digital mirror using complex algorithms to calculate the vehicle’s position, driving situation and the space between the truck and trailer to anticipate what the driver should see. However, this approach often fails to show what the driver expects, leading to confusion and inefficiency. “If the view or panning on the display doesn’t change, the driver might not see the surrounding environment or the wheels when needed,” Kent explains.

Neonode’s breakthrough technology takes a different approach, prioritizing simplicity and alignment with driver instincts. “With our system, the driver simply leans forward to see exactly what they want to see—the wheels, trailer or loading dock,” Kent says. This capability ensures drivers can monitor the trailer’s position and wheels in real time, enhancing precision and safety during reversing maneuvers.

Judging 3D distances is also easier with mirror augmentation. By allowing drivers to change perspectives intuitively, it makes spatial relationships easier to grasp, even in challenging environments. This is a game-changer for drivers navigating tight spaces or unfamiliar routes, as it reduces cognitive load and improves situational awareness.

Compatibility with Augmented Reality and Regulatory Flexibility

Neonode’s system is not only practical but also forward-thinking, with compatibility for augmented reality (AR) applications. This opens the door to enhanced visualizations, such as overlaying navigational cues or hazard warnings directly onto the mirror display. While the system adheres to strict legislation governing what can be shown while driving, Kent notes that in special driving conditions, such as reversing, “you can show anything.” This flexibility allows OEMs to tailor the user interface (UI) to specific vehicle models and regional requirements, ensuring compliance while maximizing functionality.

Neonode provides the core input technology, while OEMs have the freedom to design the UI, ensuring the system integrates seamlessly into each vehicle’s ecosystem. This collaborative approach empowers manufacturers to create brand-specific experiences that differentiate their vehicles in a highly competitive market.

A Proven Solution in a Competitive Landscape

For years, companies have tried to address the limitations of digital mirrors, often adopting solutions that fall short of driver expectations. Neonode’s Digital Mirror Augmentation stands out by combining advanced technology with a deep understanding of driver behavior. By focusing on head tracking, smart integration and intuitive design, the system delivers a solution that feels natural and reliable.

Neonode’s Digital Mirror Augmentation is poised to become a cornerstone technology, reducing driver fatigue, enhancing safety and meeting the evolving needs of OEMs and drivers alike.

Kent Pålsson, Vice President Engineering, Neonode