Problem
In an investigation report of an accident that involved a helmsman applying the wrong helm, the Australian Transport Safety Bureau stated: THIS TYPE OF ERROR IS NOT UNCOMMON.
Exxon Valdez
In 1989, the Exxon Valdez oil spill was one of the biggest environmental disasters in history. It resulted from insufficient helm orders' monitoring.
Costa Concordia
Did you know that disaster of Costa Concordia happened due to the helmsman applying the helm on the wrong side shortly before the impact?
How Does It Work?
Helm Order Monitor was made with simplicity in mind
Solution
The Helm Order Monitor integrates automatic speech recognition and data from the ship's sensors to alert the bridge team about potential errors. Additionally, it utilizes speech emotion recognition to identify and caution against elevated stress levels on the navigational bridge.
Computer Components
Type approved for Marine applications, PCAP multi-touch, designed for 24/7 usage, wide temperature range, low power consumption, fanless operation, ambient light sensor, integrated buzzer, NMEA0183 input, IEC 60945 and IACS E10 certification.
Microphone
The "Octopus" acoustic sensor front end is a research and development platform, developed with the Fraunhofer IDMT's Oldenburg Branch for Hearing, Speech and Audio Technology, with a far-field voice capture custom-made integrated SCH microphone array, ceiling-mounted and optimized for the navigational bridge.
Automatic Speech Recognition
For a Helm Order Monitor technology demonstrator, Fraunhofer IDMT in Oldenburg, Germany, is providing research and development for the optimal acoustic setup, and a special in-house developed speech recognition system optimized for the recognition of maritime phrases.
Speech Emotion Recognition
We are collaborating with audEERING® in Germany to create a specialized Speech Emotion Recognition system. This system will alert the navigational bridge team about elevated stress levels, a significant factor contributing to navigational incidents.
Many maritime accidents stem from compromised decision-making under intense stress on ships' navigational bridges. A notable example is the MV Ever Given's grounding in the Suez Canal on March 23, 2021, illustrating the critical impact of such high-pressure situations. The six-day blockade of the Suez Canal had a profound impact on the global economy, causing daily losses estimated at around $10 billion.
The attached report details incidents of shouting and confusion among the bridge team, indicative of high-stress levels. There were moments of impaired decision-making, highlighted by the abrupt and reactive maneuvers to counteract the vessel's drift and the miscommunications between the pilot and the bridge team. These stress factors underscore the intense pressure and challenging circumstances faced by the crew during the incident, affecting their ability to effectively manage the situation.
The Helm Order Monitor equipped with a speech emotion recognition feature is designed to improve decision-making and manage stress levels on ships' navigational bridges. By analyzing the tone and emotional state of the crew's voices, the system can detect stress levels, facilitating timely interventions to mitigate tension and prevent decision impairment.
Benefits
Alerts
Visual and audio warnings if the order is being omitted, misinterpreted, or wrongly executed
Bridging the gap
Implementation of automated alerts otherwise not available in manual mode steering
Analytics
Transcription of recorded data as an analytical tool/performance benchmarking
Speech emotion recognition
Will warn about unsafe stress level, significant contributor to navigational incidents
Situational awareness
Assistance in monitoring the execution of the orders when the concentration drops
Language barrier
Clear English pronunciation reduces the burden on the listener
LANGUAGE BARRIER
In the attached study conducted by Transport Canada, when marine pilots were asked whether language barriers make it challenging to communicate orders to the helmsman on foreign-registered vessels, 20% reported that it “often” resulted in difficulty communicating.
In the same study, pilots stated that the major problem in pilotage anywhere in the international scene is the language barrier. They fear that it will again be a case of the marine industry experiencing accidents before any positive action is taken and regulations implemented.
Thanks to rapid advances in ASR technology, the Helm Order Monitor is now in a unique position to become an example of positive action towards language barrier problem solutions in the marine industry.
Preorders are available
Sign up for preorder, and we will let you know when Helm order Monitor is available.