Helm Order Monitor
Speech recognition for safer manual steering
Automatic Speech Recognition
On Edge
An ELNAV.AI system in development for verifying spoken helm orders during hand steering, using automatic speech recognition and bridge / steering context.
Manual steering still depends on clear order handling
During pilotage, port approach, confined waters and other manual-steering phases, helm orders are still issued, repeated and executed by people. If an order is misheard, omitted, repeated incorrectly or executed the wrong way, the bridge team may have only seconds to detect and correct the error.
Misheard or omitted order
A spoken order is not repeated clearly or is missed during a high-workload phase.
Wrong-side or delayed execution
The helmsman applies the wrong helm, delays the action, or the vessel response does not match the order.
Limited automated safeguards
In hand steering, the bridge team must actively monitor rudder angle, heading and rate of turn.
A simple order-readback-execution flow
Helm Order Monitor listens for standard helm-order phraseology, checks the repeated order, and compares the expected action with available bridge and steering data.
Order issued
The pilot or navigator gives a standard helm order.
Read-back recognised
The system checks whether the repeated order is clear and consistent
Execution checked
The expected action is compared with rudder, heading and steering context.
The solution
ASR + Bridge context​
Edge computer
Marine-rated local processing unit for bridge environments and operator HMI.
Microphone array
Far-field speech capture for bridge conditions, with local processing.
Automatic speech recognition
Domain-adapted recognition for helm-order phraseology.
Bridge and steering context
Rudder angle, heading, rate-of-turn and other available signals used to compare order intent and vessel response.
Simulator demo video
Benefits
Order verification
Helps detect omitted, misheard, repeated or wrongly executed helm orders.
Manual-steering support
Adds advisory monitoring during hand steering, where automated safeguards are limited.
Bridge-team workload
Supports the officer, pilot and helmsman during high-attention phases.
Language and phraseology
Encourages clear repeat-back and standard helm-order communication.
Training and review
Can support simulator training, debriefing and review of helm-order handling.
Advisory alerts
Provides visual and audio advisories when the order flow or execution appears inconsistent.
Clear phraseology reduces communication risk
Helm orders depend on clear communication between the pilot, officer of the watch and helmsman. Language barriers, accents, noise and non-standard phraseology can increase the chance of misunderstanding. Helm Order Monitor is designed to support standard phraseology and clear repeat-back.
Problem
During pilotage, port approach, confined waters and other manual-steering phases, helm orders are still issued, repeated and executed by people. If an order is misheard, omitted, repeated incorrectly or executed the wrong way, the bridge team may have only seconds to detect and correct the error.
Â
In hand steering, several automatic safeguards available in autopilot or track-control modes are not available. Monitoring the execution of helm orders therefore remains a high-attention bridge-team task.
Exxon Valdez
In 1989, the Exxon Valdez oil spill was one of the biggest environmental disasters in history. It resulted from insufficient helm orders' monitoring.
Costa Concordia
Did you know that disaster of Costa Concordia happened due to the helmsman applying the helm on the wrong side shortly before the impact?
How Does It Work?
Helm Order Monitor listens for standard helm-order phraseology, checks the repeated order, and compares the expected action with available bridge and steering data.
Â
The system is designed to support the bridge team during manual steering by making order handling easier to monitor and by issuing advisory alerts when the order flow appears unclear, omitted, delayed or inconsistent with the vessel response.
Solution
Helm Order Monitor combines automatic speech recognition with bridge context and ship sensor data to help verify that helm orders are clearly issued, repeated and executed during manual steering.
Â
The system is advisory only. It supports the bridge team without taking control, replacing the helmsman, or overriding existing bridge procedures.
Edge computer
Marine-rated processing unit for local operation and bridge display.
Microphone array
Far-field speech capture for bridge environments.
Automatic speech recognition
Domain-adapted recognition for helm-order phraseology.
Bridge and steering context
Rudder angle, heading, rate-of-turn and other available signals used to compare order intent and vessel response.
Many maritime accidents stem from compromised decision-making under intense stress on ships' navigational bridges. A notable example is the MV Ever Given's grounding in the Suez Canal on March 23, 2021, illustrating the critical impact of such high-pressure situations. The six-day blockade of the Suez Canal had a profound impact on the global economy, causing daily losses estimated at around $10 billion.
The attached report details incidents of shouting and confusion among the bridge team, indicative of high-stress levels. There were moments of impaired decision-making, highlighted by the abrupt and reactive maneuvers to counteract the vessel's drift and the miscommunications between the pilot and the bridge team. These stress factors underscore the intense pressure and challenging circumstances faced by the crew during the incident, affecting their ability to effectively manage the situation.
Benefits
Order verification
Helps detect omitted, misheard, repeated or wrongly executed helm orders.
Manual-steering support
Adds advisory monitoring during hand steering, where automated safeguards are limited.
Bridge-team workload
Supports the officer, pilot and helmsman during high-attention phases.
Language and phraseology
Encourages clear repeat-back and standard helm-order communication.
Training and review
Can support simulator training, debriefing and review of helm-order handling.
Safety alerts
Provides visual and audio advisories when the order flow or execution appears inconsistent.
LANGUAGE BARRIER
Helm orders depend on clear, standard communication between the pilot, officer of the watch and helmsman. Language barriers, accents, noise and non-standard phraseology can all increase the chance of misunderstanding.
Helm Order Monitor is designed to support standard phraseology and clear repeat-back, reducing the burden on the listener and helping the bridge team detect unclear or inconsistent order handling earlier.
Register your interest
Helm Order Monitor is currently an ELNAV.AI project in development. Share your details and we will keep you informed about testing, pilot availability and deployment updates.