Problem
Helm Order Monitor is the first technological solution to the problem of insufficient monitoring of helm orders between helmsmen and marine pilots or navigators onboard ships.
Not uncommon error
In an investigation report of a marine accident that involved a helmsman applying the wrong helm, Australian Transport Safety Bureau stated: THIS TYPE OF ERROR IS NOT UNCOMMON.
Costa Concordia
Did you know that disaster of Costa Concordia happened due to the helmsman applying the helm on the wrong side shortly before the impact?
How Does It Work?
Helm Order Monitor was made with simplicity in mind
Product
Helm Order Monitor combines speech recognition and data from the ship's sensors. This artificial intelligence continuously monitors whether issued helm orders are clear, confirmed, and correctly executed.
PC Panel
DuraPANEL PC 7" - Type approved for Marine applications, PCAP multi-touch, designed for 24/7 usage, wide temperature range, low power consumption, fanless operation, ambient light sensor, integrated buzzer, NMEA0183 input via RS422, IEC 60945 and IACS E10 certification.
Microphone
The "Octopus" acoustic sensor front end is a research and development platform, developed with the Fraunhofer IDMT's Oldenburg Branch for Hearing, Speech and Audio Technology, with a far-field voice capture custom-made integrated SCH microphone array, ceiling-mounted and optimized for the navigational bridge.
Automatic Speech Recognition
For a Helm Order Monitor technology demonstrator, Fraunhofer IDMT in Oldenburg, Germany, is providing research and development for the optimal acoustic setup, and a special in-house developed speech recognition system optimized for the recognition of maritime phrases.
INTERVIEW WITH A CAPTAIN REGARDING PASSAGE THROUGH SUEZ CANAL
I'm on the Navigational bridge all the time (passage lasts 12 to 13 hours).
I leave nothing to chance; I follow every pilot’s helm order and helmsman response. Several times, it happened that I had to jump and grab the helm to avoid ship grounding because of a misunderstanding between the pilot and helmsman.
Such a situation can occur because of a simple misinterpretation, someone hears the wrong figure, and everything goes wrong in the second.
Benefits
Alerts
Visual and audio warnings if the order is being omitted, misinterpreted, or wrongly executed
Bridging the gap
Implementation of automated alerts otherwise not available in manual mode steering
Analytics
Transcription of recorded data as an analytical tool/performance benchmarking
Speech emotion recognition
Will warn about unsafe stress level, significant contributor to navigational incidents
Situational awareness
Assistance in monitoring the execution of the orders when the concentration drops
Language barrier
Clear English pronunciation reduces the burden on the listener
LANGUAGE BARRIER
In a study conducted by Transport Canada, when pilots were asked whether language barriers make it challenging to communicate orders to the helmsman on foreign-registered vessels, 20% reported that it “often” resulted in difficulty communicating.
In the same study, pilots stated that the major problem in pilotage anywhere in the international scene is the language barrier. They fear that it will again be a case of the marine industry experiencing accidents before any positive action is taken and regulations implemented.
Thanks to rapid advances in ASR technology, the Helm Order Monitor is now in a unique position to become an example of positive action towards language barrier problem solutions in the marine industry.
Preorders are available
Sign up for preorder, and we will let you know when Helm order Monitor is available.