Kuidas silmade jälgimine võib kokpiti simulaatoreid täiustada: kiirendavad tulemused juhi ja lennukoolituse jaoks

Nagu näitavad uued uuringud, silmade jälgimise tehnoloogia võib simulaatorites treenimist parandada kognitiivse koormuse mõõtmine (teabe hulk, mida te võtate). Seda saab kasutada ka isikupärastatud ja adaptiivses õppes, mis viib kiirema õppeprotsessini ja töötajate varased tulemused. 

Out of all industries where this technology takes training methods to a different level, aviation and automotive are positively impacted. Silmade tähelepanu ja inimese vaatlus in these fields are crucial, and by monitoring them during flight or driving simulator programs, trainers can predict future behavior and assess employees’ take-in. Furthermore, they can understand how the learning and training process can be improved, thus koolitustundide arvu ja kulude vähendamine.

It can also have a huge impact on providing a much safer environment by reducing human errors – you will be able to identify the mistakes that wouldn’t be so easily identifiable without a repetitive study of eye movements during training sessions.


So how can 3D eye tracking technology influence and improve the learning process, and how can this apply to flight crews (pilots, especially) and driver training? This is precisely what our article aims to answer by initially explaining the benefits one generally gets when using 3D eye tracking in the learning process and then applying those general benefits to flying and driving training.

Mida saab 3D-silma jälgimine teha koolituse toetamiseks ja õpilaste tulemuste parandamiseks?

Before answering what and how 3D eye tracking can support training programs, we should know kuidas 3D-silmajälgimise tehnoloogia töötab

As opposed to regular eye tracking, 3D eye tracking tracks visual attention remotely from as far as 1.3m (4.3 ft) away. This means that the classic gear used is not needed anymore, and the trainee is not burdened by any headgear during training or simulation.

  • Prille pole 
  • VR-peakomplekt puudub 
  • Kalibreerimine puudub 

Pilgujälgimise-kokpiti simulaator

Kuidas saate seda teha? Üsna lihtne – kasutades a 3D sügavustundlik kaamera teie kokpiti simulaatoris, through which you can track multiple subjects, label objects of interest (command/control area, specific gears, instrument panels, etc.) in the flying/driving decks, and track attention towards them in real-time. 

See on võimalik abiga GazeSense, 3D-silma jälgimise tarkvara created to map your point of analysis. This software can interpret precisely where or what the subject is looking at (just like the video below demonstrates).

3D-silma jälgimise tehnoloogia koosneb a non-wearable, unintrusive device that can be integrated with real-world environments to gather new data, which can help improve training programs

It comes as a next-level technology, ready to challenge the “status-quo” of simulation programs and offer new perspectives. Now, the focus is not necessarily on the training info, but the subject/student, his swiftness, alertness, engagement, and performance.

Its purpose is higher than just making sure your future or present employees follow procedures by first gathering data about the trainee’s gazes and points of interest. Eye tracking helps you better understand learning habits, reduce the number of training hours and make the trainees improve their skills faster.

Real-Time Trainee Monitoring

The first thing you can do with 3D eye tracking is monitor gaze in real-time or post-session review. Real-time visual checks and attention span monitoring become efficiency tools. Furthermore, you can consider early habit-building by making on-the-spot improvements for emergency event prioritization. 

Ühendage oma praktikandiga treeningute ajal 

Having access to the trainee’s eye attention is vital for the trainer. 

3D eye tracking makes it possible for the trainer to see every eye movement, even if he is positioned behind him. This allows the process to be better assisted and to better and faster detect what parts of the training should be repeated, what instant corrections should be made, and what can be improved in the control panel attention.

“No Strings Attached” during Training

One of the main benefits of 3D eye tracking is that it doesn’t require any glasses or any other type of headgear. This is especially important for flying and driving training, as extra headgear could affect the trainee’s experience and performance. Furthermore, there is no need for calibration, and it works in low-light environments using a discreet & inexpensive 3D camera.

Kognitiivse koormuse ülevaated

Training programs have the primary responsibility to support the learning process. But the learning process is entirely dependent upon the human memory system. 

The responsibility lies within understanding how you can optimize and, when necessary, minimize the load of info and procedures you put on the trainees’ shoulders or, better said, brains.


Moreover, by tracking the eye attention during training hours, you have access to eye movement data that gives you essential trainee attention span and prioritization insight. For example, in pilot and driving training simulators, it is crucial to know how the pilot trainee reacts to cognitive overstimulation, such as activating 5 major alarms at once and prioritizing his attention.

Parem ja turvalisem töökeskkond

Big data analysis, gathered with 3D eye tracking, also gives important insights about what rules and procedures should be improved/changed and what the best practices should be further promoted.  

For example, as an airline company, you can use eye-tracking to identify where most errors occur during extreme weather conditions. You can see if the subjects are looking at or doing something wrong that needs reviewing or if the cockpit instruments are not adequately monitored. 

Consequently, the flight instructor can further improve the training strategy to include data about how practitioners should behave in a context like this one.

Silmajälgimise-lennu simulaator

3D-silma jälgimise rakendamine juhtide ja pilootide koolituses 

The above benefits of training conducted with 3D eye tracking are helpful to jobs where attention and safety are crucial. 

Thus, it can make a difference and change the game in pilot and drivers’ training – two jobs with a high level of risk and responsibility. Not only are you responsible for an impeccable performance at work, but you are also responsible for the lives of others. These are fields where no room for any error is permitted. 

Ja just siin tuleb 3D-silmajälgimine inimese jõudluse parandamiseks.

Kuidas 3D-silmajälgimine parandab juhi koolitust

Major benefits apply when implementing 3D eye tracking for where the trainee is required to multitask while operating the vehicle: controlling the vehicle, assessment of a situation by analyzing essential visual elements, and navigation.

Silmade jälgimine-juhilubade-koolitus

Pilgujälgimine-juhi-koolitusJärelikult võimaldab pilgu mõõtmise analüüs – mis on juhtide puhul enamasti seotud tähelepanu hajutamise ja unisusega –:

  • muuta paremaks sõiduohutusprotseduuride väljatöötamisel;
  • parandada tulevasi koolituste aruandlusi koolitatavatega.

Kuidas 3D-silma jälgimine piloodikoolitust mõjutab

By combining eye gaze tracking with a real-world situation, like the cockpit of a plane, you can assess in real-time how the trainee is taking in information about his surroundings, gather data about the human behavior in real situations and about alertness and performance indicators, data to which you do not have access to during a formal pilot training.

Silmajälgimise-lennu simulaator

And by having real-time access to this data and further analyzing it, pilot instructors gain actionable insights, which helps them to:

  • parem understand contextual naturalistic pilot behavior and situational awareness (SA) – kuidas praktikant reageerib loomulikult tehniliste raskuste tõrkeotsingule, halbades ilmastikutingimustes lendamisele või hädaolukordade lahendamisele;
  • pakkuma evidence-based personalized evaluation or correction of the pilot’s skills ja pädevused;
  • parandada koolitusprotseduure ja -meetodeid – you can better present information as an instructor – be more effective, and offer exactly the needed info.

Kokkuvõte: 3D-silma jälgimise kasutamine treeninguseadetes

3D eye tracking enables, in the end, better nonverbal communication between instructors and pilot crews/drivers/trainees. 

Without any words and only by gaze, students offer valuable feedback on how the training can be better conducted, according to their needs, what are the critical areas of interest (when talking about cockpit simulations), and how can the most relevant information be presented at the most appropriate time.

Selle struktureeritumalt tuvastamiseks 3D-silma jälgimise abil on eelised järgmised:

    • improved instructional materials from the early stages of training. Having all the evidence from previous training sessions, you can improve the way you display information, and you know what areas should be highlighted or insisted upon;

    • üldiselt paranenud treeningkeskkond, based on prior experience with 3D eye tracking training;

    • inimlike vigade varajane ennustamine ja ennetamine;

    • üldiselt palju turvalisem lendamine või sõidukogemus/teenus, kus pole ruumi vigadele ja õnnetustele

It is safe to say that 3D eye tracking is an upgrade for the training environment, reducing training hours costs and improving employees’ efficiency and transportation safety parameters.

👉 Get in touch, and we’ll help you use 3D eye tracking to improve your simulator training programs.