WO2015143530A1

WO2015143530A1 - Method for performing an objective evaluation of a simulation performed by user of a simulator

Info

Publication number: WO2015143530A1
Application number: PCT/CA2014/000332
Authority: WO
Inventors: Eric MANSEAU; Dac Toan HO
Original assignee: Cae Inc.
Priority date: 2014-03-26
Filing date: 2014-04-04
Publication date: 2015-10-01

Abstract

The present disclosure relates to a method and system for performing an objective evaluation of a simulation performed by a trainee on a simulator. The method and system comprise receiving at a simulator a plurality of simulation steps, each simulation step comprising at least one event and at least one objective, and storing the simulation steps in a memory of the simulator. The method and system further execute a simulation code to perform a simulation including the simulation steps. The method and system also collect in real time simulation data for each of the events, and process in real time the collected simulation data to determine a value of the at least one event for each of the simulation steps. The method and system further compare the value of the at least one event for each of the simulation steps with the at least one objective, and determines objective evaluation results of the simulation based on the comparison of the values of the events with the at least one objective.

Description

METHOD FOR PERFORMING AN OBJECTIVE EVALUATION OF A SIMULATION PERFORMED BY USER OF A SIMULATOR

TECHNICAL FIELD

[0001] The present disclosure relates to the field of simulators. More specifically, the present disclosure relates to a method and a system for performing objective evaluation results of a simulation performed by a simulator.

BACKGROUND

[0002] Flight simulators are used by commercial airlines and air forces to train their pilots and crews to face various types of situations. A simulator is typically adapted for and capable of simulating various functionalities of an aircraft, and of reproducing various operational conditions of a flight (e.g. takeoff, landing, hovering, etc.).

[0003] A particular simulation scenario executed by the simulator is generally hardcoded in the simulator, and consists of a set of pre-determined simulation steps performed by the simulator. The results of the simulation scenario are exported as a log file comprising simulation data and corresponding times of occurrence for the simulation data. The evaluation of a trainee who has performed the simulation scenario is based on an interpretation of the log file by an instructor, and on visual subjective observations performed by the instructor during the simulation.

[0004] One issue related to the evaluation is its subjectivity, since two different instructors may make different visual observations and interpret the same log file differently. Another issue related to the simulation scenario is its lack of flexibility, since a particular simulation scenario may only be varied by having the instructor manually introduce new challenges for the trainee in the course of the simulation. Furthermore, it is not possible to evaluate objectively a trainee's progress and difficulties, since the evaluation is only based on the log file currently at hand, for which an interpretation by an instructor is completely subjective.

[0005] Therefore, there is a need for a method and a system for performing an objective evaluation of a simulation performed by a user of a simulator.

SUMMARY

[0006] According to a first aspect, the present disclosure provides a method for performing an objective evaluation of a simulation performed by a trainee on a simulator. The method comprises receiving at a simulator a plurality of simulation steps, each simulation step comprising at least one event and at least one objective. The method further stores the simulation steps in a memory of the simulator. The method then executes a simulation code by a processor of the simulator to perform a simulation including the simulation steps. The method also collects in real time by the processor simulation data for each of the events, and processes in real time the collected simulation data to determine a value of the at least one event for each of the simulation steps. The method further compares the value of the at least one event for each of the simulation steps with the at least one objective and determines objective evaluation results of the simulation based on the comparison of the values of the events with the at least one objective.

[0007] In a particular aspect, the present disclosure relates to a system for performing an objective evaluation of a simulation performed by a trainee on a simulator. The system comprises an input, a memory, a simulator, a flight data recorder and an evaluator module. The input receives a plurality of simulation steps, each simulation step comprising at least one event and at least one objective. The memory stores the simulation steps. The simulator executes a simulation code to perform a simulation including the simulation steps. The flight data recorder collects in real time simulation data for each of the events. The evaluator module processes in real time the collected simulation data to determine a value of the at least one event for each of the simulation steps. The evaluator module also compares the value of the at least one event for each of the simulation steps with the at least one objective. The evaluator module further determines objective evaluation results of the simulation based on the comparison of the values of the events with the at least one objective.

BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Embodiments of the disclosure will be described by way of example only with reference to the accompanying drawings, in which:

[0009] Figure 1 illustrates a method for performing an objective evaluation of a simulation performed by a user of a simulator;

[0010] Figure 2 illustrates a simulation system for implementing the method of Figure 1 ; and

[0011] Figure 3 illustrates a series of exemplary simulation steps used in the method of claim 1.

DETAILED DESCRIPTION

[0012] The foregoing and other features will become more apparent upon reading of the following non-restrictive description of illustrative embodiments thereof, given by way of example only with reference to the accompanying drawings. Like numerals represent like features on the various drawings.

[0013] Various aspects of the present disclosure generally address one or more of the problems related to performing objective evaluation of a simulation performed by a user of a simulator. [0014] Referring now concurrently to Figures 1 and 2, a method 100 for performing an objective evaluation of a simulation performed by a user of a simulator, and a simulation system 200 for implementing the method 100, are represented.

[0015] The simulation system 200 comprises a simulator 210 an evaluator module 220 and a flight data recorder 230. In the present disclosure, the simulator 210 is described as a flight simulator, capable of simulating various functionalities of an aircraft, and of reproducing various operational conditions of a flight (e.g. takeoff, landing, hovering, etc.). However, those of ordinary skill in the art will readily appreciate that the description of a flight simulator is exemplary and is not intended to limit the present disclosure. For instance, the simulator 210 may also consist of any type of vehicle for which training by means of a simulator is preferred, or any type of simulation, which can be used to train people in achieving special tasks. Furthermore, although a single simulator 210 is represented, the simulation system 200 may comprise several simulators 210 concurrently or alternately interacting with the evaluator module 220.

[0016] The simulator 210 comprises a processor 212 and a memory 214.

The processor 212 executes a simulation code (generally stored in the memory 214) for realizing a functionality of the simulator 210. Although a single processor 212 is represented, the simulator 210 may comprise several processors for executing several simulation codes corresponding to several functionalities or sub-functionalities of the simulator 210. Similarly, although a single memory 214 is represented, the simulator 210 may comprise several memories. Additionally, the simulator 210 may comprise several complimentary board cards, each card comprising at least one processor 212 and at least one memory 214, for implementing a specific functionality of the simulator. The processor 212 and the memory 214 may be co-located, or physically separated. The processor 212 and the memory 214 may communicate directly, or indirectly through a network such as an intranet, Ethernet, Internet, etc., either in a wired or wireless manner.

[0017] The simulator 210 comprises an input / output (I/O) unit for exchanging data with other entities, for example with the evaluator module 220. The I/O unit supports at least one communication protocol, such as Ethernet or Wireless Fidelity (Wi-Fi). The I/O unit further receives simulation steps, including events and objectives, discussed in further detail later. The simulator 210 also comprises one or several displays for displaying simulation data, and one or several user interfaces allowing interactions with users (also referred as trainees throughout the present description) and / or instructors. The user interfaces may include traditional computer user interfaces (e.g. keyboard, mouse, touch screen, etc.), as well as dedicated simulation user interfaces (e.g. switches, simulation command controls, joysticks, etc.). The simulator 210 further comprises dedicated hardware components interacting with the processor 212. For example, the processor 212 receives data from simulated physical components, such as for example a sensor, and the simulation code executed by the processor 212 processes the received data. The processor 212 also transmits data generated by the execution of the simulation code to one or several displays. Additionally, the processor transmits commands generated by the execution of the simulation code to one or several actuators (e.g. mechanical, pneumatic or hydraulic actuator). The simulator 210 may comprise additional components not represented in Figure 2 for simplification purposes.

[0018] The evaluator module 220 comprises a processor 222 and a memory (not represented in Figure 2 for simplification purposes). The processor 222 executes an evaluation code (generally stored in the memory of the evaluator 220). The role of the evaluation code will be detailed later when describing the method 100. Although a single processor 222 is represented, the evaluator 220 may comprise several processors. For example, several processors 222 may execute several instances of the evaluation code in parallel, each instance of the evaluation code processing data transmitted by a different simulator 210. Alternatively, a single processor 222 may execute several instances of the evaluation code in parallel, each instance of the evaluation code similarly processing data transmitted by a different simulator 210. In both cases, a single evaluator module 220 is capable of processing data transmitted by several simulators 210. The evaluator 220 may also comprise several memories.

[0019] The evaluator module 220 may comprise additional components not represented in Figure 2 for simplification purposes. The evaluator module 220 comprises an I/O unit for exchanging data with other entities, for example with the flight data recorder 230 and a tablet. The I/O unit supports at least one communication protocol, such as Ethernet or Wireless Fidelity (Wi-Fi). The evaluator module 220 also comprises a display, and one or several user interfaces (e.g. keyboard, mouse, touch screen).

[0020] Although shown as separate entities of the simulator 210, the evaluator module 220 and the flight data recorder 230 can be co-located with the simulator 210, integrated within the simulator 210, or physically independent of the simulator 210.

[0021] The method 100 comprises receiving 110 at the simulator 210 simulation steps. A simulation step corresponds to a particular phase of a simulation, where specific actions must be taken by a trainee in reaction to specific conditions presented to him/her by the simulator 210. A simulation is usually divided into a series of steps, starting at an initial step and leading to a final step, through intermediate steps. Alternatively, a simulation may include a single step, in order to concentrate the training on this particular single step. Although future examples will be given for a flight simulator, the present disclosure is not limited to such a type of simulator, and the flight simulator is used only for example purposes. In the context of an aircraft simulator, simulation steps include: airplane at a specific altitude range (e.g. 100 to 500 feet, 20 to 100 feet, below 20 feet), descent, climbing, runaway approach, airplane landing, airplane taxiing, airplane takeoff, etc.

[0022] The simulation steps may be modified and/or bonified via one of the user interfaces operated by an instructor. Alternatively, the simulation steps may be received by the simulator 210 via its I/O unit from a computing device (not represented in Figure 2), where they have been modified and/or bonified by an instructor.

[0023] Each received simulation step comprises at least one event and at least one objective. An event has a value that can be objectively validated and/or measured, and compared to a range of acceptable values. One or several events are used in defining each measurable objective. An event may thus consist of an action to be taken by the trainee, a series of actions which must be taken in a specific order by the trainee, one or several parameters which may be met by the trainee during one of the simulation steps, etc. For example, if the event consists of an action, that action must be measurable (and/or validated) in at least one way, such as for example: speed of execution of the action, delay before starting the action, intensity of the action, etc. For each event, a Key Performance Indicator (KPI) is assigned to the event by an instructor or as a default value. The KPI corresponds to the expected actions and values. Each KPI may also be accompanied by a set of deviation values (low, medium and high). Each deviation value corresponds to a range of values which corresponds in the context of the event to be measured to measurable and quantifiable measurements. The action is validated if a trainee performing the simulation step has taken the action in accordance with the established range of acceptable values. If the trainee succeeds in meeting the KPI values, the objective of the simulated training has been met, if the trainee performs within the ranges of the low deviation range of established values, the performance is rated as low variation. The same method of assignment of rating is applied to the medium and high deviation results. [0024] In the context of an aircraft simulation, examples of actions include: autopilot engaged, autopilot disengaged, flaps movements, altitude of the aircraft, speed of the aircraft, motor extinction, motor restart, fuel drop, etc. In the context of an aircraft simulation, measurements include: altitude, bank angle, deviation from a glideslope path, deviation from a localizer path, tailwind, pitch angle, pitch rate, power setting, airspeed, etc. A measurement may have a single value, or a range of values. An event may further consist of a combination of action(s) and measurement(s). Thus, a simulation step may include any number of event(s), and each event may include any number of action(s) associated with any number of measurement(s). A given simulation step may comprise no events and objectives, in the case where it is only a necessary transitory step between a previous step (with event(s) and objective(s)) and a next step (with event(s) and objective(s)) in a series of simulation steps. Examples of simulation steps, events and objectives will be given later in the description with reference to Figure 3.

[0025] The method 100 comprises storing 120 the simulation steps in the memory 214 of the simulator 210. The method 100 comprises executing a simulation code by the processor 212 of the simulator 210 to perform a simulation corresponding to the simulation steps stored in the memory 214. The simulation code may consist of a plurality of software modules stored in the memory 214. A plurality of simulation parameters may also be stored in the memory 214. In the context of an aircraft simulator, one or several functionalities of the aircraft may be simulated for each particular simulation step. Such functionalities include simulating operation of: the engines, the landing gear, the pilot display, the wings, the pneumatics, the displays, the brakes, the electrical circuits, radio, etc. Thus, for each particular simulation step, the processor 212 executes specific software modules corresponding to the functionalities simulated during this particular simulation step. Furthermore, the processor 212 uses specific simulation parameters corresponding to the particular simulation step for executing the software modules. For example, the specific simulation parameters may include: specific values of the external air pressure, of the external temperature, and of the wind speed for each particular simulation step, icing convolution, combination of simulation parameters, and actions resulting in causing another problem other than external parameters, etc.

[0026] The method 100 comprises collecting 140 in real time simulation data by the processor 212 for each of the events. The simulation data is a combination of data generated by the execution of the simulation software in response to a trainee's actions, and measurements of the trainee's actions or consequences of the trainee's actions.

[0027] The method 100 further comprises processing 150 in real time the collected simulation data to determine value(s) for each event. Determination of the value of an event may consist in determining the value of the action(s) of the trainee and / or measurement(s) of the consequences of the action(s) of the trainee with respect to the event. As the collection of the simulation data and the processing of the collected simulation data are performed in real time, the collected simulation data and the determination of the value(s) of each event is performed as the simulation code is executed, during execution of the simulation steps. By collecting the simulation data and determining value(s) of each event in real time, it is thus possible to determine the progression of the trainee with respect to the objectives, in real time, and then stop a simulation and repeat one of the simulation steps until a trainee meets the set objective.

[0028] In the embodiment illustrated in Figure 2, the evaluator module

220 is a standalone entity. The processor 222 of the evaluator module 220 executes an evaluation code for processing the simulation data transmitted by the simulator 210, and determining the values of the event(s). The simulations steps, comprising the event(s) and the objective(s), are transmitted by the simulator 210 to the flight data recorder 230, which bundles the data into flight data provided to the evaluator module 220. Alternatively, the simulation steps (including the events and objectives), could be inputted in the evaluator module 220 instead of the simulator 210. In this embodiment, the simulation steps could be provided for storage together with the simulation data to the flight data recorder 230 by the evaluator module 220, or stored only in the memory of the evaluator module 220. The evaluator module 220 uses the definition of the simulation steps, and of the event(s) of each simulation step, to adequately process the simulation data to determine the value of the event(s). The simulation data and simulation steps (comprising the event(s) and the objective(s)) may transmitted from the simulator 210 to the evaluator module 220 via their respective I/O units (not shown).

[0029] In an alternative embodiment not represented in the Figures, the evaluator module 220 is integrated to the simulator 210. For instance, the processor 222 is integrated to the simulator 210. Thus, the evaluation code executed by the processor 222 has a direct access to the simulation steps (comprising the event(s) and the objective(s)) stored in the memory 214. The evaluation code executed by the processor 222 also has a direct access to the simulation data generated by the execution of the simulation code by the processor 212. The generated simulation data can be stored in the memory 214 for easy access at any time by the evaluation code executed by the processor 222. In still another alternative embodiment, the processor 212 of the simulator 210 may be capable of executing both the simulation code and the evaluation code.

[0030] Reverting to Figure 1 , the method 100 further comprises comparing 160 value(s) of the event(s) for the undergoing simulation step with the at least one objective for that simulation step. Comparing the value of the event(s) with the objective to be achieved by the trainee during a particular simulation step may consist in comparing the value of the action(s) and / or measurement(s) of the event with a corresponding objective, also called KPI. Thus one objective or KPI of one simulation step may include one or several measurements of actions of the trainee during that particular simulation step. Alternately, the objective or KPI of one simulation step may include one or several measurements of consequences of actions of the trainee during that particular simulation step. Additionally, one objective or KPI could include both measurements of actions of the trainee and measurements of consequences of actions of the trainee during the simulation step. To exemplify both the measurements of the actions of the trainee and the measurements of the consequences of the actions of the trainee for a simulation step, the following example will be used. In that example, the measurements of the actions of the trainee and the consequences of the actions of the trainee are measured for an instance of simulation of breaking of an aircraft. The measurement of the action of the trainee could include several measurements: time it took the trainee to activate the breaks and pressure applied against the break pedals. The measurement of the action of the trainee could include one or several measurements: distance required to stop the aircraft, time required to stop the aircraft, etc. For both types of measurements, the comparison is performed between the measurement value(s) (based on the simulation data i.e. the breaks have effectively been deployed or not at a particular time during the simulation step, and the objective for this particular simulation step). In a second example, the measurement(s) may consist in the measurement of a pitch angle. The comparison may be performed between the value of the measurement determined by the simulation data (the pitch angle has a specific value or range of values at a particular time in the simulation step), and the objective or PKI of the measurement (the pitch angle shall have a specific value or range of values at this particular time in the simulation step). In the embodiment illustrated in Figure 2, the comparison of the value(s) of the event(s) with the objective(s) for that particular simulation step is objectively performed by the evaluation code executed by the processor 222 of the evaluator 220. The objective or KPI also includes three-levels of deviations. The levels of deviations provide indications as to the measurable actions that were taken by the trainee outside of the objective. The levels are incremental, and divided in low deviation, medium deviation and high deviation. For example, a low level of deviation could correspond to non-optimal measurable actions, a medium level of deviation to abnormal measurable actions and a high level of deviation to unacceptable measurable actions.

[0031] Finally, the method 100 further comprises determining 170 objective evaluation results of the simulation performed by the trainee based on the comparison of the measurements values performed for the events to the at least one objective. In the embodiment illustrated in Figure 2, the determination of the objective evaluation results is performed by the evaluation code executed by the processor 222 of the evaluator module 220.

[0032] The objective evaluation results may be displayed to the trainee and / or the instructor on a display of the evaluator module 220. Alternatively, the evaluation results may be transmitted via the I/O unit of the evaluator 220 to a computing device (not represented in Figure 2), for further consultation by the trainee and / or the instructor.

[0033] The flight data recorder 230 stores flight data corresponding to a particular simulation performed by a particular trainee. The flight data may be transmitted by the simulator 210 via its I/O unit. The flight data recorder 230 may be a standalone computing device capable of receiving (and sending) and storing information (e.g. a computer or a network-attached storage (NAS) device). Alternatively, the functionality of the flight data recorder 230 may be integrated in the evaluator module 230, in the form of a permanent memory such as a disk. The flight data include any combination of: an identification of the trainee who performed the simulation, the simulation data, the simulation steps (including the events and objectives), the determined values of the events for each of the simulation steps, and the evaluation results. The objective evaluation results could further be stored for future reference, for ensuring constant progress, and for establishing a trend of a trainee's performances.

[0034] Although not shown in Figure 1 , the method 100 could also comprise interrupting the execution of the simulation code executed by the processor 212 of the simulator 210 after a particular simulation step has been performed (this step of the method 100 is not explicitly represented in Figure 1 for simplification purposes) or during execution of one of the simulation steps. As previously mentioned, the evaluation code executed by the processor 222 of the evaluator module 220 determines in real time the evaluation results for this particular simulation step (based on the simulation data corresponding to this particular simulation step transmitted in real time from the simulator 210 to the evaluator 220). The execution of the simulation code by the processor 212 may be resumed from the particular simulation step where it was interrupted. Alternatively, the processor 212 may repeat the execution of the simulation code for the particular simulation step. Although the simulation is paused or resumed during the execution of the simulation step, the objective evaluation are determined for the paused and/or resumed simulation step by the evaluation code executed by the processor 222 of the evaluator module 220 so as to be able to monitor progress of repeated simulation steps within the same simulation.

[0035] The pause/resume functionality allows an instructor to debrief in real time with a trainee the evaluation results of a particular simulation step or a series of particular simulation steps. For example, a simulation comprising a series of simulation steps may be executed and interrupted step by step by the simulator 210, and the corresponding evaluation results generated by the evaluator module 220 debriefed step by step in real time. Thus, the instructor may identify one (or several) simulation step(s) where the evaluation results of the trainee are not satisfying, and may repeat this simulation step until the evaluation results become satisfying.

[0036] In addition to the pause/resume functionality, the method further provides for modifying 180 in real time at least one of an event or an objective of a particular simulation step. For instance, the real time modification may render the particular simulation step more difficult or easier. This allows an adaption of the simulation to a specific experience level of a specific trainee. This also allows an increase /decrease of the level of difficulty of the simulation during the execution of the simulation step. To render the simulation more difficult, additional events may be added and / or objectives of existing events may be made more difficult to meet. To render the simulation easier, existing events may be deleted and / or objectives of existing events may be made less stringent.

[0037] The real time modification 180 may be performed by the instructor via a user interface of the simulator 210, and the resulting modifications to the events and / or objectives are stored in the memory 214. Alternatively, the real time modifications 180 may be transmitted from a computing device to the simulator 210 via its I/O unit, and stored in the memory 214, or by means of the tablet.

[0038] Referring now to Figure 3, a series of three exemplary simulation steps is represented.

[0039] The three exemplary simulation steps correspond to the simulation of some of the final steps of the landing of an aircraft.

[0040] The first simulation step corresponds to the descent when the altitude is between 100 and 20 feet. A first event consists in an action: the deployment of the speed breaks. A second event consists in a measurement: the measurement of the bank angle. The corresponding objective or KPI of the simulation step are to have the speed breaks deployed by a certain time of the simulation step, and to have the bank angle bellow a given value. Examples of deviation values are also provided.

[0041] The second simulation step corresponds to the runaway approach. A single event consists in an action and a measurement. The action consists in the engagement of the autopilot. The corresponding objective is to have the autopilot not engaged at this simulation step. The measurement consists in the measurement of the glideslope deviation. The corresponding objective or KPI is to have the glideslope deviation bellow a given value at this simulation step. Incremental deviation values are also provided.

[0042] The third simulation step corresponds to the airplane landing. A single event consists in two measurements. The first measurement consists in the measurement of the taiiwind. The corresponding objective or KPI is to have the taiiwind bellow a given value at this simulation step. The second measurement consists in the measurement of the pitch angle. The corresponding objective is to have the pitch angle within a given range at this simulation step. The KPI may thus include several concurrent measurement values, and corresponding deviation ranges of values.

[0043] Now referring back to Figures 1 and 2, in a particular aspect, a mobile computing device such as a tablet is used to implement several functionalities of the method 100. In the following, the term tablet is used for simplifications purposes, but is meant to include any mobile computing device with the following capabilities: a processor, a memory, an I/O unit, a display, a user interface, and a form factor allowing easy transport and manipulation.

[0044] The tablet may be connected to the simulator 210 via their respective I/O units, using a mobile networking protocol such as Wi-Fi or cellular. The connection is secured, unique and temporary; in order to protect the confidentiality of the data stored in / generated by the simulator 210. The tablet may be used to select and/or modify the simulation steps (including the events and objectives) received by the simulator 210 at step 110 of the method 100. The selected simulations steps (including the events and objectives) are transmitted via the secured connection established between the tablet and the simulator 210. Similarly, the tablet may be used to modify in real time the simulation steps (including the events and objectives) of the simulator 210 as per step 180 of the method 100. The tablet may also be used to perform the following functionalities of the method 100 (not represented in Figure 1 ): interrupting the execution of the simulation code by the processor 212 of the simulator 210 after a particular simulation step (or a series of particular simulation steps) has been performed; and resuming the execution of the simulation code by the processor 212 from the particular simulation step (or series of particular simulation steps) where it was interrupted or repeating the execution of the simulation code for the particular simulation step (or series of particular simulation steps). For this purpose, the simulator 210 informs in real time the tablet about the current state (e.g. started, in-progress, finished) of the simulation step currently performed by the execution of the simulation software by the processor 212. The simulator 210 may further forward to the table the collected simulation data and the determination of the objective evaluation results in real time so as to allow objective real-time brief/debrief capability to the instructor.

[0045] The tablet may also be used by an instructor to control and synchronize a simulation performed in parallel by several trainees on several simulators 210. The simulation steps (including the events and objectives), and the execution of the simulation code according to the simulation steps, are managed as previously explained via the tablet for the several simulators 210 operating in parallel.

[0046] The tablet may also receive all or a portion of the simulation data generated by the execution of the simulation code by the processor 212 of the simulator 210, either directly or through the flight data recorder 230 and the evaluator module 220. Thus, a visual representation of the undergoing simulation may be played in 'quasi' real time on the tablet, while it is being executed on the simulator 210 and performed by a trainee. Based on the quantity and accuracy of the simulation data received on the tablet, and based on the computing and display capabilities of the tablet, the simulation played on the tablet may be a simplification of the simulation executed by the simulator 210. For instance, the simulation played on the tablet may represent an aircraft on a two dimension and / or three dimensions map, and display essential flight parameters and aircraft functionalities. Alternatively, a simulation which occurred previously may be replayed on the tablet based on the corresponding simulation data (which have been received and stored on the tablet), while a new simulation is being played on the simulator 210.

[0047] The tablet is also be connected to the evaluator module 220 via their respective I/O units, using a mobile networking protocol such as Wi-Fi or cellular. The connection is secured, unique and temporary; in order to protect the confidentiality of the data stored in / generated by the evaluator module 220. The evaluation results generated by the execution of the evaluation code by the processor 222 of the evaluator module 220 may be transmitted to the tablet via the secured connection established between the tablet and the evaluator module 220. The evaluation results are presented on the display of the tablet in an appropriate format, to allow an analysis and debriefing of the results by an instructor. The tablet may store in a secure manner all the evaluation results generated over time for a specific trainee, allowing a comparison of the performances of the trainee over time. The tablet may ensure the confidentiality of the evaluation results on a per trainee basis, by individually protecting the evaluation results of each trainee.

[0048] In a particular embodiment, the evaluator module 220 may be implemented by the tablet. Similarly, the flight data recorder 230 may also be implement by the tablet. In another embodiment, the evaluator module 220 and the flight data recorder 230 are implemented by a single tablet. Furthermore, in still another embodiment, the single tablet may also include functionalities for controlling the execution of the simulation according to the simulation steps by the simulator 210, as previously described.

[0049] Although the present disclosure has been described hereinabove by way of non-restrictive, illustrative embodiments thereof, these embodiments may be modified at will within the scope of the appended claims without departing from the present disclosure.

Claims

WHAT IS CLAIMED IS:

A method for performing an objective evaluation of a simulation performed by a trainee on a simulator, the method comprising:

receiving at a simulator a plurality of simulation steps, each simulation step comprising at least one event and at least one objective;

storing the simulation steps in a memory of the simulator; executing a simulation code by a processor of the simulator to perform a simulation including the simulation steps;

collecting in real time by the processor simulation data for each of the events;

processing in real time the collected simulation data to determine a value of the at least one event for each of the simulation steps; comparing the value of the at least one event for each of the simulation steps with the at least one objective; and

determining objective evaluation results of the simulation based on the comparison of the values of the events with the at least one objective.

The method of claim 1 , wherein each simulation step corresponds to a particular aptitude of the trainee to be evaluated.

The method of claim 1 , wherein each event is one of the following: an action, a measurement, a consequence of an action and/or measurement, and a combination thereof.

The method of claim 3, wherein the value of the action consists in a determination that the action has been taken or not at a specified time in the simulation step.

5. The method of claim 3, wherein the measurement is one of the following: a time to perform an action, a delay between two consecutive actions, and a pressure applied by the trainee.

6. The method of claim 5, wherein the objective consists in a specific value or a specific value or range of values for the measurement.

7. The method of claim 1 , wherein one objective may include several events for a specific simulation step.

8. The method of claim 1 , further comprising interrupting the execution of the simulation code during or after execution of a particular simulation step to assess with the trainee the objective evaluation results of the particular simulation step.

9. The method of claim 8, comprising resuming the execution of the simulation code from the particular simulation step where it was interrupted.

10. The method of claim 9, further comprising: repeating the execution of the simulation code for the particular simulation step.

11. The method of claim 1 , further comprising: interrupting the execution of the simulation code after a series of particular simulation steps has been performed to assess the determined objective evaluation results of the series of particular simulation steps.

12. The method of claim 1 , comprising modifying in real time at least one of an event or an objective of a particular simulation step.

13. The method of claim 12, wherein the real time modification renders the particular simulation step more difficult or easier.

14. A system for performing an objective evaluation of a simulation performed by a trainee on a simulator, the system comprising:

a simulator for executing a simulation code to perform a simulation including the simulation steps, the simulator including:

an input for receiving a plurality of simulation steps, each simulation step comprising at least one event and at least one objective; and

a memory for storing the simulation steps;

a flight data recorder for collecting in real time simulation data for each of the events; and

an evaluator module for:

processing in real time the collected simulation data to determine a value of the at least one event for each of the simulation steps;

comparing the value of the at least one event for each of the simulation steps with the at least one objective; and

15. The system of claim 14, wherein the simulator, the flight data recorder and the evaluator module are co-located.

16. The system of claim 15, wherein the simulator and the flight data recorder are co-located.