[go: up one dir, main page]

WO2020196818A1 - Cell culturing education system and method - Google Patents

Cell culturing education system and method Download PDF

Info

Publication number
WO2020196818A1
WO2020196818A1 PCT/JP2020/013940 JP2020013940W WO2020196818A1 WO 2020196818 A1 WO2020196818 A1 WO 2020196818A1 JP 2020013940 W JP2020013940 W JP 2020013940W WO 2020196818 A1 WO2020196818 A1 WO 2020196818A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
posture
protocol
movement
training
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2020/013940
Other languages
French (fr)
Japanese (ja)
Inventor
秀輝 種村
幸司 小出
モハマッド ガジザデ
泰寛 能勢
陽一朗 西野
千草 下川
真帆 今井
闊 陳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Biomimetics Sympathies Inc
Original Assignee
Biomimetics Sympathies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2020053979A external-priority patent/JP2020166264A/en
Application filed by Biomimetics Sympathies Inc filed Critical Biomimetics Sympathies Inc
Publication of WO2020196818A1 publication Critical patent/WO2020196818A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • CCHEMISTRY; METALLURGY
    • C12BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12MAPPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS
    • C12M1/00Apparatus for enzymology or microbiology
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes

Definitions

  • the present invention relates to an education system and an education method for acquiring and mastering a technique related to stem cell culture, and particularly to an education system and an education method to which a virtual reality (VR) technique is applied.
  • VR virtual reality
  • xR augmented reality
  • MR mixed reality
  • the clean room is a limited space, it is difficult to practice various operations in cell isolation and culturing due to the capacity of the clean room.
  • the clean room is a limited space, and the work in the clean room, which is a limited space, is limited to 3 hours due to the relationship between tension and continuous concentration. Therefore, it is difficult to practice the work performed in the clean room for 3 hours or more due to the relationship between the trainee's tension and the maintenance of concentration.
  • various operations in cell isolation and culturing required training for at least about 6 months. However, it is difficult to accept a large number of trainees because a small number of skilled workers need to teach individual trainees on a so-called “one-to-one” basis.
  • the present invention has been proposed in view of the above-mentioned problems of the prior art, and an object of the present invention is to provide a system and a method for acquiring and mastering a technique related to stem cell culture by applying virtual reality (VR) technique. There is.
  • VR virtual reality
  • the cell culture education system (100) of the present invention Measuring device (10: glove 1, goggles 2, camera 3, etc.) and control device for measuring the state (position, posture, movement, etc. of subject E's hand) of the subject (E: inexperienced in stem cell culture technology)
  • the control device (20) includes (20: control unit CU). From the information from the measuring device (10), the data of the position, posture, and movement of the subject (E) (used to include not only the simple movement but also the work sequence and procedure) is calculated and created, and the image (used.
  • Avatar, alter ego image) calculation and creation function A function to display the image of the subject (E) in virtual reality (VR), From the data (position, posture, movement) based on the protocol of the technology related to stem cell culture, the subject (E) was modified according to (height, age, gender, etc.), and the subject (E) followed the protocol.
  • a function to create data position, posture, motion data: including video) by calculating the position, posture, and motion of the case, It is characterized by having a function of comparing the position, posture, and movement of the subject (E) with the data (position, posture, movement) according to the protocol (in virtual reality or between data).
  • VR virtual reality
  • AR augmented reality
  • VR virtual reality
  • equipment necessary for cell culture for example, clean bench, incubator, etc.
  • instruments for example, flasks, pipettes, etc.
  • reagents for example, microscopes, and other necessary articles. Necessary for everything.
  • AR augmented reality
  • VR virtual reality
  • the real thing can be used for various devices and articles.
  • the control device (20) conforms to the position, posture, movement (or image calculated and created based on the data) of the subject (E), and the protocol. It has a function to warn the subject (E) by stopping the image displayed in virtual reality, for example, when there is a large difference in data (position, posture, movement: or calculation, created image). It is preferable to have it. Further, in the cell culture education system (100) of the present invention, the control device (20) reproduces a work procedure as a model moving image (a moving image showing a model work; a moving image as a model), character information, and voice information. It is preferable to have a function of executing a mode (mode) (scenario mode), a mode (simulation mode) for practicing the subject (E), and a mode (trial mode) for evaluating the subject (E).
  • mode mode
  • the cell culture education method of the present invention A measuring device (10: glove 1, goggles 2, camera 3, etc.) and a control device (10: glove 1, goggles 2, camera 3, etc.) for measuring the state (position, posture, movement of the subject E's hand) of the subject (E: inexperienced in technology related to stem cell culture) 20: Using the system including the control unit CU) (100: the system of claims 1 and 2), The position, posture, and motion data of the subject (E) are calculated and created from the information from the measuring device (10), and the image (avatar, alter ego image) is calculated and created.
  • the image of the subject (E) is displayed in virtual reality (VR), From the data (position, posture, movement) based on the protocol of the technology related to stem cell culture, it is modified according to the subject (E) (height, age, gender, etc.), and the position when the subject follows the protocol.
  • Posture, motion is calculated to create data (position, posture, motion, etc.), It is characterized by comparing the position, posture, and movement of the subject (E) with the data (position, posture, movement) according to the protocol (in virtual reality or between data).
  • the position, posture, and movement of the subject (E) (or an image calculated and created based on the data) and data according to the protocol (position, posture, movement: or calculation,
  • the protocol position, posture, movement: or calculation
  • various techniques (work or operation) related to cell culture include cell isolation, cell culture (for example, subculture work), wearing gouning (dedicated clothes), washing after wearing, entering and exiting a clean room, and the like. It includes various contents in hygiene control department education, manufacturing control department education, and quality control department education.
  • a mode in which a work procedure is reproduced by a model moving image (a moving image showing a model work; a moving image as a model), text information, and voice information, and a subject. It is preferable to have a step of selecting either the mode for practicing (E) (simulation mode) or the mode for evaluating the subject (E) (trial mode).
  • stem cell culture various contents in hygiene management department education, manufacturing management department education, quality control department education
  • VR virtual reality
  • facilities can be used for training, so the ability to perform necessary processing can be improved. Since it is not necessary to use an actual living body (human body) or facility, there is no limitation on the place where training or education is performed, and it is possible to remove the limitation on the time for training or education. Further, since it is not necessary for the expert to accompany each trainee (subject E) on a one-to-one basis, the time burden on the expert who is insufficient in number is reduced.
  • the training is performed by virtual reality, even if an inexperienced trainee makes a mistake, a serious situation does not occur. Therefore, it does not give excessive tension to immature trainees. Then, since the content of the failure can be recorded and checked by the person who made the failure, the cause of the failure can be analyzed accurately and calmly.
  • the so-called "quality of education” can be made uniform with respect to cell culture without any variation in educational results due to differences in teaching skills and educational skills among individual leaders and experts.
  • the cell culture engineer can be efficiently educated, the time required for the education of the cell culture technology is not prolonged, and it is not necessary to increase the place or equipment required for the education. (For example, the time of a skilled person must be spent for the education of beginners) can be reduced, which is advantageous in performing cell culture as a business.
  • the work is strictly defined according to a strictly defined protocol for cell culture, for example, when cell isolation occurs, not only the tissue from which the cell was isolated but also the isolated cell is damaged. Will not be given. Therefore, it is prevented that the isolated cells are damaged and cannot be cultured.
  • the fluctuation for each case is small, and in many cases the same movement is performed in the same procedure. You can expect good skill.
  • SOP Standard Operation Program
  • the present invention since it is possible to become proficient in the work according to the strictly defined protocol, contamination by foreign substances (contamination by foreign substances) when a person who has received the education (training) of the present invention carries out the cell culture process ( Contamination) is less likely to occur. Then, if necessary, training using virtual reality for various tasks in the clean room, such as wearing downing (special clothes), cleaning after wearing, procedures for entering the clean room, and procedures for exiting the clean room. Can be done, further reducing the possibility of contamination. In addition, it is possible to improve the quality of engineers by providing high-quality education (or training) for all of the various contents in hygiene management department education, manufacturing control department education, and quality control department education.
  • a mode (mode) (scenario mode) in which a work procedure is reproduced by a model moving image (a moving image showing a model work; a model moving image), text information, and voice information, and a subject
  • mode scenario mode
  • a model moving image a moving image showing a model work; a model moving image
  • text information a subject
  • voice information a subject
  • a mode for practicing E simulation mode
  • the mode for evaluating the subject (E) (trial mode) it is efficient according to the proficiency level of the subject (E).
  • the cell culture education system according to the embodiment is indicated by reference numeral 100 as a whole, and is in a state of subject E (an unskilled person who receives education in the system according to the embodiment) (for example, the hand of subject E). It has a measuring device 10 (in the example of FIG. 1, a glove 1, goggles 2, a camera 3) and a control device 20 (control unit) for measuring a position, an attitude, an operation, etc.).
  • a measuring device 10 in the example of FIG. 1, a glove 1, goggles 2, a camera 3
  • control device 20 control unit for measuring a position, an attitude, an operation, etc.
  • the measuring device 10 includes gloves 1 (left-handed gloves 1A, right-handed gloves 1B), goggles 2, and a camera 3 worn by subject E during training (during attendance) by the system 100, and includes gloves 1A, 1B, and goggles. 2.
  • the camera 3 is connected to the control unit 20 via signal lines SL1-1A, SL1-1B, SL1-2, and SL1-3, respectively.
  • Information on the position and movement of the hand of subject E is input to the control unit 20 from the gloves 1A and 1B, and information on the position of the face of subject E, the direction in which the subject is facing, the movement, the direction of the line of sight, etc. is input from the goggles 2. It is input to the control 20.
  • the camera 3 captures the position, posture, and movement of the whole body of the subject E, and the information (information on the position, posture, and movement of the whole body of the subject E: including video or video) is input to the control unit 20.
  • the cell culture education system 100 has a display device 4 (monitor), and the display device 4 is connected to the control unit 20 via the signal line SL18.
  • the signal lines SL1-1A, SL1-1B, SL1-2, and SL1-3 may be wired or wireless.
  • the control unit 20 acquires information on the position (for example, the position of the hand), the posture, the movement, and the like of the subject E under training from the gloves 1 (1A, 1B), the goggles 2, the camera 3, and the like of the measuring device 10. Then, the avatar (image, alter ego image) on VR (virtual reality) is calculated and created. Then, the control unit 20 transmits the avatar of the subject E to the goggles 2 by the signal line SL1-2, and displays the avatar on the VR. At the same time, the avatar of the subject E is transmitted to the display device 4 via the signal line SL18, and the avatar of the subject E is displayed on the VR displayed by the display device 4. In FIG.
  • a VR that is, a virtual reality moving image or video that subject E is experiencing
  • the VR is the position, posture, and whole body of subject E's hand.
  • This is a VR related to the movement of the subject E, which is visually recognized and experienced by the subject E with the goggles 2.
  • the VR in reference numeral A is also displayed on the display device 4 for reference by the supervisor, the instructor, and the like.
  • an image of the work of isolating adipose tissue is shown in the range shown by region A.
  • the adipose tissue is aspirated or partially excised by surgery in a medical institution and brought into a cell culture institution (CPC: not shown) in a syringe-like or examiner-like container.
  • CPC cell culture institution
  • the stem cells are then isolated using a device such as a reagent or a centrifuge.
  • a video of the work of isolating subcutaneous fat from the human body H using a syringe-shaped instrument T is shown in the region A of FIG.
  • the stem cell culturing operation is performed in a so-called "clean bench” and is displayed in VR or AR to reproduce the operation in the green bench.
  • the avatar of the hand (glove 1A, 1B) of the subject E in VR is displayed.
  • control unit 20 see FIG. 2 of the control unit 20 (control device: see FIG. 2)
  • reference positions for example, hand positions, etc.
  • postures, movements, etc. are previously set for each of various cell culture operations. It is saved as data (including video).
  • data including video
  • the correct position, posture, movement, etc. model position, posture, movement, etc.
  • various operations of cell culture include cell isolation, cell culture, wearing gouning, washing washing, entering and exiting a clean room, and the like, and cell isolation and cell culture are further divided into multiple steps. Exists.
  • Data position, posture, movement, etc.
  • various work protocols related to cell culture stored in the database 20K are appropriately modified according to the height, age, gender, etc. of subject E and are displayed on VR. Is displayed in.
  • Data position, posture, movement, etc.
  • Data is created by calculating the corrected position, posture, movement, etc. when subject E follows the protocol, and an image (video, moving image) is further created, and the display device 4 Is displayed in VR.
  • Data such as height, age, and gender of subject E are input to the control unit 20 via the input device 5 prior to the education (training).
  • the structure of the program (the structure of the movements constituting the work), the cell culture protocol, the above-mentioned various equipments and instruments (flasks, etc.) used in the training, and the structure and structure.
  • Performance, etc. vary depending on the company or institution that performs cell culture. In the illustrated embodiment, such differences between companies and institutions are dealt with, and customization is made for each company and institution.
  • various equipment, instruments, reagents, materials, etc. are reproduced in actual size, and subject E is equivalent to the actual work. You can get a sense.
  • the data in the virtual reality such as the customized training contents, various equipments and instruments used are stored in the database 20K of the control device 20 (FIGS. 1 and 2) (FIG. 2), and correspond to the protocol and the like. It is configured to be selected and referenced. For example, with respect to equipment, appliances, etc., a plurality of types having different sizes are prepared in virtual reality, and a full-scale VR image corresponding to actual work exists in virtual reality.
  • the position, posture, movement, etc. of the subject E on the VR are compared with the position, posture, movement, etc. according to the protocol, and the difference between the two is obtained. .. Then, it is confirmed whether or not the difference is within the permissible range, and the result of the education is evaluated (for example, pass / fail is determined).
  • the difference between the two is large, not only the judgment of failure is made, but also, for example, the image displayed on the VR is stopped and a warning is given to the subject E on the VR or via the display device 4. Perform necessary processing according to the educational program, such as issuing. As a result, education or training of various movements related to cell culture is performed.
  • the “scenario mode” is a mode (aspect) for teaching subject E by displaying a video showing a model work, that is, a VR video as a model, or playing back a work procedure as text information or voice information.
  • the subject E is a beginner.
  • subject E learns by watching a video or work procedure showing a model work as text information or listening to it as audio information, and subject E performs a work operation in virtual reality. I don't do it.
  • the "simulation mode” is a mode in which the subject E wears the measuring device 10 (left-handed glove 1A, right-handed glove 1B, goggles 2) and performs a work operation or practices in virtual reality. Basically, subjects E who have experienced the scenario mode and can understand the work procedure to some extent are targeted.
  • the subject E can execute the training while receiving the work instruction (work instruction scenario guide) by voice or the like during the training (during the work operation).
  • work instruction scenario guide work instruction scenario guide
  • the "trial mode” is a mode in which the subject E wears the measuring device 10 (left-handed glove 1A, right-handed glove 1B, goggles 2) and performs the work operation to the end in virtual reality (in principle, it is not interrupted in the middle). , This is an aspect for confirming work proficiency.
  • the subject E who has experienced the scenario mode and the simulation mode is basically targeted.
  • pass / fail judgment and score evaluation are performed by comparing with the position, posture, movement, etc. according to the protocol.
  • the input device 5 has a mode switching block 5A having a function of selecting a mode, and when performing training, the subject E selects one of the three modes via the input device 5. You can choose.
  • a person other than the subject E can select the mode by the input device 5.
  • the selection or switching of "scenario mode”, “simulation mode”, and “trial mode” in the training, the contents and procedures of each mode, and the like will be described later with reference to FIG. 7.
  • the education (training, learning) carried out in the illustrated embodiment is aimed at acquiring and mastering the technique related to stem cell culture, and the data according to the protocol related to stem cell culture (position so as to serve as a model). (Including data such as posture, movement, and image) is set.
  • the protocol related to stem cell culture includes data such as posture, movement, and image.
  • the cells are isolated from fat, umbilical cord, umbilical cord blood and the like.
  • the cells are isolated around the capillaries, which can cause significant damage to both the isolated cells and (a part of) the human body from which the cells are isolated. It is necessary to take great care to isolate cells from around the capillaries so that they do not.
  • a strict protocol is defined so that it is possible to carry out the work in substantially the same procedure even if there are individual differences, and thus the risk is reduced. Therefore, as compared with surgery and the like, the movements and the like according to the protocol in various operations are made uniform according to the same procedure. Therefore, when creating virtual reality (VR), it is sufficient to create it according to SOP (Standard Operation Program).
  • VR virtual reality
  • SOP Standard Operation Program
  • the main purpose is to master uniform movements and the like according to the same procedure, so training using virtual reality is efficient.
  • Various operations related to cell culture include operations for culturing cells.
  • the operation according to the protocol is calculated and created so that the cultured cells are not completely destroyed due to contamination by foreign substances, for example.
  • training using virtual reality is also provided for wearing gouning (special clothing), cleaning after wearing, procedures for entering and exiting the clean room. Is executed. Since the clean room is a limited space here, the above-mentioned work training is limited by the capacity of the cleaning room. However, training using virtual reality does not require the use of an actual clean room and is not limited by the capacity of the clean room. And even in an open space, it is possible to train.
  • the clean room is a limited space, and work in the clean room is limited to 3 hours due to the relationship between tension and concentration. Along with that, the work in the clean room cannot be performed for more than 3 hours.
  • various tasks related to cell culture have conventionally required that each trainee be accompanied by a skilled person on a one-to-one basis. Therefore, the skilled workers, who are short of people, have taken time to give guidance to inexperienced people in addition to the work that should be done.
  • FIG. 2 which shows the functional blocks of the control unit 20 (control device) in the cell culture education system 100
  • the control unit 20 is surrounded by a broken line, and the subject position determination block 20A, the avatar creation block 20B, and the program determination block are shown.
  • It has 20C, correction block 20D, rule protocol position determination block 20E, rule protocol image creation block 20F, comparison block 20G, procedure pass / fail judgment block 20H, display video determination block 20I, video creation block 20J, and database 20K.
  • the phrase “determine the position or the like of the rule protocol” in the block 20E means “determine the position or the like according to the program”.
  • the wording "rule protocol image creation" on the block 20F means “creating an image according to a program”.
  • the subject position determination block 20A includes a glove 1 (left hand glove 1A, right hand glove 1B) worn by subject E (FIG. 1), goggles 2, and a position of subject E from the camera 3 (for example, the position of a hand). It has a function of acquiring information on posture, movement (state of subject E), etc. via the signal line SL1 and determining the real-time position, posture, movement, etc. of the hand of subject E, etc.
  • the reference numeral "SL1" is an expression including the signal lines SL1-1A, SL1-1B, SL1-2, and SL1-3 in FIG.
  • Data such as the position, posture, and motion of the subject E determined by the subject position determination block 20A are transmitted to the avatar creation block 20B via the signal line SL2.
  • the avatar creation block 20B has a function of calculating and creating an avatar (video, image, alter ego image) on VR based on data such as the position, posture, and motion of subject E acquired from the subject position determination block 20A. ..
  • the calculation and the function to be created are executed by applying a conventionally known technique.
  • the image (avatar) created by the avatar creation block 20B is transmitted to the comparison block 20G via the signal line SL3 and is transmitted to the moving image creation block 20J via the signal line SL4.
  • the moving image creation block 20J has a function of creating a working image of the subject E on the VR based on the data of the image (avatar) acquired from the avatar creation block 20B.
  • the data of the work image of the subject E created by the moving image creation block 20J is transmitted to the goggles 2 worn by the subject E via the signal line SL1-2, and the subject E displays the displayed image on the VR by the goggles 2. Visualize as an image.
  • the data signal of the work image of the subject E created by the moving image creation block 20J is transmitted to the display device 4 (monitor) via the signal line SL18, and the display device 4 is an image in which the avatar or the like is displayed on the VR. Is displayed.
  • a person other than the subject E for example, an instructor
  • the other functions of the moving image creation block 20J will be described in detail later.
  • the educator inputs the type of education (training) related to cell culture via the input device 5.
  • the program determination block 20C has a function of determining a target program corresponding to the input type of education.
  • Types of education (training) include, for example, cell isolation, cell culture, wearing gouning, washing washing, entering and exiting a clean room, and the like. Regarding cell isolation and cell culture, the content of training may be divided into multiple stages.
  • the correct position for example, hand position
  • the correct (worker's) position, posture, movement, etc. according to the protocol are stored in the database 20K.
  • the type (information) of the target program determined by the program determination block 20C is transmitted to the database 20K via the signal line SL6 and also transmitted to the rule protocol position determination block 20E via the signal line SL7.
  • the correction block 20D acquires information about the subject E (training target person) input via the input device 5 via the signal line SL8.
  • the information regarding the subject E is, for example, the identification number, gender, age, height, etc. of the subject E, and may include other physique information and the like.
  • the correction block 20D is based on the acquired information about the subject E (for example, data such as the height, body shape, and gender of the subject E), and the correct position (for example, the position of the hand), the posture, and the posture according to the protocol when performing each target work. It has a function to create data for correcting data related to operations (model data).
  • the data for correcting the position, posture, motion, etc. along the protocol corrected by the correction block 20D is transmitted to the rule protocol position determination block 20E via the signal line SL9.
  • the protocol position determination block 20E acquires information on the type of the target program from the program determination block 20C via the signal line SL7, and the correct position along the protocol (for example, the position of the hand) from the database 20K via the signal line SL10. ), Posture, motion data, etc., and data (correction data) for correcting the position, posture, motion data according to the protocol from the correction block 20D via the signal line SL9 according to the height of subject E, etc. get.
  • the rule protocol position determination block 20E has a function of determining a correct position, posture, motion, etc. (corrected position, posture, motion, etc.) according to the protocol based on the correction data for the subject E.
  • Data such as accurate (corrected) position, posture, and motion according to the protocol determined by the rule protocol position determination block 20E are transmitted to the rule protocol image creation block 20F via the signal line SL11, and are also transmitted. It is transmitted to the comparison block 20G via the signal line SL12.
  • the rule protocol image creation block 20F has a function of calculating and creating an image or video of an accurate position, posture, motion, etc. according to the protocol based on the data acquired from the rule protocol position determination block 20E. ..
  • the image (video) created by the protocol image creation block 20F is transmitted to the comparison block 20G via the signal line SL13.
  • the comparison block 20G includes the position, posture, motion, etc. in the image of the subject E acquired from the avatar creation block 20B, and accurate data (position, posture, motion, etc.) according to the protocol acquired from the rule protocol position determination block 20E. Has a function to compare. At the time of comparison in the comparison block 20G, the difference between the data such as the position, posture, and movement in the image of the subject E and the data such as the accurate position, posture, and movement according to the protocol is calculated. The difference is compared with a predetermined value (threshold value) set in advance in the procedure pass / fail judgment block 20H, and it is determined whether or not the work targeted for the education has been performed accurately.
  • a predetermined value threshold value
  • the image (video) of the subject E acquired from the avatar creation block 20B is compared with an accurate image (video) according to the protocol acquired from the rule protocol image creation block 20F (that is,).
  • the protocol acquired from the rule protocol image creation block 20F (that is,).
  • the data such as position, posture, and motion may be compared with the data such as accurate position, posture, and motion according to the protocol instead of the position and the like of the image (video).
  • comparison block 20G (A) Comparison of data such as the position of the image (avatar) of subject E and the exact position according to the protocol, (B) Comparison of the image (avatar) of subject E with the image (avatar) of the exact position, posture, movement, etc. according to the protocol. (C) Comparison of data such as the position of subject E and data such as the exact position according to the protocol, Is done.
  • the comparison result by the comparison block 20G is transmitted to the procedure pass / fail judgment block 20H via the signal line SL14.
  • the procedure pass / fail determination block 20H has a function of determining the pass / fail of the position, posture, movement, etc. (that is, work procedure) of the subject E in the work to be educated, based on the comparison result obtained from the comparison block 20G.
  • the work procedure of subject E is "good", that is, acceptable when the difference in (A) to (C) is equal to or less than a preset first predetermined value in the judgment. Judge as (pass).
  • the work procedure of the subject E is determined to be "poor", that is, unacceptable (failed).
  • the difference is larger than the first predetermined value but less than or equal to the second predetermined value (greater than the first predetermined value) (the difference is a small difference)
  • the work procedure of the subject E is described as "bad There is, but the degree of defect is small.
  • the difference is larger than the second predetermined value (the difference is large)
  • the determination result of the procedure pass / fail determination block 20H is transmitted to the display moving image determination block 20I via the signal line SL15.
  • the display moving image determination block 20I has a function of determining an image (moving image) to be displayed (viewed: confirmed) on the VR based on the determination result acquired from the procedure pass / fail determination block 20H.
  • the difference between the image of subject E (position, posture, movement, etc.) and the accurate position, posture, movement, etc. according to the protocol is less than or equal to the first predetermined value, that is, the procedure is good or bad.
  • the pass / fail judgment result from the judgment block 20H is "good"
  • a video (video) indicating that the work procedure is "good” and acceptable (pass) is displayed on the VR.
  • the pass / fail judgment result from the procedure pass / fail judgment block 20H is "no", and the difference between the image of subject E (position, posture, movement, etc.) and the accurate position, posture, movement, etc. according to the protocol is the first.
  • the subject E is, for example, in the work procedure (position, posture, movement, etc.) and protocol of the subject E.
  • An image (moving image) that clearly shows the difference from the exact position, posture, movement, etc. along the line is displayed on the VR.
  • the video that clearly shows the difference may be calculated and created as a video that the subject E can understand by himself / herself about the difference between the work procedure performed by the subject E on the VR and the accurate work procedure according to the protocol. desirable.
  • the work procedure of subject E and the accurate work procedure according to the protocol are superimposed and displayed, and a video (moving image) in which the difference between the two becomes clear is displayed on the VR.
  • a video (moving image) of an accurate position, posture, motion, etc. according to the protocol may be simply displayed on the VR.
  • the pass / fail judgment result from the procedure pass / fail judgment block 20H is "no", and the difference between the image of subject E (position, posture, movement, etc. in) and the accurate position, posture, movement, etc.
  • the second predetermined value is the second predetermined value. If it is larger than the value, that is, if the degree of defect is large, the video (animation) displayed to the subject E on the VR should be such that the subject E takes the evaluation result seriously, for example, a work procedure. An animation or the like showing how the cultured stem cells are completely destroyed due to the above is displayed on the VR.
  • the determination result of the display moving image determination block 20I is transmitted to the moving image creation block 20J via the signal line SL16.
  • the video creation block 20J acquires the corresponding video (video) data from the database 20K via the signal line SL17 based on the determination result acquired from the display video determination block 20I, and based on the evaluation result of the education (training). It has a function to create a video (moving image).
  • each type of education (training) related to cell culture is evaluated by education (“judgment result is good”, “judgment result is poor and its degree is small”, and “judgment result is poor”.
  • the video (video) data corresponding to "the degree is large" is saved.
  • the video (video) of the database 20K It is also possible to create a video (video) by processing the avatar (image) data in addition to the data.
  • the video (moving image) data created by the moving image creation block 20J is transmitted to the display device 4 (monitor) via the signal line SL18 and is broadcast on the display device 4. Further, the data of the video (moving image) is transmitted to the goggles 2 worn by the subject E via the signal line SL1-2, and is broadcast on the VR.
  • the database 20K contains the target program corresponding to each education (training) related to cell culture, the accurate position (for example, hand position), posture, movement, etc. of the worker according to the protocol in each education target work. Data, videos (videos) for each evaluation based on the evaluation results of the education (training), etc. are saved, and the contents saved by each functional block are transmitted as needed.
  • a plurality of training contents customized for each company or institution described above, and data in virtual reality such as the plurality of various facilities and instruments are stored.
  • the practitioner when carrying out the training, the practitioner (subject E, etc.) operates the input device 5 to select 1 from the three modes of "scenario mode", “simulation mode”, and "trial mode". Select one.
  • the mode switching block 5A (see FIG. 1: not shown in FIG. 2) transmits a mode selection signal to the control device 20 via the signal line SL19.
  • the control device 20 that has received the mode selection signal executes control according to the mode. For example, in the scenario mode, since the subject E does not perform the work operation, the subject position determination block 20A, the avatar creation block 20B, and the like in FIG. 2 do not function. Therefore, the movement of the subject E and the position, posture, movement, etc.
  • the program determination block 20C, the rule protocol position determination block 20E, the comparison block 20G, the procedure pass / fail judgment block 20H, etc. Does not work either.
  • the VR video that serves as a model (model) in the scenario mode and the function of reproducing and teaching the work procedure as text information and voice information are provided by the database 20K, the video creation block 20J, the display device 4, and the goggles 2. Will be executed. Further, when the trial mode is performed, each block in the control device 20 is functioning and executed. Further, in the simulation mode, if the movement of the subject E is not compared and evaluated with the position, posture, movement, etc. along the protocol, the blocks related to the comparison and evaluation do not function.
  • step S1 it is determined whether or not the training program (training or education related to cell culture) to be performed has been selected. Specifically, it is determined whether or not the training type is input to the program determination block 20C of the control unit 20 (control device, see FIG. 2) via the input device 5.
  • step S1 if the training program is selected (step S1 is "Yes"), the process proceeds to step S2, and if the training type is not selected (step S1 is "No"), the process returns to step S1 (step S1 is "Yes”). No "loop).
  • step S2 information on the position (for example, the position of the hand), posture, movement, etc. of the subject E is input from the gloves 1 (1A, 1B), the goggles 2, and the camera 3 worn by the subject E.
  • information on the position, posture, movement, etc. of the subject E is input from the glove 1 (1A, 1B), the goggles 2, the camera 3 to the subject position determination block 20A of the control unit 20.
  • the position and posture of the subject E are specified from the information on the position, posture, movement and the like acquired in step S2.
  • the movement of the subject E in VR including AR
  • the position, posture, motion, etc. of the subject E are specified by the subject position determination block 20A of the control unit 20.
  • the avatar creation block 20B calculates and creates an avatar (image: for example, a hand image) of the subject E and displays it on the VR.
  • step S4 the position, posture, movement, etc. of the subject E are compared with the accurate position, posture, movement, etc. on the protocol (comparison block 20G, etc.).
  • step S4 of FIG. 3 will be described separately.
  • step S41 the type of training (education) related to the cell culture to be performed is read, and the data (gender, age, height, etc.) related to the subject E is read.
  • the type of training is input from the input device 5 (FIG. 2) to the program determination block 20C, and the data regarding the subject E is input from the input device 5 to the correction block 20D.
  • step S42 the process proceeds to step S42.
  • step S42 the correct position, posture, motion, etc. (model motion, etc.) on the protocol in the selected (specified) training (education) are read.
  • the reading is performed by the rule protocol position determination block 20E, the training type is acquired from the program determination block 20C, and the data corresponding to the training type is acquired from the database 20K and executed.
  • the data such as the correct position, posture, and movement on the protocol read from the database 20K is corrected to the accurate data corresponding to the subject E according to the data (gender, age, height, etc.) related to the subject E. To do.
  • the correction is performed in the rule protocol position determination block 20E, and is executed after acquiring the correction amount data based on the data of the subject E from the correction block 20D. Then, the process proceeds to step S43.
  • step S43 the position, posture, movement, etc. of the subject E are compared with the accurate position, posture, movement, etc. on the protocol corrected by the data of the subject E.
  • the comparison in step S43 is performed in comparison block 20G.
  • the position, posture, motion, etc. of the subject E are determined based on the image (avatar) of the subject E acquired from the avatar creation block 20B, and the accurate position, posture, motion, etc. on the corrected protocol are determined. It is determined from the data acquired from the rule protocol position determination block 20E or the video relating to the accurate position, posture, motion, etc. along the protocol acquired from the rule protocol image creation block 20F.
  • the position, posture, movement, etc. the position, posture, movement, etc.
  • step S5 the process proceeds to step S5 (FIG. 3).
  • step S5 based on the comparison result of step S4, the difference between the image of subject E (position, posture, movement, etc.) and the accurate position, posture, movement, etc. on the protocol is within the permissible range. Determine if it exists. In other words, it is determined whether or not the position, posture, movement, etc. of the subject E are good (whether or not it is "passed”). Judgment as to whether or not the position, posture, movement, etc. of subject E is good (whether or not it is "passed") is described above in the comparison block 20G and the procedure pass / fail judgment block 20H with reference to FIG. Performed in an embodiment.
  • step S5 If the difference is within the permissible range in step S5 (step S5 is “Yes”: the difference is within the first predetermined value), the process proceeds to step S6, and if the difference is not within the permissible range (step S5 is “No”). : The difference is larger than the first predetermined value), the process proceeds to step S7.
  • step S6 step S5 is "Yes”: the difference is within the first predetermined value
  • step S6 when the training is terminated (step S6 is “Yes”), the procedures shown in FIGS. 3 and 4 are terminated, and when the training is not completed (step S6 is “No”), step S2 is performed.
  • step S6 returns to step S2 without completing the training (step S6 is “No”), the subject E continues to carry out the same type of training as before.
  • subject E desires other training, he / she can return to step S1 instead of returning to step S2. In that case (when returning to step S1), the subject E can select the training again and perform the desired training.
  • step S7 (“No” in step S5: the difference is larger than the first predetermined value), the subject E receives a judgment result that the position, posture, movement, etc. of the subject E are not within the permissible range and is not good.
  • a video (video) for confirming (recognizing) the evaluation result of the education (training) is determined and displayed on the VR.
  • step S7 in FIG. 3 will be described by dividing it into a plurality of detailed steps as shown in FIG.
  • Step S7 of FIG. 3 is a case where it is determined in step S5 that the difference between the position, posture, movement, etc. of the subject E and the accurate position, posture, movement, etc. on the protocol is not within the permissible range.
  • step S71 if the difference is larger than the second predetermined value (the difference is a large difference), the process proceeds to step S72, and if the difference is equal to or less than the second predetermined value (the difference is a small difference). In the case of), the process proceeds to step S73.
  • step S72 when the difference is larger than the second predetermined value, a predetermined image (moving image) is broadcast on VR (AR) to the subject E having a large difference.
  • the video (video) is intended to take the evaluation results more seriously. For example, an animation in which the cultured stem cells are completely destroyed due to the work procedure is displayed on VR. Display with.
  • step S73 when the difference is equal to or less than the second predetermined value, an image (moving image) for the subject E having a small difference is broadcast on VR (AR).
  • the work procedure (position, posture, movement, etc.) of subject E and the accurate position, posture, movement, etc. according to the protocol are superimposed and displayed to clarify the difference between the two.
  • step S8 it is determined whether or not to continue the training (education) related to cell culture.
  • step S8 if the training is continued (step S8 is “Yes”), the process returns to step S2, and if the training is not continued (step S8 is “No”), the procedure of FIG. 3 ends. Similar to the case where step S6 is "No”, when returning to step S2 without finishing the training (step S8 is "No"), the subject E continues to carry out the same type of training as before. If subject E wishes to have another training, he / she can return to step S1 instead of returning to step S2. In that case (when returning to step S1), the subject E can select the training again and perform the desired training.
  • step S11 training is performed for individual tasks related to cell culture (cell isolation, cell culture, gouning, etc.).
  • step S11 the contents of various trainings described with reference to FIGS. 3 to 5 are executed. Details of step S11 will be described later with reference to FIG.
  • step S12 as a result of the training in step S11, the instructor (training instructor) who instructed the training performed by the subject E determines whether or not the subject E has passed.
  • the instructor basically allows a difference between the position, posture, movement, etc. of the subject E and the exact position, posture, movement, etc. on the protocol.
  • step S12 if the instructor decides to pass (step S12 is “Yes”), the process proceeds to step S13, and if the instructor does not pass (step S12 is “No”), the process returns to step S11. Repeat the training.
  • step S13 when the instructor is found to pass in step S12, it is determined whether or not the instructor has passed all the work training related to cell culture of subject E. As a result of the determination in step S13, if the instructor recognizes that all the work has passed (step S13 is "Yes"), the process proceeds to step S15, and if the instructor does not recognize that all the work has passed (step S13 is "Yes”). "No") proceeds to step S14.
  • step S14 when the instructor has not certified that all the work has passed, the subject E trains (educates) the work that the instructor has not certified as passing.
  • the process returns to step S12.
  • the instructor evaluates that the result of the training in step S14 (position, posture, movement, etc. of the subject E) has passed. Determine if you did.
  • step S15 when the instructor finds that all the tasks have passed, subject E is subjected to a comprehensive test for all tasks related to cell culture.
  • the comprehensive test may be performed by subject E performing all the work trainings in succession, or a test for comprehensively testing the work training of subject E performed in steps S11 to S13 is executed. You may.
  • step S16 it is determined whether or not the subject E has passed the comprehensive test of step S15. If subject E passes the comprehensive test as a result of the determination in step S16 (step S16 is “Yes”), the procedure of FIG. 6 is terminated. On the other hand, if the subject E does not pass the comprehensive test (step S16 is “No”), the process proceeds to step S17.
  • step S17 subject E retrains the work that failed the comprehensive test in step S16.
  • the process returns to step S12.
  • the instructor verifies that the result of the retraining of step S17 (position, posture, movement, etc. of the subject E) has passed. Judge whether or not. It is also possible to omit the step (step S13) of determining whether or not the instructor has confirmed that all the work training related to the cell culture of the subject E has passed.
  • step S11 of FIG. 6 will be described with reference to FIG. 7.
  • a selection is made from "scenario mode", "simulation mode”, and "trial mode”, and training (education) in the selected mode is executed. , Then perform other modes of training (education) as needed.
  • the scenario mode is mainly aimed at beginners
  • the simulation mode is mainly aimed at beginners who can understand the work procedure to some extent.
  • the trial mode is carried out so that a person who has experienced the scenario mode and the simulation mode can confirm the proficiency level.
  • step S21 it is determined whether or not the training (education) mode has been selected in the training (training or education related to cell culture) to be performed. Specifically, it is determined whether or not the mode selection signal is transmitted to the control device 20 via the input device 5. In step S21, if the mode is selected (step S21 is “Yes”), the process proceeds to step S22, and if the mode is not selected, the process returns to step S21 (step S21 is a “No” loop).
  • step S22 in order to execute training (education) in the mode selected in step S21, the process proceeds to any one of steps S23, S24, and S25. That is, if the scenario mode is selected in step S22, the process proceeds to step S23, if the simulation mode is selected, the process proceeds to step S24, and if the trial mode is selected, the process proceeds to step S26.
  • step S23 training (education) in the scenario mode is carried out.
  • the scenario mode for the work related to the cell culture to be trained, a video of the position (for example, the position of the hand), the posture, and the movement of the model worker (for example, the position of the hand) in virtual reality (VR) Show to subject E.
  • the content of specific instructions for correct posture, movement, etc. is displayed as character information (caption).
  • Character information can also be reproduced as voice information.
  • the model moving image, character information, and voice information are displayed by the control device 20 on the display device 4 and / or the goggles 2 worn by the subject E.
  • the model moving image is produced in a state of being viewed from a plurality of viewpoints (in a multi-angle), and the produced moving image can switch the viewpoints.
  • the subject E has no choice but to look into from behind the performer, and the learner's viewpoint is limited to the back of the performer. In that respect, it differs from VR video from multiple angles that can be observed from various useful angles.
  • step S23 character information (caption) for instructing points to be noted and necessary points in the work is also displayed in addition to the sample moving image as described above. Character information can also be reproduced as voice information. Further, in the scenario mode of step S23, a model worker's position (for example, hand position), posture, and attention points for movement are displayed. The display of the caution point is performed by the control device 20 on the display device 4 and / or the goggles 2 worn by the subject E, and the display of the caution point is executed at a timing effective for education. When step S23 is completed, the process proceeds to step S28.
  • step S24 it is determined whether or not the subject E who has selected the simulation mode has already performed training (education) in the scenario mode. If the training (education) in the scenario mode has already been performed (step S24 is “Yes”), the process proceeds to step S25, and if the training (education) in the scenario mode has not been performed (step S24 is “No”), step S21 Return to. That is, in the illustrated embodiment, it is set so that the subject E cannot receive the training (education) in the simulation mode if the subject E has not received the training (education) in the scenario mode. This is because more efficient training (education) can be expected by experiencing the scenario mode and then implementing the simulation mode. However, it is possible to set the simulation mode so that the subject E can execute the simulation mode even when the scenario mode is not executed.
  • step S25 training (education) in the simulation mode is carried out.
  • Subject E wears the measuring device 10 (left-handed glove 1A, right-handed glove 1B, goggles 2) and performs the operation of the cell culture work to be trained in virtual reality for practice.
  • the above-mentioned training (education) is executed with reference to FIGS. 3 to 5.
  • the position, posture, and movement of subject E are compared with the data (position, posture, movement) according to the protocol (in virtual reality or between the data), and the difference is within the permissible range. Confirm whether or not it is, and evaluate it. However, comparison and evaluation can be omitted.
  • the subject E can receive instructions (work instruction scenario guide) regarding the work by voice or letters.
  • the work instruction scenario guide can be transmitted to the subject E from a voice device (not shown). And / or, the work instruction scenario guide is displayed on the display device 4 and / or the goggles 2 worn by the subject E.
  • the elapsed time of the work of the subject E regarding the stem cell culture to be trained is measured.
  • the measurement of the elapsed time includes both the measurement of the elapsed time in each operation constituting the work and the measurement of the elapsed time until the entire work is completed (the elapsed time of the entire work).
  • the working time is measured in the training in the virtual reality, and it is confirmed whether or not the working time is appropriate so that the actual work does not adversely affect the cells.
  • the control device 20 has a timer function.
  • the training in the simulation mode when subject E makes an operation error or failure (for example, the position, posture, and movement are significantly different from the position, posture, and movement based on the protocol) during the work movement, voice or character display is performed.
  • An alert is issued by (for example, reddening of characters).
  • the alert is uttered by the control device 20 from a voice device (not shown) and / or displayed on the display device 4 and the goggles 2 worn by the subject E.
  • the important attention points are confirmed so that the position, posture, and movement of the subject E become (approach) the position, posture, and movement based on the protocol (for example, the movement that is the point is appropriate). Check if it was possible to execute).
  • the confirmation result is displayed by the control device 20 on the display device 4 and / or the goggles 2 worn by the subject E. There are no particular restrictions on the timing of displaying the confirmation result, but it is desirable that the confirmation result be displayed at a timing that improves the training efficiency of subject E.
  • step S25 the process proceeds to step S28.
  • step SS26 When the training (education) in the trial mode is executed, it is determined in step SS26 whether or not the training (education) in the scenario mode and the simulation mode has already been executed. If the training (education) in the scenario mode and the simulation mode has already been carried out in step S26 (step S26 is “Yes”), the process proceeds to step S27, and the training (education) in the scenario mode and the simulation mode has not been carried out (step S26). Step S26 is "No") returns to step S21. That is, in the illustrated embodiment, the trial mode is not executed for the subject who has not experienced the scenario mode and the simulation mode. As described above, the trial mode is an embodiment performed to confirm the proficiency level, and it is meaningless to execute it by a subject who has not performed the scenario mode or the simulation mode.
  • step S27 subject E wears the measuring device 10 (left-handed glove 1A, right-handed glove 1B, goggles 2) and performs a cell culture work (operation) to be trained in virtual reality to confirm work proficiency.
  • a series of work procedures are carried out without interruption until the end.
  • the position, posture, and movement of the subject E are compared with the data (position, posture, movement) according to the protocol (in virtual reality or between the data). Check and evaluate whether the difference is within the permissible range.
  • the elapsed time of the work of subject E regarding the stem cell culture to be trained is measured, and whether the measurement result (elapsed time for each movement constituting the work and the elapsed time for the entire work) is appropriate. Check if it is not.
  • step S27 when the subject E makes an operation error or failure (for example, the position, posture, or motion is significantly different from the position, posture, or motion based on the protocol) during the work operation, the error or the failure is made.
  • the details of the failure are recorded by the control device 20. Even if such a mistake or failure is made, the trial mode is continued without interruption, and the subject confirms the record of the mistake or failure after the trial mode ends. This is to bring the trial mode closer to the actual work that cannot be interrupted because no alarm sound is emitted or an alarm is displayed even if an operation error or failure is made.
  • step S27 The evaluation in the training (education) in the trial mode compares the position, posture, and movement of subject E with the data (exemplary position, posture, movement) according to the protocol (in virtual reality or between data). A pass / fail judgment is made based on whether or not the difference is within the permissible range. At that time, score evaluation may be adopted.
  • step S27 the process proceeds to step S28.
  • step S28 subject E determines whether or not he / she has passed the training (education) in the trial mode.
  • step S28 if the subject E passes the trial mode (step S28 is “Yes”), the process proceeds to step S12. On the other hand, if the subject E has not passed the trial mode (step S28 is “No”), the process returns to step S21, and the trial mode is performed again, the training is performed in the simulation mode, or the model work is performed in the scenario mode. Select whether to reconfirm the procedure.
  • step S12 a person who has passed the trial mode proceeds to step S12 (FIG. 6) and receives a pass / fail judgment by the instructor.
  • step S28 if the subject E passes the trial mode (step S28 is “Yes”), the process proceeds to step S13, and step S12 can be omitted.
  • the trial mode in step S27 can be changed to a pass / fail judgment by the instructor in step S12.
  • techniques related to stem cell culture are trained using virtual reality (VR) without using an actual living body (human body) or facility. Therefore, the ability to perform necessary processing can be efficiently improved. Since it is not necessary to use an actual living body (human body) or facility, there is no limitation on the place where training or education is performed, and it is possible to remove the limitation on the time for training or education.
  • VR virtual reality
  • the illustrated embodiment is merely an example and is not a description intended to limit the technical scope of the present invention.
  • it is possible to appropriately combine the determination of the state of the cells actually cultured.
  • it can be combined with not only the check in the virtual reality but also the check of the practical skill (check of the actual work).

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Wood Science & Technology (AREA)
  • Zoology (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Biotechnology (AREA)
  • Organic Chemistry (AREA)
  • Medicinal Chemistry (AREA)
  • Human Computer Interaction (AREA)
  • Genetics & Genomics (AREA)
  • General Health & Medical Sciences (AREA)
  • Biochemistry (AREA)
  • Sustainable Development (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Microbiology (AREA)
  • Biomedical Technology (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The purpose of the present invention is to provide a system or a method for learning and mastering a technique related to stem cell culturing, using a virtual reality (VR) technology. To that end, this cell culturing education system (100) includes a measuring device (10: gloves 1, goggle 2, camera 3, etc.) and a control device (20) that measures the position, the posture, and the body movement of a subject (E). The control device (20) has: a function of calculating the position, the posture and the body movement of the subject (E) using information from the measuring device (10), executing preparation, and displaying the results thereof in virtual reality; a function of modifying the calculation, in accordance with (the height etc. of) the subject (E), from data (of the position, the posture, the body movement, etc.) based on a cell culturing technique protocol, calculating the position, the posture and the body movement that would be realized if the subject (E) follows the protocol, and preparing data (position, posture, body movement, etc.); and a function of comparing the position, the posture, and the body movement of the subject (E) with the data that matches the protocol.

Description

細胞培養教育システム及び方法Cell culture education system and method

 本発明は、幹細胞培養に関する技術を取得、習熟するための教育システム及び教育方法に関し、特に、仮想現実(VR)技術を適用した教育システム及び教育方法に関する。ここで、「仮想現実」或いは「VR」という文言は、拡張現実(AR)や複合現実(MR)等の総称「xR」を意味するものとする。 The present invention relates to an education system and an education method for acquiring and mastering a technique related to stem cell culture, and particularly to an education system and an education method to which a virtual reality (VR) technique is applied. Here, the wording "virtual reality" or "VR" means a generic term "xR" such as augmented reality (AR) and mixed reality (MR).

 近年、仮想現実(VR)に関する技術が急速の進歩を遂げており、種々の分野で適用されている。
 幹細胞の培養は、細胞を脂肪、臍帯、臍帯血その他から単離するコストが非常に高く、単離された幹細胞(取り扱うべき幹細胞)が生きていることから、培養するための各種処理に大きな労力とコストを必要とする。例えば、組織(脂肪)から細胞を単離する場合、毛細血管の周囲から優しく細胞を単離しないと、単離された細胞と、細胞が単離される組織の双方に大きなダメージを与える恐れがある。そして、単離された細胞がダメージを受けていると、培養することは出来ない。それと共に、細胞を単離した後、同一人から再度単離することは非常に困難である。
In recent years, technology related to virtual reality (VR) has made rapid progress and is applied in various fields.
In culturing stem cells, the cost of isolating cells from fat, umbilical cord, umbilical cord blood, etc. is very high, and since the isolated stem cells (stem cells to be handled) are alive, a great deal of labor is required for various processes for culturing. And cost. For example, when isolating cells from tissue (fat), if the cells are not gently isolated from around the capillaries, there is a risk of significant damage to both the isolated cells and the tissue from which the cells are isolated. .. And if the isolated cells are damaged, they cannot be cultured. At the same time, it is very difficult to isolate the cells again from the same person after isolation.

 また、細胞培養の過程においても、例えば、細胞培養をする者が誤って他の容器等を触った手で培養作業を行うと、異物による汚染(コンタミネーション)が起こり、培養した細胞が全滅する場合がある。すなわち、未熟な培養者の不注意により、培養した細胞が全滅するリスクが存在する。
 また、単離した細胞は複数回(例えば4回)に亘って継代作業を行い、最終的に約1億個程度の細胞を培養するが、最終段階の作業で汚染が発生してしまうと、その損害が大きい。
 そのため、培養過程でも、作業者の熟練が切望されている。
Also, in the process of cell culture, for example, if a person who cultures cells accidentally touches another container or the like and performs the culture work by hand, contamination by foreign substances occurs and the cultured cells are completely destroyed. In some cases. That is, there is a risk that the cultured cells will be wiped out due to the carelessness of the immature incubator.
In addition, the isolated cells are subcultured multiple times (for example, 4 times), and about 100 million cells are finally cultured, but if contamination occurs in the final stage work, , The damage is great.
Therefore, even in the culture process, the skill of the worker is eagerly desired.

 さらに、細胞の単離や培養はクリーンルーム内で行われるため、いわゆる「ガウニング」(専用の服)の着用が義務付けられている。ガウニングの着用についても訓練が必要であり、また、ガウニングの着用後に(着用されたガウニングの)洗浄が必要となるが、その洗浄作業についても所定の手順に従って行わないと、上述した異物による汚染(コンタミネーション)を惹起する可能性が存在する。
 それに加えて、クリーンルームへの入室についても必要な手順(作業)が存在し、当該手順について訓練を行っていない未熟練者がクリーンルームに入ると、培養している細胞が全滅する恐れがある。
Furthermore, since cells are isolated and cultured in a clean room, it is obligatory to wear so-called "gouning" (special clothing). Training is also required for wearing the gouning, and cleaning (of the worn gouning) is required after wearing the gouning, but if the cleaning work is not performed according to the prescribed procedure, contamination by the above-mentioned foreign matter (contamination by foreign substances mentioned above) There is a possibility of causing contamination).
In addition, there is a necessary procedure (work) for entering the clean room, and if an unskilled person who has not been trained in the procedure enters the clean room, the cultured cells may be wiped out.

 しかし、クリーンルームは限定された空間なので、細胞の単離や培養における各種作業は、クリーンルームの収容人員の関係から実習が困難である。
 また、クリーンルームは限定された空間であり、限定された空間であるクリーンルーム内での作業は緊張と集中力の持続の関係から、3時間が限界とされている。そのため、クリーンルーム内で行う作業の実習も、実習生の緊張と集中力の持続の関係から、3時間以上行うことは困難である。
 そして、細胞の単離や培養における各種作業は、少なくとも6ヶ月程度の訓練が必要とされていた。しかし、数が少ない熟練者が個々の実習生に対して、いわゆる「マン・ツー・マン」で指導する必要があるため、多数の実習生を受け入れることが困難である。
However, since the clean room is a limited space, it is difficult to practice various operations in cell isolation and culturing due to the capacity of the clean room.
In addition, the clean room is a limited space, and the work in the clean room, which is a limited space, is limited to 3 hours due to the relationship between tension and continuous concentration. Therefore, it is difficult to practice the work performed in the clean room for 3 hours or more due to the relationship between the trainee's tension and the maintenance of concentration.
And, various operations in cell isolation and culturing required training for at least about 6 months. However, it is difficult to accept a large number of trainees because a small number of skilled workers need to teach individual trainees on a so-called “one-to-one” basis.

 従来技術において、医療における外科手術等の教育用に仮想現実技術を用いた事例が存在する(例えば特許文献1参照)。
 しかし、外科手術では、摘出した患部の残りである患者の身体にダメージを与えないことを考慮しているが、摘出した患部についてはダメージを考慮しない。そのため、細胞を単離した組織(細胞を単離した残り)のみならず、単離した細胞にダメージを与えることは出来ない細胞培養の分野に、外科手術の教育用の仮想現実技術を適用することは出来ない。
 一方、外科手術の仮想現実による教育では、心臓その他の臓器移植手術においてドナー(臓器提供者)から臓器を取り出す場合、移植用の臓器にダメージを与えない様に処理しているが、移植用臓器を取り出した後のドナーの身体は脳死体であるためダメージ云々はさほど考慮されない。その点で、細胞を単離した後の組織にダメージを与えないことを考慮するべき細胞培養の分野に、外科手術の仮想現実による教育技術を適用することは不適当である。
 換言すると、医療用の仮想現実を用いた教育ツール(プログラム等)では、摘出した組織(幹部或いは移植用の臓器)或いは組織摘出後の人体の何れか一方のみにダメージを与えないように構成されているが、他方についてはダメージ云々を考慮しない。そのため、医療用の仮想現実を用いた教育ツール(プログラム等)は細胞の単離や培養における各種作業に適用することは出来ず、細胞培養の教育用システム、方法の目的を達することが不可能である。
In the prior art, there is a case where a virtual reality technique is used for education such as surgery in medical treatment (see, for example, Patent Document 1).
However, in surgery, it is considered that the body of the patient who is the rest of the removed affected area is not damaged, but the damage is not considered for the removed affected area. Therefore, we apply virtual reality technology for the education of surgery not only to the tissue from which the cells were isolated (the rest of the isolated cells) but also to the field of cell culture where the isolated cells cannot be damaged. I can't do that.
On the other hand, in the virtual reality education of surgery, when an organ is taken out from a donor (organ donor) in heart or other organ transplant surgery, it is processed so as not to damage the organ for transplantation, but the organ for transplantation Since the donor's body after removal is a brain corpse, damage is not considered so much. In that respect, it is inappropriate to apply the virtual reality educational technique of surgery to the field of cell culture, which should be considered not to damage the tissue after the cells have been isolated.
In other words, educational tools (programs, etc.) that use virtual reality for medical use are configured so as not to damage either the removed tissue (executive or organ for transplantation) or the human body after tissue removal. However, the damage is not considered for the other. Therefore, educational tools (programs, etc.) using virtual reality for medical use cannot be applied to various tasks in cell isolation and culture, and it is impossible to achieve the purpose of the educational system and method of cell culture. Is.

 また、外科医療の手術は個々のケースごとに施術の内容が大きく異なるため、仮想現実による訓練に加えて実際に行うこと(実地の訓練)が必要不可欠であるが、上述した様に、細胞培養に関する各種作業では実地の訓練が困難な場合が多い。
 そのため、実習(実地の訓練)の比重が大きい医療分野における教育ツール(プログラム等)は、上述した様に細胞培養に関する各種作業の訓練に適用することは、事実上不可能である。
In addition, since the content of surgical treatment differs greatly in each case, it is indispensable to actually perform it (practical training) in addition to the training by virtual reality. As mentioned above, cell culture On-the-job training is often difficult in various tasks related to.
Therefore, it is practically impossible to apply educational tools (programs, etc.) in the medical field, which have a large weight of practical training (practical training), to training of various tasks related to cell culture as described above.

特開2015-133143号公報Japanese Unexamined Patent Publication No. 2015-133143

 本発明は上述した従来技術の問題点に鑑みて提案されたものであり、仮想現実(VR)技術を適用して、幹細胞培養に関する技術を取得、習熟するためのシステム及び方法の提供を目的としている。 The present invention has been proposed in view of the above-mentioned problems of the prior art, and an object of the present invention is to provide a system and a method for acquiring and mastering a technique related to stem cell culture by applying virtual reality (VR) technique. There is.

 本発明の細胞培養教育システム(100)は、
 被験者(E:幹細胞培養に関する技術の未熟練者)の状態(被験者Eの手の位置、姿勢、動作等)を計測する計測装置(10:グローブ1、ゴーグル2、カメラ3等)と、制御装置(20:コントロールユニットCU)とを含み、前記制御装置(20)は、
 計測装置(10)からの情報から被験者(E)の位置、姿勢、動作(単なる動きのみならず、作業の順序、手順を包含する意味で用いられる)のデータを演算、作成して、画像(アバター、分身画像)を演算、作成する機能と、
 被験者(E)の画像を仮想現実(VR)に表示する機能と、
 幹細胞培養に関する技術のプロトコルに基づいた(位置、姿勢、動作の)データから、被験者(E)(の身長や年齢、性別等)に応じて修正して、当該被験者(E)がプロトコルに従った場合の位置、姿勢、動作を演算してデータ(位置、姿勢、動作のデータ:映像を含む)を作成する機能と、
 被験者(E)の位置、姿勢、動作と、プロトコルに沿ったデータ(位置、姿勢、動作)とを(仮想現実上或いはデータ同士で)比較する機能を有していることを特徴としている。
 上述した通り、仮想現実(VR)は拡張現実(AR)を包含する文言として用いられる場合がある。ここで、仮想現実(VR)においては被験者の画像のみならず、細胞培養に必要な機器(例えば、クリーンベンチ、インキュベーター等)、器具(例えばフラスコ、ピペット等)、試薬、顕微鏡、その他必要な物品全てについて必要である。それに対して拡張現実(AR)の場合には、仮想現実(VR)とは異なり、各種機器や物品について実物を使用することが出来る。
The cell culture education system (100) of the present invention
Measuring device (10: glove 1, goggles 2, camera 3, etc.) and control device for measuring the state (position, posture, movement, etc. of subject E's hand) of the subject (E: inexperienced in stem cell culture technology) The control device (20) includes (20: control unit CU).
From the information from the measuring device (10), the data of the position, posture, and movement of the subject (E) (used to include not only the simple movement but also the work sequence and procedure) is calculated and created, and the image (used. Avatar, alter ego image) calculation and creation function,
A function to display the image of the subject (E) in virtual reality (VR),
From the data (position, posture, movement) based on the protocol of the technology related to stem cell culture, the subject (E) was modified according to (height, age, gender, etc.), and the subject (E) followed the protocol. A function to create data (position, posture, motion data: including video) by calculating the position, posture, and motion of the case,
It is characterized by having a function of comparing the position, posture, and movement of the subject (E) with the data (position, posture, movement) according to the protocol (in virtual reality or between data).
As mentioned above, virtual reality (VR) may be used as a wording that includes augmented reality (AR). Here, in virtual reality (VR), not only images of subjects, but also equipment necessary for cell culture (for example, clean bench, incubator, etc.), instruments (for example, flasks, pipettes, etc.), reagents, microscopes, and other necessary articles. Necessary for everything. On the other hand, in the case of augmented reality (AR), unlike virtual reality (VR), the real thing can be used for various devices and articles.

 本発明の細胞培養教育システム(100)において、前記制御装置(20)は、被験者(E)の位置、姿勢、動作(或いはそのデータに基づいて演算、作成された映像)と、プロトコルに沿ったデータ(位置、姿勢、動作:或いは演算、作成された映像)に大きな差異がある場合に、例えば仮想現実に表示されている画像を静止して、被験者(E)に警告する機能を有しているのが好ましい。
 また、本発明の細胞培養教育システム(100)において、前記制御装置(20)は、模範動画(模範的な作業を示す動画;お手本となる動画)や、文字情報、音声情報として作業手順を再生する態様(モード)(シナリオモード)と、被験者(E)の練習のための態様(シミュレーションモード)と、被験者(E)を評価する態様(トライアルモード)を実行する機能を有するのが好ましい。
In the cell culture education system (100) of the present invention, the control device (20) conforms to the position, posture, movement (or image calculated and created based on the data) of the subject (E), and the protocol. It has a function to warn the subject (E) by stopping the image displayed in virtual reality, for example, when there is a large difference in data (position, posture, movement: or calculation, created image). It is preferable to have it.
Further, in the cell culture education system (100) of the present invention, the control device (20) reproduces a work procedure as a model moving image (a moving image showing a model work; a moving image as a model), character information, and voice information. It is preferable to have a function of executing a mode (mode) (scenario mode), a mode (simulation mode) for practicing the subject (E), and a mode (trial mode) for evaluating the subject (E).

 また本発明の細胞培養教育方法は、
 被験者(E:幹細胞培養に関する技術の未熟練者)の状態(被験者Eの手の位置、姿勢、動作)を計測する計測装置(10:グローブ1、ゴーグル2、カメラ3等)と、制御装置(20:コントロールユニットCU)とを含むシステム(100:請求項1、2のシステム)を用いて、
 前記計測装置(10)からの情報から被験者(E)の位置、姿勢、動作のデータを演算、作成して、画像(アバター、分身画像)を演算、作成し、
 被験者(E)の画像を仮想現実(VR)に表示し、
 幹細胞培養に関する技術のプロトコルに基づいた(位置、姿勢、動作の)データから、被験者(E)(の身長や年齢、性別等)に応じて修正して、当該被験者がプロトコルに従った場合の位置、姿勢、動作を演算してデータ(位置、姿勢、動作等)を作成し、
 被験者(E)の位置、姿勢、動作と、プロトコルに沿ったデータ(位置、姿勢、動作)とを(仮想現実上或いはデータ同士で)比較することを特徴としている。
Moreover, the cell culture education method of the present invention
A measuring device (10: glove 1, goggles 2, camera 3, etc.) and a control device (10: glove 1, goggles 2, camera 3, etc.) for measuring the state (position, posture, movement of the subject E's hand) of the subject (E: inexperienced in technology related to stem cell culture) 20: Using the system including the control unit CU) (100: the system of claims 1 and 2),
The position, posture, and motion data of the subject (E) are calculated and created from the information from the measuring device (10), and the image (avatar, alter ego image) is calculated and created.
The image of the subject (E) is displayed in virtual reality (VR),
From the data (position, posture, movement) based on the protocol of the technology related to stem cell culture, it is modified according to the subject (E) (height, age, gender, etc.), and the position when the subject follows the protocol. , Posture, motion is calculated to create data (position, posture, motion, etc.),
It is characterized by comparing the position, posture, and movement of the subject (E) with the data (position, posture, movement) according to the protocol (in virtual reality or between data).

 本発明の細胞培養教育方法において、被験者(E)の位置、姿勢、動作(或いはそのデータに基づいて演算、作成された映像)と、プロトコルに沿ったデータ(位置、姿勢、動作:或いは演算、作成された映像)に大きな差異がある場合に、例えば仮想現実に表示されている画像を静止して、被験者(E)に警告するのが好ましい。
 ここで、細胞培養に関する各種技術(作業或いは動作)は、細胞単離、細胞培養(例えば継代作業)、ガウニング(専用の服)の着用、着用後の洗浄、クリーンルームへの進入、退出等、衛生管理部門教育、製造管理部門教育、品質管理部門教育における各種内容を包含している。
In the cell culture education method of the present invention, the position, posture, and movement of the subject (E) (or an image calculated and created based on the data) and data according to the protocol (position, posture, movement: or calculation, When there is a large difference in the created video), for example, it is preferable to stop the image displayed in the virtual reality and warn the subject (E).
Here, various techniques (work or operation) related to cell culture include cell isolation, cell culture (for example, subculture work), wearing gouning (dedicated clothes), washing after wearing, entering and exiting a clean room, and the like. It includes various contents in hygiene control department education, manufacturing control department education, and quality control department education.

 また本発明の細胞培養教育方法において、模範動画(模範的な作業を示す動画;お手本となる動画)や、文字情報、音声情報によって作業手順を再生する態様(モード)(シナリオモード)と、被験者(E)の練習のための態様(シミュレーションモード)と、被験者(E)を評価する態様(トライアルモード)の何れかを選択する工程を有するのが好ましい。 Further, in the cell culture education method of the present invention, a mode (mode) (scenario mode) in which a work procedure is reproduced by a model moving image (a moving image showing a model work; a moving image as a model), text information, and voice information, and a subject. It is preferable to have a step of selecting either the mode for practicing (E) (simulation mode) or the mode for evaluating the subject (E) (trial mode).

 上述の構成を具備する本発明によれば、仮想現実(VR)を用いて幹細胞培養に関する技術(衛生管理部門教育、製造管理部門教育、品質管理部門教育における各種内容)を、実際の生体(人体)や施設を用いることなく訓練することが出来るので、必要な処理を行う能力を向上させることが出来る。
 そして、実際の生体(人体)や施設を用いる必要が無いので、訓練或いは教育を行う場所に制限が無く、訓練或いは教育を受ける時間についても制限をなくすことが可能である。
 さらに、個々の練習生(被験者E)に対して熟練者がマン・ツー・マンで付き添う必要がなくなるので、人数が不足している熟練者の時間的な負担が軽くなる。
 また本発明によれば、仮想現実により訓練が行われるので、未熟な練習生が失敗をしても深刻な事態を惹起しない。そのため、未熟な練習生に過大な緊張を与えてしまうことが無い。そして、失敗した内容を記録し、失敗を犯した者がチェックすることが出来るので、失敗の原因を正確に且つ冷静に分析することが出来る。
 それに加えて、指導者、熟練者の個々による指導スキル、教育スキルの差に起因した教育成果のバラつきが生じることが無く、細胞培養に関して所謂「教育の質」を均一化することが出来る。
 そして、本発明では細胞培養の技術者を効率的に教育出来るので、細胞培養技術の教育に必要な時間が長期化せず、教育に必要な場所或いは設備を多大にする必要が無くなり、熟練者の負担(例えば、初心者の教育のため熟練者の時間を割かなければならない等)を少なくすることが出来るので、事業として細胞培養を行うにあたって有利となる。
According to the present invention having the above-described configuration, techniques related to stem cell culture (various contents in hygiene management department education, manufacturing management department education, quality control department education) can be applied to an actual living body (human body) using virtual reality (VR). ) And facilities can be used for training, so the ability to perform necessary processing can be improved.
Since it is not necessary to use an actual living body (human body) or facility, there is no limitation on the place where training or education is performed, and it is possible to remove the limitation on the time for training or education.
Further, since it is not necessary for the expert to accompany each trainee (subject E) on a one-to-one basis, the time burden on the expert who is insufficient in number is reduced.
Further, according to the present invention, since the training is performed by virtual reality, even if an inexperienced trainee makes a mistake, a serious situation does not occur. Therefore, it does not give excessive tension to immature trainees. Then, since the content of the failure can be recorded and checked by the person who made the failure, the cause of the failure can be analyzed accurately and calmly.
In addition, the so-called "quality of education" can be made uniform with respect to cell culture without any variation in educational results due to differences in teaching skills and educational skills among individual leaders and experts.
Further, in the present invention, since the cell culture engineer can be efficiently educated, the time required for the education of the cell culture technology is not prolonged, and it is not necessary to increase the place or equipment required for the education. (For example, the time of a skilled person must be spent for the education of beginners) can be reduced, which is advantageous in performing cell culture as a business.

 本発明によれば、細胞培養に関して厳格に定められたプロトコルに従って作業が厳密に定められているため、例えば細胞単離に際しては、細胞を単離した組織のみならず、単離された細胞にダメージを与えることはない。そのため、単離された細胞がダメージを受けて培養不能となることが防止される。
 また、厳格に定められたプロトコルに従って作業が厳密に定められている細胞培養に関する作業では、案件毎の変動が小さく、同一手順で同一の動きをする場合が多いので、仮想現実による訓練によって、相当な熟練を見込むことが出来る。
 更に、仮想現実を作成するに際しては、SOP(スタンダード オペレーション プログラム)に沿って作成すれば足りるので、各種費用を低く抑えることが出来る。
According to the present invention, since the work is strictly defined according to a strictly defined protocol for cell culture, for example, when cell isolation occurs, not only the tissue from which the cell was isolated but also the isolated cell is damaged. Will not be given. Therefore, it is prevented that the isolated cells are damaged and cannot be cultured.
In addition, in the work related to cell culture, where the work is strictly defined according to the strictly defined protocol, the fluctuation for each case is small, and in many cases the same movement is performed in the same procedure. You can expect good skill.
Furthermore, when creating virtual reality, it is sufficient to create it according to SOP (Standard Operation Program), so various costs can be kept low.

 また本発明によれば、厳格に定められたプロトコルに従った作業に習熟することが出来るので、本発明の教育(訓練)を受けた者が細胞培養過程を実行する際に、異物による汚染(コンタミネーション)が発生する可能性が低くなる。そして、必要に応じてクリーンルーム内の各種作業、例えば、ガウニング(専用の服)の着用、着用後の洗浄、クリーンルームに進入するための手順、退出するための手順についても、仮想現実を用いた訓練を行うことが出来るので、汚染の可能性が更に低下する。
 それに加えて、衛生管理部門教育、製造管理部門教育、品質管理部門教育における各種内容の全てについて、質の高い教育(或いは訓練)を提供して、技術者の質を向上することが出来る。それと共に、衛生管理部門教育、製造管理部門教育、品質管理部門教育等、細胞培養で必要な教育の全般について、個々の指導者や熟練者における教育スキルとは無関係に、均等且つ質の高い教育を施すことが出来るという利点がある。
 これに加えて、本発明において、模範動画(模範的な作業を示す動画;お手本となる動画)や、文字情報、音声情報によって作業手順を再生する態様(モード)(シナリオモード)と、被験者(E)の練習のための態様(シミュレーションモード)と、被験者(E)を評価する態様(トライアルモード)の何れかを選択可能に構成すれば、被験者(E)の習熟度に対応して効率的な教育或いは訓練を実行することが出来る。そして、被験者(E)を評価する態様(トライアルモード)で習熟度合を評価することで、機関が定める基準を満たしているか否かを判定し、被験者(E)の教育訓練の終了を判断することができる。
Further, according to the present invention, since it is possible to become proficient in the work according to the strictly defined protocol, contamination by foreign substances (contamination by foreign substances) when a person who has received the education (training) of the present invention carries out the cell culture process ( Contamination) is less likely to occur. Then, if necessary, training using virtual reality for various tasks in the clean room, such as wearing downing (special clothes), cleaning after wearing, procedures for entering the clean room, and procedures for exiting the clean room. Can be done, further reducing the possibility of contamination.
In addition, it is possible to improve the quality of engineers by providing high-quality education (or training) for all of the various contents in hygiene management department education, manufacturing control department education, and quality control department education. At the same time, general education required for cell culture, such as hygiene management department education, manufacturing control department education, quality control department education, etc., is equal and high quality education regardless of the educational skills of individual instructors and experts. There is an advantage that it can be applied.
In addition to this, in the present invention, a mode (mode) (scenario mode) in which a work procedure is reproduced by a model moving image (a moving image showing a model work; a model moving image), text information, and voice information, and a subject ( If either the mode for practicing E) (simulation mode) or the mode for evaluating the subject (E) (trial mode) can be selected, it is efficient according to the proficiency level of the subject (E). Can carry out various education or training. Then, by evaluating the degree of proficiency in the mode of evaluating the subject (E) (trial mode), it is determined whether or not the criteria set by the institution are satisfied, and the end of education and training of the subject (E) is determined. Can be done.

本発明の実施形態の概要を示す説明図である。It is explanatory drawing which shows the outline of the Embodiment of this invention. 図1におけるコントロールユニットの機能ブロック図であるIt is a functional block diagram of the control unit in FIG. 仮想現実を用いた訓練の制御を示すフローチャートである。It is a flowchart which shows the control of training using virtual reality. 図3におけるステップS4の詳細を示すフローチャートである。It is a flowchart which shows the detail of step S4 in FIG. 図3におけるステップS7の詳細を示すフローチャートである。It is a flowchart which shows the detail of step S7 in FIG. 未熟練者が受けるべき訓練全体を説明するフローチャートである。It is a flowchart explaining the whole training that an unskilled person should receive. 図6におけるステップS11の詳細を示すフローチャートである。It is a flowchart which shows the detail of step S11 in FIG.

 以下、添付図面を参照して、本発明の実施形態について説明する。
 最初に図1を参照して、実施形態に係るシステムの概要を説明する。
 図1において、実施形態に係る細胞培養教育システムは全体が符号100で示されており、被験者E(実施形態に係るシステムで教育を受講する未熟練者)の状態(例えば、被験者Eの手の位置、姿勢、動作等)を計測する計測装置10(図1の例では、グローブ1、ゴーグル2、カメラ3)と、制御装置20(コントロールユニット)とを有している。
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
First, the outline of the system according to the embodiment will be described with reference to FIG.
In FIG. 1, the cell culture education system according to the embodiment is indicated by reference numeral 100 as a whole, and is in a state of subject E (an unskilled person who receives education in the system according to the embodiment) (for example, the hand of subject E). It has a measuring device 10 (in the example of FIG. 1, a glove 1, goggles 2, a camera 3) and a control device 20 (control unit) for measuring a position, an attitude, an operation, etc.).

 計測装置10は、システム100による訓練時(受講時)に被験者Eが装着するグローブ1(左手用グローブ1A、右手用グローブ1B)、ゴーグル2、カメラ3を備えており、グローブ1A、1B、ゴーグル2、カメラ3は、それぞれ信号ラインSL1-1A、SL1-1B、SL1-2、SL1-3を介してコントロールユニット20と接続されている。
 被験者Eの手の位置と動作等に関する情報は、グローブ1A、1Bからコントロールユニット20に入力され、被験者Eの顔の位置、向いている方向、動作、視線の方向等に関する情報が、ゴーグル2からコントロール20に入力される。
 カメラ3は被験者Eの手の位置、姿勢、全身の動作を撮影し、当該情報(被験者Eの手の位置、姿勢、全身の動作に関する情報:映像或いは動画も含む)がコントロールユニット20に入力される。
 また、細胞培養教育システム100は表示装置4(モニタ)を有しており、表示装置4は信号ラインSL18を介してコントロールユニット20と接続されている。
 なお、前記信号ラインSL1-1A、SL1-1B、SL1-2、SL1-3は有線であっても良いし、無線であっても良い。
The measuring device 10 includes gloves 1 (left-handed gloves 1A, right-handed gloves 1B), goggles 2, and a camera 3 worn by subject E during training (during attendance) by the system 100, and includes gloves 1A, 1B, and goggles. 2. The camera 3 is connected to the control unit 20 via signal lines SL1-1A, SL1-1B, SL1-2, and SL1-3, respectively.
Information on the position and movement of the hand of subject E is input to the control unit 20 from the gloves 1A and 1B, and information on the position of the face of subject E, the direction in which the subject is facing, the movement, the direction of the line of sight, etc. is input from the goggles 2. It is input to the control 20.
The camera 3 captures the position, posture, and movement of the whole body of the subject E, and the information (information on the position, posture, and movement of the whole body of the subject E: including video or video) is input to the control unit 20. To.
Further, the cell culture education system 100 has a display device 4 (monitor), and the display device 4 is connected to the control unit 20 via the signal line SL18.
The signal lines SL1-1A, SL1-1B, SL1-2, and SL1-3 may be wired or wireless.

 コントロールユニット20は、計測装置10のグローブ1(1A、1B)、ゴーグル2、カメラ3等から、訓練中の被験者Eの位置(例えば手の位置)や姿勢、動作等に関する情報を取得する。そして、VR(仮想現実)上のアバター(画像、分身画像)を演算して、作成する。そして、コントロールユニット20は、被験者Eのアバターを信号ラインSL1-2によりゴーグル2に送信し、当該アバターをVRに表示させる。それと共に、信号ラインSL18を介して被験者Eのアバターを表示装置4に送信し、表示装置4が表示しているVR上に被験者Eのアバターを表示させる。
 図1において、VR(すなわち、被験者Eが体験している仮想現実上の動画或いは映像)が符号Aで示す領域内に示されており、当該VRは、被験者Eの手の位置、姿勢、全身の動作等に関するVRであって、被験者Eがゴーグル2により視認して体験しているVRである。ここで符号A内のVRは、監督者、指導者等の参考とするため、表示装置4にも表示されている。
 図1において、領域Aで示す範囲内には、脂肪組織を単離する作業の映像が示されている。ここで、実際の単離作業では、脂肪組織は医療機関における手術で吸引或いは少量を部分切除されて、注射器様或いは試験官様の容器で細胞培養機関(CPC:図示せず)に持ち込まれる。そして幹細胞は、試薬や遠心分離機等の装置を用いて単離される。しかし、図示の煩雑を防止するため、図1の領域Aでは、注射器状の器具Tを用いて人体Hから皮下脂肪を単離する作業の映像が示されている。明確には図示されていないが、幹細胞の培養作業は、いわゆる「クリーンベンチ」内で行われ、VR或いはARではグリーンベンチ内の作業を再現する様に表示される。なお、VRにおける被験者Eの手(グローブ1A、1B)のアバターが表示されている。
The control unit 20 acquires information on the position (for example, the position of the hand), the posture, the movement, and the like of the subject E under training from the gloves 1 (1A, 1B), the goggles 2, the camera 3, and the like of the measuring device 10. Then, the avatar (image, alter ego image) on VR (virtual reality) is calculated and created. Then, the control unit 20 transmits the avatar of the subject E to the goggles 2 by the signal line SL1-2, and displays the avatar on the VR. At the same time, the avatar of the subject E is transmitted to the display device 4 via the signal line SL18, and the avatar of the subject E is displayed on the VR displayed by the display device 4.
In FIG. 1, a VR (that is, a virtual reality moving image or video that subject E is experiencing) is shown in the region indicated by reference numeral A, and the VR is the position, posture, and whole body of subject E's hand. This is a VR related to the movement of the subject E, which is visually recognized and experienced by the subject E with the goggles 2. Here, the VR in reference numeral A is also displayed on the display device 4 for reference by the supervisor, the instructor, and the like.
In FIG. 1, an image of the work of isolating adipose tissue is shown in the range shown by region A. Here, in the actual isolation work, the adipose tissue is aspirated or partially excised by surgery in a medical institution and brought into a cell culture institution (CPC: not shown) in a syringe-like or examiner-like container. The stem cells are then isolated using a device such as a reagent or a centrifuge. However, in order to prevent complications in the drawing, in the region A of FIG. 1, a video of the work of isolating subcutaneous fat from the human body H using a syringe-shaped instrument T is shown. Although not explicitly illustrated, the stem cell culturing operation is performed in a so-called "clean bench" and is displayed in VR or AR to reproduce the operation in the green bench. In addition, the avatar of the hand (glove 1A, 1B) of the subject E in VR is displayed.

 コントロールユニット20(制御装置:図2参照)のデータベース20K(図2参照)には、細胞培養の各種作業を行う際にそれぞれ基準となる位置(例えば手の位置等)、姿勢、動作等が予めデータ(映像を含む)として保存されている。換言すれば、データベース20Kには、プロトコルに沿って作業を行った場合の作業者の正しい位置、姿勢、動作等(手本となる位置、姿勢、動作等)がデータ(映像を含む)として保存されている)。なお、細胞培養の各種作業としては細胞単離、細胞培養、ガウニング着用、ガウニング洗浄、クリーンルーム進入、退出、その他があり、細胞単離、細胞培養については、さらに複数の工程毎に分割された作業が存在する。
 データベース20K(図2)に保存された細胞培養に関する各種作業のプロトコルに基づいたデータ(位置、姿勢、動作等)は、被験者Eの身長や年齢、性別等に応じて、適宜修正してVR上に表示される。
 被験者Eがプロトコルに従った場合の修正された位置、姿勢、動作等を演算してデータ(位置、姿勢、動作等)を作成し、さらに画像(映像、動画)が作成されて、表示装置4により、VRで表示される。なお、被験者Eの身長や年齢、性別等のデータは、当該教育(訓練)に先立ち、入力装置5を介してコントロールユニット20に入力される。
In the database 20K (see FIG. 2) of the control unit 20 (control device: see FIG. 2), reference positions (for example, hand positions, etc.), postures, movements, etc. are previously set for each of various cell culture operations. It is saved as data (including video). In other words, in the database 20K, the correct position, posture, movement, etc. (model position, posture, movement, etc.) of the worker when the work is performed according to the protocol are stored as data (including video). Has been). In addition, various operations of cell culture include cell isolation, cell culture, wearing gouning, washing washing, entering and exiting a clean room, and the like, and cell isolation and cell culture are further divided into multiple steps. Exists.
Data (position, posture, movement, etc.) based on various work protocols related to cell culture stored in the database 20K (Fig. 2) are appropriately modified according to the height, age, gender, etc. of subject E and are displayed on VR. Is displayed in.
Data (position, posture, movement, etc.) is created by calculating the corrected position, posture, movement, etc. when subject E follows the protocol, and an image (video, moving image) is further created, and the display device 4 Is displayed in VR. Data such as height, age, and gender of subject E are input to the control unit 20 via the input device 5 prior to the education (training).

 ここで、訓練対象となる細胞培養作業について、プログラムの構成(作業を構成する動作の構成)、細胞培養のプロトコル、当該訓練で使用する上述した各種設備、器具(フラスコ、その他)の形状、構造、性能、その他は、細胞培養を行う会社や機関毎に異なる。図示の実施形態においては、その様な会社や機関毎の相違に対応しており、会社及び機関毎にカスタマイズされている。
 また、訓練の際のVR画像と、プロトコルに沿った位置、姿勢、動作等のVR画像において、各種設備、器具、試薬、資材等は実寸で再現されており、被験者Eは実際の作業と等しい感覚を得られるようになっている。
 そして、前記カスタマイズされた訓練内容、使用される各種設備、器具等の仮想現実におけるデータは、制御装置20(図1、図2)のデータベース20Kに(図2)保存され、プロトコル等に対応して選択、参照されるように構成されている。
 例えば、設備、器具等については、サイズの異なるものを仮想現実で複数種類用意して、実際の作業に対応した実寸大のVR画像が仮想現実に存在する様になっている。
Here, regarding the cell culture work to be trained, the structure of the program (the structure of the movements constituting the work), the cell culture protocol, the above-mentioned various equipments and instruments (flasks, etc.) used in the training, and the structure and structure. , Performance, etc. vary depending on the company or institution that performs cell culture. In the illustrated embodiment, such differences between companies and institutions are dealt with, and customization is made for each company and institution.
In addition, in the VR image at the time of training and the VR image of the position, posture, movement, etc. along the protocol, various equipment, instruments, reagents, materials, etc. are reproduced in actual size, and subject E is equivalent to the actual work. You can get a sense.
Then, the data in the virtual reality such as the customized training contents, various equipments and instruments used are stored in the database 20K of the control device 20 (FIGS. 1 and 2) (FIG. 2), and correspond to the protocol and the like. It is configured to be selected and referenced.
For example, with respect to equipment, appliances, etc., a plurality of types having different sizes are prepared in virtual reality, and a full-scale VR image corresponding to actual work exists in virtual reality.

 図2を参照して後述するが、コントロールユニット20において、被験者EのVR上の位置、姿勢、動作等と、プロトコルに沿った位置、姿勢、動作等とを比較して、両者の差異を求める。そして、当該差異が許容範囲内であるか否かを確認して、当該教育の成果を評価する(例えば、合否を判定する)。
 両者の差異が大きな場合には、不合格の判定を下すのみに留まらず、例えば、VR上に表示されている映像を静止して、VR上或いは表示装置4を介して、被験者Eに警告を発する等、教育プログラムに従って必要な処理を行う。
 これにより、細胞培養に関する各種動作の教育或いは訓練が行われる。
As will be described later with reference to FIG. 2, in the control unit 20, the position, posture, movement, etc. of the subject E on the VR are compared with the position, posture, movement, etc. according to the protocol, and the difference between the two is obtained. .. Then, it is confirmed whether or not the difference is within the permissible range, and the result of the education is evaluated (for example, pass / fail is determined).
When the difference between the two is large, not only the judgment of failure is made, but also, for example, the image displayed on the VR is stopped and a warning is given to the subject E on the VR or via the display device 4. Perform necessary processing according to the educational program, such as issuing.
As a result, education or training of various movements related to cell culture is performed.

 図示の実施形態では、細胞培養に関する各種作業の訓練の際は、被験者Eの習熟度、訓練のタイミング等に応じて、「シナリオモード」、「シミュレーションモード」及び「トライアルモード」を選択し、使い分けることが出来る。
 「シナリオモード」は、模範的な作業を示す動画、すなわちお手本となるVR動画を表示したり、作業手順を文字情報や音声情報として再生したりして被験者Eに教えるモード(態様)であり、基本的には被験者Eが初心者の場合が対象となる。換言すれば、シナリオモードは被験者Eが模範的な作業を示す動画や作業手順を文字情報として見たり、音声情報として聞いたりして学習するものであり、被験者Eは仮想現実上で作業動作を行う訳ではない。
 「シミュレーションモード」は、被験者Eが計測装置10(左手用グローブ1A、右手用グローブ1B、ゴーグル2)を装着して、仮想現実で作業動作を行う、或いは練習を行う態様である。基本的にはシナリオモードを経験済であり、ある程度作業手順が理解できた被験者E合が対象となる。シミュレーションモードによる訓練では、被験者Eは訓練の際(作業動作の際)、音声等による作業指示(作業指示シナリオガイド)を受けつつ実行することが可能である。もちろん、「作業指示シナリオガイド」を受けることなく、被験者Eが仮想現実上で作業をする様な設定も可能である。さらに、シミュレーションモードにおいて、被験者Eの作業動作とプロトコルに沿った位置、姿勢、動作等との比較による合否判定、或いはスコア評価は行わないことも可能であるし、或いは、合否判定、スコア評価を行うことも可能である)。
In the illustrated embodiment, when training various tasks related to cell culture, "scenario mode", "simulation mode" and "trial mode" are selected and used properly according to the proficiency level of subject E, the timing of training, and the like. Can be done.
The "scenario mode" is a mode (aspect) for teaching subject E by displaying a video showing a model work, that is, a VR video as a model, or playing back a work procedure as text information or voice information. Basically, the subject E is a beginner. In other words, in the scenario mode, subject E learns by watching a video or work procedure showing a model work as text information or listening to it as audio information, and subject E performs a work operation in virtual reality. I don't do it.
The "simulation mode" is a mode in which the subject E wears the measuring device 10 (left-handed glove 1A, right-handed glove 1B, goggles 2) and performs a work operation or practices in virtual reality. Basically, subjects E who have experienced the scenario mode and can understand the work procedure to some extent are targeted. In the training in the simulation mode, the subject E can execute the training while receiving the work instruction (work instruction scenario guide) by voice or the like during the training (during the work operation). Of course, it is also possible to set the subject E to work in virtual reality without receiving the "work instruction scenario guide". Further, in the simulation mode, it is possible not to perform pass / fail judgment or score evaluation by comparing the work movement of subject E with the position, posture, movement, etc. along the protocol, or the pass / fail judgment and score evaluation are performed. It is also possible to do).

 「トライアルモード」は、被験者Eが計測装置10(左手用グローブ1A、右手用グローブ1B、ゴーグル2)を装着して、仮想現実で作業動作を最後まで行う(原則途中で中断しない)態様であり、作業習熟度確認のための態様である。トライアルモードでは、基本的には、シナリオモード、シミュレーションモードを経験した被験者Eが対象となる。トライアルモードにおいて、プロトコルに沿った位置、姿勢、動作等との比較による合否判定やスコア評価を行う。
 図1において、入力装置5はモードを選択する機能を有するモード切替ブロック5Aを有しており、訓練を実施する際に、被験者Eは、入力装置5を介して、3つのモードから1つを選択することが出来る。ただし、被験者E以外の者(例えばインストラクター)が入力装置5によりモードを選択することも出来る。
 訓練における「シナリオモード」、「シミュレーションモード」、「トライアルモード」の選択或いは切替、各モードの内容及び手順、その他については、図7を参照して後述する。
The "trial mode" is a mode in which the subject E wears the measuring device 10 (left-handed glove 1A, right-handed glove 1B, goggles 2) and performs the work operation to the end in virtual reality (in principle, it is not interrupted in the middle). , This is an aspect for confirming work proficiency. In the trial mode, the subject E who has experienced the scenario mode and the simulation mode is basically targeted. In the trial mode, pass / fail judgment and score evaluation are performed by comparing with the position, posture, movement, etc. according to the protocol.
In FIG. 1, the input device 5 has a mode switching block 5A having a function of selecting a mode, and when performing training, the subject E selects one of the three modes via the input device 5. You can choose. However, a person other than the subject E (for example, an instructor) can select the mode by the input device 5.
The selection or switching of "scenario mode", "simulation mode", and "trial mode" in the training, the contents and procedures of each mode, and the like will be described later with reference to FIG. 7.

 ここで、図示の実施形態で実行される教育(訓練、学習)は幹細胞培養に関する技術を取得、習熟することを目的としており、幹細胞培養に関するプロトコルに沿ったデータ(手本となる様な位置、姿勢、動作、画像等のデータを含む)が設定されている。
 幹細胞培養のためには、人体H(の一部)から培養に必要な細胞を単離する必要があり、細胞を脂肪、臍帯、臍帯血その他から単離している。例えば、脂肪から細胞を単離する場合、毛細血管の周囲から細胞を単離するが、単離された細胞と、細胞が単離される人体(の一部)の双方に大きなダメージを与えることが無い様に、毛細血管の周囲から細心の注意を払って細胞を単離する必要がある。採取された細胞がダメージを受けていると、培養が困難になるからであり、細胞を一度単離すると、同一の人体から再度単離することは困難である。例えば細胞を単離する作業におけるプロトコルに沿った作業者の動作等は、係る見地から演算、作成される。
 換言すると、細胞培養の教育用プログラムにおいて、例えば単離作業のプロトコルに沿ったデータや映像等は、細胞が単離された後の組織と単離された細胞の双方にダメージを与えないような動作等のデータ及び映像となっている。
Here, the education (training, learning) carried out in the illustrated embodiment is aimed at acquiring and mastering the technique related to stem cell culture, and the data according to the protocol related to stem cell culture (position so as to serve as a model). (Including data such as posture, movement, and image) is set.
For stem cell culture, it is necessary to isolate the cells necessary for the culture from (a part of) the human body H, and the cells are isolated from fat, umbilical cord, umbilical cord blood and the like. For example, when isolating cells from fat, the cells are isolated around the capillaries, which can cause significant damage to both the isolated cells and (a part of) the human body from which the cells are isolated. It is necessary to take great care to isolate cells from around the capillaries so that they do not. This is because if the collected cells are damaged, it becomes difficult to culture them, and once the cells are isolated, it is difficult to isolate them again from the same human body. For example, the operation of the worker according to the protocol in the work of isolating the cell is calculated and created from such a viewpoint.
In other words, in an educational program of cell culture, for example, data or images according to the protocol of isolation work do not damage both the tissue after the cells have been isolated and the isolated cells. It is data and video such as operation.

 ここで、細胞培養に関する各種作業では、個人差があっても概略同一の手順で施工することを可能ならしめ、以て危険性が減少する様に、厳格なプロトコルが規定されている。そのため、外科手術等に比較して、各種作業のおけるプロトコルに沿った動作等は同一の手順に従って均一化されている。そのため、仮想現実(VR)を作成するに際しては、SOP(スタンダード オペレーション プログラム)に沿って作成すれば足りる。
 そして、細胞培養に関する各種作業では、同一の手順に従った均一化された動作等の習熟が主目的となるため、仮想現実を用いた訓練が効率的である。
Here, in various operations related to cell culture, a strict protocol is defined so that it is possible to carry out the work in substantially the same procedure even if there are individual differences, and thus the risk is reduced. Therefore, as compared with surgery and the like, the movements and the like according to the protocol in various operations are made uniform according to the same procedure. Therefore, when creating virtual reality (VR), it is sufficient to create it according to SOP (Standard Operation Program).
In various operations related to cell culture, the main purpose is to master uniform movements and the like according to the same procedure, so training using virtual reality is efficient.

 細胞培養に関する各種作業は、細胞を培養する作業を含んでいる。
 細胞を培養する作業、例えば継代作業においては、プロトコルに沿った動作等は、例えば異物による汚染(コンタミネーション)により培養した細胞が全滅することが無い様に、演算、作成されている。
 また、単離や培養はクリーンルーム内で行われるため、ガウニング(専用の服)の着用、着用後の洗浄、クリーンルームに進入するための手順、退出するための手順についても、仮想現実を用いた訓練が実行される。
 ここでクリーンルームは限定された空間なので、上述した作業の実習はクリーニングルームの収容人員(キャパシティ)による制限を受けてしまう。
 しかし、仮想現実を用いた訓練であれば実際のクリーンルームを使用する必要が無く、クリーンルームのキャパシティによる制限を受けない。そして開放空間であっても、訓練することが可能である。
Various operations related to cell culture include operations for culturing cells.
In the work of culturing cells, for example, in the subculture work, the operation according to the protocol is calculated and created so that the cultured cells are not completely destroyed due to contamination by foreign substances, for example.
In addition, since isolation and culture are performed in a clean room, training using virtual reality is also provided for wearing gouning (special clothing), cleaning after wearing, procedures for entering and exiting the clean room. Is executed.
Since the clean room is a limited space here, the above-mentioned work training is limited by the capacity of the cleaning room.
However, training using virtual reality does not require the use of an actual clean room and is not limited by the capacity of the clean room. And even in an open space, it is possible to train.

 さらに、クリーンルームは限定された空間であり、クリーンルーム内での作業は、緊張と集中力の持続の関係から、3時間が限界とされている。それに伴い、クリーンルーム内での作業も3時間以上行うことが出来ない。しかし、仮想現実による訓練であれば、3時間を超えたとしても被験者の肉体や精神に過度の負担を与える恐れが無い。
 これに加えて、細胞培養に関する各種作業は、従来、個々の練習生に対して熟練者がマン・ツー・マンで付き添って指導する必要があった。そのため、人数が不足している熟練者は、本来行うべき作業に加えて、未熟者に対する指導で時間を取られていた。それに対して、仮想現実を用いた訓練では、熟練者がマン・ツー・マンで付き添って指導する必要は無いため、熟練者に過度の負担を掛けずに済む。
 また、仮想現実による訓練であれば、たとえ失敗をしても深刻な事態を惹起しないので、現実の作業で失敗することに比較して、訓練中の失敗を許容出来る。それに起因して、未熟な練習生に過大な緊張を与えてしまうことが無い。そして、失敗した内容を記録して失敗を犯した者が見ることにより失敗の原因を正確に且つ冷静に分析することが出来る。それに加えて、練習生(教育を受ける者、被験者)は、特に失敗した手順を繰り返し反復練習することが出来るので、苦手な点或いは欠点を事故修正することが出来る。
Furthermore, the clean room is a limited space, and work in the clean room is limited to 3 hours due to the relationship between tension and concentration. Along with that, the work in the clean room cannot be performed for more than 3 hours. However, in the case of training by virtual reality, there is no risk of giving an excessive burden to the body and mind of the subject even if it exceeds 3 hours.
In addition to this, various tasks related to cell culture have conventionally required that each trainee be accompanied by a skilled person on a one-to-one basis. Therefore, the skilled workers, who are short of people, have taken time to give guidance to inexperienced people in addition to the work that should be done. On the other hand, in the training using virtual reality, it is not necessary for the expert to accompany and instruct one-on-one, so that the expert does not have to be overloaded.
Moreover, in the case of training by virtual reality, even if a failure is made, a serious situation is not caused, so that a failure during training can be tolerated as compared with a failure in actual work. As a result, it does not give excessive tension to immature trainees. Then, by recording the contents of the failure and viewing it by the person who made the failure, the cause of the failure can be analyzed accurately and calmly. In addition, trainees (educated persons, subjects) can repeatedly practice particularly failed procedures, so that they can correct their weak points or shortcomings.

 図2以下を参照して、図示の実施形態の教育用システムと教育方法をさらに説明する。
 細胞培養教育システム100におけるコントロールユニット20(制御装置)の機能ブロックを示す図2において、コントロールユニット20は破線で囲んで示されており、被験者位置等決定ブロック20A、アバター作成ブロック20B、プログラム決定ブロック20C、補正ブロック20D、則プロトコル位置等決定ブロック20E、則プロトコル画像作成ブロック20F、比較ブロック20G、手順良否判断ブロック20H、表示動画決定ブロック20I、動画作成ブロック20J及びデータベース20Kを有している。
 なお、ブロック20Eにおける「則プロトコル位置等決定」と言う文言は、「プログラムに従って位置等を決定する」旨を意味している。そしてブロック20Fにおける「則プロトコル画像作成」と言う文言は、「プログラムに従って画像を作成する」旨を意味している。
The educational system and the educational method of the illustrated embodiment will be further described with reference to FIG. 2 and below.
In FIG. 2, which shows the functional blocks of the control unit 20 (control device) in the cell culture education system 100, the control unit 20 is surrounded by a broken line, and the subject position determination block 20A, the avatar creation block 20B, and the program determination block are shown. It has 20C, correction block 20D, rule protocol position determination block 20E, rule protocol image creation block 20F, comparison block 20G, procedure pass / fail judgment block 20H, display video determination block 20I, video creation block 20J, and database 20K.
The phrase "determine the position or the like of the rule protocol" in the block 20E means "determine the position or the like according to the program". The wording "rule protocol image creation" on the block 20F means "creating an image according to a program".

 被験者位置等決定ブロック20Aは、被験者E(図1)が装着しているグローブ1(左手用グローブ1A、右手用グローブ1B)、ゴーグル2、カメラ3から被験者Eの位置(例えば手の位置)、姿勢、動作(被験者Eの状態)等に関する情報を、信号ラインSL1を介して取得し、被験者Eの手等のリアルタイムな位置、姿勢、動作等を決定する機能を有している。ここで、符号「SL1」は、図1における信号ラインSL1-1A、SL1-1B、SL1-2、SL1-3を包括した表現である。
 被験者位置等決定ブロック20Aで決定された被験者Eの位置、姿勢、動作等のデータは、信号ラインSL2を介してアバター作成ブロック20Bに送信される。
The subject position determination block 20A includes a glove 1 (left hand glove 1A, right hand glove 1B) worn by subject E (FIG. 1), goggles 2, and a position of subject E from the camera 3 (for example, the position of a hand). It has a function of acquiring information on posture, movement (state of subject E), etc. via the signal line SL1 and determining the real-time position, posture, movement, etc. of the hand of subject E, etc. Here, the reference numeral "SL1" is an expression including the signal lines SL1-1A, SL1-1B, SL1-2, and SL1-3 in FIG.
Data such as the position, posture, and motion of the subject E determined by the subject position determination block 20A are transmitted to the avatar creation block 20B via the signal line SL2.

 アバター作成ブロック20Bは、被験者位置等決定ブロック20Aから取得した被験者Eの位置、姿勢、動作等のデータに基づき、VR上のアバター(映像、画像、分身画像)を、演算、作成する機能を有する。当該演算、作成する機能は、従来公知の技術を適用することにより実行される。
 アバター作成ブロック20Bで作成した画像(アバター)は、信号ラインSL3を介して比較ブロック20Gに送信されると共に、信号ラインSL4を介して動画作成ブロック20Jに送信される。
 動画作成ブロック20Jは、アバター作成ブロック20Bから取得した映像(アバター)のデータに基づいて、VR上における被験者Eの作業映像を作成する機能を有する。動画作成ブロック20Jで作成した被験者Eの作業映像のデータは、信号ラインSL1-2を介して被験者Eが装着するゴーグル2に送信され、ゴーグル2により、被験者Eは表示された映像をVR上の映像として視認する。
 また、動画作成ブロック20Jで作成した被験者Eの作業映像のデータ信号は、信号ラインSL18を介して表示装置4(モニタ)に送信され、表示装置4はアバター等がVR上で表示されている映像を表示する。これにより、被験者E以外の者(例えばインストラクター)がVR上の映像をチェックすることが出来る。
 なお、動画作成ブロック20Jのその他の機能については、追って詳述する。
The avatar creation block 20B has a function of calculating and creating an avatar (video, image, alter ego image) on VR based on data such as the position, posture, and motion of subject E acquired from the subject position determination block 20A. .. The calculation and the function to be created are executed by applying a conventionally known technique.
The image (avatar) created by the avatar creation block 20B is transmitted to the comparison block 20G via the signal line SL3 and is transmitted to the moving image creation block 20J via the signal line SL4.
The moving image creation block 20J has a function of creating a working image of the subject E on the VR based on the data of the image (avatar) acquired from the avatar creation block 20B. The data of the work image of the subject E created by the moving image creation block 20J is transmitted to the goggles 2 worn by the subject E via the signal line SL1-2, and the subject E displays the displayed image on the VR by the goggles 2. Visualize as an image.
Further, the data signal of the work image of the subject E created by the moving image creation block 20J is transmitted to the display device 4 (monitor) via the signal line SL18, and the display device 4 is an image in which the avatar or the like is displayed on the VR. Is displayed. As a result, a person other than the subject E (for example, an instructor) can check the image on the VR.
The other functions of the moving image creation block 20J will be described in detail later.

 教育実施者(被験者Eも包含するが、被験者Eに限定される訳ではない)は、入力装置5を介して、細胞培養に関する教育(訓練)の種類を入力する。プログラム決定ブロック20Cは、入力された教育の種類に対応する対象プログラムを決定する機能を有する。
 教育(訓練)の種類としては、例えば、細胞単離、細胞培養、ガウニング着用、ガウニング洗浄、クリーンルーム進入、退出等の作業がある。細胞単離、細胞培養については、訓練の内容は複数の段階に分かれている場合がある。
 ここで、プログラム決定ブロック20Cで決定される対象プログラムについては、それぞれ手本となる(或いは基準となる)作業者の正しい位置(例えば手の位置)、姿勢、動作等が、予めデータベース20Kに保存されている。すなわち、個々の対象プラグラムについて、プロトコルに沿った正しい(作業者の)位置、姿勢、動作等がデータベース20Kに保存されている。
 プログラム決定ブロック20Cで決定された対象プログラムの種類(情報)は、信号ラインSL6を介してデータベース20Kに送信されると共に、信号ラインSL7を介して則プロトコル位置等決定ブロック20Eに送信される。
The educator (including, but not limited to, subject E) inputs the type of education (training) related to cell culture via the input device 5. The program determination block 20C has a function of determining a target program corresponding to the input type of education.
Types of education (training) include, for example, cell isolation, cell culture, wearing gouning, washing washing, entering and exiting a clean room, and the like. Regarding cell isolation and cell culture, the content of training may be divided into multiple stages.
Here, for the target program determined by the program determination block 20C, the correct position (for example, hand position), posture, movement, etc. of the worker who serves as a model (or reference) is stored in the database 20K in advance. Has been done. That is, for each target program, the correct (worker's) position, posture, movement, etc. according to the protocol are stored in the database 20K.
The type (information) of the target program determined by the program determination block 20C is transmitted to the database 20K via the signal line SL6 and also transmitted to the rule protocol position determination block 20E via the signal line SL7.

 補正ブロック20Dは、入力装置5を介して入力した被験者E(訓練対象者)に関する情報を、信号ラインSL8を介して取得する。被験者Eに関する情報は、例えば被験者Eの識別番号、性別、年齢、身長等であり、その他の体格情報等を含む場合もある。
 補正ブロック20Dは、取得した被験者Eに関する情報(例えば被験者Eの身長、体型、性別等のデータ)に基づき、各対象作業を行う際のプロトコルに沿った正しい位置(例えば手の位置)、姿勢、動作等に関するデータ(手本となるデータ)を補正するためのデータを作成する機能を有する。
 補正ブロック20Dで補正されたプロトコルに沿った位置、姿勢、動作等を補正するためのデータは、信号ラインSL9を介して則プロトコル位置等決定ブロック20Eに送信される。
The correction block 20D acquires information about the subject E (training target person) input via the input device 5 via the signal line SL8. The information regarding the subject E is, for example, the identification number, gender, age, height, etc. of the subject E, and may include other physique information and the like.
The correction block 20D is based on the acquired information about the subject E (for example, data such as the height, body shape, and gender of the subject E), and the correct position (for example, the position of the hand), the posture, and the posture according to the protocol when performing each target work. It has a function to create data for correcting data related to operations (model data).
The data for correcting the position, posture, motion, etc. along the protocol corrected by the correction block 20D is transmitted to the rule protocol position determination block 20E via the signal line SL9.

 則プロトコル位置等決定ブロック20Eは、プログラム決定ブロック20Cから信号ラインSL7を介して対象プログラムの種類の情報を取得し、データベース20Kから信号ラインSL10を介してプロトコルに沿った正しい位置(例えば手の位置)、姿勢、動作等のデータを所得し、補正ブロック20Dから信号ラインSL9を介して被験者Eの身長等によりプロトコルに沿った位置、姿勢、動作データを補正するためのデータ(補正分データ)を取得する。
 則プロトコル位置等決定ブロック20Eは、被験者Eに関する補正分データに基づき、プロトコルに沿った正しい位置、姿勢、動作等(補正された位置、姿勢、動作等)を決定する機能を有する。
 則プロトコル位置等決定ブロック20Eで決定されたプロトコルに沿った正確な(補正された)位置、姿勢、動作等のデータは、信号ラインSL11を介して則プロトコル画像作成ブロック20Fに送信されると共に、信号ラインSL12を介して比較ブロック20Gに送信される。
The protocol position determination block 20E acquires information on the type of the target program from the program determination block 20C via the signal line SL7, and the correct position along the protocol (for example, the position of the hand) from the database 20K via the signal line SL10. ), Posture, motion data, etc., and data (correction data) for correcting the position, posture, motion data according to the protocol from the correction block 20D via the signal line SL9 according to the height of subject E, etc. get.
The rule protocol position determination block 20E has a function of determining a correct position, posture, motion, etc. (corrected position, posture, motion, etc.) according to the protocol based on the correction data for the subject E.
Data such as accurate (corrected) position, posture, and motion according to the protocol determined by the rule protocol position determination block 20E are transmitted to the rule protocol image creation block 20F via the signal line SL11, and are also transmitted. It is transmitted to the comparison block 20G via the signal line SL12.

 則プロトコル画像作成ブロック20Fは、則プロトコル位置等決定ブロック20Eから取得したデータに基づき、プロトコルに沿った正確な位置、姿勢、動作等の画像或いは映像を、演算、作成する機能を有している。
 則プロトコル画像作成ブロック20Fで作成した画像(映像)は、信号ラインSL13を介して比較ブロック20Gに送信される。
The rule protocol image creation block 20F has a function of calculating and creating an image or video of an accurate position, posture, motion, etc. according to the protocol based on the data acquired from the rule protocol position determination block 20E. ..
The image (video) created by the protocol image creation block 20F is transmitted to the comparison block 20G via the signal line SL13.

 比較ブロック20Gは、アバター作成ブロック20Bから取得した被験者Eの画像における位置、姿勢、動作等と、則プロトコル位置等決定ブロック20Eから取得したプロトコルに沿った正確なデータ(位置、姿勢、動作等)を比較する機能を有している。
 比較ブロック20Gにおける比較に際して、被験者Eの画像における位置、姿勢、動作等のデータと、プロトコルに沿った正確な位置、姿勢、動作等のデータの差異が演算される。係る差異は、手順良否判断ブロック20Hにおいて、予め定められた所定値(しきい値)と比較されて、当該教育の対象となる作業が正確に行われた否かが判定される。
 比較ブロック20Gにおける前記比較は、アバター作成ブロック20Bから取得した被験者Eの画像(映像)と、則プロトコル画像作成ブロック20Fから取得したプロトコルに沿った正確な画像(映像)とを比較して(すなわち、画像同士を比較して)、VR上の画像の差異を演算する機能を有する様に構成しても良い。
 或いは、画像(映像)の位置等ではなく、位置、姿勢、動作等のデータとプロトコルに沿った正確な位置、姿勢、動作等のデータとを比較しても良い。
The comparison block 20G includes the position, posture, motion, etc. in the image of the subject E acquired from the avatar creation block 20B, and accurate data (position, posture, motion, etc.) according to the protocol acquired from the rule protocol position determination block 20E. Has a function to compare.
At the time of comparison in the comparison block 20G, the difference between the data such as the position, posture, and movement in the image of the subject E and the data such as the accurate position, posture, and movement according to the protocol is calculated. The difference is compared with a predetermined value (threshold value) set in advance in the procedure pass / fail judgment block 20H, and it is determined whether or not the work targeted for the education has been performed accurately.
In the comparison in the comparison block 20G, the image (video) of the subject E acquired from the avatar creation block 20B is compared with an accurate image (video) according to the protocol acquired from the rule protocol image creation block 20F (that is,). , By comparing the images), it may be configured to have a function of calculating the difference between the images on the VR.
Alternatively, the data such as position, posture, and motion may be compared with the data such as accurate position, posture, and motion according to the protocol instead of the position and the like of the image (video).

 すなわち、比較ブロック20Gでは、
 (A) 被験者Eの画像(アバター)の位置等と、プロトコルに沿った正確な位置等のデータの比較、
 (B) 被験者Eの画像(アバター)と、プロトコルに沿った正確な位置、姿勢、動作等の画像(アバター)の比較、
 (C) 被験者Eの位置等のデータと、プロトコルに沿った正確な位置等のデータの比較、
の何れかが行われる。
 比較ブロック20Gによる比較結果は、信号ラインSL14を介して手順良否判断ブロック20Hに送信される。
That is, in the comparison block 20G,
(A) Comparison of data such as the position of the image (avatar) of subject E and the exact position according to the protocol,
(B) Comparison of the image (avatar) of subject E with the image (avatar) of the exact position, posture, movement, etc. according to the protocol.
(C) Comparison of data such as the position of subject E and data such as the exact position according to the protocol,
Is done.
The comparison result by the comparison block 20G is transmitted to the procedure pass / fail judgment block 20H via the signal line SL14.

 手順良否判断ブロック20Hは、比較ブロック20Gから取得した比較結果に基づき、当該教育対象作業における被験者Eの位置、姿勢、動作等(すなわち作業手順)の良否を判断する機能を有する。
 明確には図示されないが、当該判断に際して、前記(A)~(C)における差異が予め設定された第1の所定値以下である場合に、被験者Eの作業手順を「良」、すなわち容認可能(合格)と判断する。
 一方、当該差異が第1の所定値よりも大きい場合に、被験者Eの作業手順を「不良」、すなわち容認不可(不合格)と判断する。
 さらに、当該差異が第1の所定値よりも大きいが、第2の所定値(第1の所定値より大きい)以下の場合に(差異が小差)、被験者Eの作業手順を、「不良であるが不良の程度は小さい」と判断する。また、当該差異が第2の所定値よりも大きい場合に(差異が大差)、被験者Eの作業手順を、「不良であり不良の程度は大きい」と判断する。
 手順良否判断ブロック20Hの判断結果は、信号ラインSL15を介して表示動画決定ブロック20Iに送信される。
The procedure pass / fail determination block 20H has a function of determining the pass / fail of the position, posture, movement, etc. (that is, work procedure) of the subject E in the work to be educated, based on the comparison result obtained from the comparison block 20G.
Although not clearly shown, the work procedure of subject E is "good", that is, acceptable when the difference in (A) to (C) is equal to or less than a preset first predetermined value in the judgment. Judge as (pass).
On the other hand, when the difference is larger than the first predetermined value, the work procedure of the subject E is determined to be "poor", that is, unacceptable (failed).
Further, when the difference is larger than the first predetermined value but less than or equal to the second predetermined value (greater than the first predetermined value) (the difference is a small difference), the work procedure of the subject E is described as "bad There is, but the degree of defect is small. " Further, when the difference is larger than the second predetermined value (the difference is large), it is determined that the work procedure of the subject E is "defective and the degree of defect is large".
The determination result of the procedure pass / fail determination block 20H is transmitted to the display moving image determination block 20I via the signal line SL15.

 表示動画決定ブロック20Iは、手順良否判断ブロック20Hから取得した判断結果に基づき、VR上で表示される(見る:確認する)映像(動画)を決定する機能を有する。
 映像(動画)の決定に際して、被験者Eの画像(における位置、姿勢、動作等)とプロトコルに沿った正確な位置、姿勢、動作等との差異が第1の所定値以下の場合、すなわち手順良否判断ブロック20Hからの良否判断結果が「良」の場合は、VR上には、その作業手順が「良」であり容認可能(合格)であることを示す映像(動画)が表示される。
The display moving image determination block 20I has a function of determining an image (moving image) to be displayed (viewed: confirmed) on the VR based on the determination result acquired from the procedure pass / fail determination block 20H.
When determining the video (video), the difference between the image of subject E (position, posture, movement, etc.) and the accurate position, posture, movement, etc. according to the protocol is less than or equal to the first predetermined value, that is, the procedure is good or bad. When the pass / fail judgment result from the judgment block 20H is "good", a video (video) indicating that the work procedure is "good" and acceptable (pass) is displayed on the VR.

 手順良否判断ブロック20Hからの良否判断結果が「否」であり、被験者Eの画像(における位置、姿勢、動作等)とプロトコルに沿った正確な位置、姿勢、動作等との差異が第1の所定値より大きく第2の所定値以下である場合、すなわち、「不良の程度が小さい」場合には、被験者Eには、例えば、被験者Eの作業手順(位置、姿勢、動作等)とプロトコルに沿った正確な位置、姿勢、動作等との違いを明示する映像(動画)をVR上で表示する。前記違いを明示する映像は、被験者EがVR上で行った作業手順と、プロトコルに沿った正確な作業手順との違いについて、被験者Eが自ら理解出来る様な映像として演算、作成されることが望ましい。例えば、被験者Eの作業手順とプロトコルに沿った正確な作業手順とを重ねて表示して、両者の違いが明瞭となる様な映像(動画)をVR上に表示する。なお、単に、プロトコルに沿った正確な位置、姿勢、動作等の映像(動画)をVR上で表示しても良い。
 手順良否判断ブロック20Hからの良否判断結果が「否」であり、被験者Eの画像(における位置、姿勢、動作等とプロトコルに沿った正確な位置、姿勢、動作等との差異が第2の所定値より大きい場合、すなわち「不良の程度が大きい」場合には、VR上で被験者Eに表示する映像(動画)は、評価結果を被験者Eが深刻に受け止める様な内容にする。例えば、作業手順に起因して培養していた幹細胞が全滅する様子を表示したアニメーション等が、VR上で表示される。
 表示動画決定ブロック20Iの決定結果は、信号ラインSL16を介して動画作成ブロック20Jに送信される。
The pass / fail judgment result from the procedure pass / fail judgment block 20H is "no", and the difference between the image of subject E (position, posture, movement, etc.) and the accurate position, posture, movement, etc. according to the protocol is the first. When it is larger than the predetermined value and equal to or less than the second predetermined value, that is, when the degree of defect is small, the subject E is, for example, in the work procedure (position, posture, movement, etc.) and protocol of the subject E. An image (moving image) that clearly shows the difference from the exact position, posture, movement, etc. along the line is displayed on the VR. The video that clearly shows the difference may be calculated and created as a video that the subject E can understand by himself / herself about the difference between the work procedure performed by the subject E on the VR and the accurate work procedure according to the protocol. desirable. For example, the work procedure of subject E and the accurate work procedure according to the protocol are superimposed and displayed, and a video (moving image) in which the difference between the two becomes clear is displayed on the VR. It should be noted that a video (moving image) of an accurate position, posture, motion, etc. according to the protocol may be simply displayed on the VR.
The pass / fail judgment result from the procedure pass / fail judgment block 20H is "no", and the difference between the image of subject E (position, posture, movement, etc. in) and the accurate position, posture, movement, etc. according to the protocol is the second predetermined value. If it is larger than the value, that is, if the degree of defect is large, the video (animation) displayed to the subject E on the VR should be such that the subject E takes the evaluation result seriously, for example, a work procedure. An animation or the like showing how the cultured stem cells are completely destroyed due to the above is displayed on the VR.
The determination result of the display moving image determination block 20I is transmitted to the moving image creation block 20J via the signal line SL16.

 動画作成ブロック20Jは、表示動画決定ブロック20Iから取得した決定結果に基づき、データベース20Kから信号ラインSL17を介して対応する映像(動画)データを取得し、当該教育(訓練)の評価結果を踏まえた映像(動画)を作成する機能を有する。
 なお、データベース20Kには、細胞培養に関する教育(訓練)の種類毎に教育の評価別(「判断結果が良」、「判断結果が不良でありその程度が小さい」、「判断結果が不良でありその程度が大きい」)に対応する映像(動画)データが保存されている。
 ここで、被験者Eの作業手順(位置、姿勢、動作等)とプロトコルに沿った正確な位置、姿勢、動作等との違いの映像(動画)を作成する場合は、データベース20Kの映像(動画)データに加えてアバター(画像)のデータを処理して映像(動画)を作成することも出来る。
The video creation block 20J acquires the corresponding video (video) data from the database 20K via the signal line SL17 based on the determination result acquired from the display video determination block 20I, and based on the evaluation result of the education (training). It has a function to create a video (moving image).
In the database 20K, each type of education (training) related to cell culture is evaluated by education (“judgment result is good”, “judgment result is poor and its degree is small”, and “judgment result is poor”. The video (video) data corresponding to "the degree is large") is saved.
Here, when creating a video (video) of the difference between the work procedure (position, posture, movement, etc.) of subject E and the accurate position, posture, movement, etc. according to the protocol, the video (video) of the database 20K It is also possible to create a video (video) by processing the avatar (image) data in addition to the data.

 動画作成ブロック20Jで作成された映像(動画)のデータは、信号ラインSL18を介して表示装置4(モニタ)に送信され、表示装置4で放映される。また、当該映像(動画)のデータは、信号ラインSL1-2を介して被験者Eが装着するゴーグル2に送信され、VR上で放映される。
 データベース20Kは、上述した様に、細胞培養に関する各教育(訓練)に対応する対象プログラム、各教育対象作業におけるプロトコルに沿った作業者の正確な位置(例えば手の位置)、姿勢、動作等のデータ、当該教育(訓練)の評価結果を踏まえた評価別の映像(動画)、その他を保存しており、必要に応じて各機能ブロックにより保存した内容を送信する。
 データベース20Kには、前述された会社或いは機関毎にカスタマイズされた複数の訓練内容、同複数の各種設備、器具等の仮想現実におけるデータが保存される。
The video (moving image) data created by the moving image creation block 20J is transmitted to the display device 4 (monitor) via the signal line SL18 and is broadcast on the display device 4. Further, the data of the video (moving image) is transmitted to the goggles 2 worn by the subject E via the signal line SL1-2, and is broadcast on the VR.
As described above, the database 20K contains the target program corresponding to each education (training) related to cell culture, the accurate position (for example, hand position), posture, movement, etc. of the worker according to the protocol in each education target work. Data, videos (videos) for each evaluation based on the evaluation results of the education (training), etc. are saved, and the contents saved by each functional block are transmitted as needed.
In the database 20K, a plurality of training contents customized for each company or institution described above, and data in virtual reality such as the plurality of various facilities and instruments are stored.

 上述した様に、訓練を実施する際に、実施者(被験者E、その他)は、入力装置5を操作して、「シナリオモード」、「シミュレーションモード」、「トライアルモード」の3つのモードから1つを選択する。
 図2において、モード切替ブロック5A(図1参照:図2では図示せず)により、信号ラインSL19を介して、制御装置20にモード選択信号が送信される。モード選択信号を受信した制御装置20は、当該モードに沿った制御を実行する。
 例えば、シナリオモードの場合、被験者Eは作業動作を行わないため、図2における被験者位置等決定ブロック20A、アバター作成ブロック20B等は機能しない。そのため、被験者Eの動作とプロトコルに沿った位置、姿勢、動作等との比較、評価も実行されず、プログラム決定ブロック20C、則プロトコル位置等決定ブロック20E、比較ブロック20G、手順良否判断ブロック20H等も機能しない。
 図2において、シナリオモードの際に模範(お手本)となるVR動画や、作業手順を文字情報や音声情報として再生して教える機能は、データベース20K、動画作成ブロック20J、表示装置4、ゴーグル2により実行される。
 また、トライアルモードを行う場合は、制御装置20における各ブロックを機能して実行される。さらにシミュレーションモードにおいて、被験者Eの動作とプロトコルに沿った位置、姿勢、動作等との比較、評価は行わない場合には、比較、評価に関連するブロックは機能しない。
As described above, when carrying out the training, the practitioner (subject E, etc.) operates the input device 5 to select 1 from the three modes of "scenario mode", "simulation mode", and "trial mode". Select one.
In FIG. 2, the mode switching block 5A (see FIG. 1: not shown in FIG. 2) transmits a mode selection signal to the control device 20 via the signal line SL19. The control device 20 that has received the mode selection signal executes control according to the mode.
For example, in the scenario mode, since the subject E does not perform the work operation, the subject position determination block 20A, the avatar creation block 20B, and the like in FIG. 2 do not function. Therefore, the movement of the subject E and the position, posture, movement, etc. along the protocol are not compared and evaluated, and the program determination block 20C, the rule protocol position determination block 20E, the comparison block 20G, the procedure pass / fail judgment block 20H, etc. Does not work either.
In FIG. 2, the VR video that serves as a model (model) in the scenario mode and the function of reproducing and teaching the work procedure as text information and voice information are provided by the database 20K, the video creation block 20J, the display device 4, and the goggles 2. Will be executed.
Further, when the trial mode is performed, each block in the control device 20 is functioning and executed. Further, in the simulation mode, if the movement of the subject E is not compared and evaluated with the position, posture, movement, etc. along the protocol, the blocks related to the comparison and evaluation do not function.

 次に図3~図6を参照してVR(仮想現実)を用いた細胞培養教育(訓練)方法の手順について説明する。図3~図6は、主としてトライアルモード及びシミュレーションモードで被験者Eの動作とプロトコルに沿った位置、姿勢、動作等との比較、評価を行う場合を示している。
 図3において、ステップS1では、実施すべき訓練(細胞培養に関する訓練或いは教育)のプログラムが選択されたか否かを判断する。具体的には、入力装置5を介してコントロールユニット20(制御装置、図2参照)のプログラム決定ブロック20Cに訓練の種類が入力されたか否かを判断する。
 ステップS1において、訓練プログラムが選択された場合(ステップS1が「Yes」)はステップS2に進み、訓練の種類が選択されない場合(ステップS1が「No」)はステップS1に戻る(ステップS1が「No」のループ)。
Next, the procedure of the cell culture education (training) method using VR (virtual reality) will be described with reference to FIGS. 3 to 6. 3 to 6 show a case where the movement of the subject E is compared and evaluated with the position, posture, movement, etc. along the protocol mainly in the trial mode and the simulation mode.
In FIG. 3, in step S1, it is determined whether or not the training program (training or education related to cell culture) to be performed has been selected. Specifically, it is determined whether or not the training type is input to the program determination block 20C of the control unit 20 (control device, see FIG. 2) via the input device 5.
In step S1, if the training program is selected (step S1 is "Yes"), the process proceeds to step S2, and if the training type is not selected (step S1 is "No"), the process returns to step S1 (step S1 is "Yes"). No "loop).

 ステップS2では、被験者Eが装着するグローブ1(1A、1B)、ゴーグル2及びカメラ3から被験者Eの位置(例えば手の位置)、姿勢、動作等に関する情報が入力される。具体的には、被験者Eの位置、姿勢、動作等に関する情報は、図示の実施形態では、グローブ1(1A、1B)、ゴーグル2、カメラ3からコントロールユニット20の被験者位置等決定ブロック20Aに入力される。
 続くステップS3では、ステップS2で取得した位置、姿勢、動作等に関する情報から被験者Eの位置、姿勢を特定する。
 またステップS3では、VR(ARも含む)における被被験者Eの動作等を特定する。被験者Eの位置、姿勢、動作等の特定は、コントロールユニット20の被験者位置等決定ブロック20Aで実行される。
 さらにステップS3では、アバター作成ブロック20Bにより、被験者Eのアバター(画像:例えば手の画像)を演算、作成し、VR上に表示する。
In step S2, information on the position (for example, the position of the hand), posture, movement, etc. of the subject E is input from the gloves 1 (1A, 1B), the goggles 2, and the camera 3 worn by the subject E. Specifically, in the illustrated embodiment, information on the position, posture, movement, etc. of the subject E is input from the glove 1 (1A, 1B), the goggles 2, the camera 3 to the subject position determination block 20A of the control unit 20. Will be done.
In the following step S3, the position and posture of the subject E are specified from the information on the position, posture, movement and the like acquired in step S2.
Further, in step S3, the movement of the subject E in VR (including AR) and the like are specified. The position, posture, motion, etc. of the subject E are specified by the subject position determination block 20A of the control unit 20.
Further, in step S3, the avatar creation block 20B calculates and creates an avatar (image: for example, a hand image) of the subject E and displays it on the VR.

 次のステップS4では、被験者Eの位置、姿勢、動作等と、プロトコル上の正確な位置、姿勢、動作等とを比較する(比較ブロック20G等)。
 図4を参照して、図3のステップS4を分割して説明する。
 図4において、ステップS41では、実施しようとする細胞培養に関する訓練(教育)の種類を読み込むと共に、被験者Eに関するデータ(性別、年齢、身長等)を読み込む。訓練の種類については入力装置5(図2)からプログラム決定ブロック20Cに入力され、被験者Eに関するデータは入力装置5から補正ブロック20Dに入力される。
 そしてステップS42に進む。
In the next step S4, the position, posture, movement, etc. of the subject E are compared with the accurate position, posture, movement, etc. on the protocol (comparison block 20G, etc.).
With reference to FIG. 4, step S4 of FIG. 3 will be described separately.
In FIG. 4, in step S41, the type of training (education) related to the cell culture to be performed is read, and the data (gender, age, height, etc.) related to the subject E is read. The type of training is input from the input device 5 (FIG. 2) to the program determination block 20C, and the data regarding the subject E is input from the input device 5 to the correction block 20D.
Then, the process proceeds to step S42.

 ステップS42では、選択(特定)された訓練(教育)におけるプロトコル上の正しい位置、姿勢、動作等(お手本となる動作等)を読み込む。当該読み込みは則プロトコル位置等決定ブロック20Eで行われ、プログラム決定ブロック20Cから訓練の種類を取得し、当該訓練の種類に対応するデータをデータベース20Kから取得して実行する。
 また、ステップS42では、被験者Eに関するデータ(性別、年齢、身長等)に応じて、データベース20Kから読み込んだプロトコル上の正しい位置、姿勢、動作等のデータを被験者Eに対応した正確なデータに補正する。当該補正は則プロトコル位置等決定ブロック20Eで行われ、補正ブロック20Dから被験者Eのデータに基づく補正分データを取得した上で実行される。
 そしてステップS43に進む。
In step S42, the correct position, posture, motion, etc. (model motion, etc.) on the protocol in the selected (specified) training (education) are read. The reading is performed by the rule protocol position determination block 20E, the training type is acquired from the program determination block 20C, and the data corresponding to the training type is acquired from the database 20K and executed.
Further, in step S42, the data such as the correct position, posture, and movement on the protocol read from the database 20K is corrected to the accurate data corresponding to the subject E according to the data (gender, age, height, etc.) related to the subject E. To do. The correction is performed in the rule protocol position determination block 20E, and is executed after acquiring the correction amount data based on the data of the subject E from the correction block 20D.
Then, the process proceeds to step S43.

 ステップS43では、被験者Eの位置、姿勢、動作等と、被験者Eのデータにより補正されたプロトコル上の正確な位置、姿勢、動作等とを比較する。
 ステップS43における比較は、比較ブロック20Gで実行される。その際、被験者Eの位置、姿勢、動作等は、アバター作成ブロック20Bから取得した被験者Eの画像(アバター)に基づいて決定され、補正されたプロトコル上の正確な位置、姿勢、動作等は、則プロトコル位置等決定ブロック20Eから取得したデータ、或いは、則プロトコル画像作成ブロック20Fから取得したプロトコルに沿った正確な位置、姿勢、動作等に関する映像から決定される。
 被験者Eの位置、姿勢、動作等としては、被験者Eの画像(アバター)でなく被験者Eの位置、姿勢、動作等のデータそのものを、プロトコルに沿った正確な位置、姿勢、動作等と比較することも出来る。
 そしてステップS5(図3)に進む。
In step S43, the position, posture, movement, etc. of the subject E are compared with the accurate position, posture, movement, etc. on the protocol corrected by the data of the subject E.
The comparison in step S43 is performed in comparison block 20G. At that time, the position, posture, motion, etc. of the subject E are determined based on the image (avatar) of the subject E acquired from the avatar creation block 20B, and the accurate position, posture, motion, etc. on the corrected protocol are determined. It is determined from the data acquired from the rule protocol position determination block 20E or the video relating to the accurate position, posture, motion, etc. along the protocol acquired from the rule protocol image creation block 20F.
As for the position, posture, movement, etc. of the subject E, the data itself such as the position, posture, movement, etc. of the subject E, not the image (avatar) of the subject E, is compared with the accurate position, posture, movement, etc. according to the protocol. You can also do it.
Then, the process proceeds to step S5 (FIG. 3).

 再び図3において、ステップS5では、ステップS4の比較結果を受け、被験者Eの画像(における位置、姿勢、動作等)とプロトコル上の正確な位置、姿勢、動作等との差異が許容範囲内であるか否かを判断する。換言すれば、被験者Eの位置、姿勢、動作等が良好であるか否か(「合格」であるか否か)を判断する。
 被験者Eの位置、姿勢、動作等が良好であるか否か(「合格」であるか否か)の判断は、比較ブロック20G及び手順良否判断ブロック20Hにおいて、図2を参照して前述された態様で実行される。
 ステップS5において前記差異が許容範囲内の場合(ステップS5が「Yes」:差異が第1の所定値以内)にはステップS6に進み、前記差異が許容範囲内でない場合(ステップS5が「No」:差異が第1の所定値より大きい)にはステップS7に進む。
Again, in FIG. 3, in step S5, based on the comparison result of step S4, the difference between the image of subject E (position, posture, movement, etc.) and the accurate position, posture, movement, etc. on the protocol is within the permissible range. Determine if it exists. In other words, it is determined whether or not the position, posture, movement, etc. of the subject E are good (whether or not it is "passed").
Judgment as to whether or not the position, posture, movement, etc. of subject E is good (whether or not it is "passed") is described above in the comparison block 20G and the procedure pass / fail judgment block 20H with reference to FIG. Performed in an embodiment.
If the difference is within the permissible range in step S5 (step S5 is “Yes”: the difference is within the first predetermined value), the process proceeds to step S6, and if the difference is not within the permissible range (step S5 is “No”). : The difference is larger than the first predetermined value), the process proceeds to step S7.

 ステップS6(ステップS5が「Yes」:差異が第1の所定値以内)では、細胞培養に関する訓練(教育)を終了するか否かを判断する。
 ステップS6の判断の結果、訓練を終了する場合(ステップS6が「Yes」)は図3、図4で示す手順を終了し、訓練を終了しない場合(ステップS6が「No」)、ステップS2に戻る。
 なお、訓練を終了しないでステップS2に戻った場合(ステップS6が「No」)、被験者Eは今までと同種類の訓練を継続して実施する。図示はされていないが、被験者Eが他の訓練を希望する場合には、ステップS2に戻ることに代えてステップS1に戻る様にすることが出来る。その場合(ステップS1に戻る場合)、被験者Eは改めて訓練を選択して、希望する訓練を行うことが出来る。
In step S6 (step S5 is "Yes": the difference is within the first predetermined value), it is determined whether or not to end the training (education) related to cell culture.
As a result of the determination in step S6, when the training is terminated (step S6 is “Yes”), the procedures shown in FIGS. 3 and 4 are terminated, and when the training is not completed (step S6 is “No”), step S2 is performed. Return.
If the subject returns to step S2 without completing the training (step S6 is “No”), the subject E continues to carry out the same type of training as before. Although not shown, if subject E desires other training, he / she can return to step S1 instead of returning to step S2. In that case (when returning to step S1), the subject E can select the training again and perform the desired training.

 ステップS7(ステップS5が「No」:差異が第1の所定値より大きい)では、被験者Eの位置、姿勢、動作等が許容範囲内でなく、良好でないという判断結果を受けて、被験者Eに当該教育(訓練)の評価結果を確認(認識)させるための映像(動画)を決定してVR上に表示する。
 ここで、図3のステップS7を、図5で示す様に詳細な複数のステップに分割して説明する。
 図3のステップS7は、ステップS5において、被験者Eの位置、姿勢、動作等とプロトコル上の正確な位置、姿勢、動作等との差異が許容範囲内でないと判断された場合である。図5のステップS71では、被験者Eの位置、姿勢、動作等とプロトコル上の正確な位置、姿勢、動作等との差異が大きいか小さいかを、比較ブロック20G及び手順良否判断ブロック20Hで判断する。ここで、差異が大きいか小さいかのしきい値は、訓練内容や被験者Eその他の条件により、ケース・バイ・ケースで設定される。
 ステップS71の判断の結果、前記差異が第2の所定値より大きい場合(前記差異が大差である場合)はステップS72に進み、前記差異が第2の所定値以下の場合(前記差異が小差の場合)はステップS73に進む。
In step S7 (“No” in step S5: the difference is larger than the first predetermined value), the subject E receives a judgment result that the position, posture, movement, etc. of the subject E are not within the permissible range and is not good. A video (video) for confirming (recognizing) the evaluation result of the education (training) is determined and displayed on the VR.
Here, step S7 in FIG. 3 will be described by dividing it into a plurality of detailed steps as shown in FIG.
Step S7 of FIG. 3 is a case where it is determined in step S5 that the difference between the position, posture, movement, etc. of the subject E and the accurate position, posture, movement, etc. on the protocol is not within the permissible range. In step S71 of FIG. 5, it is determined by the comparison block 20G and the procedure pass / fail judgment block 20H whether the difference between the position, posture, movement, etc. of the subject E and the accurate position, posture, movement, etc. on the protocol is large or small. .. Here, the threshold value of whether the difference is large or small is set on a case-by-case basis depending on the training content, subject E, and other conditions.
As a result of the determination in step S71, if the difference is larger than the second predetermined value (the difference is a large difference), the process proceeds to step S72, and if the difference is equal to or less than the second predetermined value (the difference is a small difference). In the case of), the process proceeds to step S73.

 ステップS72(前記差異が第2の所定値より大きい場合)では、前記差異が大きかった被験者Eに対して、VR(AR)上で所定の映像(動画)を放映する。当該映像(動画)は、上述した様に、評価結果をより深刻に受け止めてことを目的とする内容であり、例えば、作業手順に起因して培養していた幹細胞が全滅するアニメーション等をVR上で表示する。
 ステップS73(前記差異が第2の所定値以下の場合)では、前記差異が小さかった被験者Eに対する映像(動画)をVR(AR)上で放映する。当該映像(動画)は、例えば、被験者Eの作業手順(位置、姿勢、動作等)とプロトコルに沿った正確な位置、姿勢、動作等とを重ねて表示して、両者の違いを明確にした映像(動画)である。これに代えて、プロトコルに沿った正確な位置、姿勢、動作等の映像(動画)のみをVR上で表示しても良い。
 ステップS72、ステップS73における映像(動画)の決定とVR上の表示(放映)は、表示動画決定ブロック20I及び動画作成ブロック20Jで実行され、表示装置4(モニタ)においても表示、放映される。
 なお、前記差異が第2の所定値より大きい場合には、仮想現実に表示されている画像を静止して、被験者Eに表示装置4を介して警告を発する様にすることも出来る。
In step S72 (when the difference is larger than the second predetermined value), a predetermined image (moving image) is broadcast on VR (AR) to the subject E having a large difference. As mentioned above, the video (video) is intended to take the evaluation results more seriously. For example, an animation in which the cultured stem cells are completely destroyed due to the work procedure is displayed on VR. Display with.
In step S73 (when the difference is equal to or less than the second predetermined value), an image (moving image) for the subject E having a small difference is broadcast on VR (AR). In the video (video), for example, the work procedure (position, posture, movement, etc.) of subject E and the accurate position, posture, movement, etc. according to the protocol are superimposed and displayed to clarify the difference between the two. It is a video (video). Instead of this, only images (moving images) such as accurate positions, postures, and movements according to the protocol may be displayed on the VR.
The determination of the video (moving image) and the display (broadcasting) on the VR in steps S72 and S73 are executed by the display moving image determination block 20I and the moving image creation block 20J, and are also displayed and broadcast on the display device 4 (monitor).
When the difference is larger than the second predetermined value, the image displayed in the virtual reality can be stopped and a warning can be issued to the subject E via the display device 4.

 再び図3において、ステップS7に続くステップS8では、細胞培養に関する訓練(教育)を続行するか否かを判断する。
 ステップS8において、訓練を続行する場合(ステップS8が「Yes」)はステップS2に戻り、訓練を続行しない場合(ステップS8が「No」)は図3の手順を終了する。
 ステップS6が「No」の場合と同様に、訓練を終了しないでステップS2に戻る場合(ステップS8が「No」)には、被験者Eは今までと同種類の訓練を継続して実施するが、被験者Eが他の訓練を希望する場合には、ステップS2に戻ることに代えてステップS1に戻る様にすることが出来る。その場合(ステップS1に戻る場合)、被験者Eは改めて訓練を選択して、希望する訓練を行うことが出来る。
Again, in FIG. 3, in step S8 following step S7, it is determined whether or not to continue the training (education) related to cell culture.
In step S8, if the training is continued (step S8 is “Yes”), the process returns to step S2, and if the training is not continued (step S8 is “No”), the procedure of FIG. 3 ends.
Similar to the case where step S6 is "No", when returning to step S2 without finishing the training (step S8 is "No"), the subject E continues to carry out the same type of training as before. If subject E wishes to have another training, he / she can return to step S1 instead of returning to step S2. In that case (when returning to step S1), the subject E can select the training again and perform the desired training.

 次に、図6を参照して細胞培養の訓練(教育)全体の手順について説明する。
 図6において、ステップS11では、細胞培養に関する個々の作業(細胞単離、細胞培養、ガウニング、その他)について訓練を実施する。換言すれば、ステップS11では、図3~図5を参照して説明した各種訓練の内容が実行される。ステップS11の詳細については、図7を参照して後述する。
 ステップS12では、ステップS11における訓練が行われた結果として、被験者Eが実行した訓練を指導したインストラクター(訓練の指導者)が、被験者Eは合格か否かを判断する。ここで、インストラクターによる合否認定は、基本的には、図3~図5で説明した様に、被験者Eの位置、姿勢、動作等とプロトコル上の正確な位置、姿勢、動作等と差異が許容範囲内であるか否か、すなわち、前記差異が第1の所定値以下であるかにより判断される。図示はされていないが、現在の制度では、細胞培養の訓練については、VRのみならず、実技のチェック(現実の作業のチェック)が必ず行われる。
 ステップS12において、インストラクターが合格と認定断した場合(ステップS12が「Yes」)はステップS13に進み、インストラクターが合格と認定しなかった場合(ステップS12が「No」)はステップS11に戻って当該訓練を繰り返す。
Next, the procedure of the entire cell culture training (education) will be described with reference to FIG.
In FIG. 6, in step S11, training is performed for individual tasks related to cell culture (cell isolation, cell culture, gouning, etc.). In other words, in step S11, the contents of various trainings described with reference to FIGS. 3 to 5 are executed. Details of step S11 will be described later with reference to FIG.
In step S12, as a result of the training in step S11, the instructor (training instructor) who instructed the training performed by the subject E determines whether or not the subject E has passed. Here, as described in FIGS. 3 to 5, the instructor basically allows a difference between the position, posture, movement, etc. of the subject E and the exact position, posture, movement, etc. on the protocol. It is determined whether or not it is within the range, that is, whether or not the difference is equal to or less than the first predetermined value. Although not shown in the figure, in the current system, not only VR but also practical skill check (check of actual work) is always performed for cell culture training.
In step S12, if the instructor decides to pass (step S12 is “Yes”), the process proceeds to step S13, and if the instructor does not pass (step S12 is “No”), the process returns to step S11. Repeat the training.

 ステップS13(ステップS12でインストラクターが合格と認定した場合)では、被験者Eの細胞培養に関する全ての作業訓練について、インストラクターが合格と認定したか否かを判断する。
 ステップS13の判断の結果、全ての作業についてインストラクターが合格と認定した場合(ステップS13が「Yes」)はステップS15に進み、全ての作業についてインストラクターが合格と認定していない場合(ステップS13が「No」)はステップS14に進む。
In step S13 (when the instructor is found to pass in step S12), it is determined whether or not the instructor has passed all the work training related to cell culture of subject E.
As a result of the determination in step S13, if the instructor recognizes that all the work has passed (step S13 is "Yes"), the process proceeds to step S15, and if the instructor does not recognize that all the work has passed (step S13 is "Yes"). "No") proceeds to step S14.

 ステップS14(全ての作業についてインストラクターが合格と認定していない場合)では、被験者Eは、インストラクターが合格と認定していない作業について、訓練(教育)を行う。
 ステップS14で他の作業について訓練が終了したら、ステップS12に戻る。ここで、ステップS14を経由してステップS12の判断を行う場合、ステップS12では、ステップS14の訓練の結果(当該被験者Eの位置、姿勢、動作等)について、インストラクター(評価者)が合格と認定したか否かを判断する。
In step S14 (when the instructor has not certified that all the work has passed), the subject E trains (educates) the work that the instructor has not certified as passing.
When the training for other work is completed in step S14, the process returns to step S12. Here, when the determination in step S12 is made via step S14, in step S12, the instructor (evaluator) recognizes that the result of the training in step S14 (position, posture, movement, etc. of the subject E) has passed. Determine if you did.

 ステップS15(全ての作業についてインストラクターが合格と認定した場合)では、被験者Eに対して、細胞培養に関する全ての作業に関して総合的な検定を実施する。
 総合的な検定は、被験者Eが全ての作業訓練を改めて連続して実施することにより行っても良いし、ステップS11~ステップS13で実施した被験者Eの作業訓練を総合的に検定する試験を実行しても良い。
 次のステップS16では、ステップS15の総合的な検定に被験者Eが合格したか否かを判断する。
 ステップS16の判断の結果、総合的な検定に被験者Eが合格した場合(ステップS16が「Yes」)は図6の手順を終了する。一方、総合的な検定に被験者Eが合格しなかった場合(ステップS16が「No」)はステップS17に進む。
In step S15 (when the instructor finds that all the tasks have passed), subject E is subjected to a comprehensive test for all tasks related to cell culture.
The comprehensive test may be performed by subject E performing all the work trainings in succession, or a test for comprehensively testing the work training of subject E performed in steps S11 to S13 is executed. You may.
In the next step S16, it is determined whether or not the subject E has passed the comprehensive test of step S15.
If subject E passes the comprehensive test as a result of the determination in step S16 (step S16 is “Yes”), the procedure of FIG. 6 is terminated. On the other hand, if the subject E does not pass the comprehensive test (step S16 is “No”), the process proceeds to step S17.

 ステップS17では、被験者Eは、ステップS16の総合的な検定で不合格であった作業について、再訓練を実施する。
 ステップS17で再訓練が終了したら、ステップS12に戻る。ここで、ステップS17を経由してステップS12に戻る場合、ステップS12では、ステップS17の再訓練の結果(当該被験者Eの位置、姿勢、動作等)について、インストラクター(評価者)が合格と検定したか否かを判断する。
 なお、被験者Eの細胞培養に関する全ての作業訓練についてインストラクターが合格と認定したか否かを判断する工程(ステップS13)を省略することも可能である。
In step S17, subject E retrains the work that failed the comprehensive test in step S16.
When the retraining is completed in step S17, the process returns to step S12. Here, when returning to step S12 via step S17, in step S12, the instructor (evaluator) verifies that the result of the retraining of step S17 (position, posture, movement, etc. of the subject E) has passed. Judge whether or not.
It is also possible to omit the step (step S13) of determining whether or not the instructor has confirmed that all the work training related to the cell culture of the subject E has passed.

 次に図7を参照して、図6のステップS11を説明する。
 上述した様に、図示の実施形態では、被験者Eの訓練(教育)に際しては、「シナリオモード」、「シミュレーションモード」、「トライアルモード」から選択し、選択したモードによる訓練(教育)を実行し、その後、必要に応じて他のモードの訓練(教育)を実行する。係る手順について、図7を参照して以下で説明する。
 上述した様に、シナリオモードは主に初心者を対象としており、シミュレーションモードは主にある程度まで作業手順が理解できた初学者が対象となる。そして、トライアルモードはシナリオモード、シミュレーションモードを経験した者が習熟度を確認するために実施する。
 図7において、ステップS21では、実施すべき訓練(細胞培養に関する訓練或いは教育)において、訓練(教育)のモード選択がされたか否かを判断する。具体的には、入力装置5を介してモード選択信号が制御装置20に送信されたか否かを判断する。
 ステップS21において、モード選択がされた場合(ステップS21が「Yes」)はステップS22に進み、モード選択がされない場合はステップS21に戻る(ステップS21が「No」のループ)。
Next, step S11 of FIG. 6 will be described with reference to FIG. 7.
As described above, in the illustrated embodiment, when training (education) of subject E, a selection is made from "scenario mode", "simulation mode", and "trial mode", and training (education) in the selected mode is executed. , Then perform other modes of training (education) as needed. Such a procedure will be described below with reference to FIG.
As mentioned above, the scenario mode is mainly aimed at beginners, and the simulation mode is mainly aimed at beginners who can understand the work procedure to some extent. Then, the trial mode is carried out so that a person who has experienced the scenario mode and the simulation mode can confirm the proficiency level.
In FIG. 7, in step S21, it is determined whether or not the training (education) mode has been selected in the training (training or education related to cell culture) to be performed. Specifically, it is determined whether or not the mode selection signal is transmitted to the control device 20 via the input device 5.
In step S21, if the mode is selected (step S21 is “Yes”), the process proceeds to step S22, and if the mode is not selected, the process returns to step S21 (step S21 is a “No” loop).

 ステップS22(モード選択がされた場合)では、ステップS21で選択されたモードにおける訓練(教育)を実行するため、ステップS23、S24、S25の何れかに進む。すなわち、ステップS22でシナリオモードが選択された場合はステップS23に進み、シミュレーションモードが選択された場合はステップS24に進み、トライアルモードが選択された場合はステップS26に進む。 In step S22 (when a mode is selected), in order to execute training (education) in the mode selected in step S21, the process proceeds to any one of steps S23, S24, and S25. That is, if the scenario mode is selected in step S22, the process proceeds to step S23, if the simulation mode is selected, the process proceeds to step S24, and if the trial mode is selected, the process proceeds to step S26.

 ステップS23では、シナリオモードによる訓練(教育)が実施される。
 シナリオモード(ステップS23)では、訓練対象の細胞培養に関する作業について、模範的な(見本となる様な)作業者の位置(例えば手の位置)、姿勢、動作の動画を仮想現実(VR)で被験者Eに見せる。その際、正しい姿勢、動作等のための具合的な指示内容を文字情報(キャプション)で表示する。文字情報は、音声情報として再生もできる。当該模範的な動画や文字情報、音声情報は、制御装置20により、表示装置4及び/又は被験者Eが装着するゴーグル2に表示される。
 ここで、模範的な動画は複数の視点から見た状態で(マルチアングルで)作製されたものであり、作製された動画は視点の切り替えが可能である。従来の人による実際の作業の実演では、被験者Eは、実演者の後方から覗き込む様にして見るしかなく、学習者の視点は実演者後方からに限られてしまう。その点で、有益な様々な角度から観察出来るマルチアングルからのVR動画とは相違する。
In step S23, training (education) in the scenario mode is carried out.
In the scenario mode (step S23), for the work related to the cell culture to be trained, a video of the position (for example, the position of the hand), the posture, and the movement of the model worker (for example, the position of the hand) in virtual reality (VR) Show to subject E. At that time, the content of specific instructions for correct posture, movement, etc. is displayed as character information (caption). Character information can also be reproduced as voice information. The model moving image, character information, and voice information are displayed by the control device 20 on the display device 4 and / or the goggles 2 worn by the subject E.
Here, the model moving image is produced in a state of being viewed from a plurality of viewpoints (in a multi-angle), and the produced moving image can switch the viewpoints. In a conventional demonstration of actual work by a person, the subject E has no choice but to look into from behind the performer, and the learner's viewpoint is limited to the back of the performer. In that respect, it differs from VR video from multiple angles that can be observed from various useful angles.

 ステップS23のシナリオモードの訓練(教育)では、上述した様に見本となる動画に併せて、作業における注意点や必要なポイント等を具合的に指示する文字情報(キャプション)も表示される。文字情報は、音声情報として再生もできる。
 さらに、ステップS23のシナリオモードでは、模範的な作業者の位置(例えば手の位置)、姿勢、動作のための注意ポイントを表示する。当該注意ポイントの表示は、制御装置20により、表示装置4及び/又は被験者Eが装着するゴーグル2に行われるが、当該注意ポイントの表示は、教育に有効なタイミングで実行される。
 ステップS23が終了したら、ステップS28に進む。
In the scenario mode training (education) in step S23, character information (caption) for instructing points to be noted and necessary points in the work is also displayed in addition to the sample moving image as described above. Character information can also be reproduced as voice information.
Further, in the scenario mode of step S23, a model worker's position (for example, hand position), posture, and attention points for movement are displayed. The display of the caution point is performed by the control device 20 on the display device 4 and / or the goggles 2 worn by the subject E, and the display of the caution point is executed at a timing effective for education.
When step S23 is completed, the process proceeds to step S28.

 シミュレーションモードが選択された場合は、ステップS24において、シミュレーションモードを選択した被験者Eがシナリオモードによる訓練(教育)を既に実施したか否かを判断する。
 既にシナリオモードによる訓練(教育)を実施した場合(ステップS24が「Yes」)はステップS25に進み、シナリオモードによる訓練(教育)を実施していない場合(ステップS24が「No」)はステップS21に戻る。
 すなわち、図示の実施形態では、被験者Eがシナリオモードによる訓練(教育)を受けていない場合はシミュレーションモードにおける訓練(教育)を受けることが出来ないように設定されている。シナリオモードを経験して後にシミュレーションモードを実施した方が効率的な訓練(教育)が期待できるからである。ただし、被験者Eがシナリオモードを実行していない場合でも、シミュレーションモードを実行できるように設定することは可能である。
When the simulation mode is selected, in step S24, it is determined whether or not the subject E who has selected the simulation mode has already performed training (education) in the scenario mode.
If the training (education) in the scenario mode has already been performed (step S24 is “Yes”), the process proceeds to step S25, and if the training (education) in the scenario mode has not been performed (step S24 is “No”), step S21 Return to.
That is, in the illustrated embodiment, it is set so that the subject E cannot receive the training (education) in the simulation mode if the subject E has not received the training (education) in the scenario mode. This is because more efficient training (education) can be expected by experiencing the scenario mode and then implementing the simulation mode. However, it is possible to set the simulation mode so that the subject E can execute the simulation mode even when the scenario mode is not executed.

 ステップS25では、シミュレーションモードによる訓練(教育)が実施される。
 被験者Eは、計測装置10(左手用グローブ1A、右手用グローブ1B、ゴーグル2)を装着して、練習のため仮想現実で訓練対象の細胞培養作業の動作を行う。
 シミュレーションモードによる訓練では、図3~図5を参照して上述した訓練(教育)が実行される。そして、幹細胞培養に関する作業に関し、被験者Eの位置、姿勢、動作と、プロトコルに沿ったデータ(位置、姿勢、動作)とを(仮想現実上或いはデータ同士で)比較し、当該差異が許容範囲内であるか否かを確認して、評価する。ただし、比較、評価を省略することも出来る。
 シミュレーションモードによる訓練において、被験者Eは、音声或いは文字により、作業に関する指示(作業指示シナリオガイド)を受けることが出来る。作業指示シナリオガイドは、図示しない音声装置から被験者Eに伝達することが出来る。及び/又は、表示装置4及び/又は被験者Eが装着するゴーグル2に作業指示シナリオガイドが表示される。ここで、被験者Eの習熟度、その他の状況に応じて、作業指示シナリオガイドを表示しない(発声しない)設定を選択することが出来る。
In step S25, training (education) in the simulation mode is carried out.
Subject E wears the measuring device 10 (left-handed glove 1A, right-handed glove 1B, goggles 2) and performs the operation of the cell culture work to be trained in virtual reality for practice.
In the training in the simulation mode, the above-mentioned training (education) is executed with reference to FIGS. 3 to 5. Then, regarding the work related to stem cell culture, the position, posture, and movement of subject E are compared with the data (position, posture, movement) according to the protocol (in virtual reality or between the data), and the difference is within the permissible range. Confirm whether or not it is, and evaluate it. However, comparison and evaluation can be omitted.
In the training in the simulation mode, the subject E can receive instructions (work instruction scenario guide) regarding the work by voice or letters. The work instruction scenario guide can be transmitted to the subject E from a voice device (not shown). And / or, the work instruction scenario guide is displayed on the display device 4 and / or the goggles 2 worn by the subject E. Here, it is possible to select a setting that does not display (do not speak) the work instruction scenario guide according to the proficiency level of subject E and other situations.

 また、ステップS25のシミュレーションモードによる訓練では、訓練対象の幹細胞培養に関する被験者Eの作業の経過時間を計測する。経過時間の計測は、作業を構成する個々の動作における経過時間の計測と、作業全体を完了するまでの経過時間(作業全体の経過時間)の計測の双方を含む。細胞培養では、個々の動作及び作業全体に時間を掛け過ぎることは出来ない。そのため、仮想現実における訓練において作業時間を計測して、作業時間が適正か否かを確認して、実際の作業で細胞に悪影響を与えることが無い様にせしめている。明確には図示されていないが、制御装置20はタイマー機能を有している。
 さらに、シミュレーションモードによる訓練では、被験者Eが作業動作の際、操作ミスや失敗(例えば位置、姿勢、動作がプロトコルに基づく位置、姿勢、動作と大きく相違する)をした際に、音声或いは文字表示(例えば文字の赤化)によるアラート(警報)が発せられる。当該アラートは、制御装置20により、図示しない音声装置から発声され、及び/又は、表示装置4や被験者Eが装着するゴーグル2に表示される。
 加えて、シミュレーションモードによる訓練では、被験者Eの位置、姿勢、動作がプロトコルに基づく位置、姿勢、動作になる(近づく)ために重要な注意ポイントの確認を行う(例えば、ポイントとなる動作が適切に実行出来たか否かの確認を行う)。当該確認結果は、制御装置20により、表示装置4及び/又は被験者Eが装着するゴーグル2に表示される。確認結果の表示のタイミングについては特に限定条件はないが、被験者Eの訓練効率が向上するようなタイミングで表示されることが望ましい。
 ステップS25が終了したら、ステップS28に進む。
Further, in the training in the simulation mode in step S25, the elapsed time of the work of the subject E regarding the stem cell culture to be trained is measured. The measurement of the elapsed time includes both the measurement of the elapsed time in each operation constituting the work and the measurement of the elapsed time until the entire work is completed (the elapsed time of the entire work). In cell culture, it is not possible to spend too much time on individual movements and overall work. Therefore, the working time is measured in the training in the virtual reality, and it is confirmed whether or not the working time is appropriate so that the actual work does not adversely affect the cells. Although not clearly shown, the control device 20 has a timer function.
Furthermore, in the training in the simulation mode, when subject E makes an operation error or failure (for example, the position, posture, and movement are significantly different from the position, posture, and movement based on the protocol) during the work movement, voice or character display is performed. An alert is issued by (for example, reddening of characters). The alert is uttered by the control device 20 from a voice device (not shown) and / or displayed on the display device 4 and the goggles 2 worn by the subject E.
In addition, in the training in the simulation mode, the important attention points are confirmed so that the position, posture, and movement of the subject E become (approach) the position, posture, and movement based on the protocol (for example, the movement that is the point is appropriate). Check if it was possible to execute). The confirmation result is displayed by the control device 20 on the display device 4 and / or the goggles 2 worn by the subject E. There are no particular restrictions on the timing of displaying the confirmation result, but it is desirable that the confirmation result be displayed at a timing that improves the training efficiency of subject E.
When step S25 is completed, the process proceeds to step S28.

 トライアルモードによる訓練(教育)が実行される場合には、ステップSS26において、シナリオモード及びシミュレーションモードによる訓練(教育)を既に実行したか否かが判断される。
 ステップS26において、既にシナリオモード及びシミュレーションモードによる訓練(教育)を実施した場合(ステップS26が「Yes」)はステップS27に進み、シナリオモード及びシミュレーションモードによる訓練(教育)を実施していない場合(ステップS26が「No」)はステップS21に戻る。すなわち、図示の実施形態では、シナリオモード、シミュレーションモードを経験していない被験者には、トライアルモードを実行しない。上述した様にトライアルモードは習熟度を確認するために実施される態様であり、シナリオモード、シミュレーションモードを行っていない被験者が実行しても意味がない
When the training (education) in the trial mode is executed, it is determined in step SS26 whether or not the training (education) in the scenario mode and the simulation mode has already been executed.
If the training (education) in the scenario mode and the simulation mode has already been carried out in step S26 (step S26 is “Yes”), the process proceeds to step S27, and the training (education) in the scenario mode and the simulation mode has not been carried out (step S26). Step S26 is "No") returns to step S21. That is, in the illustrated embodiment, the trial mode is not executed for the subject who has not experienced the scenario mode and the simulation mode. As described above, the trial mode is an embodiment performed to confirm the proficiency level, and it is meaningless to execute it by a subject who has not performed the scenario mode or the simulation mode.

 ステップS27において、被験者Eは、計測装置10(左手用グローブ1A、右手用グローブ1B、ゴーグル2)を装着して、作業習熟度の確認のため仮想現実で訓練対象の細胞培養作業(動作)の一連の作業手順を、最後まで中断することなく実施する。その際、図3~図5で説明した様に、被験者Eの位置、姿勢、動作と、プロトコルに沿ったデータ(位置、姿勢、動作)とを(仮想現実上或いはデータ同士で)比較し、当該差異が許容範囲内であるか否かを確認して、評価する。
 トライアルモードでは、シミュレーションモードによる訓練と同様、訓練対象の幹細胞培養に関する被験者Eの作業の経過時間を計測し、計測結果(作業を構成する動作毎の経過時間及び作業全体の経過時間)が適正か否かを確認する。
In step S27, subject E wears the measuring device 10 (left-handed glove 1A, right-handed glove 1B, goggles 2) and performs a cell culture work (operation) to be trained in virtual reality to confirm work proficiency. A series of work procedures are carried out without interruption until the end. At that time, as described with reference to FIGS. 3 to 5, the position, posture, and movement of the subject E are compared with the data (position, posture, movement) according to the protocol (in virtual reality or between the data). Check and evaluate whether the difference is within the permissible range.
In the trial mode, as in the training in the simulation mode, the elapsed time of the work of subject E regarding the stem cell culture to be trained is measured, and whether the measurement result (elapsed time for each movement constituting the work and the elapsed time for the entire work) is appropriate. Check if it is not.

 また、ステップS27のトライアルモードでは、被験者Eが作業動作の際、操作ミスや失敗(例えば位置、姿勢、動作がプロトコルに基づく位置、姿勢、動作と大きく相違する)をした際に、当該ミスや失敗の内容が制御装置20により記録される。そのようなミスや失敗を犯した場合でも、トライアルモードは中断せずに継続され、被験者はトライアルモード終了後に前記ミスや失敗の記録を確認する。操作ミスや失敗をしても警報音が発せられたり、警報の表示がされたりことはなく、中断することも出来ない実際の作業に、トライアルモードを近づけるためである。
 トライアルモードによる訓練(教育)における評価は、被験者Eの位置、姿勢、動作と、プロトコルに沿ったデータ(模範的な位置、姿勢、動作)とを(仮想現実上或いはデータ同士で)比較し、差異が許容範囲内であるか否かに基づいて合否判定を行う。その際に、スコア評価を採用しても良い。
 ステップS27が終了したら、ステップS28に進む。
Further, in the trial mode of step S27, when the subject E makes an operation error or failure (for example, the position, posture, or motion is significantly different from the position, posture, or motion based on the protocol) during the work operation, the error or the failure is made. The details of the failure are recorded by the control device 20. Even if such a mistake or failure is made, the trial mode is continued without interruption, and the subject confirms the record of the mistake or failure after the trial mode ends. This is to bring the trial mode closer to the actual work that cannot be interrupted because no alarm sound is emitted or an alarm is displayed even if an operation error or failure is made.
The evaluation in the training (education) in the trial mode compares the position, posture, and movement of subject E with the data (exemplary position, posture, movement) according to the protocol (in virtual reality or between data). A pass / fail judgment is made based on whether or not the difference is within the permissible range. At that time, score evaluation may be adopted.
When step S27 is completed, the process proceeds to step S28.

 図7において、ステップS28では、被験者Eはトライアルモードによる訓練(教育)に合格しているか否かを判断する。
 ステップS28において、被験者Eがトライアルモードによる合格した場合(ステップS28が「Yes」)はステップS12に進む。一方、被験者Eがトライアルモードに合格していない場合(ステップS28が「No」)はステップS21に戻り、再度、トライアルモードを行うか、シミュレーションモードで訓練をするか、シナリオモードで模範的な作業手順を再確認するかを選択する。
In FIG. 7, in step S28, subject E determines whether or not he / she has passed the training (education) in the trial mode.
In step S28, if the subject E passes the trial mode (step S28 is “Yes”), the process proceeds to step S12. On the other hand, if the subject E has not passed the trial mode (step S28 is “No”), the process returns to step S21, and the trial mode is performed again, the training is performed in the simulation mode, or the model work is performed in the scenario mode. Select whether to reconfirm the procedure.

 図示の実施形態では、トライアルモードに合格した者がステップS12(図6)に進み、インストラクターによる合否判定を受けている。しかし、ステップS28で、被験者Eがトライアルモードによる合格した場合に(ステップS28が「Yes」)ステップS13に進み、ステップS12を省略することが可能である。換言すれば、ステップS27のトライアルモードをステップS12のインストラクターによる合否判定に変えることが可能である。 In the illustrated embodiment, a person who has passed the trial mode proceeds to step S12 (FIG. 6) and receives a pass / fail judgment by the instructor. However, in step S28, if the subject E passes the trial mode (step S28 is “Yes”), the process proceeds to step S13, and step S12 can be omitted. In other words, the trial mode in step S27 can be changed to a pass / fail judgment by the instructor in step S12.

 図示の実施形態によれば、仮想現実(VR)を用いて幹細胞培養に関する技術(単離、培養、クリーンルーム内での各種動作等)を、実際の生体(人体)や施設を用いることなく訓練することが出来るので、必要な処理を行う能力を効率的に向上させることが出来る。
 そして、実際の生体(人体)や施設を用いる必要が無いので、訓練或いは教育を行う場所に制限が無く、訓練或いは教育を受ける時間についても制限をなくすことが可能である。
According to the illustrated embodiment, techniques related to stem cell culture (isolation, culture, various operations in a clean room, etc.) are trained using virtual reality (VR) without using an actual living body (human body) or facility. Therefore, the ability to perform necessary processing can be efficiently improved.
Since it is not necessary to use an actual living body (human body) or facility, there is no limitation on the place where training or education is performed, and it is possible to remove the limitation on the time for training or education.

 図示の実施形態はあくまでも例示であり、本発明の技術的範囲を限定する趣旨の記述ではないことを付記する。
 例えば、図示の実施形態において、実際に培養された細胞の状態の判定等を適宜組み合わせることが可能である。
 また、細胞培養の訓練において、仮想現実におけるチェックするのみならず、実技のチェック(現実の作業のチェック)と組み合わせることが出来る。
It should be added that the illustrated embodiment is merely an example and is not a description intended to limit the technical scope of the present invention.
For example, in the illustrated embodiment, it is possible to appropriately combine the determination of the state of the cells actually cultured.
Moreover, in the cell culture training, it can be combined with not only the check in the virtual reality but also the check of the practical skill (check of the actual work).

1・・・グローブ
2・・・ゴーグル
3・・・カメラ
10・・・計測装置
20・・・コントロールユニット(制御装置)
100・・・細胞培養教育システム
E・・・被験者
1 ... Gloves 2 ... Goggles 3 ... Camera 10 ... Measuring device 20 ... Control unit (control device)
100 ... Cell culture education system E ... Subject

Claims (6)

 被験者の状態を計測する計測装置と、制御装置とを含み、前記制御装置は、
 計測装置からの情報から被験者の位置、姿勢、動作のデータを演算、作成して、映像を演算、作成する機能と、
 被験者の映像を仮想現実に表示する機能と、
 幹細胞培養に関する技術のプロトコルに基づいたデータから、被験者に応じて修正して、当該被験者がプロトコルに従った場合の位置、姿勢、動作を演算してデータを作成する機能と、
 被験者の位置、姿勢、動作と、プロトコルに沿ったデータとを比較する機能を有していることを特徴とする細胞培養教育システム。
The control device includes a measuring device for measuring the state of the subject and a control device.
A function that calculates and creates data on the subject's position, posture, and movement from information from the measuring device, and calculates and creates video.
A function to display the subject's image in virtual reality,
A function to create data by modifying the data based on the protocol of the technology related to stem cell culture according to the subject and calculating the position, posture, and movement when the subject follows the protocol.
A cell culture education system characterized in having a function of comparing the position, posture, and movement of a subject with data according to a protocol.
 前記制御装置は、被験者の位置、姿勢、動作と、プロトコルに沿ったデータに大きな差異がある場合に、被験者に警告する機能を有している請求項1の細胞培養教育システム。 The cell culture education system according to claim 1, wherein the control device has a function of warning the subject when there is a large difference between the position, posture, and movement of the subject and the data according to the protocol.  前記制御装置は、模範動画や作業手順を示す文字情報、音声情報を再生する態様と、被験者の練習のための態様と、被験者を評価する態様を実行する機能を有する請求項1、2の何れかの細胞培養教育システム。 Any of claims 1 and 2, wherein the control device has a function of reproducing a mode of reproducing a model moving image, text information indicating a work procedure, and voice information, a mode for practicing a subject, and a mode of evaluating a subject. The cell culture education system.  被験者の状態を計測する計測装置と制御装置を含むシステムを用いて、前記計測装置からの情報から被験者の位置、姿勢、動作のデータを演算、作成し、
 被験者の画像を仮想現実に表示し、
 幹細胞培養に関する技術のプロトコルに基づいたデータから、被験者に応じて修正して、当該被験者がプロトコルに従った場合の位置、姿勢、動作を演算してデータを作成し、
 被験者の位置、姿勢、動作と、プロトコルに沿ったデータとを比較することを特徴とする細胞培養教育方法。
Using a system including a measuring device and a control device for measuring the state of the subject, data on the position, posture, and movement of the subject is calculated and created from the information from the measuring device.
Display the subject's image in virtual reality
From the data based on the protocol of the technology related to stem cell culture, the data is created by modifying the data according to the subject and calculating the position, posture, and movement when the subject follows the protocol.
A cell culture education method characterized by comparing the position, posture, and movement of a subject with data according to a protocol.
 被験者の画像と、プロトコルに沿ったデータに大きな差異がある場合に、被験者に警告する機能を有している請求項3の細胞培養教育方法。 The cell culture education method according to claim 3, which has a function of warning the subject when there is a large difference between the image of the subject and the data according to the protocol.  模範動画や作業手順を示す文字情報、音声情報を再生する態様と、被験者の練習のための態様と、被験者を評価する態様の何れかを選択する工程を有する請求項4、5の何れかの細胞培養教育方法。 Any of claims 4 and 5, which comprises a step of selecting one of a mode for reproducing a model video, text information and voice information indicating a work procedure, a mode for practicing the subject, and a mode for evaluating the subject. Cell culture education method.
PCT/JP2020/013940 2019-03-27 2020-03-27 Cell culturing education system and method Ceased WO2020196818A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2019-059752 2019-03-27
JP2019059752 2019-03-27
JP2020-053979 2020-03-25
JP2020053979A JP2020166264A (en) 2019-03-27 2020-03-25 System and method for cell growth education

Publications (1)

Publication Number Publication Date
WO2020196818A1 true WO2020196818A1 (en) 2020-10-01

Family

ID=72611574

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/013940 Ceased WO2020196818A1 (en) 2019-03-27 2020-03-27 Cell culturing education system and method

Country Status (1)

Country Link
WO (1) WO2020196818A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023553513A (en) * 2020-12-31 2023-12-21 オベロン・テクノロジーズ・インコーポレイテッド Systems and methods for providing virtual reality environment-based training and certification
TWI845462B (en) * 2024-01-03 2024-06-11 亞東學校財團法人亞東科技大學 Virtual training system and its training method
JP2024167655A (en) * 2023-05-22 2024-12-04 トヨタ自動車株式会社 Simulation system and simulation program

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005134536A (en) * 2003-10-29 2005-05-26 Omron Corp Work training support system
US20180203238A1 (en) * 2017-01-18 2018-07-19 Marshall Leroy Smith, JR. Method of education and simulation learning
JP2018185501A (en) * 2017-08-25 2018-11-22 株式会社mediVR System, method, and program for supporting rehabilitation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005134536A (en) * 2003-10-29 2005-05-26 Omron Corp Work training support system
US20180203238A1 (en) * 2017-01-18 2018-07-19 Marshall Leroy Smith, JR. Method of education and simulation learning
JP2018185501A (en) * 2017-08-25 2018-11-22 株式会社mediVR System, method, and program for supporting rehabilitation

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023553513A (en) * 2020-12-31 2023-12-21 オベロン・テクノロジーズ・インコーポレイテッド Systems and methods for providing virtual reality environment-based training and certification
JP7411856B2 (en) 2020-12-31 2024-01-11 オベロン・テクノロジーズ・インコーポレイテッド Systems and methods for providing virtual reality environment-based training and certification
JP2024167655A (en) * 2023-05-22 2024-12-04 トヨタ自動車株式会社 Simulation system and simulation program
TWI845462B (en) * 2024-01-03 2024-06-11 亞東學校財團法人亞東科技大學 Virtual training system and its training method

Similar Documents

Publication Publication Date Title
Pearson et al. Evaluation of structured and quantitative training methods for teaching intracorporeal knot tying
Chan et al. Validation of microsurgical models in microsurgery training and competence: a review
Haque et al. A meta-analysis of the training effectiveness of virtual reality surgical simulators
Tolba et al. Defining standards in experimental microsurgical training: recommendations of the European Society for Surgical Research (ESSR) and the International Society for Experimental Microsurgery (ISEM)
Grantcharov et al. Assessment of technical surgical skills
WO2020196818A1 (en) Cell culturing education system and method
JP2020166264A (en) System and method for cell growth education
Wynn et al. Development and implementation of a virtual reality laparoscopic colorectal training curriculum
White et al. Current understanding of learning psychomotor skills and the impact on teaching laparoscopic surgical skills
JP2022182673A (en) Learning system and learning method
Glaser et al. The effects of previously acquired skills on sinus surgery simulator performance
Lorch et al. An evidence-based approach to surgical teaching in ophthalmology
Zulbaran-Rojas et al. Utilization of flexible-wearable sensors to describe the kinematics of surgical proficiency
Valles et al. Assessment of core surgical skills using a mixed reality headset–the MoTOR study
Vergis et al. Skill acquisition, assessment, and simulation in minimal access surgery: an evolution of technical training in surgery
Kaluschke et al. Reflecting on excellence: Vr simulation for learning indirect vision in complex bi-manual tasks
Okhah et al. Assessment of surgical residents in a vascular anastomosis laboratory
Munro et al. Essentials in minimally invasive gynecology manual skills pilot validation trial
Jensen et al. Effective instruction of vascular anastomosis in the surgical skills laboratory
Takiguchi et al. Cyber visual training as a new method for the mastery of endoscopic surgery
Forneris Teaching and learning using simulations
Healy et al. Impact of supervised training on the acquisition of simulated laparoscopic skills
CN113299144A (en) Automatic error correction intelligent training system
Joseph et al. Data-Driven Approach for Medical Competency Assessment Using VR Patients
Guni et al. DEVELOPMENT OF A TECHNICAL CHECKLIST FOR THE ASSESSMENT OF SUTURING IN ROBOTIC SIMULATION: MP01-06

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20776804

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20776804

Country of ref document: EP

Kind code of ref document: A1