CN104658393A - Evaluation system and method for training of laparoscopic surgery simulation - Google Patents
Evaluation system and method for training of laparoscopic surgery simulation Download PDFInfo
- Publication number
- CN104658393A CN104658393A CN201510070098.2A CN201510070098A CN104658393A CN 104658393 A CN104658393 A CN 104658393A CN 201510070098 A CN201510070098 A CN 201510070098A CN 104658393 A CN104658393 A CN 104658393A
- Authority
- CN
- China
- Prior art keywords
- module
- time
- training
- evaluation system
- laparoscopic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B23/00—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
- G09B23/28—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
- G09B23/285—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Computational Mathematics (AREA)
- Mathematical Optimization (AREA)
- Medical Informatics (AREA)
- Medicinal Chemistry (AREA)
- Chemical & Material Sciences (AREA)
- Algebra (AREA)
- Radiology & Medical Imaging (AREA)
- Pulmonology (AREA)
- Mathematical Analysis (AREA)
- General Health & Medical Sciences (AREA)
- Mathematical Physics (AREA)
- Pure & Applied Mathematics (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Theoretical Computer Science (AREA)
- Endoscopes (AREA)
Abstract
腹腔镜模拟手术训练评价系统,包括视觉系统,加速度传感器模块和评测系统,其中:视觉系统用于获得器械三维坐标数据;加速度传感器模块用于获得器械的速度和运动平稳度数据;评测系统对视觉系统和加速度传感器模块所测量得到的数据进行计算和数据保存,并导出训练完成情况报告。
The evaluation system for laparoscopic simulated surgery training includes a vision system, an acceleration sensor module and an evaluation system, in which: the vision system is used to obtain three-dimensional coordinate data of the device; the acceleration sensor module is used to obtain the data of the speed and motion stability of the device; The data measured by the system and the acceleration sensor module are calculated and saved, and a training completion report is exported.
Description
技术领域technical field
本发明涉及腹腔镜模拟手术训练评价系统及方法。The invention relates to a laparoscopic simulated operation training evaluation system and method.
背景技术Background technique
微创伤或者无创伤是人们对手术永无止境的追求,其经历了从传统形式的开腹大创伤手术到如今的微创伤手术的发展历程,如今又在朝着创伤更小的单孔腹腔镜手术方向发展。单孔腹腔镜手术因其创伤极其微小、并发症概率低、病床利用率高、不会留下较大的疤痕等特点,成为当今医学科技最前沿的发展方向。Minimally invasive or non-invasive is people's never-ending pursuit of surgery. It has experienced the development process from traditional laparotomy and large trauma surgery to today's minimally invasive surgery, and now it is moving towards less invasive single-hole surgery. Development of laparoscopic surgery. Single-port laparoscopic surgery has become the most advanced development direction of medical science and technology because of its extremely small trauma, low complication probability, high utilization rate of hospital beds, and no large scars.
腹腔镜手术区别于传统手术的特点有:①二维的空间观念感;②熟练掌握腹腔镜器械;③腹腔镜下解剖的识别能力;④双手的协调性。由此可见其技术难度大,学习曲线长,培养方式与传统外科医师的培养也有所不同。研究发现,腹腔镜医生手术的训练效果、手术经验与腹腔镜手术并发症的发生有着密切的关系。对初学者而言,技术熟练程度和经验可以说是决定性因素,处于学习曲线不同时期的术者,选择适应症的范围(标准)应该是有差异的,如何有效的避免医源性伤害,提高手术成功率是当前腹腔镜外科面临的重要课题。在国外腹腔镜医师需经过严格的训练,通过模拟器训练或计算机模拟训练后,才可在有经验的腹腔镜医师指导下进行人体操作。而目前在国内,初学者通常是通过视频观看后在有经验的上级医师指导下开展腹腔镜手术。所以,腹腔镜外科发展面临的严峻问题是如何对腹腔镜医师进行训练。国内的腹腔镜外科医师训练方式主要有短期训练、自主训练、专家指导和进修学习,训练内容包括理论授课和技能训练两个方面。在妇科腹腔镜训练时,也有采取三人小组式训练,锻炼团队合作能力和个人的手眼脚配合、立体定位等技能。但训练效果如何,却无法得知。在国内,如何对受训者的受训效果进行评估尚无统一标准,相关报道也较少。The characteristics of laparoscopic surgery that are different from traditional surgery are: ① a sense of two-dimensional space concept; ② mastery of laparoscopic instruments; ③ the ability to recognize anatomy under laparoscopy; ④ the coordination of both hands. It can be seen that its technical difficulty is high, the learning curve is long, and the training method is different from that of traditional surgeons. The study found that there is a close relationship between the training effect and surgical experience of laparoscopic doctors and the occurrence of laparoscopic complications. For beginners, technical proficiency and experience can be said to be the decisive factors. For operators at different stages of the learning curve, the range (standard) of indications should be different. How to effectively avoid iatrogenic injuries and improve Surgical success rate is an important issue facing laparoscopic surgery. Laparoscopists in foreign countries need to undergo strict training, and only after passing simulator training or computer simulation training can they perform human operations under the guidance of experienced laparoscopists. At present, in China, beginners usually perform laparoscopic surgery under the guidance of experienced superior doctors after watching videos. Therefore, the severe problem facing the development of laparoscopic surgery is how to train laparoscopic surgeons. The domestic training methods for laparoscopic surgeons mainly include short-term training, independent training, expert guidance and advanced study, and the training content includes two aspects: theoretical teaching and skill training. During gynecological laparoscopy training, three-person group training is also adopted to exercise teamwork ability and personal hand-eye-foot coordination, stereotaxic and other skills. However, it is impossible to know how effective the training will be. In China, there is no unified standard on how to evaluate the training effect of trainees, and there are few related reports.
传统的腹腔镜模拟训练器主要由监视器、训练箱、摄像头、照明装置组成。在培训过程中,培训者通过监视器(即显示器)可以实时观察到器械在训练箱中的任务完成过程,是一种常见的腹腔镜手术培训装置。目前的模拟训练系统支持多种训练模式,可以提高培训者的三维空间感知能力、双手协调能力、缝合打结等精细操作能力。通过观察二维监视器完成三维空间的模拟训练常用于初学者训练,利用腹腔镜手术训练箱,模拟人体腹腔,训练初学者手眼协调能力、三维空间感知能力。腹腔镜模拟训练任务主要包括以下内容:The traditional laparoscopic simulation training device is mainly composed of a monitor, a training box, a camera, and a lighting device. During the training process, the trainer can observe the task completion process of the instrument in the training box in real time through the monitor (ie, the display), which is a common laparoscopic surgery training device. The current simulation training system supports a variety of training modes, which can improve the trainer's three-dimensional space perception ability, hand coordination ability, suture knotting and other fine operation ability. The simulation training of three-dimensional space by observing the two-dimensional monitor is often used in the training of beginners. The laparoscopic surgery training box is used to simulate the abdominal cavity of the human body to train beginners' hand-eye coordination and three-dimensional space perception. Laparoscopic simulation training tasks mainly include the following:
①手眼协调训练① Hand-eye coordination training
主要为了提高培训者的手眼协调能力。在训练箱中放入画有两个大小相同区域的任务纸片,其中一块区域内放置由不同颜色的小物块,另外一个则是空的,培训者被要求将物块逐一夹取并移动移动到另外一个区域。操作过程应尽量做到快、稳、准,不要碰到周围的物体。培训者可以随时调整镜头,使物块始终清晰的保持在手术视野中。Mainly to improve the trainer's hand-eye coordination. In the training box, put two pieces of task paper with two areas of the same size. One area contains small blocks of different colors, and the other is empty. The trainer is asked to pick up and move the blocks one by one. to another area. The operation process should be as fast, stable and accurate as possible, and do not touch the surrounding objects. The trainer can adjust the lens at any time to keep the object clearly in the surgical field of view.
②定向适应训练② Orientation adaptation training
主要为了提高培训者的三维空间感知能力。在训练箱内放入装有柱子的任务板,柱子上面有大小适中的孔,培训者被要求操作器械夹取缝合线完成穿针操作。通过多次反复训练,培训者的腹腔镜操作定向能力可以得到提高。Mainly to improve the three-dimensional space perception ability of trainers. Put a task board with a post in the training box. There are holes of appropriate size on the post. The trainer is required to operate the instrument to pick up the suture to complete the needle threading operation. Through repeated training, the trainer's laparoscopic operation orientation ability can be improved.
③组织分离训练③Tissue separation training
主要为了提高培训者的双手配合能力。在训练箱内放模拟皮肤或者橡胶之类的物体,用腹腔镜抓钳、剪刀、电刀等手术器械进行分离训练。Mainly to improve the trainer's ability to cooperate with both hands. Objects such as simulated skin or rubber are placed in the training box, and surgical instruments such as laparoscopic grasping forceps, scissors, and electric knife are used for separation training.
④精确定位训练④ Precise positioning training
主要为了提高培训者的精确操作能力。相较于传统手术器械,腹腔镜手术器械长度较大,初次操作过程中不易实现精确定位。在训练箱中放入安装有柱子的培训板,这些小柱子顶面有大小适中的凹坑,训练板旁边放置由塑料柱子,培训者被要求操作器械将柱子放置到凹坑中,在整个训练过程中要保持动作的快速和准确。Mainly to improve the trainer's precise operation ability. Compared with traditional surgical instruments, laparoscopic surgical instruments are longer, and it is difficult to achieve precise positioning during the initial operation. Put a training board with columns in the training box. There are pits of appropriate size on the top of these small posts. Plastic posts are placed next to the training board. The trainer is required to operate the equipment to place the posts into the pits. During the process, the speed and accuracy of the movement should be maintained.
⑤缝合打结训练⑤Suture knotting training
主要为了提高培训者的缝合打结操作能力。在腹腔镜手术实际操作由于空间狭小,对操作者的双手协调配合能力提出了更高的要求,打结和缝合需要更多的培训。在训练箱内放入安装有仿真皮肤的训练板,仿真皮肤上面画有切口和缝合点。培训者被要求按照缝合点位置完成缝合和打结任务。反复练习,可以提高缝合打结操作能力。Mainly to improve the trainer's ability to suture and tie knots. Due to the narrow space in the actual operation of laparoscopic surgery, higher requirements are placed on the operator's ability to coordinate and cooperate with both hands, and more training is required for knotting and suturing. Put the training board equipped with the artificial skin in the training box, and the incision and suture points are drawn on the artificial skin. The trainers were asked to complete the suturing and knotting tasks according to the location of the suture points. Repeated practice can improve the suture knotting operation ability.
然而传统系统在测量精度、评估准确性方面存在不足。本发明提供的腹腔镜模拟手术训练评价系统及方法,能够对模拟手术训练提供高精度的测量和准确的评价,提升训练效果。However, traditional systems have shortcomings in measurement accuracy and evaluation accuracy. The laparoscopic simulated surgery training evaluation system and method provided by the present invention can provide high-precision measurement and accurate evaluation for simulated surgery training, and improve the training effect.
发明内容Contents of the invention
为了克服上述问题,本发明提供了一种腹腔镜手术训练评价系统和方法,给出客观参数指标对训练过程中手术技能进行客观评定。In order to overcome the above problems, the present invention provides a laparoscopic surgery training evaluation system and method, which provides objective parameter indicators to objectively evaluate surgical skills during the training process.
为实现本发明之目的,采用以下技术方案予以实现:For realizing the purpose of the present invention, adopt following technical scheme to realize:
一种腹腔镜模拟手术训练评价系统,包括视觉系统,加速度传感器模块和评测系统,A laparoscopic simulated surgery training evaluation system, including a vision system, an acceleration sensor module and an evaluation system,
其中:in:
视觉系统用于获得器械三维坐标数据;The vision system is used to obtain the three-dimensional coordinate data of the device;
加速度传感器模块用于获得器械的速度和运动平稳度数据;The acceleration sensor module is used to obtain the speed and motion smoothness data of the device;
评测系统对视觉系统和加速度传感器模块所测量得到的数据进行计算和数据保存,并导出训练完成情况报告。The evaluation system calculates and saves the data measured by the vision system and the acceleration sensor module, and exports a training completion report.
如上所述的腹腔镜模拟手术训练评价系统,其中:As mentioned above, the laparoscopic simulated surgery training evaluation system, wherein:
视觉系统的追踪点夹具为六边形模块,保证任务过程中追踪点能够尽可能多的被采集到。The tracking point fixture of the vision system is a hexagonal module to ensure that as many tracking points as possible can be collected during the task.
如上所述的腹腔镜模拟手术训练评价系统,其中:As mentioned above, the laparoscopic simulated surgery training evaluation system, wherein:
加速度传感器模块中输出的信号,经过卡尔曼滤波算法对输出数据进行时域滤波,提高数据精度,并采用欧拉角算法通过实时计算传感器的位姿,消除固有的重力加速度在各轴上的分量,从而消除其干扰。The signal output from the acceleration sensor module is filtered in the time domain by the Kalman filter algorithm to improve the accuracy of the data, and the Euler angle algorithm is used to calculate the sensor's pose in real time to eliminate the inherent gravitational acceleration on each axis. , thereby eliminating its interference.
如上所述的腹腔镜模拟手术训练评价系统,As mentioned above, the laparoscopic simulated surgery training evaluation system,
评测系统包括操作时间模块、路径长度模块、平均速度模块、运动平滑性模块和空闲率模块;其中:The evaluation system includes operation time module, path length module, average speed module, motion smoothness module and idle rate module; among them:
操作时间模块:通过下式计算器械操作过程的总时间,不论任务完成与否:Operating time module: Calculate the total time of the device operating process, regardless of whether the task is completed or not, by the following formula:
其中t表示单位时间;T为每个手术模拟动作从开始到动作完成的总时间;Where t represents the unit time; T is the total time from the start to the completion of each surgical simulation action;
路径长度模块:通过下式计算器械尖端在整个操作过程中所移动的总长度:Path Length Module: Calculates the total length traveled by the instrument tip throughout the procedure using the formula:
其中x、y、z分别表示视觉系统采集到的追踪点沿三个轴的位移增量;Among them, x, y, and z respectively represent the displacement increments of the tracking points collected by the vision system along the three axes;
平均速度模块:通过下式计算器械尖端在操作过程中的平均速度:Average Velocity Module: Calculates the average velocity of the instrument tip during operation by the following formula:
其中ax、ay、az分别表示加速度传感器模块测得的器械沿传感器三个敏感轴的加速度值;Among them, a x , a y , and a z respectively represent the acceleration values of the instrument along the three sensitive axes of the sensor measured by the acceleration sensor module;
运动平滑性模块:通过下式计算加速度的变化率以描述操作过程器械运动的平稳程度:Motion smoothness module: calculate the rate of change of acceleration by the following formula to describe the smoothness of the movement of the device during operation:
空闲率模块:通过下式计算任务过程中器械无运动时间与操作时间的比例:Idle rate module: Calculate the ratio of the device's non-moving time to operating time during the task by the following formula:
其中Tf表示器械运动增量小于5mm的时间。Where T f represents the time when the instrument movement increment is less than 5mm.
如权利要求1所述的腹腔镜模拟手术训练评价系统,其中评测系统用于计算操作时间、左右手移动长度、左右手平均速度、左右手空闲率和左右手平稳度并显示。The laparoscopic simulated surgery training evaluation system according to claim 1, wherein the evaluation system is used to calculate and display operation time, moving length of left and right hands, average speed of left and right hands, idling rate of left and right hands, and smoothness of left and right hands.
一种腹腔镜模拟手术训练评价方法,包括:A laparoscopic simulated surgery training evaluation method, comprising:
视觉系统获得器械三维坐标数据;The vision system obtains the three-dimensional coordinate data of the device;
加速度传感器模块获得器械的速度和运动平稳度数据;The acceleration sensor module obtains the speed and motion smoothness data of the apparatus;
评测系统对视觉系统和加速度传感器模块所测量得到的数据进行计算和数据保存,并导出训练完成情况报告。The evaluation system calculates and saves the data measured by the vision system and the acceleration sensor module, and exports a training completion report.
如上所述的腹腔镜模拟手术训练评价方法,其中:Laparoscopic simulated surgery training evaluation method as above, wherein:
视觉系统的追踪点夹具为六边形模块,保证任务过程中追踪点能够尽可能多的被采集到。The tracking point fixture of the vision system is a hexagonal module to ensure that as many tracking points as possible can be collected during the task.
如上所述的腹腔镜模拟手术训练评价方法,其中:Laparoscopic simulated surgery training evaluation method as above, wherein:
加速度传感器模块中输出的信号,经过卡尔曼滤波算法对输出数据进行时域滤波,提高数据精度,并采用欧拉角算法通过实时计算传感器的位姿,消除固有的重力加速度在各轴上的分量,从而消除其干扰。The signal output from the acceleration sensor module is filtered in the time domain by the Kalman filter algorithm to improve the accuracy of the data, and the Euler angle algorithm is used to calculate the sensor's pose in real time to eliminate the inherent gravitational acceleration on each axis. , thereby eliminating its interference.
如上所述的腹腔镜模拟手术训练评价方法,As mentioned above, the laparoscopic simulated surgery training evaluation method,
评测系统包括操作时间模块、路径长度模块、平均速度模块、运动平滑性模块和空闲率模块;其中:The evaluation system includes operation time module, path length module, average speed module, motion smoothness module and idle rate module; among them:
操作时间模块通过下式计算器械操作过程的总时间,不论任务完成与否:The Operation Time module calculates the total time for a device operation, regardless of whether the task is completed or not, by the following formula:
其中t表示单位时间;T为每个手术模拟动作从开始到动作完成的总时间;Where t represents the unit time; T is the total time from the start to the completion of each surgical simulation action;
路径长度模块通过下式计算器械尖端在整个操作过程中所移动的总长度:The Path Length module calculates the total length traveled by the tip of the instrument throughout the procedure using the following formula:
其中x、y、z分别表示视觉系统采集到的Marker点沿三个轴的位移增量;Among them, x, y, and z respectively represent the displacement increments of the Marker points collected by the vision system along the three axes;
平均速度模块通过下式计算器械尖端在操作过程中的平均速度:The Average Velocity module calculates the average velocity of the instrument tip during operation using the following formula:
其中ax、ay、az分别表示MEMS加速度传感器模块测得的器械沿传感器三个敏感轴的加速度值;Among them, a x , a y , and a z respectively represent the acceleration values of the device along the three sensitive axes of the sensor measured by the MEMS acceleration sensor module;
运动平滑性模块通过下式计算加速度的变化率以描述操作过程器械运动的平稳程度:The motion smoothness module calculates the rate of change of acceleration by the following formula to describe the smoothness of the device during operation:
空闲率模块通过下式计算任务过程中器械无运动时间与操作时间的比例:The idle rate module calculates the ratio of the device's non-moving time to operating time during the task through the following formula:
其中Tf表示器械运动增量小于5mm的时间。Where T f represents the time when the instrument movement increment is less than 5mm.
如上所述的腹腔镜模拟手术训练评价方法,其中评测系统计算操作时间、左右手移动长度、左右手平均速度、左右手空闲率和左右手平稳度并显示。In the laparoscopic simulated surgery training evaluation method described above, the evaluation system calculates and displays the operating time, the length of movement of the left and right hands, the average speed of the left and right hands, the idle rate of the left and right hands, and the smoothness of the left and right hands.
附图说明Description of drawings
图1为本发明腹腔镜手术训练评价系统的示意图;Fig. 1 is the schematic diagram of laparoscopic surgery training evaluation system of the present invention;
图2为系统设计示意图;Figure 2 is a schematic diagram of the system design;
图3为marker六边形追踪板图;Figure 3 is a map of the marker hexagonal tracking board;
图4为MEMS模块实现流程图。Figure 4 is a flow chart of the implementation of the MEMS module.
具体实施方式Detailed ways
如图1所示,本发明的腹腔镜模拟手术训练评价系统包括视觉系统1、加速度传感器模块3、评测系统2。As shown in FIG. 1 , the laparoscopic simulated surgery training evaluation system of the present invention includes a vision system 1 , an acceleration sensor module 3 , and an evaluation system 2 .
附图2为本发明系统设计示意图,其中本发明的视觉系统1可采用但不限于Micron Tracker双目视觉系统,该系统用于获取器械三维坐标数据。Accompanying drawing 2 is the schematic diagram of system design of the present invention, wherein the visual system 1 of the present invention can adopt but not limited to Micron Tracker binocular vision system, and this system is used for obtaining three-dimensional coordinate data of equipment.
Marker(追踪)点夹具设计:Micron Tracker双目视觉系统测量最大测量范围为200cm*240cm,边界大约是一个矩形截面的形状,一个Maker点要在照相机的左右两侧投下一个最小区域,为了能够使Micron Tracker有效识别,本发明通过减小投影尺寸来扩展相机FOM(镜头视野),这样测量范围符合测量要求。但是这样会造成检测精确度降低,检测Marker点位置的像素数会减少;另外当Marker点(追踪点)4所处平面与双目视觉仪所在平面的夹角超过60°,该追踪点将不能被Tracker双目视觉系统检测追踪到。所以本发明设计的追踪模板为六边形模块(如图3所示),可安装在手术器械上,在进行模拟手术训练时,保证任务过程中Marker能够尽可能多的被采集到。Marker (tracking) point fixture design: Micron Tracker binocular vision system has a maximum measurement range of 200cm*240cm, and the boundary is roughly in the shape of a rectangular section. A Maker point must cast a minimum area on the left and right sides of the camera. In order to be able to Micron Tracker effectively identifies, and the present invention expands the camera FOM (lens field of view) by reducing the projection size, so that the measurement range meets the measurement requirements. But this will cause the detection accuracy to be reduced, and the number of pixels to detect the position of the Marker point will be reduced; in addition, when the angle between the plane where the Marker point (tracking point) 4 is located and the plane where the binocular vision device is located exceeds 60°, the tracking point will not be able to It was detected and tracked by the Tracker binocular vision system. Therefore, the tracking template designed by the present invention is a hexagonal module (as shown in FIG. 3 ), which can be installed on surgical instruments, and when performing simulated surgical training, it is ensured that as many Markers as possible can be collected during the task.
本发明的加速度传感器模块3可使用但不限于MEMS加速度传感器,其获得的数据经过积分和微分分别得到器械的速度和运动平稳度指标。The acceleration sensor module 3 of the present invention can use, but is not limited to, a MEMS acceleration sensor, and the data obtained by it can be integrated and differentiated to obtain the speed and motion smoothness index of the device respectively.
MEMS加速度传感器模块设计(如图4所示):在本发明中设计并制作了MEMS加速度传感器测量模块,为了消除MEMS传感器的零点漂移影响,本发明使用了两个传感器模块来进行数据采集,这两个模块XY轴垂直分布,取两个传感器加速度和陀螺仪数据的平均值以提高数据精确度;由于测量过程中,传感器数据容易受到环境变化的影响,会有大量的噪声进入传感器输出数据,而且噪声的频率和运动参数频率混叠。本发明采用卡尔曼滤波算法对输出数据进行时域滤波,提高数据精度,并采用欧拉角算法通过实时计算传感器的位姿,消除固有的重力加速度在各轴上的分量,从而消除其影响;模块使用f l ash实时存储经过滤波处理后得到的各个轴向加速度数据,通过串口通信将数据传输到PC端以txt文本格式保存;本模块中加速度和陀螺仪传感器的采样速率为100Hz,可以达到对训练中速度的测量要求。MEMS acceleration sensor module design (as shown in Figure 4): in the present invention, design and make MEMS acceleration sensor measurement module, in order to eliminate the zero drift influence of MEMS sensor, the present invention has used two sensor modules to carry out data acquisition, this The XY axes of the two modules are vertically distributed, and the average value of the acceleration and gyroscope data of the two sensors is taken to improve the accuracy of the data; since the sensor data is easily affected by environmental changes during the measurement process, a large amount of noise will enter the sensor output data, Moreover, the frequency of the noise is aliased with the frequency of the motion parameters. The present invention uses the Kalman filter algorithm to perform time-domain filtering on the output data to improve data accuracy, and uses the Euler angle algorithm to calculate the pose of the sensor in real time to eliminate the inherent component of the acceleration of gravity on each axis, thereby eliminating its influence; The module uses flash to store the axial acceleration data obtained after filtering in real time, and transmits the data to the PC through serial port communication to save in txt format; the sampling rate of the acceleration and gyroscope sensors in this module is 100Hz, which can reach Measurement requirements for speed during training.
本发明的评测系统2完成由视觉系统和加速度传感器模块所测量得到的原始数据到指标的计算和数据保存,并导出训练完成情况报告。The evaluation system 2 of the present invention completes calculation and data storage of raw data measured by the vision system and the acceleration sensor module to indicators, and derives a training completion report.
评测系统2:本发明的评测系统包括操作时间模块、路径长度模块、平均速度模块、运动平滑性模块和空闲率模块。评测系统可为服务器、硬件、固件、软件模块等形式。可由LabVIEW编写评测系统软件平台系统。其中各个模块的实现过程如下所述。Evaluation system 2: The evaluation system of the present invention includes an operation time module, a path length module, an average speed module, a motion smoothness module and an idle rate module. The evaluation system can be in the form of server, hardware, firmware, software module, etc. The evaluation system software platform system can be written by LabVIEW. The implementation process of each module is as follows.
1操作时间模块:以秒为单位描述器械操作过程的总时间(不论任务完成与否)。1 Operation time module: describe the total time of the device operation process in seconds (whether the task is completed or not).
其中t表示单位时间;T即为每个手术模拟动作从开始到动作完成的总时间,T可以从双目视觉系统中起始时间与结束时间中得到。Where t represents the unit time; T is the total time from the start to the completion of each surgical simulation action, and T can be obtained from the start time and end time of the binocular vision system.
2路径长度模块:以厘米为单位描述器械尖端在整个操作过程中所移动的总长度(左、右手):2Path length module: Describes in centimeters the total length traveled by the tip of the instrument throughout the procedure (left and right):
其中x、y、z分别表示Micron Tracker双目视觉追踪系统采集到的Marker点沿三个轴的位移增量。Among them, x, y, and z respectively represent the displacement increments of the Marker points collected by the Micron Tracker binocular vision tracking system along the three axes.
3平均速度模块:以厘米每秒为单位描述器械尖端在操作过程中的平均速度。3 Average Velocity Module: Describes the average velocity of the instrument tip during operation in centimeters per second.
其中ax、ay、az分别表示MEMS加速度传感器模块测得的器械沿传感器三个敏感轴的加速度值。Among them, a x , a y , and a z respectively represent the acceleration values of the device along the three sensitive axes of the sensor measured by the MEMS acceleration sensor module.
4运动平滑性模块:计算加速度的变化率,用以描述操作过程器械运动的平稳程度。4Motion smoothness module: calculate the rate of change of acceleration to describe the smoothness of the movement of the device during the operation.
5空闲率模块:计算任务过程中器械无运动时间与操作时间的比例。5. Idle rate module: calculate the ratio of the device's non-moving time to operating time during the task.
其中Tf表示器械运动增量小于5mm的时间。Where T f represents the time when the instrument movement increment is less than 5 mm.
本发明评测系统2将导入的Tracker采集数据和惯性测量模块采集数据,对数据进行处理,计算上述各个指标并显示。使用时在界面左侧导入Micron Tracker双目视觉追踪系统和MEMS加速度传感器模块测量得到的数据,运行程序可以得到各个参数的结果,如操作时间、左右手移动长度、左右手平均速度、左右手空闲率和左右手平稳度等,通过对各个参数结果的比较可以对训练效果作出评价,如完成同样的任务,操作时间越短、左右手移动长度越短、空闲率越低等等则越娴熟。The evaluation system 2 of the present invention collects data collected by the imported Tracker and the data collected by the inertial measurement module, processes the data, calculates and displays the above-mentioned indicators. When in use, import the data measured by the Micron Tracker binocular vision tracking system and the MEMS acceleration sensor module on the left side of the interface, and run the program to get the results of various parameters, such as operation time, length of movement of left and right hands, average speed of left and right hands, idle rate of left and right hands and left and right hands The training effect can be evaluated by comparing the results of each parameter, such as completing the same task, the shorter the operation time, the shorter the length of left and right hand movement, the lower the idle rate, etc., the more skilled you are.
本发明的腹腔镜模拟手术训练评价系统提供丰富的接口,在应用中可通过相应模块与传统训练系统的监视器、训练箱、摄像头、照明装置等装置连接,通过Micron Tracker双目视觉追踪系统和MEMS加速度传感器模块测量训练箱中模拟手术时器械的使用过程;由评测模块提供对上述装置的控制,如控制摄像头摄录训练箱中的模拟手术过程,并在监视器上显示模拟手术训练的实时过程,调节照明装置的开关、明暗、照明角度等;从而实现对腹腔镜模拟手术训练进行评估的目的。通过本发明实现了基于MEMS加速度传感器模块与双目视觉追踪系统配合使用,提高了测量精度;扩大了测量空间范围;实现训练者培训数据的数据库存储与管理。The laparoscopic simulated surgery training evaluation system of the present invention provides abundant interfaces, and can be connected with traditional training system monitors, training boxes, cameras, lighting devices and other devices through corresponding modules in application, through the Micron Tracker binocular vision tracking system and The MEMS acceleration sensor module measures the use process of the instruments during the simulated operation in the training box; the evaluation module provides control over the above devices, such as controlling the camera to record the simulated operation process in the training box, and displaying the real-time simulation operation training on the monitor. process, adjust the switch, light and shade, lighting angle, etc. of the lighting device; so as to achieve the purpose of evaluating laparoscopic simulated surgery training. Through the invention, the MEMS-based acceleration sensor module is used in conjunction with the binocular vision tracking system, which improves the measurement accuracy, expands the measurement space range, and realizes database storage and management of training data for trainers.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510070098.2A CN104658393A (en) | 2015-02-10 | 2015-02-10 | Evaluation system and method for training of laparoscopic surgery simulation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510070098.2A CN104658393A (en) | 2015-02-10 | 2015-02-10 | Evaluation system and method for training of laparoscopic surgery simulation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104658393A true CN104658393A (en) | 2015-05-27 |
Family
ID=53249452
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510070098.2A Pending CN104658393A (en) | 2015-02-10 | 2015-02-10 | Evaluation system and method for training of laparoscopic surgery simulation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104658393A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104970886A (en) * | 2015-06-23 | 2015-10-14 | 上海理工大学 | Laparoscope simulated operation path correcting device |
| CN106683518A (en) * | 2017-03-20 | 2017-05-17 | 合肥德铭电子有限公司 | Endoscope /Cavity mirror analog simulation training system and method thereof |
| CN107045592A (en) * | 2017-03-29 | 2017-08-15 | 浙江大学 | A kind of user's factor evaluation system of laparoscopic surgery operation |
| CN107545809A (en) * | 2017-09-28 | 2018-01-05 | 北京理工大学 | Training method and support intervention operative training system |
| CN111091746A (en) * | 2020-01-09 | 2020-05-01 | 军事科学院系统工程研究院卫勤保障技术研究所 | Abdominal cavity open surgery simulation training evaluation system |
| CN114373347A (en) * | 2020-12-15 | 2022-04-19 | 西安赛德欧医疗研究院有限公司 | Intelligent high-simulation training system for whole-organ surgery |
| CN116310961A (en) * | 2023-02-23 | 2023-06-23 | 上海微创医疗机器人(集团)股份有限公司 | Operation video processing method, device and computer-readable storage medium |
| TWI846076B (en) * | 2022-09-29 | 2024-06-21 | 醫百科技股份有限公司 | Service Training Simulation System |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582213A (en) * | 2008-05-13 | 2009-11-18 | 医百科技股份有限公司 | Dental clinic and teaching training simulation tracking system and evaluation method thereof |
| WO2012149548A2 (en) * | 2011-04-29 | 2012-11-01 | The Johns Hopkins University | System and method for tracking and navigation |
| CN103299355A (en) * | 2010-11-04 | 2013-09-11 | 约翰霍普金斯大学 | System and method for the evaluation of or improvement of minimally invasive surgery skills |
| CN103680279A (en) * | 2013-12-31 | 2014-03-26 | 广州赛宝联睿信息科技有限公司 | Cystoscope surgery simulated training method and system |
| WO2014052428A1 (en) * | 2012-09-26 | 2014-04-03 | Stryker Corporation | Navigation system including optical and non-optical sensors |
| US20140180290A1 (en) * | 2012-12-21 | 2014-06-26 | Mako Surgical Corp. | Systems and methods for haptic control of a surgical tool |
| CN204029245U (en) * | 2014-08-01 | 2014-12-17 | 卓思生命科技有限公司 | A surgical simulation system |
-
2015
- 2015-02-10 CN CN201510070098.2A patent/CN104658393A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582213A (en) * | 2008-05-13 | 2009-11-18 | 医百科技股份有限公司 | Dental clinic and teaching training simulation tracking system and evaluation method thereof |
| CN103299355A (en) * | 2010-11-04 | 2013-09-11 | 约翰霍普金斯大学 | System and method for the evaluation of or improvement of minimally invasive surgery skills |
| WO2012149548A2 (en) * | 2011-04-29 | 2012-11-01 | The Johns Hopkins University | System and method for tracking and navigation |
| WO2014052428A1 (en) * | 2012-09-26 | 2014-04-03 | Stryker Corporation | Navigation system including optical and non-optical sensors |
| US20140180290A1 (en) * | 2012-12-21 | 2014-06-26 | Mako Surgical Corp. | Systems and methods for haptic control of a surgical tool |
| CN103680279A (en) * | 2013-12-31 | 2014-03-26 | 广州赛宝联睿信息科技有限公司 | Cystoscope surgery simulated training method and system |
| CN204029245U (en) * | 2014-08-01 | 2014-12-17 | 卓思生命科技有限公司 | A surgical simulation system |
Non-Patent Citations (2)
| Title |
|---|
| IGNACIO OROPESA等: ""Relevance of Motion-Related Assessment Metrics in Laparoscopic Surgery"", 《SURGICAL INNOVATION》 * |
| JOURNAL OF SURGICAL RESEARCH: "Journal of Surgical Research", 《JOURNAL OF SURGICAL RESEARCH》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104970886A (en) * | 2015-06-23 | 2015-10-14 | 上海理工大学 | Laparoscope simulated operation path correcting device |
| CN106683518A (en) * | 2017-03-20 | 2017-05-17 | 合肥德铭电子有限公司 | Endoscope /Cavity mirror analog simulation training system and method thereof |
| CN107045592A (en) * | 2017-03-29 | 2017-08-15 | 浙江大学 | A kind of user's factor evaluation system of laparoscopic surgery operation |
| CN107045592B (en) * | 2017-03-29 | 2020-06-16 | 浙江大学 | An ergonomic evaluation system for laparoscopic surgery |
| CN107545809A (en) * | 2017-09-28 | 2018-01-05 | 北京理工大学 | Training method and support intervention operative training system |
| CN111091746A (en) * | 2020-01-09 | 2020-05-01 | 军事科学院系统工程研究院卫勤保障技术研究所 | Abdominal cavity open surgery simulation training evaluation system |
| CN111091746B (en) * | 2020-01-09 | 2021-07-23 | 军事科学院系统工程研究院卫勤保障技术研究所 | Abdominal cavity open surgery simulation training evaluation system |
| CN114373347A (en) * | 2020-12-15 | 2022-04-19 | 西安赛德欧医疗研究院有限公司 | Intelligent high-simulation training system for whole-organ surgery |
| TWI846076B (en) * | 2022-09-29 | 2024-06-21 | 醫百科技股份有限公司 | Service Training Simulation System |
| CN116310961A (en) * | 2023-02-23 | 2023-06-23 | 上海微创医疗机器人(集团)股份有限公司 | Operation video processing method, device and computer-readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104658393A (en) | Evaluation system and method for training of laparoscopic surgery simulation | |
| US10943508B2 (en) | Anatomical model and method for surgical training | |
| Uemura et al. | Analysis of hand motion differentiates expert and novice surgeons | |
| US20170140671A1 (en) | Surgery simulation system and method | |
| EP3762916B1 (en) | Working tool and manipulation and measurement set of laparoscopic trainer | |
| Nugent et al. | Development and evaluation of a simulator-based laparoscopic training program for surgical novices | |
| Nasr et al. | Motion analysis in the pediatric laparoscopic surgery (PLS) simulator: validation and potential use in teaching and assessing surgical skills | |
| Akdemir et al. | Laparoscopic virtual reality simulator and box trainer in gynecology | |
| WO2018035310A1 (en) | Dynamic haptic robotic trainer | |
| CN109637252A (en) | A neurosurgery virtual surgery training system | |
| Kocak et al. | Eye motion parameters correlate with level of experience in video-assisted surgery: objective testing of three tasks | |
| CN115328317A (en) | Quality control feedback system and method based on virtual reality | |
| Oropesa et al. | Feasibility of tracking laparoscopic instruments in a box trainer using a Leap Motion Controller | |
| CN202677692U (en) | Laparoscopic surgery training model used for students | |
| Gonzalez-Romo et al. | Quantification of motion during microvascular anastomosis simulation using machine learning hand detection | |
| US20250239177A1 (en) | Methods and systems for surgical training | |
| TWI431562B (en) | Stability evaluate method for minimal invasive surgery training and device thereof | |
| RU2679297C1 (en) | Device for testing and practicing microsurgical technique | |
| KR102143784B1 (en) | System for estimating otorhinolaryngology and neurosurgery surgery based on simulator of virtual reality | |
| Shah et al. | Simulation and skills assessment | |
| Beier et al. | NeuroSim–the prototype of a neurosurgical training simulator | |
| Shaharan et al. | Motion tracking system in surgical training | |
| Sonnadara et al. | A novel multimodal platform for assessing surgical technical skills | |
| King et al. | Hand gesture recognition with body sensor networks | |
| Nistor et al. | Immersive training and mentoring for laparoscopic surgery |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150527 |