[go: up one dir, main page]

CN116486665A - Construction method of cataract surgery simulation teaching model based on digital twin technology - Google Patents

Construction method of cataract surgery simulation teaching model based on digital twin technology Download PDF

Info

Publication number
CN116486665A
CN116486665A CN202310364917.9A CN202310364917A CN116486665A CN 116486665 A CN116486665 A CN 116486665A CN 202310364917 A CN202310364917 A CN 202310364917A CN 116486665 A CN116486665 A CN 116486665A
Authority
CN
China
Prior art keywords
eyeball
cataract surgery
model
constructing
cataract
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310364917.9A
Other languages
Chinese (zh)
Inventor
杨小红
余洪华
吴冠蓉
胡一骏
牛勇毅
李聪
方莹
况宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Provincial Peoples Hospital
Original Assignee
Guangdong Provincial Peoples Hospital
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Provincial Peoples Hospital filed Critical Guangdong Provincial Peoples Hospital
Priority to CN202310364917.9A priority Critical patent/CN116486665A/en
Publication of CN116486665A publication Critical patent/CN116486665A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/003Navigation within 3D models or images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/28Force feedback
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/41Medical

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Educational Technology (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Hardware Design (AREA)
  • Educational Administration (AREA)
  • Business, Economics & Management (AREA)
  • Instructional Devices (AREA)

Abstract

本发明公开了一种基于数字孪生技术的白内障手术模拟教学模型构建方法。本发明具备以下有益效果:(1)基于数字孪生技术创建3D眼球模型,该3D眼球模型能够进行眼球结构和疾病知识的动态展示,加深住院医生对白内障基本知识和诊疗过程的理解;(2)利用VR和力反馈装置创建无需实体显微操作设备的白内障手术模拟教学模型,通过手术操作的虚拟空间移植,使得住院医生可以真实感受手术器械作用于3D眼球模型的效果,白内障手术模拟具有高度真实性,实现住院医生真实体验白内障手术操作过程;(3)建立白内障手术模拟训练反馈和评分系统,通过训练过程的实时监控和反馈,引导住院医生在反复训练过程中掌握操作要领并形成良好的手术操作规范。The invention discloses a method for constructing a cataract surgery simulation teaching model based on digital twin technology. The invention has the following beneficial effects: (1) Create a 3D eyeball model based on digital twin technology, which can dynamically display eyeball structure and disease knowledge, and deepen residents’ understanding of cataract basic knowledge and diagnosis and treatment process; (2) Use VR and force feedback devices to create a cataract surgery simulation teaching model that does not require physical micromanipulation equipment. Through the virtual space transplantation of surgical operations, residents can truly experience the effect of surgical instruments on the 3D eyeball model. Experience the operation process of cataract surgery; (3) Establish a cataract surgery simulation training feedback and scoring system, through real-time monitoring and feedback of the training process, guide residents to master the essentials of operation and form good surgical operation specifications during repeated training.

Description

基于数字孪生技术的白内障手术模拟教学模型构建方法Construction method of cataract surgery simulation teaching model based on digital twin technology

技术领域technical field

本发明涉及白内障手术模拟教学技术领域,具体为一种基于数字孪生技术的白内障手术模拟教学模型构建方法。The invention relates to the technical field of cataract surgery simulation teaching, in particular to a method for constructing a cataract surgery simulation teaching model based on digital twin technology.

背景技术Background technique

随着医疗技术和设备的进步,白内障手术已经发展为微创的超声乳化手术,具备视力恢复迅速、手术效果良好且并发症少的优点,是最具成本效益的治疗方法之一,也是眼科最常用的显微手术之一。根据我国住院医师规范化培训内容与标准,眼科住院医师规范化培训需要理解和掌握白内障手术操作过程。With the advancement of medical technology and equipment, cataract surgery has developed into a minimally invasive phacoemulsification surgery, which has the advantages of rapid vision recovery, good surgical results and fewer complications. It is one of the most cost-effective treatments and one of the most commonly used microsurgeries in ophthalmology. According to the content and standards of the standardized training of residents in ophthalmology, the standardized training of ophthalmology residents needs to understand and master the operation process of cataract surgery.

然而,在实际临床环境中想要达到理想的规范化培训效果是极其困难的。首先,眼球是非常精密的视觉器官,白内障手术对术者的精细显微操作要求颇高,操作稍有偏差可能会给病人带来不可挽回的视功能损伤;其次,目前白内障手术已从治盲走向屈光时代,患者对手术效果要求高,导致眼科住院医生临床实践机会少、显微手术技能训练不足,极大延长了眼科白内障手术人才培养的周期。因此,如何开发安全便捷的白内障手术模拟教学工具成为目前眼科住院医生显微手术教学亟需解决的难题。However, it is extremely difficult to achieve the ideal standardized training effect in the actual clinical environment. First of all, the eyeball is a very precise visual organ. Cataract surgery requires high precision microscopic manipulation by the operator. A slight deviation in the operation may cause irreparable damage to the visual function of the patient. Secondly, cataract surgery has moved from blindness to the era of refraction, and patients have high requirements for surgical results. As a result, there are few opportunities for ophthalmology residents to practice clinically and insufficient training in microsurgery skills, which greatly prolongs the training period for ophthalmology cataract surgery talents. Therefore, how to develop a safe and convenient cataract surgery simulation teaching tool has become an urgent problem to be solved in the teaching of microsurgery for ophthalmology residents.

发明内容Contents of the invention

(一)解决的技术问题(1) Solved technical problems

针对现有技术的不足,本发明提供了一种基于数字孪生技术的白内障手术模拟教学模型构建方法,能够解决上述技术问题。Aiming at the deficiencies of the prior art, the present invention provides a method for constructing a cataract surgery simulation teaching model based on digital twin technology, which can solve the above-mentioned technical problems.

(二)技术方案(2) Technical solutions

为解决上述技术问题,本发明提供如下技术方案:一种基于数字孪生技术的白内障手术模拟教学模型构建方法,包括以下步骤:In order to solve the above technical problems, the present invention provides the following technical solutions: a method for constructing a cataract surgery simulation teaching model based on digital twin technology, comprising the following steps:

S1:基于数字孪生技术构建3D眼球模型;S1: Build a 3D eyeball model based on digital twin technology;

S2:利用VR和力反馈装置在虚拟空间内对3D眼球模型的眼球组织进行白内障手术;S2: Using VR and force feedback devices to perform cataract surgery on the eyeball tissue of the 3D eyeball model in the virtual space;

S3:采集白内障手术时眼球组织的形态变化数据以及白内障手术时的力学参数;S3: Collect the morphological change data of eyeball tissue during cataract surgery and the mechanical parameters during cataract surgery;

S4:将眼球组织的形态变化数据以及力学参数同步到3D眼球模型,以建立白内障手术模拟教学模型。S4: Synchronize the morphological change data and mechanical parameters of eyeball tissue to the 3D eyeball model to establish a cataract surgery simulation teaching model.

优选的,步骤S1具体包括以下子步骤:Preferably, step S1 specifically includes the following sub-steps:

S11:获取构建3D眼球模型所需的数据;S11: Acquiring data required for building a 3D eyeball model;

S12:对数据进行标识与清洗;S12: Identify and clean the data;

S13:利用数据以及数字建模软件构建3D眼球模型的静态模型;S13: Using data and digital modeling software to construct a static model of the 3D eyeball model;

S14:基于数据匹配方法由静态模型自动生成3D眼球模型的动态仿真模型。S14: Automatically generate a dynamic simulation model of a 3D eyeball model from a static model based on a data matching method.

优选的,在子步骤S14之后还包括子步骤S15:在视觉设备上呈现3D眼球模型的眼球解剖解构、眼球组织生理病理特性以及白内障疾病发病机理。Preferably, after the sub-step S14, a sub-step S15 is further included: presenting the eyeball anatomy and deconstruction of the 3D eyeball model, the physiological and pathological characteristics of the eyeball tissue, and the pathogenesis of cataract disease on the visual device.

优选的,步骤S2具体包括以下子步骤:Preferably, step S2 specifically includes the following sub-steps:

S21:使用三角划分的方法对眼球组织进行建模,以将眼球组织细分成多个三角形;S21: Modeling the eyeball tissue by using a triangulation method to subdivide the eyeball tissue into multiple triangles;

S22:利用VR、力反馈装置以及手术器械在虚拟空间内对眼球组织进行白内障手术;S22: Use VR, force feedback devices and surgical instruments to perform cataract surgery on eyeball tissue in virtual space;

S23:检测出手术器械与眼球组织接触的位置和作用程度;S23: Detect the position and degree of action of the surgical instrument in contact with the eyeball tissue;

S24:在每个三角形上模拟出手术器械作用于眼球组织表面的法向力。S24: Simulate the normal force of the surgical instrument acting on the surface of the eyeball tissue on each triangle.

优选的,步骤S3具体为:通过手术录像设备采集白内障手术时眼球组织的形态变化数据,同时通过力反馈装置采集白内障手术时的力学参数。Preferably, step S3 specifically includes: collecting the morphological change data of the eyeball tissue during the cataract operation through the operation video equipment, and simultaneously collecting the mechanical parameters during the cataract operation through the force feedback device.

优选的,在步骤S4之后还包括步骤S5:进行白内障手术模拟训练反馈及评分。Preferably, step S5 is further included after step S4: performing cataract surgery simulation training feedback and scoring.

优选的,步骤S5具体包括以下子步骤:Preferably, step S5 specifically includes the following sub-steps:

S51:学生使用模拟手术教学套装,在3D眼球模型上进行白内障手术操作,其中模拟手术教学套装包括VR、力反馈装置以及手术器械;S51: Students use the simulated surgery teaching kit to perform cataract surgery on the 3D eyeball model. The simulated surgery teaching kit includes VR, force feedback device and surgical instruments;

S52:实时采集学生在白内障手术过程中手术器械作用于眼球组织的位置、力学参数,以及采集学生在白内障手术过程中眼球组织的形态变化数据,生成学生手术模型;S52: Collect in real time the position and mechanical parameters of the surgical instruments acting on the eyeball tissue of the students during the cataract surgery process, and collect the morphological change data of the student's eyeball tissue during the cataract surgery process, and generate the student's surgical model;

S53:将学生手术模型与老师手术模型进行比对。S53: Comparing the student's surgical model with the teacher's surgical model.

优选的,子步骤S53具体为:将学生手术模型与老师手术模型进行比对,以及通过专家点评,以对学生的手术训练进行评分。Preferably, sub-step S53 is specifically: comparing the student's surgical model with the teacher's surgical model, and evaluating the student's surgical training through expert evaluation.

优选的,步骤S5还包括子步骤S54:进行综合评估,生成手术优化方案,以进一步指导学生进行手术。Preferably, step S5 also includes a sub-step S54: conducting a comprehensive assessment and generating an operation optimization plan to further guide students to perform the operation.

(三)有益效果(3) Beneficial effects

与现有技术相比,本发明提供了一种基于数字孪生技术的白内障手术模拟教学模型构建方法,具备以下有益效果:(1)基于数字孪生技术创建3D眼球模型,该3D眼球模型能够进行眼球结构和疾病知识的动态展示,加深住院医生对白内障基本知识和诊疗过程的理解;(2)利用VR和力反馈装置创建无需实体显微操作设备的白内障手术模拟教学模型,通过手术操作的虚拟空间移植,使得住院医生可以真实感受手术器械作用于3D眼球模型的效果,白内障手术模拟具有高度真实性,实现住院医生真实体验白内障手术操作过程;(3)建立白内障手术模拟训练反馈和评分系统,通过训练过程的实时监控和反馈,引导住院医生在反复训练过程中掌握操作要领并形成良好的手术操作规范。通过上述方式,本发明能为锻炼和提高眼科住院医生的白内障显微手术技能提供安全便捷、高真实性、交互式的学习平台。Compared with the prior art, the present invention provides a method for constructing a cataract surgery simulation teaching model based on digital twin technology, which has the following beneficial effects: (1) Create a 3D eyeball model based on digital twin technology, and the 3D eyeball model can perform dynamic display of eyeball structure and disease knowledge, and deepen residents’ understanding of cataract basic knowledge and diagnosis and treatment process; (2) Use VR and force feedback devices to create a cataract surgery simulation teaching model that does not require physical micromanipulation equipment. The effect of the device acting on the 3D eyeball model, cataract surgery simulation has a high degree of authenticity, allowing residents to experience the cataract surgery operation process; (3) Establish a cataract surgery simulation training feedback and scoring system, through real-time monitoring and feedback of the training process, guide residents to master the essentials of operation during repeated training and form a good surgical operation specification. Through the above method, the present invention can provide a safe, convenient, highly authentic and interactive learning platform for exercising and improving the cataract microsurgery skills of ophthalmology residents.

附图说明Description of drawings

图1为本发明一种基于数字孪生技术的白内障手术模拟教学模型构建方法的步骤流程图;Fig. 1 is a step flow chart of a method for constructing a cataract surgery simulation teaching model based on digital twin technology in the present invention;

图2为本发明的步骤S1的步骤流程图;Fig. 2 is the step flowchart of step S1 of the present invention;

图3为本发明的步骤S2-S4的步骤流程图;Fig. 3 is the flow chart of steps S2-S4 of the present invention;

图4为本发明的步骤S5的步骤流程图。FIG. 4 is a flow chart of step S5 of the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

本发明提供一种基于数字孪生技术的白内障手术模拟教学模型构建方法,包括以下步骤:The present invention provides a method for constructing a cataract surgery simulation teaching model based on digital twin technology, comprising the following steps:

S1:基于数字孪生技术构建3D眼球模型。S1: Construct a 3D eyeball model based on digital twin technology.

数字孪生是充分利用物理模型、传感器更新、运行历史等数据,集成多学科、多物理量、多尺度、多概率的仿真过程,在虚拟空间中完成映射,从而反映相对应的实体装备的全生命周期过程。数字孪生技术的高速发展使得手术模拟训练工具的开发成为可能。数字孪生技术通过应用数字建模、物联网、信息感知、人工智能(AI)、云计算等技术,可以构建各种动态仿真模型,可用于教学、设备研发、疾病诊疗、疾病演变和机制研究等领域。Digital twin is to make full use of physical model, sensor update, operation history and other data, integrate multi-discipline, multi-physical quantity, multi-scale, multi-probability simulation process, and complete the mapping in the virtual space, so as to reflect the whole life cycle process of the corresponding physical equipment. The rapid development of digital twin technology has made it possible to develop surgical simulation training tools. Through the application of digital modeling, Internet of Things, information perception, artificial intelligence (AI), cloud computing and other technologies, digital twin technology can construct various dynamic simulation models, which can be used in teaching, equipment research and development, disease diagnosis and treatment, disease evolution and mechanism research and other fields.

具体的,该步骤S1具体包括以下子步骤:Specifically, the step S1 specifically includes the following sub-steps:

S11:获取构建3D眼球模型所需的数据。具体的,通过眼科检查设备和医疗信息化系统(HIS、EMR、LIS、PACS系统等)采集眼球基本结构和生理功能、白内障发生发展以及诊疗过程的真实世界数据。S11: Obtain data required for building a 3D eyeball model. Specifically, real-world data on the basic structure and physiological functions of the eyeball, the occurrence and development of cataracts, and the diagnosis and treatment process are collected through ophthalmic examination equipment and medical information systems (HIS, EMR, LIS, PACS systems, etc.).

S12:对数据进行标识与清洗。通过对所获取的数据进行标识与清洗,使得数据的类型及属性符合搭建3D眼球模型的需求。S12: Identify and clean the data. By identifying and cleaning the acquired data, the type and attributes of the data meet the requirements of building a 3D eyeball model.

S13:利用数据以及数字建模软件构建3D眼球模型的静态模型。该子步骤S13通过使用所获取并处理后的结构化数据,结合眼科学、材料力学、光学等理论,使用各类3D模型建模工具,构建各类初始3D眼球模型即静态模型。S13: Using data and digital modeling software to build a static model of the 3D eyeball model. In this sub-step S13, various initial 3D eyeball models, ie static models, are constructed by using the acquired and processed structured data, combining ophthalmology, material mechanics, optics and other theories, and using various 3D model modeling tools.

S14:基于数据匹配方法由静态模型自动生成3D眼球模型的动态仿真模型。该子步骤S14基于数据匹配方法由静态模型自动生成动态仿真模型,并通过实时数据反馈持续优化,最终使得3D眼球模型的解剖解构及生理病理特点无限接近真实的眼球。S14: Automatically generate a dynamic simulation model of a 3D eyeball model from a static model based on a data matching method. The sub-step S14 automatically generates a dynamic simulation model from the static model based on the data matching method, and continuously optimizes it through real-time data feedback, finally making the anatomical deconstruction and physiological and pathological characteristics of the 3D eyeball model infinitely close to the real eyeball.

例如,首先,勾勒眼球整体轮廓,通过程序定位整体及局部组织空间参数,先进行眼球整体模型的搭建,再进行角膜、虹膜、睫状肌、晶体、玻璃体、巩膜、虹膜、视网膜等重要组织的搭建。然后,按照眼球生理运动参数特点应用程序,实现眼球及其组织的生理变化。例如我们通过调节虹膜内径及厚度、睫状肌长度及厚度和晶体直径及厚度的变化来控制瞳孔缩放;而瞳孔颜色控制是通过原始模型纹理乘以定义好的颜色属性来实现的。For example, first, outline the overall outline of the eyeball, locate the overall and local tissue space parameters through the program, first build the overall model of the eyeball, and then build cornea, iris, ciliary muscle, lens, vitreous body, sclera, iris, retina and other important tissues. Then, according to the characteristic application program of eyeball physiological movement parameters, the physiological changes of the eyeball and its tissues are realized. For example, we control the pupil zoom by adjusting the inner diameter and thickness of the iris, the length and thickness of the ciliary muscle, and the diameter and thickness of the crystal; and the pupil color control is achieved by multiplying the original model texture by the defined color attribute.

此外,在上述子步骤S14之后还包括子步骤S15:在视觉设备上呈现3D眼球模型的眼球解剖解构、眼球组织生理病理特性以及白内障疾病发病机理。具体可在PC端、VR或移动终端等视觉设备上,全视角多维度呈现眼球解剖解构,动态呈现眼球组织生理病理特性及白内障等疾病发病机理。In addition, after the above sub-step S14, a sub-step S15 is also included: presenting the eyeball anatomy and deconstruction of the 3D eyeball model, the physiological and pathological characteristics of the eyeball tissue, and the pathogenesis of cataract disease on the visual device. Specifically, on visual devices such as PCs, VR or mobile terminals, the anatomy and deconstruction of the eyeball can be presented in a full-view and multi-dimensional way, and the physiological and pathological characteristics of the eyeball tissue and the pathogenesis of cataract and other diseases can be dynamically presented.

S2:利用VR和力反馈装置在虚拟空间内对3D眼球模型的眼球组织进行白内障手术。S2: Using VR and force feedback device to perform cataract surgery on the eyeball tissue of the 3D eyeball model in the virtual space.

VR(Virtual Reality,虚拟现实),为虚拟和现实相互结合,其可以创建和体验虚拟世界。力反馈装置为触觉感知的刺激器,本发明的力反馈装置具体可采用力反馈手套。白内障手术操作具体可包括超声乳化和人工晶体植入等。VR (Virtual Reality, virtual reality) is a combination of virtual and reality, which can create and experience a virtual world. The force feedback device is a stimulator for tactile perception, and the force feedback device of the present invention may specifically adopt a force feedback glove. Cataract surgery may specifically include phacoemulsification and intraocular lens implantation.

具体的,该步骤S2具体包括以下子步骤:Specifically, the step S2 specifically includes the following sub-steps:

S21:使用三角划分的方法对眼球组织进行建模,以将眼球组织细分成多个三角形。S21: Model the eyeball tissue using a triangulation method to subdivide the eyeball tissue into multiple triangles.

S22:利用VR、力反馈装置以及手术器械在虚拟空间内对眼球组织进行白内障手术。S22: Use VR, force feedback devices and surgical instruments to perform cataract surgery on eyeball tissue in virtual space.

S23:检测出手术器械与眼球组织接触的位置(对应三角形区域)和作用程度(深度)。S23: Detect the position (corresponding to the triangular area) and the degree of action (depth) of the surgical instrument in contact with the eyeball tissue.

S24:在每个三角形上模拟出手术器械作用于眼球组织表面的法向力。S24: Simulate the normal force of the surgical instrument acting on the surface of the eyeball tissue on each triangle.

S3:采集白内障手术时眼球组织的形态变化数据以及白内障手术时的力学参数。S3: Collect the morphological change data of eyeball tissue during cataract surgery and the mechanical parameters during cataract surgery.

优选的,该步骤S3具体为:通过手术录像设备采集白内障手术时眼球组织的形态变化数据,同时通过力反馈装置采集白内障手术时的力学参数。力学参数具体可包括白内障手术过程中手指作用于手术器械以及手术器械作用于眼球组织表面的压力和摩擦力等。Preferably, the step S3 specifically includes: collecting the morphological change data of the eyeball tissue during the cataract operation through the operation video equipment, and simultaneously collecting the mechanical parameters during the cataract operation through the force feedback device. The mechanical parameters may specifically include the pressure and friction of fingers acting on surgical instruments during cataract surgery, and the pressure and friction of surgical instruments acting on the surface of eyeball tissue.

S4:将眼球组织的形态变化数据以及力学参数同步到3D眼球模型,以建立白内障手术模拟教学模型。S4: Synchronize the morphological change data and mechanical parameters of eyeball tissue to the 3D eyeball model to establish a cataract surgery simulation teaching model.

优选的,在步骤S4之后还包括步骤S5:进行白内障手术模拟训练反馈及评分。Preferably, step S5 is further included after step S4: performing cataract surgery simulation training feedback and scoring.

进一步的,上述步骤S5具体包括以下子步骤:Further, the above step S5 specifically includes the following sub-steps:

S51:学生使用模拟手术教学套装,在3D眼球模型上进行白内障手术操作,其中模拟手术教学套装包括VR、力反馈装置以及手术器械。学生使用模拟手术教学套装,在3D眼球模型上进行手术操作,此过程学生可以真实感受虚拟手术器械作用于3D眼球模型上的触感及受力度,可以实时看到眼球组织形态的变化。S51: Students use the simulated surgery teaching kit to perform cataract surgery on the 3D eyeball model. The simulated surgery teaching kit includes VR, force feedback devices and surgical instruments. Students use the simulated surgery teaching kit to perform surgery on the 3D eyeball model. During this process, students can truly feel the touch and force of the virtual surgical instruments acting on the 3D eyeball model, and can see the changes in the shape of the eyeball tissue in real time.

S52:实时采集学生在白内障手术过程中手术器械作用于眼球组织的位置、力学参数,以及采集学生在白内障手术过程中眼球组织的形态变化数据,生成学生手术模型。S52: Collect in real time the position and mechanical parameters of the surgical instruments acting on the eyeball tissue of the student during the cataract operation, and collect the morphological change data of the student's eyeball tissue during the cataract operation to generate the student's surgical model.

S53:将学生手术模型与老师手术模型进行比对。应理解,老师手术模型为老师通过使用模拟手术教学套装在3D眼球模型上进行白内障手术操作所相应生成的手术模型。S53: Comparing the student's surgical model with the teacher's surgical model. It should be understood that the teacher's surgical model is a surgical model generated by the teacher by using the simulated surgical teaching kit to perform cataract surgery on the 3D eyeball model.

优选的,该子步骤S53具体为:将学生手术模型与老师手术模型进行比对,以及通过专家点评,以对学生的手术训练进行评分。即通过专家点评和学生—老师模型比对,双机制对学生手术关键环节进行评分。Preferably, the sub-step S53 is specifically: comparing the student's surgical model with the teacher's surgical model, and evaluating the student's surgical training through expert evaluation. That is, through expert evaluation and student-teacher model comparison, the dual mechanism evaluates the key links of student surgery.

此外,步骤S5还包括子步骤S54:进行综合评估,生成手术优化方案,以进一步指导学生进行手术。具体可根据白内障手术操作技术规范、学生手术过程的操作熟练程度和手术操作中出现失误的情况等进行综合评估,相应生成生成手术优化方案。In addition, step S5 also includes a sub-step S54: conducting a comprehensive assessment and generating an operation optimization plan to further guide students to perform operations. Specifically, it can be comprehensively evaluated according to the technical specifications of cataract surgery operation, the operation proficiency of the students in the operation process, and the situation of mistakes in the operation, and the operation optimization plan can be generated accordingly.

与现有技术相比,本发明提供了一种基于数字孪生技术的白内障手术模拟教学模型构建方法,具备以下有益效果:(1)基于数字孪生技术创建3D眼球模型,该3D眼球模型能够进行眼球结构和疾病知识的动态展示,加深住院医生对白内障基本知识和诊疗过程的理解;(2)利用VR和力反馈装置创建无需实体显微操作设备的白内障手术模拟教学模型,通过手术操作的虚拟空间移植,使得住院医生可以真实感受手术器械作用于3D眼球模型的效果,白内障手术模拟具有高度真实性,实现住院医生真实体验白内障手术操作过程;(3)建立白内障手术模拟训练反馈和评分系统,通过训练过程的实时监控和反馈,引导住院医生在反复训练过程中掌握操作要领并形成良好的手术操作规范。通过上述方式,本发明能为锻炼和提高眼科住院医生的白内障显微手术技能提供安全便捷、高真实性、交互式的学习平台。Compared with the prior art, the present invention provides a method for constructing a cataract surgery simulation teaching model based on digital twin technology, which has the following beneficial effects: (1) Create a 3D eyeball model based on digital twin technology, and the 3D eyeball model can perform dynamic display of eyeball structure and disease knowledge, and deepen residents’ understanding of cataract basic knowledge and diagnosis and treatment process; (2) Use VR and force feedback devices to create a cataract surgery simulation teaching model that does not require physical micromanipulation equipment. The effect of the device acting on the 3D eyeball model, cataract surgery simulation has a high degree of authenticity, allowing residents to experience the cataract surgery operation process; (3) Establish a cataract surgery simulation training feedback and scoring system, through real-time monitoring and feedback of the training process, guide residents to master the essentials of operation during repeated training and form a good surgical operation specification. Through the above method, the present invention can provide a safe, convenient, highly authentic and interactive learning platform for exercising and improving the cataract microsurgery skills of ophthalmology residents.

需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements but also other elements not expressly listed or elements inherent in such a process, method, article or apparatus. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

尽管已经示出和描述了本发明的实施例,对于本领域的普通技术人员而言,可以理解在不脱离本发明的原理和精神的情况下可以对这些实施例进行多种变化、修改、替换和变型,本发明的范围由所附权利要求及其等同物限定。Although the embodiment of the present invention has been shown and described, for those of ordinary skill in the art, it can be understood that various changes, modifications, replacements and modifications can be made to these embodiments without departing from the principle and spirit of the present invention, and the scope of the present invention is defined by the appended claims and their equivalents.

Claims (9)

1. The method for constructing the cataract surgery simulation teaching model based on the digital twin technology is characterized by comprising the following steps of:
s1: constructing a 3D eyeball model based on a digital twin technology;
s2: performing cataract surgery on eyeball tissues of the 3D eyeball model in a virtual space by utilizing VR and a force feedback device;
s3: collecting morphological change data of the eyeball tissue during the cataract surgery and mechanical parameters during the cataract surgery;
s4: synchronizing the morphological change data of the eyeball tissues and the mechanical parameters to the 3D eyeball model to establish a cataract surgery simulation teaching model.
2. The method for constructing a digital twinning-based cataract surgery simulation teaching model according to claim 1, wherein the step S1 specifically comprises the following substeps:
s11: acquiring data required for constructing the 3D eyeball model;
s12: identifying and cleaning the data;
s13: constructing a static model of the 3D eyeball model by utilizing the data and digital modeling software;
s14: and automatically generating a dynamic simulation model of the 3D eyeball model from the static model based on a data matching method.
3. The method for constructing a digital twinning-based cataract surgery simulation teaching model according to claim 2, characterized by further comprising the substep S15 after the substep S14: and presenting eyeball de-dissection, eyeball tissue physiological and pathological characteristics and cataract disease pathogenesis of the 3D eyeball model on visual equipment.
4. The method for constructing a digital twinning-based cataract surgery simulation teaching model according to claim 1, wherein the step S2 specifically comprises the following substeps:
s21: modeling the eye tissue using a triangulation method to subdivide the eye tissue into a plurality of triangles;
s22: performing cataract surgery on the eyeball tissue in a virtual space by using the VR, a force feedback device and a surgical instrument;
s23: detecting the contact position and action degree of the surgical instrument and the eyeball tissues;
s24: the normal force of the surgical instrument on the eyeball tissue surface is simulated on each triangle.
5. The method for constructing a simulated teaching model for cataract surgery based on digital twinning technique according to claim 4, wherein the step S3 is specifically: the morphological change data of the eyeball tissues during cataract surgery is collected through a surgical video device, and meanwhile, the mechanical parameters during cataract surgery are collected through the force feedback device.
6. The method for constructing a digital twin technology-based cataract surgery simulation teaching model according to claim 5, further comprising step S5 after step S4: simulation training feedback and scoring of cataract surgery are performed.
7. The method for constructing a simulated teaching model for cataract surgery based on digital twinning technique according to claim 6, wherein the step S5 specifically comprises the following substeps:
s51: performing cataract surgery on the 3D eye model using a simulated surgical teaching set, wherein the simulated surgical teaching set comprises the VR, a force feedback device, and a surgical instrument;
s52: collecting the position and mechanical parameters of the student acting on the eyeball tissues by the surgical instrument in the cataract surgery process in real time, and collecting the morphological change data of the eyeball tissues of the student in the cataract surgery process to generate a student surgery model;
s53: and comparing the student operation model with a teacher operation model.
8. The method for constructing a digital twin technology-based cataract surgery simulation teaching model according to claim 7, wherein the substep S53 is specifically: and comparing the student operation model with a teacher operation model, and scoring the operation training of the student by expert comment.
9. The method for constructing a digital twin technology-based cataract surgery simulation teaching model according to claim 8, wherein the step S5 further comprises the substep S54: and (5) performing comprehensive evaluation to generate a surgery optimization scheme so as to further guide students to perform surgery.
CN202310364917.9A 2023-04-06 2023-04-06 Construction method of cataract surgery simulation teaching model based on digital twin technology Pending CN116486665A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310364917.9A CN116486665A (en) 2023-04-06 2023-04-06 Construction method of cataract surgery simulation teaching model based on digital twin technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310364917.9A CN116486665A (en) 2023-04-06 2023-04-06 Construction method of cataract surgery simulation teaching model based on digital twin technology

Publications (1)

Publication Number Publication Date
CN116486665A true CN116486665A (en) 2023-07-25

Family

ID=87214779

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310364917.9A Pending CN116486665A (en) 2023-04-06 2023-04-06 Construction method of cataract surgery simulation teaching model based on digital twin technology

Country Status (1)

Country Link
CN (1) CN116486665A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116959306A (en) * 2023-07-31 2023-10-27 杭州市中医院 A traditional Chinese medicine chiropractic teaching method based on VR technology and spine model

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106294918A (en) * 2015-06-10 2017-01-04 中国科学院宁波材料技术与工程研究所 A kind of method for designing of virtual transparence office system
CN111128367A (en) * 2020-01-13 2020-05-08 浙江清华柔性电子技术研究院 Modeling and simulating method and system for eyes
CN111667906A (en) * 2020-06-15 2020-09-15 上海交通大学医学院附属仁济医院 An eyeball structure virtual teaching system and its digital model building method
CN112836317A (en) * 2021-03-05 2021-05-25 南昌工程学院 An intelligent modeling method for product design based on eye tracking technology
CN114120735A (en) * 2021-07-28 2022-03-01 上海华模科技有限公司 Cataract phacoemulsification virtual surgery training system
CN115034022A (en) * 2022-04-22 2022-09-09 阿里巴巴(中国)有限公司 Digital twin model generation method and standardization processing method for data center
CN115346665A (en) * 2022-10-19 2022-11-15 南昌大学第二附属医院 Method, system and equipment for constructing retinopathy risk prediction model
CN115641232A (en) * 2022-09-16 2023-01-24 常州纺织服装职业技术学院 Classroom teaching system and method based on digital twin technology

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106294918A (en) * 2015-06-10 2017-01-04 中国科学院宁波材料技术与工程研究所 A kind of method for designing of virtual transparence office system
CN111128367A (en) * 2020-01-13 2020-05-08 浙江清华柔性电子技术研究院 Modeling and simulating method and system for eyes
CN111667906A (en) * 2020-06-15 2020-09-15 上海交通大学医学院附属仁济医院 An eyeball structure virtual teaching system and its digital model building method
CN112836317A (en) * 2021-03-05 2021-05-25 南昌工程学院 An intelligent modeling method for product design based on eye tracking technology
CN114120735A (en) * 2021-07-28 2022-03-01 上海华模科技有限公司 Cataract phacoemulsification virtual surgery training system
CN115034022A (en) * 2022-04-22 2022-09-09 阿里巴巴(中国)有限公司 Digital twin model generation method and standardization processing method for data center
CN115641232A (en) * 2022-09-16 2023-01-24 常州纺织服装职业技术学院 Classroom teaching system and method based on digital twin technology
CN115346665A (en) * 2022-10-19 2022-11-15 南昌大学第二附属医院 Method, system and equipment for constructing retinopathy risk prediction model

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116959306A (en) * 2023-07-31 2023-10-27 杭州市中医院 A traditional Chinese medicine chiropractic teaching method based on VR technology and spine model

Similar Documents

Publication Publication Date Title
Ong et al. Applications of extended reality in ophthalmology: systematic review
Sinclair et al. Computer-simulated eye surgery: a novel teaching method for residents and practitioners
Khalifa et al. Virtual reality in ophthalmology training
Ting et al. Ophthalmology simulation for undergraduate and postgraduate clinical education
Lam et al. Virtual reality simulator for phacoemulsification cataract surgery education and training
US11984045B2 (en) Surgical simulator systems and methods
TWI830910B (en) Device, method and system for cloud based system cataract treatment
Laurell et al. Computer-simulated phacoemulsification
KR20200048830A (en) Cataract surgery Simulation System for education based on virtual reality
CN115454254A (en) Endoscopic guided transnasal virtual simulated surgery method and device
CN116486665A (en) Construction method of cataract surgery simulation teaching model based on digital twin technology
EP4018428B1 (en) Surgical simulator systems and methods
Jayakumar et al. Interactive gesture based cataract surgery simulation
Perez et al. Cataract surgery simulator for medical education & finite element/3D human eye model
Mahr The Eyesi Ophthalmic Surgical Simulator
Cai et al. Parametric eyeball model for interactive simulation of ophthalmologic surgery
Lam et al. Virtual simulation of eyeball and extraocular muscle reaction during cataract surgery
RU2755546C1 (en) Method for teaching basic technical skills of phacoemulsification and vitreoretinal surgery using simulation technologies
Koh Applications of extended reality in ophthalmology: Systematic
Barea et al. Cataract surgery simulator for medical education
Rivera et al. Innovative Simulation Training Model for Cataract Surgery
Lee et al. Ophthalmoscopic examination training using virtual reality
Choi A virtual reality simulator prototype for learning and assessing phaco-sculpting skills
WO2024211375A1 (en) Surgical simulator systems and methods
Abulgasem A haptic surgical simulator for cataract eye surgery using circular wave model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination