[go: up one dir, main page]

WO2018028166A1 - Système et procédé d'interaction à distance basés sur un dispositif d'affichage de réalité virtuelle monté sur la tête - Google Patents

Système et procédé d'interaction à distance basés sur un dispositif d'affichage de réalité virtuelle monté sur la tête Download PDF

Info

Publication number
WO2018028166A1
WO2018028166A1 PCT/CN2017/073978 CN2017073978W WO2018028166A1 WO 2018028166 A1 WO2018028166 A1 WO 2018028166A1 CN 2017073978 W CN2017073978 W CN 2017073978W WO 2018028166 A1 WO2018028166 A1 WO 2018028166A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
mounted display
virtual reality
reality head
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/073978
Other languages
English (en)
Chinese (zh)
Inventor
李炜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inlife Handnet Co Ltd
Original Assignee
Inlife Handnet Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inlife Handnet Co Ltd filed Critical Inlife Handnet Co Ltd
Publication of WO2018028166A1 publication Critical patent/WO2018028166A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/318—Heart-related electrical modalities, e.g. electrocardiography [ECG]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/021—Measuring pressure in heart or blood vessels
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B7/00—Instruments for auscultation
    • A61B7/003—Detecting lung or respiration noise
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B7/00—Instruments for auscultation
    • A61B7/02—Stethoscopes
    • A61B7/04—Electric stethoscopes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects

Definitions

  • the present invention relates to the field of medical treatment, and in particular to the field of telemedicine, and more particularly to a remote interactive system and method based on a virtual reality head mounted display device.
  • Telemedicine is a special way for hospitals to treat patients in recent years, which is conducive to alleviating medical resources and improving the efficiency of diagnosis and treatment.
  • treatment for some critical illnesses is generally concentrated in major hospitals in major cities.
  • the doctors of different qualifications in different hospitals and hospitals in different departments of the hospital will be affected by the above external factors for the diagnosis and treatment of patients with severe diseases, which may result in patients not enjoying the best diagnosis and treatment results.
  • the existing telemedicine system can integrate the superior medical resources of each hospital to treat patients with various diseases steadily, and eliminate the limitations of realistic factors such as distance location and asymmetry of patient diagnosis and treatment information.
  • the technical problem to be solved by the present invention is to provide a virtual reality based head based on the shortcomings of the existing telemedicine interactive technology that the support system is difficult to provide accurate and accurate surgical guidance and effective solutions for the surgical site.
  • a remote interactive system and method for a wearable display device that provides an authoritative surgical guide and an effective solution for the surgical field.
  • the present invention provides a remote interactive system based on a virtual reality head mounted display device, including a clinical system And a support system, the clinical system comprising a data collection device, a data transmission channel, a cloud database, and a data exchange hub, the support system comprising a virtual reality head mounted display device;
  • the data collection device is connected to the data transmission channel for collecting human physiological data
  • the data transmission channel includes at least one of an Ethernet, a WiFi, a wireless private network, a telephone PSTN network, a satellite, or a mobile Internet, for transmitting data;
  • the cloud database connecting the data transmission channel, including a cloud computing platform and a cloud storage platform, for providing a unified data access interface and arranging corresponding data access rights;
  • the data exchange hub is connected to the data transmission channel for completing data exchange between the clinical system and the support system;
  • the virtual reality head-mounted display device is connected to the data exchange hub by a network, and is configured to generate a corresponding image according to the physiological data.
  • the system has a human body simulation processor for generating a three-dimensional model of a patient site, and is used to generate a three-dimensional model of the surgical instrument.
  • a tool simulation processor, the virtual reality head mounted display device having a screen for dynamically displaying a three-dimensional model of the patient site and a three-dimensional model of the surgical instrument.
  • the display screen has a graphical user interface for selectively displaying the physiological data.
  • the virtual reality head-mounted display device has a motion displacement sensing module, and the support system further has the motion displacement sensing A wearable accessory that is electrically connected to the module.
  • the system has a virtual human body model library for storing a three-dimensional model of human tissue and organs.
  • the support system and the clinical system are geographically distant from each other.
  • the cloud computing platform includes a first hardware system and a first software system
  • the first hardware system includes a first server and a first storage system
  • the first software system comprising a first operating system and a first database system
  • the cloud storage platform includes a second hardware system and a second software system, where the second hardware system includes A second server and a second storage system, the second software system comprising a second operating system and a second database system.
  • the present invention also provides a remote interactive medical method based on a virtual reality head mounted display device, the method comprising the following steps:
  • the medical system of the clinical system uses the data collection device to collect the physiological data of the patient and sends it to the cloud database through the data transmission channel;
  • the physiological data in the cloud database is transmitted to the virtual reality head-mounted display device through the data exchange hub;
  • the virtual reality head-mounted display device establishes and dynamically displays a three-dimensional model of a patient's diseased part according to the physiological data
  • the virtual reality head-mounted display device establishes and dynamically displays a three-dimensional model of a surgical instrument for treating a patient's diseased part of the patient;
  • a medical staff supporting the system manipulates a three-dimensional model of the surgical instrument to perform a virtual surgical treatment on a three-dimensional model of the patient's patient site, and the virtual reality head-mounted display device records the support system for performing a surgical procedure
  • the gesture operation step is combined with the three-dimensional model of the patient's patient site and the three-dimensional model of the surgical instrument to be transmitted to the cloud database through the data exchange center for reference by the clinical system.
  • the method includes the following steps:
  • the screen display acquires and dynamically displays a three-dimensional model of the patient's site.
  • the method includes the following steps: the implementer of the virtual surgery in the support system wears the virtual reality head mounted display device sexually connected wearable accessories.
  • a remote interactive medical system and method based on virtual reality head mounted display device provided by the present invention Has the following beneficial effects:
  • the virtual reality head-mounted display device provides the medical staff of the support system with the actual physiological data of the patient's patient part and the real dynamic three-dimensional model, and can generate a three-dimensional model of the medical device required for various operations. Therefore, the medical staff of the support system can formulate a corresponding treatment plan according to the tamping dynamic three-dimensional model of the patient part, and perform virtual surgery using the three-dimensional model of the medical device, and the virtual reality head-mounted display device records support system is formulated.
  • the treatment plan transmits data related to the virtual surgery to the cloud database for reference by the clinical system.
  • the data collection device may include multiple professional-level medical information collection devices such as a multi-parameter monitor, an electrocardiogram, a high-definition speculum, an electronic stethoscope, a camera, etc., and may also be accessed according to work needs. Many other medical information collection devices. Realize the physical examination of various physiological indicators, such as electrocardiogram, body temperature, pulse, blood pressure, blood oxygen, heart sound, lung sound, eye, nose and throat, etc., so that medical personnel can obtain more comprehensive diagnostic data for analysis and judgment.
  • the medical information collected above can be connected to the private network through a wired network, a WiFi wireless network, a satellite network, or a 3G/4G wireless broadband network to ensure the security of data transmission.
  • the cloud database implements real interaction or offline interaction between multiple medical diagnosis terminals.
  • the cloud database implements network storage and control interaction of multiple types of data of multiple medical diagnostic terminals.
  • the medical staff of the support system can realize the physiological data of the patient through the virtual reality helmet display device, and the medical system of the clinical system can also obtain the treatment plan provided by the support system by accessing the cloud database, and realize the innovative telemedicine. Diagnostic application mode.
  • the massive data and data of the sick patient are stored in the cloud database, which facilitates access and access by authorized institutions at various levels through various devices, and realizes disease diagnosis, medical quality tracking, and statistical analysis of various services. It can also be based on big data to realize medical knowledge base, human-oriented health tracking and regional disease monitoring.
  • FIG. 1 is a schematic structural diagram of a remote interactive medical system based on a virtual reality head mounted display device according to Embodiment 1 of the present invention
  • FIG. 2 is a schematic structural diagram of a virtual reality head-mounted display device according to Embodiment 1 of the present invention
  • 3 is a flow chart of steps of a remote interactive medical method based on a virtual reality head mounted display device according to Embodiment 2 of the present invention
  • step S3 is a specific flowchart of step S3 in the remote interactive medical method based on the virtual reality head mounted display device according to the second embodiment of the present invention.
  • the present invention aims to provide a virtual reality based headset.
  • the remote interaction system and method of the display device has the core idea of: acquiring the physiological data collected by the clinical medical structure by using the virtual reality head-mounted display device, and then generating the corresponding three-dimensional model image for the medical personnel of the support system to formulate and virtualize A corresponding treatment regimen is transmitted to the cloud database for reference by the clinical system.
  • Embodiment 1 The remote interactive medical system based on the virtual reality head mounted display device 201 provided by the present invention, see FIG. 1, the system includes a clinical system 100 and a support system 200, and the clinical system 100 and the support system 200 are geographically isolated from each other.
  • the clinical system 100 includes a data collection device 101, a data transmission channel 102, a cloud database 103, a data exchange hub 104, and a virtual reality head mounted display device 201, the support system 200 including a virtual reality head mounted display device 201 and wearable Accessory 202;
  • the data collection device 101 is connected to the data transmission channel 102 for collecting human physiological data
  • the data transmission channel 102 including at least one of an Ethernet, a WiFi, a wireless private network, a telephone PSTN network, a satellite, or a mobile Internet, for transmitting data;
  • the cloud database 103 is connected to the data transmission channel 102, and includes a cloud computing platform and a cloud storage platform, for providing a unified data access interface and arranging corresponding data access rights;
  • the data exchange hub 104 is connected to the data transmission channel 102 for completing data exchange between the clinical system 100 and the support system 200;
  • the virtual reality head mounted display device 201 is connected to the data exchange hub 104 for generating a corresponding image according to the physiological data.
  • the wearing accessory 202 is connected to the virtual reality head mounted display device 201 in a network.
  • the data collection device 101 includes a portable multi-parameter vital sign monitor for detecting blood pressure, blood oxygen, pulse, body temperature, and electrocardiogram, a 12-lead network electrocardiograph, and an optical glimpse of the ear, nose and throat.
  • a portable multi-parameter vital sign monitor for detecting blood pressure, blood oxygen, pulse, body temperature, and electrocardiogram, a 12-lead network electrocardiograph, and an optical glimpse of the ear, nose and throat.
  • Mirror, optical goggles for detecting skin, professional cardiopulmonary high-fidelity electronic stethoscope, and webcam are used to collect various life indicators and physiological characteristics of patients.
  • the data collection device 101 may also include other detection devices in the future.
  • the data transmission channel 102 provides the entire clinical system 100 with data transmission between the collection, storage, processing, and transmission links, and the data transmission channel 102 performs transmission link encryption through the VPN.
  • the clinical system 100 supports a variety of network transmission means such as wired, wireless, and satellite, and the physiological data can be uploaded to the cloud database 103 through the network.
  • the cloud computing platform of the cloud database 103 includes a first hardware system and a first software system, the first hardware system includes a first server and a first storage system, and the first software system includes a first operating system and a first database system; a cloud storage platform of the cloud database 103 includes a second hardware system and a second software system, the second hardware system including a second server and a second storage system, The second software system includes a second operating system and a second database system.
  • This part adopts cloud computing technology to realize cloud computing platform and cloud storage platform to realize a secure and scalable computing environment.
  • Cloud Database 03 can be deployed in the hospital's computer room or deployed on a proprietary private cloud provided by a third party.
  • the medical staff supporting the system 200 and the medical staff of the clinical system 100 can realize the interaction of the medical information through the cloud database 103. If the network is disconnected, the support system 200 and the clinical system 100 can also operate separately, and the connection is restored in the network. At this time, the data is uploaded to the cloud database 103.
  • the human body simulation processor 221 is used to generate a three-dimensional model of the patient's site. In the virtual surgery synchronization environment, the human body simulation processor 221 first collects data obtained by performing CT scan on the patient's patient part before the operation. It should be noted that the human body simulation processor 221 passes the DICOM 3.0 data format in this embodiment. Data collection, DICOM (digital imaging and communication in medicine), which is a standard format for medical digital imaging and communication data, can promote interoperability between medical imaging devices and provide a data for medical information. Exchange standards.
  • DICOM digital imaging and communication in medicine
  • the three-dimensional model of the corresponding part generated in advance is taken out in the virtual human model library 211 for the patient's patient part, and the B-scan curve of the CT scan data of the body part of the real patient part of the patient is three-dimensionally reconstructed, bbox algorithm, Fourier algorithm, small value dichotomy and other algorithms are processed to complete the geometric modeling, computational modeling and deformation calculation of physiological data.
  • 3DMAX10 the three-dimensional model reconstruction of the physiological characteristics of the patient, the mapping and the physiological characteristics of the organs and tissues, and the collision detection and graphic drawing of the skeletal skin tissue, and the three-dimensional model of the patient's diseased part.
  • the tool simulation processor 231 is used to generate a three-dimensional model of the surgical instrument.
  • the tool emulation processor 231 writes a three-dimensional model of various surgical instruments used in virtual surgery through a Virtual Reality Modeling Language (VRML), for example, a hand drill, a conventional disinfecting drape, a scalpel, an electric knife, and cotton.
  • a three-dimensional model of the sheet and gauze is output as the display content of the subsequent virtual reality head mounted display device 201.
  • VRML is an abbreviation of virtual reality modeling language. It is a standard for describing virtual scenes. It defines the language descriptions commonly used in 3D applications, such as hierarchical transformation, light source, pilot, geometry, animation, fog, material properties and texture. Mapping, etc., and has a simple behavioral characterization function. Assume One of the main goals of VRML is to ensure that it becomes an efficient three-dimensional file exchange format between multiple virtual reality systems or their components.
  • the on-screen display 241 can dynamically display a three-dimensional model of the patient site and a three-dimensional model of the surgical instrument.
  • the screen display 241 has a graphical user interface for selectively and dynamically displaying the physiological data.
  • the virtual reality head mounted display device 201 displays a partial partial area in the area in advance.
  • the above examples of real dynamic electrocardiogram data are only examples of many human physiological dynamic data, and are not limitations of the present invention. Since comprehensive medical diagnostic physiological data is the basis for implementing remote interaction, there are more new ones in the future.
  • the physiological data needs to be supported by the graphical user interface, and can be dynamically displayed through a graphical user interface (GUI) set in the virtual reality head mounted display device 201.
  • GUI graphical user interface
  • the virtual human body model library 211 is used to store a three-dimensional model of a human tissue organ that is generated in advance.
  • the motion displacement sensing module 251 is configured to sense and record motion track information data of the wear accessory 202.
  • the wearing accessory 202 is used to be worn by an expert who performs virtual surgery on the support system 200, and the wearing accessory 202 is electrically connected to the motion displacement sensing module 251.
  • the present invention provides a remote interactive medical system based on the virtual reality head mounted display device 201, which is applicable to the remote interactive medical system based on the virtual reality head mounted display device 201 shown in the first embodiment, see FIG. 3.
  • the method includes:
  • the medical staff of the clinical system 100 uses the data collection device 101 to collect the physiological data of the patient and send it to the cloud database 103 through the data transmission channel 102.
  • the medical system 100 medical staff detects the blood ray, blood oxygen, pulse, body temperature, electrocardiogram multi-parameter vital signs monitor, 12-lead network electrocardiograph, detects the optical otoscope of the ear, nose and throat, and detects the optical speculum of the skin. , professional cardio-pulmonary high-fidelity electronic stethoscope, CT scan and webcam to obtain various physiological data of patients.
  • the virtual reality head mounted display device 201 receives the physiological data.
  • the physiological data in the cloud database 103 is transmitted to the virtual reality head mounted display device 201 through the data exchange hub 104.
  • the virtual reality head mounted display device 201 acquires a patient's part Physiological data.
  • the virtual reality head-mounted display device 201 collects data obtained by a medical staff of the pre-operative clinical system 100 on a real CT scan of a patient's patient part (by DICOM 3.0 data format acquisition) .
  • the virtual reality head-mounted display device 201 establishes and dynamically displays a three-dimensional model of the patient's patient's part according to the physiological data. Referring to FIG. 4, the following steps are specifically included:
  • the SA extracts a three-dimensional model of the human tissue and organs corresponding to the patient's part from the virtual human model library 211.
  • a three-dimensional model of a human tissue organ corresponding to a patient's patient's disease site generated in advance is taken out in the virtual human model library 211.
  • the 3D model of the physiological features of the patient's diseased part is reconstructed, mapped, and the organ and tissue physiological characteristics are given, and the bone skin tissue collision detection and graphic drawing are performed to generate a three-dimensional model of the patient's diseased part.
  • the SC and the screen display 241 acquire and implement a three-dimensional model for dynamically displaying the patient's part.
  • the virtual reality head-mounted display device 201 establishes and dynamically displays a three-dimensional model of a surgical instrument for treating a patient's patient's condition.
  • the tool emulation processor 231 writes a three-dimensional model of various surgical instruments used in virtual surgery through a Virtual Reality Modeling Language (VRML), for example, a hand drill, a conventional disinfecting drape, a scalpel, an electric knife, and cotton.
  • VRML Virtual Reality Modeling Language
  • the three-dimensional model of the sheet and the gauze is output as the display content of the screen display 241 of the virtual reality head mounted display device 201.
  • VRML is an abbreviation of virtual reality modeling language. It is a standard for describing virtual scenes.
  • the virtual surgery implementer of the support system 200 manipulates the three-dimensional model of the surgical instrument to perform virtual surgery on the three-dimensional model of the patient's patient site, and the virtual reality head mounted display device 201 records the support system 200
  • the gesture operation step of the surgical procedure is performed, and the three-dimensional model of the patient's patient site and the three-dimensional model of the surgical instrument are combined to form a complete surgical plan and transmitted to the cloud database 103 through the data exchange center 104 for reference by the clinical system 100.
  • the remote interactive medical method based on the virtual reality head mounted display device 201 further includes the following steps:
  • the implementer of the virtual surgery in the support system 200 wears the wear accessory 202 that is networked with the virtual reality head mounted display device 201.
  • the wear accessory 202 worn by the implementer of the virtual surgery includes a finger sleeve of ten fingers, and the displacement sensing module can sense and record the movement track of the finger sleeve by inductively connecting with the finger socket network, thereby recording the virtual surgery
  • the implementer performs a gesture of virtual surgery.
  • the medical staff of the SE, clinical system 100 acquires a surgical plan.
  • the medical staff of the clinical system 100 can obtain the surgical plan provided by the support system 200 by accessing the cloud database 103.
  • step SD is completed before step S5 and after step S4, and step SE is in step S.
  • the remote interactive medical system and method based on the virtual reality head mounted display device 201 provided by the present invention has the following beneficial effects:
  • the virtual reality head-mounted display device 201 provides the medical staff supporting the system 200 with the actual physiological data of the patient's diseased part and the real dynamic three-dimensional model, and can generate various medical instruments required for the operation.
  • the three-dimensional model whereby the medical staff of the support system 200 can formulate a corresponding treatment plan according to the tamping dynamic three-dimensional model of the patient site, and perform virtual surgery using the three-dimensional model of the medical device, the virtual reality head-mounted display device 201
  • the treatment plan developed by the support system 200 is recorded and the data related to the virtual surgery is transmitted to the cloud database 103 for reference by the clinical system 100.
  • the data collection device 101 may include an access multi-parameter monitor, an electrocardiogram, a high-definition speculum, and an electronic
  • An access multi-parameter monitor such as an electrocardiogram, a high-definition speculum
  • an electronic such as an electrocardiogram, a high-definition speculum
  • an electronic such as an electrocardiogram, a high-definition speculum
  • an electronic such as stethoscopes and cameras can also access more medical information collection devices according to work needs. Realize the physical examination of various physiological indicators, such as electrocardiogram, body temperature, pulse, blood pressure, blood oxygen, heart sound, lung sound, eye, nose and throat, etc., so that medical personnel can obtain more comprehensive diagnostic data for analysis and judgment.
  • the medical information collected above can be connected to the private network through a wired network, a WiFi wireless network, a satellite network, or a 3G/4G wireless broadband network to ensure the security of data transmission.
  • the cloud database 103 implements real interaction or offline interaction between multiple medical diagnosis terminals.
  • the cloud database 103 enables network storage and control interaction of multiple types of data for a plurality of medical diagnostic terminals.
  • the medical personnel of the support system 200 can realize the physiological data of the patient through the virtual reality helmet display device, and the medical staff of the clinical system 100 can also obtain the treatment plan provided by the support system 200 by accessing the cloud database 103, thereby realizing innovative telemedicine diagnostic application model.
  • the massive data and data of the patient are stored in the cloud database 103, which facilitates access and access by various authorized organizations at various levels, and realizes disease diagnosis, medical quality tracking, and statistical analysis of various services. Etc., it can also be based on big data, to achieve medical knowledge base, human-oriented health tracking and regional disease monitoring.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Molecular Biology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Cardiology (AREA)
  • Physiology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Optics & Photonics (AREA)
  • Acoustics & Sound (AREA)
  • Pulmonology (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Vascular Medicine (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Radiology & Medical Imaging (AREA)
  • Processing Or Creating Images (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un système et un procédé d'interaction à distance basés sur un dispositif d'affichage (201) de réalité virtuelle monté sur la tête. Le système comprend un système clinique (100) et un système auxiliaire (200). Le système clinique (100) comprend un appareil (101) d'acquisition de données ; un canal (102) de transmission de données ; une base de données (103) dans le cloud ; et un concentrateur (104) d'échange de données. Le système auxiliaire (200) comprend un dispositif d'affichage (201) de réalité virtuelle monté sur la tête. Le dispositif d'affichage (201) de réalité virtuelle monté sur la tête fournit, au personnel médical du système auxiliaire, un modèle tridimensionnel dynamique et en temps réel d'une partie malade d'un patient et peut générer un modèle tridimensionnel d'un instrument médical requis par diverses interventions chirurgicales. Le personnel médical du système auxiliaire (200) peut ensuite concevoir une solution de traitement correspondante et effectuer une chirurgie virtuelle. Le dispositif d'affichage (201) de réalité virtuelle monté sur la tête enregistre la solution de traitement conçue par le système auxiliaire (200) et transmet les données pertinentes de la chirurgie virtuelle à la base de données (103) dans le cloud en tant que référence pour le système clinique (100).
PCT/CN2017/073978 2016-08-12 2017-02-17 Système et procédé d'interaction à distance basés sur un dispositif d'affichage de réalité virtuelle monté sur la tête Ceased WO2018028166A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610664575.2A CN107714006A (zh) 2016-08-12 2016-08-12 一种基于虚拟现实头戴式显示装置的远程互动系统及方法
CN201610664575.2 2016-08-12

Publications (1)

Publication Number Publication Date
WO2018028166A1 true WO2018028166A1 (fr) 2018-02-15

Family

ID=61161655

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/073978 Ceased WO2018028166A1 (fr) 2016-08-12 2017-02-17 Système et procédé d'interaction à distance basés sur un dispositif d'affichage de réalité virtuelle monté sur la tête

Country Status (2)

Country Link
CN (1) CN107714006A (fr)
WO (1) WO2018028166A1 (fr)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108389488B (zh) * 2018-03-05 2020-12-15 泉州医学高等专科学校 一种互动式口腔模拟系统
CN108563199A (zh) * 2018-03-27 2018-09-21 北京科技大学 一种热连轧生产实时监控系统
CN110459075B (zh) * 2019-07-22 2024-12-27 温州市中心医院 一种神经外科虚拟现实模拟手术系统
CN111834021A (zh) * 2020-07-20 2020-10-27 北京百度网讯科技有限公司 数据交互方法、装置、设备以及存储介质
CN112691357B (zh) * 2020-12-29 2021-09-24 深圳市艾利特医疗科技有限公司 一种心肺功能锻炼系统以及方法
CN113705836A (zh) * 2021-08-31 2021-11-26 国网山东省电力公司微山县供电公司 一种用于电网现场作业指导的系统及装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101019765A (zh) * 2007-03-29 2007-08-22 新奥博为技术有限公司 一种磁共振图像引导下的手术系统及手术导航方法
CN101904770A (zh) * 2009-06-05 2010-12-08 复旦大学 一种基于光学增强现实技术的手术导航系统及方法
CN102868755A (zh) * 2012-09-27 2013-01-09 中国科学院深圳先进技术研究院 远程医疗通信系统及其工作方法
CN103077633A (zh) * 2013-01-11 2013-05-01 深圳超多维光电子有限公司 一种立体虚拟培训系统和方法
CN104706422A (zh) * 2013-12-13 2015-06-17 Ge医疗系统环球技术有限公司 一种头戴式医疗装置、医疗系统及其操作方法
WO2015126466A1 (fr) * 2014-02-21 2015-08-27 The University Of Akron Système d'imagerie et d'affichage permettant de guider des interventions médicales
US20150264339A1 (en) * 2014-03-17 2015-09-17 Nicholas V. Riedel Stereoscopic display

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101393654A (zh) * 2008-10-07 2009-03-25 华南师范大学 一种计算机辅助脏器手术仿真系统
CN104771892A (zh) * 2015-04-02 2015-07-15 深圳市虚拟现实科技有限公司 基于虚拟现实的同步显示方法和系统
CN105184720A (zh) * 2015-09-01 2015-12-23 北京昌盛医学技术有限公司 一种基于物联网的一体化远程医疗诊断系统
CN105615831A (zh) * 2015-12-18 2016-06-01 李占和 医学影像全息ar显示系统
CN105787941B (zh) * 2016-03-01 2020-01-03 天津天堰科技股份有限公司 一种混合现实仿真系统的快速配准方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101019765A (zh) * 2007-03-29 2007-08-22 新奥博为技术有限公司 一种磁共振图像引导下的手术系统及手术导航方法
CN101904770A (zh) * 2009-06-05 2010-12-08 复旦大学 一种基于光学增强现实技术的手术导航系统及方法
CN102868755A (zh) * 2012-09-27 2013-01-09 中国科学院深圳先进技术研究院 远程医疗通信系统及其工作方法
CN103077633A (zh) * 2013-01-11 2013-05-01 深圳超多维光电子有限公司 一种立体虚拟培训系统和方法
CN104706422A (zh) * 2013-12-13 2015-06-17 Ge医疗系统环球技术有限公司 一种头戴式医疗装置、医疗系统及其操作方法
WO2015126466A1 (fr) * 2014-02-21 2015-08-27 The University Of Akron Système d'imagerie et d'affichage permettant de guider des interventions médicales
US20150264339A1 (en) * 2014-03-17 2015-09-17 Nicholas V. Riedel Stereoscopic display

Also Published As

Publication number Publication date
CN107714006A (zh) 2018-02-23

Similar Documents

Publication Publication Date Title
KR102458587B1 (ko) 진단 검사를 실시간 치료에 통합하기 위한 범용 장치 및 방법
WO2018028166A1 (fr) Système et procédé d'interaction à distance basés sur un dispositif d'affichage de réalité virtuelle monté sur la tête
US11776123B2 (en) Systems and methods for displaying augmented anatomical features
JP2022540898A (ja) 外科手術を遠隔監督するための拡張現実システムおよび方法
JP5309187B2 (ja) 医用情報表示装置およびその動作方法、並びに医用情報表示プログラム
CN108778100A (zh) 使用患者化身的医疗记录系统
CN103735312A (zh) 多模影像超声引导手术导航系统
CN110021445A (zh) 一种基于vr模型的医疗系统
CN110547869B (zh) 一种基于虚拟现实的术前辅助规划装置
Yang et al. Artificial intelligence in medical metaverse: applications, challenges, and future prospects
Oyama Virtual reality for the palliative care of cancer
US20240237953A1 (en) Methods for collecting and presenting physiological signal data and location information, and servers and systems implementing the same
JP7685262B2 (ja) 拡張された解剖学的特徴を表示するためのシステム及び方法
CN112447297A (zh) 一种3d打印结合vr虚拟现实成像的手术预演操作系统
US10854005B2 (en) Visualization of ultrasound images in physical space
US20240290449A1 (en) Report generation for radiology
US11894126B1 (en) Systems and methods for tracking movement of a wearable device for advanced image stabilization
CN111613280A (zh) 一种用于医疗的h.i.p.s多点触控宣教交互系统
CN113164067B (zh) 用于可视化患者压力的系统
Lin et al. Future Trends in Biomedical and Health Informatics and Cybersecurity in Medical Devices: Proceedings of the International Conference on Biomedical and Health Informatics, ICBHI 2019, 17-20 April 2019, Taipei, Taiwan
TWM660651U (zh) 遠距醫療物聯網整合虛擬分身實境平台
JP2024533043A (ja) 心電図判読サービス提供方法
TW202512219A (zh) 遠距醫療物聯網整合虛擬分身實境平台
CN118615021A (zh) 盆腔手术自主神经检测导航系统
GB2611556A (en) Augmented reality ultrasound-control system for enabling remote direction of a user of ultrasound equipment by experienced practitioner

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17838303

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17838303

Country of ref document: EP

Kind code of ref document: A1