[go: up one dir, main page]

WO2010110642A2 - A voice activated data retrieval and storage medical system - Google Patents

A voice activated data retrieval and storage medical system Download PDF

Info

Publication number
WO2010110642A2
WO2010110642A2 PCT/MY2010/000003 MY2010000003W WO2010110642A2 WO 2010110642 A2 WO2010110642 A2 WO 2010110642A2 MY 2010000003 W MY2010000003 W MY 2010000003W WO 2010110642 A2 WO2010110642 A2 WO 2010110642A2
Authority
WO
WIPO (PCT)
Prior art keywords
processor
medical care
commands
input
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/MY2010/000003
Other languages
French (fr)
Other versions
WO2010110642A3 (en
Inventor
Mohd. Zamrin Dimon
Ying Fong Yan
Lee Ping Swee
Bey Fenh Wei
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Universiti Putra Malaysia (UPM)
Original Assignee
Universiti Putra Malaysia (UPM)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Universiti Putra Malaysia (UPM) filed Critical Universiti Putra Malaysia (UPM)
Publication of WO2010110642A2 publication Critical patent/WO2010110642A2/en
Publication of WO2010110642A3 publication Critical patent/WO2010110642A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/20ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods
    • A61B2017/00017Electrical control of surgical instruments
    • A61B2017/00203Electrical control of surgical instruments with speech control or speech recognition
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/25User interfaces for surgical systems
    • A61B2034/256User interfaces for surgical systems having a database of accessory information, e.g. including context sensitive help or scientific articles

Definitions

  • the present invention relates to a voice activated data retrieval and storage system, more particularly relates to a voice activated data retrieval and storage system to be used in surgeries and medical procedures in medical field
  • a surgical team is required to navigate through a comDuter system that is used to store patients' details in order to retrieve critical information about a patient that will be used during a surgery
  • a voice activated data retrieval and storage medical system wherein the voice activated medical care system includes a processor, a database, wherein the database is controlled by the processor, at least one medical care device, wherein the medical care device receives commands from the processor, wherein the medical care device stores data in the database, and a speech recognition module, wherein the speech recognition module receives commands from the processor and sends commands to the processor, wherein the speech recognition module stores data in the database
  • a method of data retrieval and storage in a medical care system includes the steps of receiving verbal input commands, keyboard or mouse input data, monitoring the input data that is received by an appropriate input device, processing input data to identify pre-determined commands, storing relevant data in a database and generating corresponding control signals for transmitting said signals to a corresponding medical care device
  • FIG 1 illustrates a block diagram of an embodiment of a voice activated data retrieval and storage system
  • FIG. 2 illustrates a method of retrieving and storing data in a voice activated data retrieval and storage system
  • the present invention relates to a voice activated data retrieval and storage medical system that allows for precise control of one or more system variables
  • this specification will describe the present invention according to the preferred embodiments of the present invention
  • limiting the description to the preferred embodiments of the invention is merely to facilitate discussion of the present invention and it is envisioned that those skilled in the art may devise various modifications and equivalents without departing from the scope of the appended claims
  • FIG. 1 An embodiment of the system architecture of a voice activated data retrieval and storage medical system is shown as a block diagram in Figure 1
  • the system includes a combination of a database (101 ), processor (102), medical care devices (103) and speech recognition module (104)
  • the database (101 ) of the system contains among other data, details of medical personnel using the system and details of patients whom the system has been used on
  • the processor (102) within the system is programmed to be capable of continuously monitoring the input commands and signals from at least one medical device (103) and a speech recognition module (104) by identifying valid verbal commands
  • the processor (102) is also programmed to process input commands from other input devices (105) such as keyboards and mouse commands
  • Valid verbal commands are defined as specific command words or a mixed phrase of at least one of said command words and at least one non-command word
  • the verbal inputs should also be above a predetermined acoustic threshold level in order to activate the system Said verbal input commands include the identification of a medical care device and its respective functions
  • the processor (102) generates control signals upon receiving the valid commands for operating medical image processing and visualization such as edge detection filtering, de-noising, scaling and other similar processes in accordance with the commands
  • the processor (102) is also programmed to display processed images and message reporting status information when requested as well as functioning to generate confirmation messages and await acknowledgement before executing a command
  • the system is configures to interface with and control via voice activation in real time by the processor (102)
  • the medical care devices (103) that are used in conjunction with the system are controllable devices that include a variable input, a variable output, and an interface circuitry that is connected to the processor (102) in order to operate »he device in accordance with control signals from the processor (102)
  • the medical care devices (103) used in the system are such as, but not limited to, environmental control devices, image processing devices and patient monitoring devices Said devices are active equipment that are being used during a surgery or medical procedure, wherein the said devices are programmable to generate control signals to be sent to the processor (102)
  • the speech recognition module (104) receives verbal commands from the processor (102) and sends verbal commands to the processor (102)
  • the verbal commands are stored in a database (101 ) that is part of the system
  • the speech recognition module (104) continuously monitors the verbal command data and the processor ( 102) processes said verbal data to identify command words as described previously
  • a method of data retrieval and storage in a medical care system includes the steps of receiving verbal input commands, keyboard or mouse input data from at least one medical care device (103), monitoring the input data that is received by an appropriate input device (105) and processing the input data The input data is then processed to identify pre-determined commands and the relevant data is stored in a database (101 ) Corresponding control signals for transmitting said signals to medical care devices (103) are generated An embodiment of this method is shown in Figure 2
  • any system variable or any change of mode that is needed in the system requires a predetermined input such as a verbal command above a predetermined acoustic threshold level, keyboard or mouse input to activate the system
  • a predetermined input such as a verbal command above a predetermined acoustic threshold level, keyboard or mouse input to activate the system
  • Any value of one or more system variables can be identified and appropriate data is stored in a database (101 ) This permits system variables to return to an identified value or state with a stngle voice or data command
  • the system variables include raw and preprocessed medical image data, patient data in text format and commands for image processing as well as image visualization
  • Image processing methods are used to generate images of an object and determine positional data about said object This data is transferred to a surgeon in various ways such as video graphics and speech synthesis Positional information about an anatomical feature of interest is transmitted and said image is displayed, manipulated using computer graphical methods and superimposing the displayed image
  • the image processing is used to determine and support decisions made while performing surgery or medical procedures This can be applied where any anatomical feature such as a vein or artery is difficult to locate
  • this invention can be used in angiograph images in heart surgery to assist in visualizing the position of blockages This additional visual is able to further supplement the data known by a surgeon in order to perform the procedure with higher accuracy

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Biomedical Technology (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

A voice activated data retrieval and storage medical system is provided wherein the voice activated medical care system includes a processor (102), a database ( 101 ), wherein the database (101 ) is controlled by the processor (102), at least one medical care device (103), wherein the medical care device (103) receives commands from the processor (102), wherein the medical care device (103) stores data in the database (101 ), and a speech recognition module ( 104), wherein the speech recognition module (104) receives commands from the processor (102) and sends commands to the processor (102), wherein the speech recognition module (104) stores data in the database (101 ).

Description

A VOICE ACTIVATED DATA RETRIEVAL AND STORAGE MEDICAL SYSTEM
FIELD OF INVENTION
The present invention relates to a voice activated data retrieval and storage system, more particularly relates to a voice activated data retrieval and storage system to be used in surgeries and medical procedures in medical field
BACKGROUND OF INVENTION
During a surgery, a surgical team is required to navigate through a comDuter system that is used to store patients' details in order to retrieve critical information about a patient that will be used during a surgery
There may be constraints arising that hinder a surgical team from doing their tasks efficiently Having to manage a computing system and assist or perform a surgery simultaneously will not be an easy task and may result in errors during the surgery This may lead to some life-threatening errors that may happen during a surgery Healthcare environment, such as a hospital or clinic, encompasses a large array of professionals, patients, and equipment Personnel in a healthcare facility must manage a plurality of patients, systems, and tasks to provide quality service to patients Healthcare personnel may encounter many difficulties or obstacles in their workflow A variety of distractions in a clinical environment may frequently interrupt medical personnel or interfere with their job performance Furthermore, workspaces, such as a radiology workspace, may become cluttered with a variety of monitors, data input devices, data storage devices, and communication device, for example Cluttered workspaces may result in efficient workflow and service to clients, which may impact a patient's health and safety or result in liability for a healthcare facility Data entry and access is also complicated in a typical healthcare facility In a healthcare environment involving extensive interaction with a plurality of devices, such as various input devices, imaging probes, and surgical equipment, repetitive motion disorders often occur
However, the computing needs are still there during a surgery as they are vital to perform enlargement, zooming and other fundamental image processing techniques that are done either by the surgeon themselves or handled by the surgical team
There is a need for simplifying activity of a surgical team to obtain necessary medical images of their patients in a short period
SUMMARY OF INVENTION
Accordingly there is provided a voice activated data retrieval and storage medical system, wherein the voice activated medical care system includes a processor, a database, wherein the database is controlled by the processor, at least one medical care device, wherein the medical care device receives commands from the processor, wherein the medical care device stores data in the database, and a speech recognition module, wherein the speech recognition module receives commands from the processor and sends commands to the processor, wherein the speech recognition module stores data in the database
There is also provided a method of data retrieval and storage in a medical care system, wherein the method includes the steps of receiving verbal input commands, keyboard or mouse input data, monitoring the input data that is received by an appropriate input device, processing input data to identify pre-determined commands, storing relevant data in a database and generating corresponding control signals for transmitting said signals to a corresponding medical care device
The present invention consists of several novel features and a combination of parts hereinafter fully described and illustrated in the accompanying description and drawings, it being understood that various changes in the details may be made without departing from the scope of the invention or sacrificing any of the advantages of the present invention BRIEF DESCRIPTION OF THE DRAWINGS
The present invention will be fully understood from the detailed description given herein below and the accompanying drawings which are given by way of illustration only, and thus are not limitative of the present invention, wherein'
FIG 1 illustrates a block diagram of an embodiment of a voice activated data retrieval and storage system
FIG. 2 illustrates a method of retrieving and storing data in a voice activated data retrieval and storage system
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
The present invention relates to a voice activated data retrieval and storage medical system that allows for precise control of one or more system variables Hereinafter, this specification will describe the present invention according to the preferred embodiments of the present invention However, it is to be understood that limiting the description to the preferred embodiments of the invention is merely to facilitate discussion of the present invention and it is envisioned that those skilled in the art may devise various modifications and equivalents without departing from the scope of the appended claims
The following detailed description of the preferred embodiments will now be described in accordance with the attached drawings, either individually or in combination
An embodiment of the system architecture of a voice activated data retrieval and storage medical system is shown as a block diagram in Figure 1 The system includes a combination of a database (101 ), processor (102), medical care devices (103) and speech recognition module (104) The database (101 ) of the system contains among other data, details of medical personnel using the system and details of patients whom the system has been used on
The processor (102) within the system is programmed to be capable of continuously monitoring the input commands and signals from at least one medical device (103) and a speech recognition module (104) by identifying valid verbal commands The processor (102) is also programmed to process input commands from other input devices (105) such as keyboards and mouse commands Valid verbal commands are defined as specific command words or a mixed phrase of at least one of said command words and at least one non-command word The verbal inputs should also be above a predetermined acoustic threshold level in order to activate the system Said verbal input commands include the identification of a medical care device and its respective functions
The processor (102) generates control signals upon receiving the valid commands for operating medical image processing and visualization such as edge detection filtering, de-noising, scaling and other similar processes in accordance with the commands The processor (102) is also programmed to display processed images and message reporting status information when requested as well as functioning to generate confirmation messages and await acknowledgement before executing a command The system is configures to interface with and control via voice activation in real time by the processor (102)
The medical care devices (103) that are used in conjunction with the system are controllable devices that include a variable input, a variable output, and an interface circuitry that is connected to the processor (102) in order to operate »he device in accordance with control signals from the processor (102) The medical care devices (103) used in the system are such as, but not limited to, environmental control devices, image processing devices and patient monitoring devices Said devices are active equipment that are being used during a surgery or medical procedure, wherein the said devices are programmable to generate control signals to be sent to the processor (102)
The speech recognition module (104) receives verbal commands from the processor (102) and sends verbal commands to the processor (102) The verbal commands are stored in a database (101 ) that is part of the system The speech recognition module (104) continuously monitors the verbal command data and the processor ( 102) processes said verbal data to identify command words as described previously
A method of data retrieval and storage in a medical care system is described now The method includes the steps of receiving verbal input commands, keyboard or mouse input data from at least one medical care device (103), monitoring the input data that is received by an appropriate input device (105) and processing the input data The input data is then processed to identify pre-determined commands and the relevant data is stored in a database (101 ) Corresponding control signals for transmitting said signals to medical care devices (103) are generated An embodiment of this method is shown in Figure 2
In one embodiment of the invention, any system variable or any change of mode that is needed in the system requires a predetermined input such as a verbal command above a predetermined acoustic threshold level, keyboard or mouse input to activate the system Any value of one or more system variables can be identified and appropriate data is stored in a database (101 ) This permits system variables to return to an identified value or state with a stngle voice or data command The system variables include raw and preprocessed medical image data, patient data in text format and commands for image processing as well as image visualization
Image processing methods are used to generate images of an object and determine positional data about said object This data is transferred to a surgeon in various ways such as video graphics and speech synthesis Positional information about an anatomical feature of interest is transmitted and said image is displayed, manipulated using computer graphical methods and superimposing the displayed image The image processing is used to determine and support decisions made while performing surgery or medical procedures This can be applied where any anatomical feature such as a vein or artery is difficult to locate
For example, this invention can be used in angiograph images in heart surgery to assist in visualizing the position of blockages This additional visual is able to further supplement the data known by a surgeon in order to perform the procedure with higher accuracy
Though the example presented here has been taken from the surgical field, it is to be appreciated however, that this invention is not limited to use in the surgical field only

Claims

1 A voice activated data retrieval and storage medical system, wherein the voice activated medical care system includes i a processor (102), ii a database (101 ), wherein the database ( 101 ) is controlled by the processor (102), in at least one medical care device (103), wherein the medical care device ( 103) receives commands from the processor (102), wherein the medical care device (103) stores data in the database (101 ), iv a speech recognition module (104), wherein the speech recognition module (104) receives commands from the processor (102) and sends commands to the processor ( 102), wherein the speech recognition module (104) stores data in the database (101 )
2 The system as claimed in claim 1 , wherein the processor ( 102) is programmed to process input commands from input devices (105) such as keyboards, mouse and verbal input commands
3 The system as claimed in claim 2, wherein the verbal input commands include specific command words or a mixed phrase of at least one of said command words and at least one non-command word
4 The system as claimed in claim 2, wherein the verbal input commands are above a predetermined acoustic threshold level to activate the system 5 The system as claimed in claim 2, wherein the verbal input commands includes an identification of the medical care device (103) and a function of the medical care device (103)
6 The system as claimed in claim 1 , wherein the medical care devices (103) are controllable devices that include a variable input, a variable output and an interface circuitry, wherein the medical care devices ( 103) are connected to the processor (102)
7 The system as claimed in claim 2, wherein the medical care device (103) is an environmental control device, an image processing device and a patient monitoring device
8 The system as claimed in claim 1 , wherein the speech recognition module (104) receives verbal commands from the processor (102) and sends verbal commands to the processor ( 102)
9 The system as claimed in claim 8, wherein the speech recognition module (104) continuously monitors verbal command data
10 A method of data retrieval and storage in a medical care system, wherein the method includes the steps of i receiving verbal input commands, keyboard or mouse input data, ii monitoring the input data that is received by an appropriate input device (105), in processing input data to identify pre-determined commands iv storing relevant data in a database (101 ), and v generating corresponding control signals for transmitting said signals to a corresponding medical care device (103)
The system and method as claimed in claim 9 and 10, wherein the system and method is used while performing surgeries or medical procedures
PCT/MY2010/000003 2009-03-26 2010-01-07 A voice activated data retrieval and storage medical system Ceased WO2010110642A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
MYPI20091227 2009-03-26
MYPI20091227 2009-03-26

Publications (2)

Publication Number Publication Date
WO2010110642A2 true WO2010110642A2 (en) 2010-09-30
WO2010110642A3 WO2010110642A3 (en) 2011-04-28

Family

ID=41716275

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/MY2010/000003 Ceased WO2010110642A2 (en) 2009-03-26 2010-01-07 A voice activated data retrieval and storage medical system

Country Status (1)

Country Link
WO (1) WO2010110642A2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160098521A1 (en) * 2014-06-16 2016-04-07 Jeffrey E. Koziol Data Encoding and Retrieval System and Method
CN108335741A (en) * 2018-01-25 2018-07-27 安徽美时影像技术有限公司 A kind of intelligent imaging voice interaction device system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160098521A1 (en) * 2014-06-16 2016-04-07 Jeffrey E. Koziol Data Encoding and Retrieval System and Method
US10210204B2 (en) * 2014-06-16 2019-02-19 Jeffrey E. Koziol Voice actuated data retrieval and automated retrieved data display
US20190188202A1 (en) * 2014-06-16 2019-06-20 Jeffrey E. Koziol Data Encoding and Retrieval System and Method
US10515074B2 (en) 2014-06-16 2019-12-24 Jeffrey E. Koziol Data encoding and retrieval system and method
US11086863B2 (en) * 2014-06-16 2021-08-10 Jeffrey E. Koziol Voice actuated data retrieval and automated retrieved data display method
CN108335741A (en) * 2018-01-25 2018-07-27 安徽美时影像技术有限公司 A kind of intelligent imaging voice interaction device system

Also Published As

Publication number Publication date
WO2010110642A3 (en) 2011-04-28

Similar Documents

Publication Publication Date Title
JP6784829B2 (en) Systems and methods to prevent surgical mistakes
US8036917B2 (en) Methods and systems for creation of hanging protocols using eye tracking and voice command and control
US7573439B2 (en) System and method for significant image selection using visual tracking
US20230134195A1 (en) Systems and methods for video and audio analysis
WO2014134196A1 (en) Augmented shared situational awareness system
US20140316813A1 (en) Healthcare Toolkit
EP3109783A1 (en) Context-aware user interface for integrated operating room
KR20210113299A (en) Systems and methods for interactive and flexible data presentation
DE102017220500B4 (en) System and method for supporting a medical procedure
CN111133521A (en) System and method for automated retrieval and analysis of medical records
JP2009518745A (en) Medical support automatic implementation method
US20170004288A1 (en) Interactive and multimedia medical report system and method thereof
Kranzfelder et al. New technologies for information retrieval to achieve situational awareness and higher patient safety in the surgical operating room: the MRI institutional approach and review of the literature
US20090132279A1 (en) Method and apparatus for significant and key image navigation
Stitini et al. Combining IoMT and XAI for Enhanced Triage Optimization: An MQTT Broker Approach with Contextual Recommendations for Improved Patient Priority Management in Healthcare.
WO2010110642A2 (en) A voice activated data retrieval and storage medical system
US20060171574A1 (en) Graphical healthcare order processing system and method
Medida et al. Transformative AIoT applications in medicine: Real-world case studies
Vaidya et al. Advancing Healthcare Through Artificial Intelligence: Opportunities, Challenges and Future Directions
Abdelwahap et al. Applications Of Natural Language Processing In Healthcare Systems
EP3943007B1 (en) Method, device and system for providing a virtual medical procedure drill
WO2021190984A1 (en) Workflow-efficiency improvement by artificial intelligence (ai)-based graphical user interface (gui)-content analysis
Miehle et al. Expert evaluation of a spoken dialogue system in a clinical operating room
EP4506951A1 (en) Remote monitoring of surgical procedure
US20240428935A1 (en) Remote monitoring of surgical procedure

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10701401

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC, (EPO FORM DATED 27.02.12)

122 Ep: pct application non-entry in european phase

Ref document number: 10701401

Country of ref document: EP

Kind code of ref document: A2