WO2025105848A1 - Procédé, programme et appareil pour fournir des informations de lecture d'électrocardiogramme - Google Patents
Procédé, programme et appareil pour fournir des informations de lecture d'électrocardiogramme Download PDFInfo
- Publication number
- WO2025105848A1 WO2025105848A1 PCT/KR2024/018024 KR2024018024W WO2025105848A1 WO 2025105848 A1 WO2025105848 A1 WO 2025105848A1 KR 2024018024 W KR2024018024 W KR 2024018024W WO 2025105848 A1 WO2025105848 A1 WO 2025105848A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- electrocardiogram
- user
- reading
- artificial intelligence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/318—Heart-related electrical modalities, e.g. electrocardiography [ECG]
- A61B5/339—Displays specially adapted therefor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/318—Heart-related electrical modalities, e.g. electrocardiography [ECG]
- A61B5/346—Analysis of electrocardiograms
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/20—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H80/00—ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
Definitions
- the present disclosure relates to data processing technology in the medical field, and more particularly, to a method for providing not only an electrocardiogram interpretation result based on artificial intelligence but also additional information related to artificial intelligence used in electrocardiogram interpretation.
- An electrocardiogram is a test that records the electrical activity of the heart.
- An electrocardiogram is a relatively simple and cost-effective test that can check the health of the heart, and it plays an important role in the early diagnosis and management of heart disease.
- the electrocardiogram signals measured through an electrocardiogram can be used to check whether each part of the heart is functioning normally, whether the size and location of the heart are normal, and whether there is damage to the heart muscle.
- the electrocardiogram signals can be used to diagnose various heart-related problems and predict the health status of a person based on these checks.
- a representative example is a service that predicts various heart diseases by inputting an electrocardiogram into a neural network-based model. These services generally simply provide the possibility of disease onset as an analysis result based on the electrocardiogram. Therefore, it is difficult to externally confirm the reliability of the interpretation results, and there is a possibility that doctors using the electrocardiogram interpretation service may not trust the interpretation results and may not use them.
- the present disclosure aims to provide a method for providing information on the specifications and performance of artificial intelligence used in electrocardiogram interpretation as well as the results of interpreting an electrocardiogram using artificial intelligence.
- a method for providing electrocardiogram reading information may include a step of obtaining a first user command through a user interface for an electrocardiogram reading service; and a step of displaying at least one of reading information regarding a disease or health condition of an electrocardiogram measurement subject, or first reference information related to artificial intelligence used for electrocardiogram reading, through the user interface.
- the first reference information may include at least one of user information requesting the electrocardiogram reading, cutoff information on the risk derived from the reading result using the artificial intelligence, data information used for learning of the artificial intelligence, or performance evaluation information of the artificial intelligence.
- the user information may include information about the type of user who measured the electrocardiogram of the electrocardiogram measurement subject, which is recorded in the electrocardiogram data of the electrocardiogram measurement subject.
- the data information used for learning of the artificial intelligence may include information about the number of learning data or verification data, information about the number of patients recruited to generate the learning data or verification data, or information about the number of medical institutions that generated the learning data or verification data.
- the performance evaluation information of the artificial intelligence may include at least one of information on a verification study by medical institution where the electrocardiogram was measured, information on a performance index according to the verification study by medical institution, information on a verification study by underlying disease of the subject whose electrocardiogram was measured, or information on a performance index according to the verification study by underlying disease.
- the first reference information may vary depending on the type of user requesting the electrocardiogram reading.
- the first reference information may be generated by processing previously stored source information according to the type of the identified user when the type of user recorded in the electrocardiogram data of the electrocardiogram measurement subject is identified.
- the method may further include the steps of obtaining a second user command through the user interface; and displaying second reference information generated by adjusting the first reference information based on the second user command through the user interface.
- the cutoff information for the risk derived from the reading result using the artificial intelligence included in the first reference information may be dynamically changed based on the performance evaluation information adjusted according to the first modification request.
- the first modification request may include a first adjustment value for at least one of the performance indicators, sensitivity or specificity, included in the performance evaluation information.
- the cutoff information can be determined by exploring the first adjustment value in a receiver operating characteristic (ROC) curve with the sensitivity and specificity as variables.
- ROC receiver operating characteristic
- the performance evaluation information of the artificial intelligence included in the first reference information may be dynamically changed based on the electrocardiogram data input as a reading target according to the first user command, the reading information, and the cutoff information adjusted according to the second modification request.
- a request for modification to the first reference information may be generated by inputting the second user command into a pre-trained large-scale language model.
- a computer program stored in a computer-readable storage medium When the computer program is executed on one or more processors, it performs operations for providing electrocardiogram reading information, and the operations may include an operation of obtaining a first user command through a user interface for an electrocardiogram reading service; and an operation of displaying at least one of reading information regarding a disease or health condition of an electrocardiogram measurement subject, or first reference information related to artificial intelligence used for electrocardiogram reading, through the user interface.
- a computing device providing electrocardiogram reading information.
- the device may include a processor including at least one core; a memory including program codes executable by the processor; and an input/output unit providing a user interface for displaying at least one of reading information regarding a disease or health condition of an electrocardiogram measurement subject, or first reference information related to artificial intelligence used for electrocardiogram reading.
- the present disclosure not only provides electrocardiogram interpretation results, but also provides additional information that can explain the specifications and performance of the artificial intelligence used for interpretation, thereby increasing the reliability of the interpretation results and helping customers accurately understand the interpretation results.
- FIG. 1 is a block diagram of a computing device according to one embodiment of the present disclosure.
- FIG. 2 is a block diagram of a system according to one embodiment of the present disclosure.
- FIG. 3 is a sequence diagram showing operations by a system according to one embodiment of the present disclosure.
- FIG. 4 is a conceptual diagram showing the relationship between performance evaluation information and cutoff information according to one embodiment of the present disclosure.
- FIG. 5 is a flowchart illustrating a method for providing electrocardiogram reading information according to one embodiment of the present disclosure.
- FIG. 6 is a flowchart illustrating a method for providing electrocardiogram reading information according to an alternative embodiment of the present disclosure.
- N N is a natural number
- N a natural number
- components performing different functional roles in the present disclosure can be distinguished as a first component or a second component.
- components that are substantially the same within the technical spirit of the present disclosure but should be distinguished for convenience of explanation may also be distinguished as a first component or a second component.
- acquisition as used in this disclosure may be understood to mean not only receiving data via a wired or wireless communication network with an external device or system, but also generating data in an on-device form.
- module or “unit” used in the present disclosure may be understood as a term referring to an independent functional unit that processes computing resources, such as a computer-related entity, firmware, software or a part thereof, hardware or a part thereof, a combination of software and hardware, etc.
- the "module” or “unit” may be a unit composed of a single element, or may be a unit expressed as a combination or set of multiple elements.
- a “module” or “unit” may refer to a hardware element of a computing device or a set thereof, an application program that performs a specific function of software, a processing process implemented through software execution, or a set of instructions for program execution, etc.
- a “module” or “unit” may refer to a computing device itself that constitutes a system, or an application that is executed on a computing device, etc.
- a “module” or “unit” may refer to a computing device itself that constitutes a system, or an application that is executed on a computing device, etc.
- the above-described concept is only an example, and the concept of “module” or “part” may be variously defined within a category understandable to those skilled in the art based on the contents of the present disclosure.
- model used in the present disclosure may be understood as a system implemented using mathematical concepts and language to solve a specific problem, a set of software units to solve a specific problem, or an abstract model regarding a processing process to solve a specific problem.
- a neural network "model” may refer to the entire system implemented as a neural network that has a problem-solving ability through learning. In this case, the neural network may have a problem-solving ability by optimizing parameters connecting nodes or neurons through learning.
- a neural network "model” may include a single neural network, or may include a neural network set in which multiple neural networks are combined.
- control graphic used in the present disclosure may be understood as a graphic object that executes a command and produces a visible result when manipulating a user interface.
- a "control graphic” may be understood as a basic unit that constitutes a user interface, and as a user interface element that displays content to be provided to a user or enables manipulation by a user.
- FIG. 1 is a block diagram of a computing device according to one embodiment of the present disclosure.
- the computing device (100) may be a hardware device or a part of a hardware device that performs comprehensive processing and calculation of data, or may be a software-based computing environment connected to a communication network.
- the computing device (100) may be a server that performs an intensive data processing function and shares resources, or may be a client that shares resources through interaction with a server.
- the computing device (100) may be a cloud system in which a plurality of servers and clients interact to comprehensively process data. Since the above description is only one example related to the type of the computing device (100), the type of the computing device (100) may be configured in various ways within a category that can be understood by those skilled in the art based on the contents of the present disclosure.
- a computing device (100) may include a processor (110), a memory (120), a network unit (130), and an input/output unit (140).
- FIG. 1 is only an example, and the computing device (100) may include other configurations for implementing a computing environment. In addition, only some of the disclosed configurations may be included in the computing device (100).
- the processor (110) may be understood as a configuration unit including hardware and/or software for performing computing operations.
- the processor (110) may process commands generated as a result of user interaction through a user interface.
- the processor (110) may read a computer program to perform data processing for machine learning.
- the processor (110) may process computational processes such as processing of input data for machine learning, feature extraction for machine learning, and error calculation based on backpropagation.
- the processor (110) for performing such data processing and operations may include a central processing unit (CPU), a general purpose graphics processing unit (GPGPU), a tensor processing unit (TPU), an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA).
- the type of processor (110) described above is only an example, and thus the type of processor (110) may be configured in various ways within a range understandable to those skilled in the art based on the contents of the present disclosure.
- the processor (110) can generate a user interface for an electrocardiogram reading service.
- the electrocardiogram reading service can be understood as a service that performs electrocardiogram reading and provides electrocardiogram reading results at the request of an electrocardiogram reading requester.
- the user interface for the electrocardiogram reading service can include control graphics for obtaining user commands, such as control graphics for receiving an electrocardiogram reading request, control graphics for receiving electrocardiogram data, etc.
- the user interface for the electrocardiogram reading service can include control graphics for providing information related to electrocardiogram reading, such as reading information about a disease or health condition of an electrocardiogram measurement subject, reference information about an artificial intelligence that performed the electrocardiogram reading, etc.
- the control graphics described above can be arranged and visually expressed by each area of the user interface.
- the processor (110) may perform electrocardiogram reading using artificial intelligence.
- the processor (110) may input electrocardiogram data into the artificial intelligence to generate electrocardiogram reading data.
- the electrocardiogram reading data may include reading information on a disease or health condition of an electrocardiogram measurement subject.
- the reading information may include information that may be used to diagnose a disease or health condition of a user, such as a type of disease, a possibility of developing a disease, a possibility of worsening a disease or health condition, etc.
- the processor (110) may input the electrocardiogram data input through the user command into a neural network model.
- the neural network model may be a pre-learned model that extracts features from the electrocardiogram data and outputs a probability of developing a disease or worsening a health condition based on the extracted features.
- the learning may be supervised learning performed based on labeled data, or may be unsupervised learning or self-supervised learning depending on the structure of the neural network model.
- the processor (110) can perform analysis on electrocardiogram data through a neural network model to generate reading data.
- the processor (110) can express the reading data generated through the neural network model as a control graphic of a user interface.
- the memory (120) may be understood as a configuration unit including hardware and/or software for storing and managing data processed in the computing device (100). That is, the memory (120) may store any type of data generated or determined by the processor (110) and any type of data received by the network unit (130).
- the memory (120) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory, a RAM (random access memory), a SRAM (static random access memory), a ROM (read-only memory), an EEPROM (electrically erasable programmable read-only memory), a PROM (programmable read-only memory), a magnetic memory, a magnetic disk, and an optical disk.
- the memory (120) may also include a database system that controls and manages data in a predetermined system.
- the type of memory (120) described above is only an example, and thus the type of memory (120) can be configured in various ways within a range understandable to those skilled in the art based on the contents of the present disclosure.
- the memory (120) can manage, by structuring and organizing, data required for the processor (110) to perform operations, combinations of data, and program codes executable by the processor (110).
- the memory (120) can store medical data received through the network unit (130) described below.
- the memory (120) can store program codes for storing rules for processing medical data, program codes for causing a neural network model to perform learning by receiving medical data, program codes for causing a neural network model to perform inference by receiving medical data in accordance with the intended use of the computing device (100), and processed data generated as the program codes are executed.
- the network unit (130) may be understood as a configuration unit that transmits and receives data via any type of known wired and wireless communication system.
- the network unit (130) may perform data transmission and reception using a wired and wireless communication system such as a local area network (LAN), wideband code division multiple access (WCDMA), long term evolution (LTE), wireless broadband internet (WiBro), fifth generation mobile communication (5G), ultra wide-band, ZigBee, radio frequency (RF) communication, wireless LAN, wireless fidelity, near field communication (NFC), or Bluetooth.
- LAN local area network
- WCDMA wideband code division multiple access
- LTE long term evolution
- WiBro wireless broadband internet
- 5G fifth generation mobile communication
- ultra wide-band ZigBee
- RF radio frequency
- wireless LAN wireless fidelity
- NFC near field communication
- Bluetooth Bluetooth
- the network unit (130) can receive data required for the processor (110) to perform calculations through wired or wireless communication with any system or any client, etc. In addition, the network unit (130) can transmit data generated through the calculation of the processor (110) through wired or wireless communication with any system or any client, etc. For example, the network unit (130) can receive biometric data through communication with a cloud server that performs tasks such as standardization of databases and medical data in a hospital environment, a client such as a smart watch, or a medical computing device, etc. The network unit (130) can transmit output data of a neural network model, intermediate data, processed data, etc. derived from the calculation process of the processor (110), etc. through communication with the aforementioned database, server, client, or computing device, etc.
- the input/output unit (140) may be understood as a configuration unit including hardware and/or software for implementing a user interface. That is, the input/output unit (140) may visualize and output any type of data generated or determined by the processor (110) and any type of data received by the network unit (130). In addition, the input/output unit (140) may receive a user input that generates a command to be transmitted to any system or any client connected to the processor (110), the computing device (100), or the like via wired or wireless communication.
- the input/output unit (140) may include a display module that may output visualized information or implement a touch screen, such as a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, etc.
- the input/output unit (140) may include an input module capable of recognizing actions such as a user's motion, voice, etc., such as a camera, a microphone, a keyboard, a mouse, etc.
- the modules described above are only examples, and thus, the modules included in the input/output unit (140) may be configured in various ways within a range understandable to those skilled in the art based on the contents of the present disclosure, in addition to the examples described above.
- the input/output unit (140) may implement a user interface to output graphics generated by the processor (110) or receive user commands generated by user manipulation and transmit them to the processor (110). For example, the input/output unit (140) may output control graphics for receiving user commands regarding electrocardiogram reading, control graphics for providing information, etc., in a specific area of the user interface. In addition, the input/output unit (140) may receive a user command for a control graphic output in a specific area of the user interface. At this time, the user command for a specific graphic may be understood as an input signal generated by a user manipulation for a specific graphic.
- the user manipulation for a specific graphic may mean an action that a user can perform through the input/output unit (140), such as a click, a double-click, a hover, a flick, a pinch, a spread, etc. for a specific graphic.
- the input/output unit (140) can receive user commands and transmit them to the processor (110), thereby enabling operations to be performed to provide a user interface based on user control.
- FIG. 2 is a block diagram of a system according to one embodiment of the present disclosure.
- FIG. 3 is a sequence diagram showing operations by a system according to one embodiment of the present disclosure.
- a system may include a client (200) that provides a user interface to a user, and a server (300) that processes information obtained through the user interface or information provided as a user interface.
- the client (200) may correspond to the computing device (100) of FIG. 1.
- the client (200) may control graphics implemented in the user interface using at least one of a command or data obtained through interaction with a user.
- the client (200) may transmit at least one of a user command or data obtained through the user interface to the server (300).
- the server (300) may correspond to a form of the computing device (100) of FIG. 1 excluding the input/output unit (140).
- the server (300) may process information to be provided through the user interface using at least one of a command or data obtained through the user interface. Specifically, the server (300) may generate visualized information to be provided to the user through the user interface using an artificial intelligence model. The server (300) transmits processed information to the client (200), and the client (200) can provide the processed information to the user through a user interface.
- the client (200) can obtain the 1-1 user command through the user interface for the electrocardiogram reading service (S110).
- the 1-1 user command can include the user's request for electrocardiogram reading and electrocardiogram data to be read.
- the client (200) can transmit the 1-1 user command to the server (300).
- the server (300) can generate electrocardiogram reading information based on the electrocardiogram data included in the 1-1 user command (S115).
- the server (300) can input the electrocardiogram data included in the 1-1 user command into a neural network model.
- the server (300) can extract electrocardiogram features from the electrocardiogram data through the neural network model.
- the electrocardiogram features are related to the electrocardiogram waveform and can include a P wave, a QRS complex, an R peak, etc.
- the server (300) can derive a numerical value indicating the possibility of disease onset or deterioration or the possibility of health deterioration based on electrocardiogram features through a neural network model.
- the server (300) can compare the numerical value derived as an output of the neural network model with a cutoff to generate reading information on the disease or health condition of the subject of electrocardiogram measurement.
- the server (300) can determine that the risk of a specific disease onset or the risk of health deterioration is low, and classify the subject of electrocardiogram measurement into a low-risk group. If the numerical value derived as an output of the neural network model is greater than or equal to the cutoff, the server (300) can determine that the risk of a specific disease onset or the risk of health deterioration is high, and classify the subject of electrocardiogram measurement into a high-risk group.
- the server (300) can transmit the electrocardiogram reading information to the client (200). And, the client (200) can display electrocardiogram reading information through the user interface (S119).
- the server (300) can identify the type of user who requested the electrocardiogram reading based on the electrocardiogram data included in the 1-1 user command (S120). For example, the server (300) can check the information about the type of user recorded in the electrocardiogram data included in the 1-1 user command. Since the electrocardiogram data included in the 1-1 user command is in XML format, the server (300) can identify the text about the type of user recorded in the electrocardiogram data in XML format to determine the type of user who requested the electrocardiogram reading. At this time, the type of user can be classified into a general hospital, a primary hospital, or a health examination center depending on the type of medical institution. In addition, the general hospital can be further classified into an outpatient clinic, an emergency room, or an intensive care unit.
- the server (300) can identify the type of user who requested the electrocardiogram reading in this way and provide the user with additional information necessary in addition to the electrocardiogram reading result. Meanwhile, although step S120 in FIG. 3 is expressed as being performed separately from step S115, step S120 may be performed simultaneously with step S115.
- the client (200) can obtain the first-second user command through the user interface (S130).
- the first-second user command may include a request for reference information regarding the artificial intelligence used for electrocardiogram reading.
- step S130 in FIG. 3 is expressed as being performed separately from step S110, step S130 may be performed simultaneously with step S110.
- the reference information may include information regarding the specification or performance of the artificial intelligence used for electrocardiogram reading.
- the client (200) can transmit the first-second user command to the server (300).
- the server (300) can generate first reference information related to the artificial intelligence used for electrocardiogram reading based on the first-second user command (S135).
- the server (300) can process the previously stored source information according to the type of user.
- the source information can be understood as a set of all information used for learning and inference of artificial intelligence.
- the source information can include electrocardiogram information, information on the subject of electrocardiogram measurement, information on the medical institution that measured the electrocardiogram, information on the underlying disease of the subject of electrocardiogram measurement, clinical research information related to electrocardiogram interpretation, or learning information of artificial intelligence used for interpretation service, evaluation information of artificial intelligence, etc.
- the server (300) can collect and process information related to the type of user from such source information to determine the first reference information.
- a user working in an emergency room may have a need to "see only very serious and clear myocardial infarctions, even if there are cases where myocardial infarctions are missed.”
- a health screening center may have a need to "lower the cutoff criteria so that no patients are missed, even if it is possible to judge a patient who does not have myocardial infarction as myocardial infarction.” Accordingly, if the type of user is an emergency room, it may be necessary to raise the cutoff for interpretation, whereas if the type of user is a health screening center, it may be necessary to lower the cutoff for interpretation.
- the server (300) may extract and process information from the source information based on the type of user, and generate first reference information tailored to the type of user. Specifically, the server (300) may extract electrocardiogram data and reading information from the source information based on the type of user. Then, the server (300) may apply a cutoff determined depending on the type of user based on the electrocardiogram data and reading information extracted from the source information, and may calculate an index for performance evaluation. The server (300) may collate the information extracted and calculated in this way to generate first reference information.
- the first reference information may include at least one of user information requesting electrocardiogram interpretation, cutoff information on the level of risk derived from the interpretation results using artificial intelligence, data information used for learning of the artificial intelligence, or performance evaluation information of the artificial intelligence.
- the cutoff information on the level of risk derived from the interpretation results using artificial intelligence may be understood as information corresponding to the criteria for judgment of a disease or health condition.
- the cutoff value included in the cutoff information may be a preset value based on a clinically acceptable performance evaluation index of artificial intelligence, or may be a value that dynamically changes according to the type of user or the user's requirements.
- the data information used for learning of the artificial intelligence may include at least one of information on the number of learning data or verification data, information on the number of patients recruited to generate learning data or verification data, or information on the number of medical institutions that generated learning data or verification data.
- the performance evaluation information of the artificial intelligence may include at least one of information on a validation study by medical institution where the electrocardiogram was measured, information on a performance index according to the validation study by medical institution, information on a validation study by underlying disease of the subject whose electrocardiogram was measured, or information on a performance index according to the validation study by underlying disease.
- the performance index may include at least one of accuracy, sensitivity, or specificity for the artificial intelligence output.
- the subject whose underlying disease has been verified may include at least one of a pregnant mother, a patient with LBBB (left bundle branch block) disease, a patient with atrial fibrillation RVR (rapid ventricular response) disease, or a patient complaining of chest pain.
- LBBB left bundle branch block
- RVR rapid ventricular response
- the server (300) can transmit the first reference information to the client (200). Then, the client (200) can display the first reference information through a user interface (S139). The client (200) and the server (300) can increase the reliability of the artificial intelligence reading result through processing and providing the first reference information.
- the client (200) can obtain a second user command through the user interface (S140).
- the second user command may include a modification request to adjust some or all of the details included in the first reference information.
- the client (200) can transmit the second user command to the server (300).
- the server (300) can adjust the first reference information based on the second user command to generate the second reference information (S145). For example, even if the server (300) identifies the type of user and provides reference information according to the type of user, the user may need to adjust the reference information in detail or need new reference information that meets his or her needs. Accordingly, the server (300) can modify the first reference information based on the second user command indicating the needs of the user so as to generate reference information that reflects the needs of the user.
- the server (300) can search for the adjustment value included in the second user command in a receiver operating characteristic (ROC) curve using the sensitivity and specificity as variables and re-determine the cutoff value. Then, the server (300) can modify the performance evaluation information included in the first reference information based on the adjustment value included in the second user command and the re-determined cutoff value to generate the second reference information.
- ROC receiver operating characteristic
- the server (300) can re-analyze the electrocardiogram data and the reading information therefor based on the cutoff to re-calculate the performance indicator.
- the re-analysis may be a task of comparing the output value of the artificial intelligence included in the reading information with the cutoff input through the second user command.
- the re-analysis may be a task of filtering the performance indicator based on the cutoff input through the second user command from the source information in which the performance indicators by cutoff are organized.
- the server (300) can generate second reference information by modifying cutoff information and performance evaluation information included in the first reference information.
- the second user command may be numerical data for information included in the first reference, or may be text data expressing a user request.
- the user may input the second user command in the form of text, “I want to see the AI reading performance index only for patients with LBBB as an underlying disease,” through the user interface.
- the server (300) may input the second user command into a pre-learned large language model in order to adjust the reference information by understanding the meaning inherent in the text.
- the server (300) may generate a modification request for the first reference information through the large language model into which the second user command is input. That is, if the second user command is in the form of text, the server (300) may utilize the large language model in order to clearly recognize the user command.
- the server (300) can transmit the second reference information to the client (200). Then, the client (200) can display the second reference information through a user interface (S149). That is, the client (200) and the server (300) can process and provide reference information that reflects the needs of the user as well as reference information suitable for the type of user through the generation of the second reference information.
- FIG. 4 is a conceptual diagram showing the relationship between performance evaluation information and cutoff information according to one embodiment of the present disclosure.
- the performance evaluation information included in the reference information may include performance indicators such as sensitivity and specificity.
- Sensitivity and specificity are indicators representing the performance of the test itself and are unique values for a specific test. For example, if a test for a specific disease has a sensitivity of 90% and a specificity of 95%, this will never change. Sensitivity and specificity will never change regardless of the test results. Sensitivity is the ratio of people who actually have the disease who are determined to be positive in the test. In other words, it indicates how well people with the disease are found. Specificity is the ratio of people who actually do not have the disease who are determined to be negative in the test. In other words, it indicates how well healthy people are distinguished. Therefore, sensitivity and specificity are values determined according to the test design and performance.
- the highest risk group is defined as the "rule-in” group
- the lowest risk group is defined as the “rule-out” group
- the medium risk group is defined as the "observation” group and treated accordingly.
- the user determines that the performance when deciding on "rule-out” for the low-risk group is a sensitivity of 99% or higher and a negative predictive value (NPV) of 99.5%
- the performance when deciding on "rule-in” for the high-risk group is a specificity of 90% and a positive predictive value (PPV) of 60-80%, which are clinically acceptable levels.
- the user can set the desired sensitivity and specificity through the user interface for the electrocardiogram interpretation service.
- the cutoff can be determined through the ROC curve.
- the ROC curve expresses the sensitivity and 1-specificity (false positive rate) at various cutoffs. Each point in the ROC curve corresponds to a specific cutoff. Therefore, the cutoff can be searched in the ROC curve based on the sensitivity and specificity set by the user. The cutoff determined in this way can be reflected in the reference information provided to the user.
- FIG. 5 is a flowchart illustrating a method for providing electrocardiogram reading information according to one embodiment of the present disclosure.
- a client (200) may obtain a first user command through a user interface for an electrocardiogram reading service (S210).
- the first user command may include a 1-1 user command including a user's request for electrocardiogram reading and electrocardiogram data to be read, and a 1-2 user command including a request for reference information regarding artificial intelligence used for electrocardiogram reading.
- the client (200) may implement a user interface through an input/output unit to provide the user with a control graphic for generating the first user command.
- the client (200) may generate the first user command through a user input action for the control graphic of the user interface.
- the client (200) may display at least one of reading information on a disease or health condition of an electrocardiogram measurement subject, or first reference information related to artificial intelligence used for electrocardiogram reading, through the user interface (S220).
- the first reference information may include at least one of user information requesting electrocardiogram reading, cutoff information on risk derived from a reading result using artificial intelligence, data information used for learning of artificial intelligence, or performance evaluation information of artificial intelligence.
- the first reference information may be information that varies depending on the type of user requesting electrocardiogram reading.
- the client (200) may recognize user information recorded in electrocardiogram data included in the first user command, and generate first reference information according to the recognized information.
- the first reference information may be generated by processing previously stored source information according to the type of the identified user.
- processing may be a task of extracting necessary information from source information, or a task of recombining or generating information from source information using a pre-learned neural network model.
- the client (200) can obtain a second user command through a user interface for an electrocardiogram reading service (S230).
- the second user command may include a modification request to adjust some or all of the details included in the first reference information.
- the client (200) may implement a user interface through an input/output unit to provide a user with a control graphic for generating the second user command.
- the control graphic for generating the second user command may be the same as the control graphic for generating the first user command.
- the client (200) may generate the second user command through a user input operation for the control graphic of the user interface. Meanwhile, the second user command may be included in the first user command. Accordingly, even if step S230 is not performed, step S240, which will be described later, may be sequentially performed after step S210 is performed. That is, step S230 may be omitted.
- the client (200) can display second reference information generated by adjusting first reference information based on a second user command through a user interface (S240). If the second user command includes a first modification request for performance evaluation information of artificial intelligence included in the first reference information, cutoff information for risk derived from a reading result using artificial intelligence included in the first reference information can be dynamically changed based on the performance evaluation information adjusted according to the first modification request.
- the first modification request can include a first adjustment value for at least one of sensitivity and specificity, which are performance indicators included in the performance evaluation information.
- the cutoff information can be determined by searching the first adjustment value in an ROC curve using sensitivity and specificity as variables.
- the performance evaluation information of the artificial intelligence may be dynamically changed based on the electrocardiogram data input as the interpretation target according to the first user command, the interpretation information, and the cutoff information adjusted according to the second modification request.
- FIG. 6 is a flowchart illustrating a method for providing electrocardiogram reading information according to an alternative embodiment of the present disclosure.
- the server (300) can identify the type of user who measured the electrocardiogram of the electrocardiogram measurement target based on the electrocardiogram data (S310).
- the server (300) can confirm the type of user recorded in the electrocardiogram data.
- the type of user can be classified according to the type of medical institution. For example, the type of user can be classified into general hospitals, primary hospitals, health checkup centers, etc. In addition, the general hospital can be classified in detail into outpatient treatment, emergency room, intensive care unit, etc.
- the server (300) can generate first reference information according to the type of user identified through step S310 (S320).
- the required reference information such as the cutoff, which is an electrocardiogram reading criterion, and the performance indicators that can be derived accordingly, may differ depending on the type of user.
- the server (300) can generate first reference information by processing the source information stored in advance according to the type of user.
- the source information may include learning data information, verification data information, clinical research information, etc. used in building artificial intelligence. Such source information may be updated periodically.
- the server (300) can obtain a second user command through a user interface for an electrocardiogram reading service (S330).
- the server (300) can obtain the second user command through communication with the client (200).
- the second user command may be included in the first user command requesting electrocardiogram reading. Accordingly, even if step S320 is not performed, step S340, which will be described later, may be performed sequentially. That is, step S330 may be omitted.
- the server (300) can adjust the first reference information to generate the second reference information (S340). Since the detailed information included in the first reference information mutually influences the determination of each piece of information, the server (300) can adjust the detailed information included in the first reference information by considering this influence. For example, if the user wants to change the cutoff, which is a reading criterion, the server (300) can not only change the cutoff information included in the first reference information, but also modify the reading information and performance evaluation information affected by the change in the cutoff information together. Through the operation of the server (300), the user can easily check the remaining reference information that changes accordingly while changing the reference information that he or she wants.
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Public Health (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Pathology (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Physics & Mathematics (AREA)
- Veterinary Medicine (AREA)
- Animal Behavior & Ethology (AREA)
- Surgery (AREA)
- Molecular Biology (AREA)
- Heart & Thoracic Surgery (AREA)
- Biophysics (AREA)
- Cardiology (AREA)
- General Business, Economics & Management (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- Bioethics (AREA)
- Computer Hardware Design (AREA)
- Human Computer Interaction (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physiology (AREA)
- Psychiatry (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
Abstract
Sont divulgués un procédé, un programme et un appareil pour fournir des informations de lecture d'électrocardiogramme, selon un mode de réalisation de la présente divulgation. Le procédé peut comprendre les étapes consistant à : obtenir une première commande d'utilisateur par l'intermédiaire d'une interface utilisateur pour un service de lecture d'électrocardiogramme ; et afficher, par l'intermédiaire de l'interface utilisateur, des informations de lecture concernant une maladie ou un état de santé d'un sujet dont l'électrocardiogramme doit être mesuré, et des premières informations de référence associées à une intelligence artificielle utilisée pour la lecture d'électrocardiogramme.
Applications Claiming Priority (8)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR10-2023-0158309 | 2023-11-15 | ||
| KR20230158309 | 2023-11-15 | ||
| KR20240049675 | 2024-04-12 | ||
| KR10-2024-0049675 | 2024-04-12 | ||
| KR10-2024-0106970 | 2024-08-09 | ||
| KR20240106970 | 2024-08-09 | ||
| KR10-2024-0162666 | 2024-11-15 | ||
| KR1020240162666A KR102890963B1 (ko) | 2023-11-15 | 2024-11-15 | 심전도 판독 정보를 제공하는 방법, 프로그램 및 장치 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2025105848A1 true WO2025105848A1 (fr) | 2025-05-22 |
Family
ID=95743208
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/KR2024/018024 Pending WO2025105848A1 (fr) | 2023-11-15 | 2024-11-15 | Procédé, programme et appareil pour fournir des informations de lecture d'électrocardiogramme |
Country Status (2)
| Country | Link |
|---|---|
| KR (1) | KR20250166081A (fr) |
| WO (1) | WO2025105848A1 (fr) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5373915B2 (ja) * | 2008-09-19 | 2013-12-18 | カーディアック ペースメイカーズ, インコーポレイテッド | 指標に基づく悪化hf警報 |
| KR20220104563A (ko) * | 2021-01-18 | 2022-07-26 | 주식회사 바디프랜드 | 심전도를 이용한 딥러닝 기반 psvt 예측 시스템 |
| KR20220111599A (ko) * | 2021-02-02 | 2022-08-09 | 주식회사 바디프랜드 | 의료데이터 인공지능 분산학습 방법 |
| KR20230025962A (ko) * | 2021-08-17 | 2023-02-24 | 주식회사 메디컬에이아이 | 딥러닝기반 모델 및 원칙기반 모델 통합 심전도 판독 시스템 |
| KR20230051754A (ko) * | 2021-10-11 | 2023-04-18 | 주식회사 메디컬에이아이 | 심전도를 기초로 좌심실 수축기 장애를 진단하는 방법, 프로그램 및 장치 |
-
2024
- 2024-11-15 WO PCT/KR2024/018024 patent/WO2025105848A1/fr active Pending
-
2025
- 2025-11-20 KR KR1020250176661A patent/KR20250166081A/ko active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5373915B2 (ja) * | 2008-09-19 | 2013-12-18 | カーディアック ペースメイカーズ, インコーポレイテッド | 指標に基づく悪化hf警報 |
| KR20220104563A (ko) * | 2021-01-18 | 2022-07-26 | 주식회사 바디프랜드 | 심전도를 이용한 딥러닝 기반 psvt 예측 시스템 |
| KR20220111599A (ko) * | 2021-02-02 | 2022-08-09 | 주식회사 바디프랜드 | 의료데이터 인공지능 분산학습 방법 |
| KR20230025962A (ko) * | 2021-08-17 | 2023-02-24 | 주식회사 메디컬에이아이 | 딥러닝기반 모델 및 원칙기반 모델 통합 심전도 판독 시스템 |
| KR20230051754A (ko) * | 2021-10-11 | 2023-04-18 | 주식회사 메디컬에이아이 | 심전도를 기초로 좌심실 수축기 장애를 진단하는 방법, 프로그램 및 장치 |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20250166081A (ko) | 2025-11-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113921141B (zh) | 一种个体慢病演进风险可视化评估方法及系统 | |
| WO2023048502A1 (fr) | Méthode, programme et dispositif pour diagnostiquer un dysfonctionnement thyroïdien sur la base d'un électrocardiogramme | |
| KR102888811B1 (ko) | 심전도 분석을 위한 사용자 인터페이스를 제공하는 방법 및 장치 | |
| WO2024025326A1 (fr) | Procédé, programme et dispositif pour fournir un service d'interprétation d'ecg | |
| CN112397194B (zh) | 用于生成患者病情归因解释模型的方法、装置和电子设备 | |
| WO2024043749A1 (fr) | Procédé et appareil qui fournissent une interface utilisateur à des fins d'analyse d'électrocardiogramme | |
| WO2024191246A1 (fr) | Procédé, programme et dispositif de pronostic d'insuffisance cardiaque | |
| WO2025105848A1 (fr) | Procédé, programme et appareil pour fournir des informations de lecture d'électrocardiogramme | |
| WO2024191190A1 (fr) | Procédé, programme et appareil de criblage de signaux d'électrocardiogramme comprenant du bruit sur la base d'un modèle de réseau neuronal | |
| KR102890963B1 (ko) | 심전도 판독 정보를 제공하는 방법, 프로그램 및 장치 | |
| Rajaram et al. | An Intelligent IoT-Enabled Healthcare Framework for Early Cardiovascular Disease Detection Using a Hybrid Deep Learning Model | |
| WO2024014821A1 (fr) | Procédé, programme et dispositif d'entraînement d'un modèle de réseau neuronal sur la base d'un électrocardiogramme | |
| Thakur et al. | Patient Health Monitoring and Inferencing Arrhythmia Using ECG_Data | |
| WO2024155140A1 (fr) | Procédé, programme et système de fourniture de service de lecture d'ecg | |
| WO2024019584A1 (fr) | Procédé, programme et dispositif pour diagnostiquer un infarctus du myocarde à l'aide d'un électrocardiogramme | |
| Georgiades et al. | Federated Learning for Early Cardiac Anomaly Prediction in Cross-Silo IoMT Environments | |
| WO2024019575A1 (fr) | Procédé, programme et dispositif de prédiction d'état de santé à l'aide d'un électrocardiogramme | |
| WO2024014888A1 (fr) | Procédé, programme et dispositif pour générer une variabilité de fréquence cardiaque à long terme sur la base de signaux de mesure à court terme | |
| WO2023048463A1 (fr) | Procédé, programme informatique et dispositif pour mesurer en continu un état corporel sur la base d'un apprentissage profond | |
| CN113223698B (zh) | 急诊分级处理方法、装置、电子设备以及存储介质 | |
| WO2025159552A1 (fr) | Procédé, dispositif et programme permettant de déterminer la sévérité d'un patient à partir de données biométriques sur la base d'un modèle d'apprentissage profond | |
| WO2025053543A1 (fr) | Procédé et appareil de fourniture d'une interface utilisateur pour l'étiquetage d'une intelligence artificielle médicale | |
| WO2024186053A1 (fr) | Procédé, programme et dispositif d'interprétation d'un modèle d'intelligence artificielle | |
| WO2025211677A1 (fr) | Procédé, dispositif et programme de diagnostic du syndrome de brugada sur la base de données d'électrocardiogramme | |
| Awsaj et al. | High-Performance System for Predicting ICU Patient Durations Using Artificial Neural Networks with Transfer Learning |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 24891794 Country of ref document: EP Kind code of ref document: A1 |