[go: up one dir, main page]

WO2019087209A1 - Wearable ophthalmoscope device and a method of capturing fundus image - Google Patents

Wearable ophthalmoscope device and a method of capturing fundus image Download PDF

Info

Publication number
WO2019087209A1
WO2019087209A1 PCT/IN2018/050704 IN2018050704W WO2019087209A1 WO 2019087209 A1 WO2019087209 A1 WO 2019087209A1 IN 2018050704 W IN2018050704 W IN 2018050704W WO 2019087209 A1 WO2019087209 A1 WO 2019087209A1
Authority
WO
WIPO (PCT)
Prior art keywords
captured
eye
image capturing
image
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IN2018/050704
Other languages
French (fr)
Inventor
Mohammed IMRAN AKTHAR
Theenathayalan PARTHASARATHY
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of WO2019087209A1 publication Critical patent/WO2019087209A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/12—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes

Definitions

  • the present invention generally relates to an ophthalmoscopy.
  • the present invention relates to a wearable ophthalmoscope device, which can monitor fundus image captured in real time. More particularly, the present invention relates to a wearable ophthalmoscope device, which can be detachably interconnected for examining user's one eye or both eyes. Further, the present invention relates to a method of capturing fundus images, auto diagnosing and generating diagnostic report in real time.
  • the present invention is configured to locally grade the captured fundus images conditions.
  • ophthalmoscopy also called funduscopy
  • funduscopy is a test that allows a health professional to see inside the fundus of the eye and other structures using an ophthalmoscope, which is done as part of an eye examination and done as part of a routine physical examination.
  • An ophthalmoscope is device used to image the fundus or eye fundus and other structures of the eye. This imaging is used to determine the health of the retina and vitreous humor and to evaluate conditions such as hypertension, diabetic retinopathy, glaucoma, diabetic macular edima, age related macualar degeneration and papilledema and other eye conditions which causes preventable blindness.
  • the ophthalmoscope device may include a camera that is used to capture the images and a display used to display the images obtained by the ophthalmoscope device. The eye must be aligned properly with the device to capture fundus images.
  • US9237847 discloses an ophthalmoscope device which includes a support structure, an image capture device, and a display device.
  • the support structure is configured to be worn by a subject.
  • the image capture device is configured to capture images of the eye fundus of the subject.
  • the display device is configured to overlay images in the field of view of the subject. The overlaid images are used to align the pupil/fovea orientation axis with the optical axis of the image capture device.
  • US20170010470 discloses a user-wearable diagnostic health system comprising a frame, an augmented reality display attached to the frame, a light detector attached to the frame and a processor configured to conduct a health analysis of the user based on light detected by the light detector.
  • US9060718 discloses an apparatus for retinal self-imaging.
  • Visual stimuli help the user self-align his eye with a camera.
  • Bi-ocular coupling induces the test eye to rotate into different positions. As the test eye rotates, a video is captured of different areas of the retina.
  • US20160135675 discloses a system and a method for detecting an optical parameter of an eye, which are used to determine an optical parameter of an eye and particularly a position of a focusing point of the eye.
  • WO2010051304 discloses an indirect ophthalmoscope which includes a wearable headset, and the wearable headset includes a light source, a beam splitter reflecting infrared radiation from the light source to an eye, a camera collecting radiation reflected by the eye through the beam splitter, an analog to digital convertor receiving a raw signal from the camera based on the collected radiation, the analog to digital convertor converting the raw signal to a digital signal; a black and white to color converter converting the digital signal into a color signal, a streaming video converter processing the color signal into a video signal, and a pair of video monitors displaying an image of the eye based on the video signal, the wearable headset also including a video transmitter, the video transmitter transmitting the video signal to a computer over a network, the computer extracting a plurality of images from the video signal.
  • KR 1020170048072 discloses a device communication unit receiving the visual material for inspecting the eye ball state of the user using the wearable device and provides the related contents the check result to the natural disposition from the server, the display section which it outputs so that the user examines the visual material, and the photographing unit surveying the eyeball state of the user examining the visual material.
  • the conventional devices fail to detect the presence of eyes and automatically align and focus on the eye. Further, the conventional devices could not grade or categorizes the image based on the disease and further requires manual alignment of the camera for viewing the fundus. Accordingly, there exists a need for a wearable ophthalmoscope device, which can monitor the fundus image captured in real time. Further, there exists a need for a wearable ophthalmoscope device, which can locally grade the captured fundus images for eye conditions.
  • a wearable ophthalmoscope device comprising of:
  • a support frame configured to be worn by a user
  • one side of the support frame is provided with at least two inner cavities, wherein each of the inner cavities is configured to detachably hold at least two image capturing devices, actuators, and light sources,
  • image capturing devices, actuators, light sources, and display screen are connected to the wired or wireless transceiver module through the processor,
  • the image capturing device is connected to the processor through the respective actuator to host said image capturing device for their automatic detection and alignment with user's retina
  • optical assembly is located in optical path between the user's eye and the image capturing device to scale the images captured for viewing
  • the display device is mounted on other side of the support frame for operator to monitor the image captured by the images capturing devices in real time.
  • the wearable ophthalmoscope device includes one or more switches connected to the processor for manual operation of the wearable ophthalmoscope device in one or more operating modes.
  • the support frame is detachably interconnected for examining the user's one eye or both eyes.
  • the light sources are configured to provide illumination towards the user eye to assist the image capturing devices to capture images in zero light condition for non-mydriatic fundus scan.
  • the light source includes infrared based LED and white LED.
  • the wearable ophthalmoscope device includes at least two view finders mounted on other side of the support frame for the operator to view the image captured by the image capturing devices in real time. It is another aspect of the present invention, wherein the wearable ophthalmoscope device is remotely or locally controlled from a portable device connected to the wired or wireless transceiver module or remotely through a cloud server for teleconsultation.
  • the portable device includes mobile phone, tablet, laptop, personal computer, headphone, and microphone.
  • the support frame includes a headset and a supporting headband.
  • the display device is a touch screen display.
  • the wearable ophthalmoscope device is self- operated using visual guidance visible in the display screen positioned inward facing towards the user along with audio instructions.
  • Yet another aspect of the present invention there is provided a method of capturing fundus images and auto diagnosing using the wearable ophthalmoscope device, comprising steps of: entering user's demographics;
  • the fundus image is captured in two dimensional (2D) or three dimensional (3D) according to the operator control.
  • the captured fundus images are automatically analyzed and diagnosed for diabetic retinopathy; identify the stage of diabetic retinopathy; identify the stage of diabetic macular edema; segmentation of retinal blood vessels; lesions in the retina; the stage of glaucoma and the stage of age related macular degeneration.
  • Figure 1 illustrates wearable ophthalmoscope device according to the present invention.
  • Figure 2 illustrates wearable ophthalmoscope device worn by user according to the present invention.
  • Figure 3 is a block diagram illustrating method of capturing fundus image, auto diagnosing and generating diagnostic report according to the present invention.
  • the present invention as herein described relates to a wearable ophthalmoscope device, which can monitor and diagnose the fundus image of a user captured in real time.
  • the wearable ophthalmoscope device comprises of a support frame [1] configured to be worn by a user; at least four 2D/3D image capturing devices [2]; at least four actuators [3]; at least two light sources [4]; at least two optical assemblies [5]; at least two display screens [6a and 6b]; processor; wired or wireless transceiver module; storage device and power source.
  • One side of the support frame [1] is provided with at least two distinct inner cavities [lb] for left and right eye. Each of the inner cavities [lb] is configured to detachably hold at least two image capturing devices [2], actuators [3], and light sources [4].
  • the image capturing devices [2], actuators [3], light sources [4], and display screen [6a] are connected to the wired or wireless transceiver module through the processor.
  • the light sources [4] are configured to provide illumination towards the user eye to assist the image capturing devices [2] to capture images in zero light condition for non-mydriatic fundus scan, said light source [4] includes infrared based LED and White LED.
  • the image capturing device [2] is connected to the processor through the respective actuator [3] to host said image capturing device [2] for their automatic detection and alignment with user's retina as shown in Figure 2.
  • the actuators [3] assist the movement of camera in three dimensional directional inside the cavity for example x, y and z directions per cavity [lb].
  • the optical assembly [5] is located in optical path between the user's eye and the image capturing device [2] to scale the images captured for viewing.
  • the display screen [6a] is mounted on other side of the support frame for operator to monitor the image captured by the images capturing devices [2] in real time.
  • the display screen [6a] is a touch screen display.
  • the support frame [1] is detachably interconnected using one or more control buttons [11] as shown in Figure 2 for examining the user's one eye or both eyes, said support frame [1] includes a headset and a supporting headband [la].
  • the support frame [1] is positioned such that it remains stable on user's eye during medical examination.
  • the headset creates complete darkness when the user wear it which causes pupil to dilate.
  • the infrared based LED aligns and focuses on the fundus to get black and white image. Once focussed, infrared based white LED is used to get color image of the fundus.
  • the wearable ophthalmoscope device includes at least two view finders [8] mounted on other side of the support frame [1] for operator to view the image captured by the image capturing devices [2] in real time.
  • the wearable ophthalmoscope device could be remotely or locally controlled from a portable device connected to the wired or wireless transceiver module through a cloud server, said portable device includes mobile phone, tablet, laptop, personal computer, headphone [12], and microphone [9].
  • the wearable ophthalmoscope device is self-operated using visual guidance visible in the display device [6b] positioned inward facing towards the user and using audio instructions.
  • the wearable ophthalmoscope device optionally includes one or more switches [7a and 7b] connected to the processor for manual operation to operate said wearable ophthalmoscope device in one or more operating modes.
  • the wearable ophthalmoscope device includes protective glass [10] positioned above the optical assembly [5], said protective glass [10] includes toughened or tempered glass.
  • the wearable ophthalmoscope device includes USB port to connect with the portable device for charging or data transfer.
  • the wearable ophthalmoscope device can also be functioned and controlled using a software application installed in a portable device such as mobile phone, tablet, laptop, and personal computer.
  • the touch screen display device performs various operations that includes but not limited to taking fundus images of retina or other portion of the eye; recording video of the patient eye; local processing of the diagnosis for the retina image captured using deep machine learning; sharing the images to remote server for tele-consultation; updating the embedded software; managing patient details; pairing head-set with other portable devices over WiFi or Bluetooth; adjusting the image capturing device for their proper alignment with eyes for examination; to firmly position the support frame.
  • the device of the present invention is powered by either AC or DC power source.
  • the present invention is directed to a method of capturing fundus images, activating auto diagnosing and generating diagnostic report.
  • the operator enters user's or patient's demographics that include but not limited to name, unique id number, date of birth, gender, left or right eye, mobile number and address.
  • the operator initiates the image capturing process through the image capturing device, said initiation is through press of a button or via the mobile application.
  • the image capturing device scans for the presence of the retina in the view along with blinks of the eye which thereby determines the presence of human being and is ready for retina fundus scan.
  • the image capturing devices is adjusted for their detection and alignment with user's eye for examination automatically using the actuators.
  • the light sources are switched on which allows the retina to be visible in the darkness.
  • the image is now visible in grey scale.
  • the image capturing device performs auto focussing on the retina image for better visibility.
  • the light sources are automatically adjusted for optimum exposure.
  • Fundus images of retina or other portion of user's eye is captured using the image capturing devices, said fundus image is captured in two dimensional (2D) or three dimensional (3D) according to the operator control.
  • the images captured are checked for quality by activating auto detection of the images. If the images captured are not satisfactory, a message is displayed about the issue with image quality and request for the new image to be captured to the user or operator.
  • the captured fundus images are processed to auto detection, if the scan was taken for left or right eye.
  • the captured fundus images are automatic analyzed, diagnosed and a diagnostic report is generated.
  • the captured fundus images are transmitted to the portable device locally or through cloud server for remote examination.
  • the captured fundus images are graded by the portable device connected through the cloud server.
  • the fundus image captured are locally graded and the diagnostic report are shown for further consultation with physicians.
  • the captured fundus images or video are displayed in the display device in real time to the operator.
  • the images or video captured by the image capturing devices are viewed in real time using the view finders.
  • the captured fundus images are automatically analysed and diagnosed for the following.
  • the captured fundus images are automatically analysed for the presence of diabetic retinopathy and identify the stage of diabetic retinopathy.
  • the captured fundus images are automatically analysed for determining the stage of diabetic macular edema.
  • Further the captured fundus images are analysed for automatically segmentation of retinal blood vessels. Diabetic retinopathy causes blood vessel proliferation.
  • Further the captured fundus images are analysed for auto detection for lesions in the retina. The regions detected with lesions are marked with labels. Further the captured fundus images are analysed for auto detection of the stage of Glaucoma.
  • the captured fundus images are analysed for auto detection of the stage of age related macular degeneration.
  • a comprehensive diagnostic report is generated with patient's name, the retina image for left and right eye. For each eye, the report list the presence of diabetic retinopathy, stage of diabetic retinopathy, stage of diabetic macular edema, image of retina with blood vessels segmented, image of retina with presence of lesions and their location with labels, presence of glaucoma with cup and disc highlighted, presence of stage of age related macular degeneration. This report is downloadable.
  • the wearable ophthalmoscope device is operated in one or more modes using one or more switches as per requirements.
  • the physician can connect the "Patient Only” mode head-set and visualise the retinal scan in his "Physician Mode” device.
  • the Physician can be connected locally to the "Patient Only” mode head-set or remotely for tele consultation.
  • 2D/3D Mode In this mode of operation, the operator can select, if the diagnosis is needed for scanning the eye in 2D or 3D mode.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The present invention relates to a wearable ophthalmoscope device, which can monitor fundus image captured in real time. More particularly, the present invention relates to a wearable ophthalmoscope device, which can be detachably interconnected for examining user's one eye or both eyes. The device can detect and align with the user's eye for examination automatically. The wearable ophthalmoscope device operation is remotely controlled from a portable mobile device connected to a wired or wireless transceiver module locally or remotely via a cloud server for teleconsultation. Further, the present invention relates to a method of capturing fundus images, auto diagnosing and generating diagnostic report in real time. Advantageously, the present invention is configured to locally grade the captured fundus images conditions.

Description

WEARABLE OPHTHALMOSCOPE DEVICE AND A METHOD OF CAPTURING
FUNDUS IMAGE
FIELD OF THE INVENTION
The present invention generally relates to an ophthalmoscopy. Particularly, the present invention relates to a wearable ophthalmoscope device, which can monitor fundus image captured in real time. More particularly, the present invention relates to a wearable ophthalmoscope device, which can be detachably interconnected for examining user's one eye or both eyes. Further, the present invention relates to a method of capturing fundus images, auto diagnosing and generating diagnostic report in real time. Advantageously, the present invention is configured to locally grade the captured fundus images conditions.
BACKGROUND OF THE INVENTION
In general, ophthalmoscopy, also called funduscopy, is a test that allows a health professional to see inside the fundus of the eye and other structures using an ophthalmoscope, which is done as part of an eye examination and done as part of a routine physical examination. An ophthalmoscope is device used to image the fundus or eye fundus and other structures of the eye. This imaging is used to determine the health of the retina and vitreous humor and to evaluate conditions such as hypertension, diabetic retinopathy, glaucoma, diabetic macular edima, age related macualar degeneration and papilledema and other eye conditions which causes preventable blindness. The ophthalmoscope device may include a camera that is used to capture the images and a display used to display the images obtained by the ophthalmoscope device. The eye must be aligned properly with the device to capture fundus images.
US9237847 discloses an ophthalmoscope device which includes a support structure, an image capture device, and a display device. The support structure is configured to be worn by a subject. The image capture device is configured to capture images of the eye fundus of the subject. The display device is configured to overlay images in the field of view of the subject. The overlaid images are used to align the pupil/fovea orientation axis with the optical axis of the image capture device. US20170010470 discloses a user-wearable diagnostic health system comprising a frame, an augmented reality display attached to the frame, a light detector attached to the frame and a processor configured to conduct a health analysis of the user based on light detected by the light detector. US9060718 discloses an apparatus for retinal self-imaging. Visual stimuli help the user self-align his eye with a camera. Bi-ocular coupling induces the test eye to rotate into different positions. As the test eye rotates, a video is captured of different areas of the retina.
US20160135675 discloses a system and a method for detecting an optical parameter of an eye, which are used to determine an optical parameter of an eye and particularly a position of a focusing point of the eye.
WO2010051304 discloses an indirect ophthalmoscope which includes a wearable headset, and the wearable headset includes a light source, a beam splitter reflecting infrared radiation from the light source to an eye, a camera collecting radiation reflected by the eye through the beam splitter, an analog to digital convertor receiving a raw signal from the camera based on the collected radiation, the analog to digital convertor converting the raw signal to a digital signal; a black and white to color converter converting the digital signal into a color signal, a streaming video converter processing the color signal into a video signal, and a pair of video monitors displaying an image of the eye based on the video signal, the wearable headset also including a video transmitter, the video transmitter transmitting the video signal to a computer over a network, the computer extracting a plurality of images from the video signal.
KR 1020170048072 discloses a device communication unit receiving the visual material for inspecting the eye ball state of the user using the wearable device and provides the related contents the check result to the natural disposition from the server, the display section which it outputs so that the user examines the visual material, and the photographing unit surveying the eyeball state of the user examining the visual material. However, the drawbacks are, the conventional devices fail to detect the presence of eyes and automatically align and focus on the eye. Further, the conventional devices could not grade or categorizes the image based on the disease and further requires manual alignment of the camera for viewing the fundus. Accordingly, there exists a need for a wearable ophthalmoscope device, which can monitor the fundus image captured in real time. Further, there exists a need for a wearable ophthalmoscope device, which can locally grade the captured fundus images for eye conditions.
OBJECTS OF THE INVENTION
One or more of the problems of the conventional prior art may be overcome by various embodiments of the present invention.
It is the primary object of the present invention to provide a wearable ophthalmoscope device, which can monitor and diagnose the fundus image captured in real time.
It is another object of the present invention to provide a wearable ophthalmoscope device, which can be detachably interconnected for examining the user's one eye or both eyes.
It is another object of the present invention to provide a wearable ophthalmoscope device, which can locally grade the captured fundus images conditions.
It is another object of the present invention to provide a wearable ophthalmoscope device, which can detect and align with the user's eye for examination automatically. It is another object of the present invention, wherein the wearable ophthalmoscope device operation is remotely controlled from a portable mobile device connected to a wired or wireless transceiver module locally or remotely via a cloud server for teleconsultation. It is another object of the present invention, wherein the wearable ophthalmoscope device is self- operated using visual guidance visible in display screen positioned inward facing towards the user eyes along with audio instructions.
It is another object of the present invention to provide a method of capturing fundus images using the wearable ophthalmoscope device
It is another object of the present invention to provide a method of capturing fundus images, activating auto diagnosing and generating diagnostic report in real time. It is another object of the present invention, wherein the diagnostic report includes patient's name, retina image for left and right eye, presence of diabetic retinopathy, stage of diabetic retinopathy, stage of diabetic macular edema, image of retina with blood vessels segmented, image of retina with presence of lesions and their location with labels, presence of glaucoma with cup and disc highlighted, presence of stage of age related macular degeneration.
It is another object of the present invention, wherein the image is captured in two dimensional (2D) or three dimensional (3D) according to the operator control.
SUMMARY OF THE INVENTION
Thus according to the basic aspect of the present invention there is provided a wearable ophthalmoscope device, comprising of:
a support frame configured to be worn by a user;
at least four 2D/3D image capturing devices;
at least four actuators;
at least two light sources;
at least two optical assemblies;
at least two display screens;
processor;
wired or wireless transceiver module; and
power source, wherein one side of the support frame is provided with at least two inner cavities, wherein each of the inner cavities is configured to detachably hold at least two image capturing devices, actuators, and light sources,
wherein the image capturing devices, actuators, light sources, and display screen are connected to the wired or wireless transceiver module through the processor,
wherein the image capturing device is connected to the processor through the respective actuator to host said image capturing device for their automatic detection and alignment with user's retina,
wherein the optical assembly is located in optical path between the user's eye and the image capturing device to scale the images captured for viewing, and
wherein the display device is mounted on other side of the support frame for operator to monitor the image captured by the images capturing devices in real time.
It is another aspect of the present invention, wherein the wearable ophthalmoscope device includes one or more switches connected to the processor for manual operation of the wearable ophthalmoscope device in one or more operating modes.
It is another aspect of the present invention, wherein the support frame is detachably interconnected for examining the user's one eye or both eyes. It is another aspect of the present invention, wherein the light sources are configured to provide illumination towards the user eye to assist the image capturing devices to capture images in zero light condition for non-mydriatic fundus scan.
It is another aspect of the present invention, wherein the light source includes infrared based LED and white LED.
It is another aspect of the present invention, wherein the wearable ophthalmoscope device includes at least two view finders mounted on other side of the support frame for the operator to view the image captured by the image capturing devices in real time. It is another aspect of the present invention, wherein the wearable ophthalmoscope device is remotely or locally controlled from a portable device connected to the wired or wireless transceiver module or remotely through a cloud server for teleconsultation.
It is another aspect of the present invention, wherein the portable device includes mobile phone, tablet, laptop, personal computer, headphone, and microphone.
It is another aspect of the present invention, wherein the support frame includes a headset and a supporting headband. It is another aspect of the present invention, wherein the display device is a touch screen display.
It is another aspect of the present invention, wherein the wearable ophthalmoscope device is self- operated using visual guidance visible in the display screen positioned inward facing towards the user along with audio instructions.
Yet another aspect of the present invention there is provided a method of capturing fundus images and auto diagnosing using the wearable ophthalmoscope device, comprising steps of: entering user's demographics;
performing scanning by the image capturing devices for the presence of the retina in the view along with blinks of the eye;
adjusting the image capturing devices for their detection, and alignment with user's eye for examination automatically using the actuators;
activating auto illumination for visibility of the retina in the darkness, wherein retina image is visible in grey scale;
performing auto focussing by the image capturing devices on the retina image for better visibility;
automatically adjusting the light sources for optimum exposure;
capturing fundus images of retina or other portion of user's eye using the image capturing devices;
activating auto detection of the captured fundus images for quality; processing the captured fundus images to auto detection, if the scan is for left or right eye;
performing automatic analyzing and diagnosing the captured fundus images and generating a diagnostic report;
transmitting the captured fundus images to the portable device locally or through cloud server for remote examination;
locally grading the fundus image captured for eye conditions and showing diagnostic report for further consultation with physicians;
displaying the captured fundus images or video in the display in real time to the operator; and
viewing the image / video captured by the image capturing devices in real time using the view finders.
It is another aspect of the present invention, wherein the fundus image is captured in two dimensional (2D) or three dimensional (3D) according to the operator control.
It is another aspect of the present invention, wherein the captured fundus images are automatically analyzed and diagnosed for diabetic retinopathy; identify the stage of diabetic retinopathy; identify the stage of diabetic macular edema; segmentation of retinal blood vessels; lesions in the retina; the stage of glaucoma and the stage of age related macular degeneration.
It is another aspect of the present invention, wherein the method comprising grading of captured fundus images by the portable device connected through the cloud server.
It is another aspect of the present invention, wherein the method comprising operating said wearable ophthalmoscope device in one or more modes using one or more switches.
BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 : illustrates wearable ophthalmoscope device according to the present invention.
Figure 2: illustrates wearable ophthalmoscope device worn by user according to the present invention. Figure 3: is a block diagram illustrating method of capturing fundus image, auto diagnosing and generating diagnostic report according to the present invention.
DETAILED DESCRIPTION OF THE INVENTION WITH REFERENCE TO THE ACCOMPANYING FIGURES
The present invention as herein described relates to a wearable ophthalmoscope device, which can monitor and diagnose the fundus image of a user captured in real time.
Referring to Figures 1 and 2, the wearable ophthalmoscope device comprises of a support frame [1] configured to be worn by a user; at least four 2D/3D image capturing devices [2]; at least four actuators [3]; at least two light sources [4]; at least two optical assemblies [5]; at least two display screens [6a and 6b]; processor; wired or wireless transceiver module; storage device and power source. One side of the support frame [1] is provided with at least two distinct inner cavities [lb] for left and right eye. Each of the inner cavities [lb] is configured to detachably hold at least two image capturing devices [2], actuators [3], and light sources [4]. The image capturing devices [2], actuators [3], light sources [4], and display screen [6a] are connected to the wired or wireless transceiver module through the processor. The light sources [4] are configured to provide illumination towards the user eye to assist the image capturing devices [2] to capture images in zero light condition for non-mydriatic fundus scan, said light source [4] includes infrared based LED and White LED.
The image capturing device [2] is connected to the processor through the respective actuator [3] to host said image capturing device [2] for their automatic detection and alignment with user's retina as shown in Figure 2. The actuators [3] assist the movement of camera in three dimensional directional inside the cavity for example x, y and z directions per cavity [lb]. The optical assembly [5] is located in optical path between the user's eye and the image capturing device [2] to scale the images captured for viewing. The display screen [6a] is mounted on other side of the support frame for operator to monitor the image captured by the images capturing devices [2] in real time. The display screen [6a] is a touch screen display. The support frame [1] is detachably interconnected using one or more control buttons [11] as shown in Figure 2 for examining the user's one eye or both eyes, said support frame [1] includes a headset and a supporting headband [la]. The support frame [1] is positioned such that it remains stable on user's eye during medical examination. The headset creates complete darkness when the user wear it which causes pupil to dilate. The infrared based LED aligns and focuses on the fundus to get black and white image. Once focussed, infrared based white LED is used to get color image of the fundus.
The wearable ophthalmoscope device includes at least two view finders [8] mounted on other side of the support frame [1] for operator to view the image captured by the image capturing devices [2] in real time. The wearable ophthalmoscope device could be remotely or locally controlled from a portable device connected to the wired or wireless transceiver module through a cloud server, said portable device includes mobile phone, tablet, laptop, personal computer, headphone [12], and microphone [9]. The wearable ophthalmoscope device is self-operated using visual guidance visible in the display device [6b] positioned inward facing towards the user and using audio instructions. The wearable ophthalmoscope device optionally includes one or more switches [7a and 7b] connected to the processor for manual operation to operate said wearable ophthalmoscope device in one or more operating modes.
The wearable ophthalmoscope device includes protective glass [10] positioned above the optical assembly [5], said protective glass [10] includes toughened or tempered glass. The wearable ophthalmoscope device includes USB port to connect with the portable device for charging or data transfer. The wearable ophthalmoscope device can also be functioned and controlled using a software application installed in a portable device such as mobile phone, tablet, laptop, and personal computer.
The touch screen display device performs various operations that includes but not limited to taking fundus images of retina or other portion of the eye; recording video of the patient eye; local processing of the diagnosis for the retina image captured using deep machine learning; sharing the images to remote server for tele-consultation; updating the embedded software; managing patient details; pairing head-set with other portable devices over WiFi or Bluetooth; adjusting the image capturing device for their proper alignment with eyes for examination; to firmly position the support frame. The device of the present invention is powered by either AC or DC power source.
In an aspect, referring to Figure 3, the present invention is directed to a method of capturing fundus images, activating auto diagnosing and generating diagnostic report. The operator enters user's or patient's demographics that include but not limited to name, unique id number, date of birth, gender, left or right eye, mobile number and address. The operator initiates the image capturing process through the image capturing device, said initiation is through press of a button or via the mobile application. The image capturing device scans for the presence of the retina in the view along with blinks of the eye which thereby determines the presence of human being and is ready for retina fundus scan. The image capturing devices is adjusted for their detection and alignment with user's eye for examination automatically using the actuators. The light sources are switched on which allows the retina to be visible in the darkness. The image is now visible in grey scale. The image capturing device performs auto focussing on the retina image for better visibility. The light sources are automatically adjusted for optimum exposure. Fundus images of retina or other portion of user's eye is captured using the image capturing devices, said fundus image is captured in two dimensional (2D) or three dimensional (3D) according to the operator control. The images captured are checked for quality by activating auto detection of the images. If the images captured are not satisfactory, a message is displayed about the issue with image quality and request for the new image to be captured to the user or operator. The captured fundus images are processed to auto detection, if the scan was taken for left or right eye. The captured fundus images are automatic analyzed, diagnosed and a diagnostic report is generated. The captured fundus images are transmitted to the portable device locally or through cloud server for remote examination. The captured fundus images are graded by the portable device connected through the cloud server. The fundus image captured are locally graded and the diagnostic report are shown for further consultation with physicians. The captured fundus images or video are displayed in the display device in real time to the operator. The images or video captured by the image capturing devices are viewed in real time using the view finders.
The captured fundus images are automatically analysed and diagnosed for the following. The captured fundus images are automatically analysed for the presence of diabetic retinopathy and identify the stage of diabetic retinopathy. The captured fundus images are automatically analysed for determining the stage of diabetic macular edema. Further the captured fundus images are analysed for automatically segmentation of retinal blood vessels. Diabetic retinopathy causes blood vessel proliferation. Further the captured fundus images are analysed for auto detection for lesions in the retina. The regions detected with lesions are marked with labels. Further the captured fundus images are analysed for auto detection of the stage of Glaucoma. The captured fundus images are analysed for auto detection of the stage of age related macular degeneration.
A comprehensive diagnostic report is generated with patient's name, the retina image for left and right eye. For each eye, the report list the presence of diabetic retinopathy, stage of diabetic retinopathy, stage of diabetic macular edema, image of retina with blood vessels segmented, image of retina with presence of lesions and their location with labels, presence of glaucoma with cup and disc highlighted, presence of stage of age related macular degeneration. This report is downloadable. The wearable ophthalmoscope device is operated in one or more modes using one or more switches as per requirements.
For illustration,
In patient only mode - In this mode of operation, only the patient retinal scan can be done and diagnosed.
Physician Mode - In this mode of operation, the physician can connect the "Patient Only" mode head-set and visualise the retinal scan in his "Physician Mode" device. The Physician can be connected locally to the "Patient Only" mode head-set or remotely for tele consultation.
2D/3D Mode - In this mode of operation, the operator can select, if the diagnosis is needed for scanning the eye in 2D or 3D mode.
Add or remove the optical assemblies to make the device 2D or 3D.
Add or remove the processors.
Add or remove backward or inward positioned displays. The foregoing description comprises illustrative embodiments of the present invention. Having thus described exemplary embodiments of the present invention, it should be noted by those skilled in the art that the within disclosures are exemplary only, and that various other alternatives, adaptations, and modifications may be made within the scope of the present invention. Merely listing or numbering the steps of a method in a certain order does not constitute any limitation on the order of the steps of that method. Many modifications and other embodiments of the invention will come to mind to one skilled in the art to which this invention pertains having the benefit of the teachings presented in the foregoing descriptions. Although specific terms may be employed herein, they are used only in generic and descriptive sense and not for purposes of limitation. Accordingly, the present invention is not limited to the specific embodiments illustrated herein.

Claims

WE CLAIM:
1. A wearable ophthalmoscope device, comprising of:
a support frame [ 1] configured to be worn by a user;
at least four 2D/3D image capturing devices [2];
at least four actuators [3];
at least two light sources [4];
at least two optical assemblies [5];
at least two display screens [6a and 6b];
processor;
wired or wireless transceiver module; and
power source,
wherein one side of the support frame [ 1] is provided with at least two inner cavities [lb], wherein each of the inner cavities [lb] is configured to detachably hold at least two image capturing devices [2], actuators [3], and light sources [4],
wherein the image capturing devices [2], actuators [3], light sources [4], and display screen [6a] are connected to the wired or wireless transceiver module through the processor,
wherein the image capturing device [2] is connected to the processor through the respective actuator [3] to host said image capturing device [2] for their automatic detection and alignment with user's retina,
wherein the optical assembly [5] is located in optical path between the user's eye and the image capturing device [2] to scale the images captured for viewing, and
wherein the display screen [6a] is mounted on other side of the support frame for operator to monitor the image captured by the images capturing devices [2] in real time.
2. The wearable ophthalmoscope device as claimed in claim 1 includes one or more switches [7a and 7b] connected to the processor for manual operation of the wearable ophthalmoscope device in one or more operating modes.
1
3. The wearable ophthalmoscope device as claimed in claim 1, wherein the support frame [1] is detachably interconnected for examining the user's one eye or both eyes.
4. The wearable ophthalmoscope device as claimed in claim 1, wherein the light sources [4] are configured to provide illumination towards the user eye to assist the image capturing devices [2] to capture images in zero light condition for non-mydriatic fundus scan.
5. The wearable ophthalmoscope device as claimed in claim 4, wherein the light source [4] includes infrared based LED and White LED.
6. The wearable ophthalmoscope device as claimed in claim 1 includes at least two view finders [8] mounted on other side of the support frame [1] for the operator to view the image captured by the image capturing devices [2] in real time.
7. The wearable ophthalmoscope device as claimed in claim 1 is remotely or locally controlled from a portable device connected to the wired or wireless transceiver module through a cloud server.
8. The wearable ophthalmoscope device as claimed in claim 7, wherein the portable device includes mobile phone, tablet, laptop, personal computer, headphone, and microphone.
9. The wearable ophthalmoscope device as claimed in claim 1, wherein the support frame [1] includes a headset and a supporting headband.
10. The wearable ophthalmoscope device as claimed in claim 1, wherein the display screen [6a] is a touch screen display.
11. The wearable ophthalmoscope device as claimed in claim 1 is self-operated using visual guidance visible in the display screen [6b] positioned inward facing towards the user and using audio instructions.
2
12. A method of capturing fundus images, and auto diagnosing using the wearable ophthalmoscope device as claimed in claim 1, comprising steps of:
entering user's demographics;
performing scanning by the image capturing devices for the presence of the retina in the view along with blinks of the eye;
adjusting the image capturing devices for their detection, and alignment with user's eye for examination automatically using the actuators;
activating auto illumination for visibility of the retina in the darkness, wherein retina image is visible in grey scale;
performing auto focussing by the image capturing devices on the retina image for better visibility;
automatically adjusting the light sources for optimum exposure;
capturing fundus images of retina or other portion of user's eye using the image capturing devices;
activating auto detection of the captured fundus images for quality;
processing the captured fundus images to auto detection, if the scan is for left or right eye;
performing automatic analyzing and diagnosing the captured fundus images and generating a diagnostic report;
transmitting the captured fundus images to the portable device locally or through cloud server for remote examination;
locally grading the fundus image captured for eye conditions and showing diagnostic report for further consultation with physicians;
displaying the captured fundus images or video in the display in real time to the operator; and
viewing the image / video captured by the image capturing devices in real time using the view finders.
13. The method as claimed in claim 12, wherein the fundus image is captured in two dimensional (2D) or three dimensional (3D) according to the operator control.
14. The method as claimed in claim 12, wherein the captured fundus images are automatically analyzed and diagnosed for diabetic retinopathy; identify the stage of diabetic retinopathy; identify the stage of diabetic macular edema; segmentation of retinal blood vessels; lesions in the retina; the stage of glaucoma and the stage of age related macular degeneration.
15. The method as claimed in claim 12, further comprising grading of captured fundus images by the portable device connected through the cloud server.
16. The method as claimed in claim 12, further comprising operating said wearable ophthalmoscope device in one or more modes using one or more switches.
4
PCT/IN2018/050704 2017-11-03 2018-10-31 Wearable ophthalmoscope device and a method of capturing fundus image Ceased WO2019087209A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN201741039185 2017-11-03
IN201741039185 2017-11-03

Publications (1)

Publication Number Publication Date
WO2019087209A1 true WO2019087209A1 (en) 2019-05-09

Family

ID=66332492

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IN2018/050704 Ceased WO2019087209A1 (en) 2017-11-03 2018-10-31 Wearable ophthalmoscope device and a method of capturing fundus image

Country Status (1)

Country Link
WO (1) WO2019087209A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3751581A1 (en) * 2019-06-07 2020-12-16 Welch Allyn, Inc. Digital image screening and/or diagnosis using artificial intelligence
CN114222520A (en) * 2019-07-31 2022-03-22 克森农-虚拟现实公司 Ophthalmic testing system and method
WO2022129591A1 (en) * 2020-12-17 2022-06-23 Delphinium Clinic Ltd. System for determining one or more characteristics of a user based on an image of their eye using an ar/vr headset
ES2933226A1 (en) * 2021-07-30 2023-02-02 Share Global Health S L Device for the control of diabetic retinopathies or other conditions detectable through the ocular study (Machine-translation by Google Translate, not legally binding)
USD1005289S1 (en) 2022-03-03 2023-11-21 Xenon Ophthalmics Inc. Headset
USD1005288S1 (en) 2022-03-03 2023-11-21 Xenon Ophthalmics Inc. Module for head mounted display
USD1019641S1 (en) 2022-03-03 2024-03-26 Xenon Ophthalmics Inc. Headset
USD1021898S1 (en) 2022-03-03 2024-04-09 Xenon Ophthalmics Inc. Module for head mounted display
EP4356818A4 (en) * 2021-06-17 2025-06-11 Kowa Company, Ltd. MEDICAL PROGRAM AND MEDICAL EXAMINATION SYSTEM

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160135675A1 (en) * 2013-07-31 2016-05-19 Beijing Zhigu Rui Tuo Tech Co., Ltd System for detecting optical parameter of eye, and method for detecting optical parameter of eye

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160135675A1 (en) * 2013-07-31 2016-05-19 Beijing Zhigu Rui Tuo Tech Co., Ltd System for detecting optical parameter of eye, and method for detecting optical parameter of eye

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MICHAEL D. ABRMOFF ET AL.: "Retinal Imaging and Image Analysis", IEEE REV BIOMED ENG., vol. 3, 1 January 2010 (2010-01-01), pages 169 - 208, XP011339903 *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3751581A1 (en) * 2019-06-07 2020-12-16 Welch Allyn, Inc. Digital image screening and/or diagnosis using artificial intelligence
US11915826B2 (en) 2019-06-07 2024-02-27 Welch Allyn, Inc. Digital image screening and/or diagnosis using artificial intelligence
CN114222520A (en) * 2019-07-31 2022-03-22 克森农-虚拟现实公司 Ophthalmic testing system and method
EP4003142A4 (en) * 2019-07-31 2023-08-23 Xenon-VR, Inc. OPHTHALMIC TESTING SYSTEMS AND METHODS
CN114222520B (en) * 2019-07-31 2025-10-14 克森农-虚拟现实公司 Ophthalmic testing systems and methods
US12376745B2 (en) 2019-07-31 2025-08-05 Xenon Ophthalmics Inc. Ophthalmologic testing systems and methods
WO2022129591A1 (en) * 2020-12-17 2022-06-23 Delphinium Clinic Ltd. System for determining one or more characteristics of a user based on an image of their eye using an ar/vr headset
EP4356818A4 (en) * 2021-06-17 2025-06-11 Kowa Company, Ltd. MEDICAL PROGRAM AND MEDICAL EXAMINATION SYSTEM
ES2933226A1 (en) * 2021-07-30 2023-02-02 Share Global Health S L Device for the control of diabetic retinopathies or other conditions detectable through the ocular study (Machine-translation by Google Translate, not legally binding)
USD1005288S1 (en) 2022-03-03 2023-11-21 Xenon Ophthalmics Inc. Module for head mounted display
USD1021898S1 (en) 2022-03-03 2024-04-09 Xenon Ophthalmics Inc. Module for head mounted display
USD1019641S1 (en) 2022-03-03 2024-03-26 Xenon Ophthalmics Inc. Headset
USD1095527S1 (en) 2022-03-03 2025-09-30 Xenon Ophthalmics I Nc. Headset
USD1005289S1 (en) 2022-03-03 2023-11-21 Xenon Ophthalmics Inc. Headset

Similar Documents

Publication Publication Date Title
WO2019087209A1 (en) Wearable ophthalmoscope device and a method of capturing fundus image
US11766173B2 (en) Device and method for capturing, analyzing, and sending still and video images of the fundus during examination using an ophthalmoscope
US11925415B2 (en) Slit-lamp microscope and ophthalmic system
JP6660750B2 (en) Ophthalmic examination system
EP3434175B1 (en) Ophthalmic system and ophthalmic information processing apparatus
US20110299036A1 (en) Portable digital direct ophthalmoscope
US12011225B2 (en) Slit lamp microscope and ophthalmic system
JP6869032B2 (en) Ophthalmic examination system
JP2017143992A (en) Ophthalmologic examination system and ophthalmologic examination apparatus
US11950849B2 (en) Ophthalmic system, ophthalmic information processing apparatus, and recording medium
US20250082201A1 (en) Slit-lamp microscope and ophthalmic system
JP7345610B2 (en) slit lamp microscope
KR20220093781A (en) Wearable neurological disease diagnosis device and the method
JP7057410B2 (en) Ophthalmic examination system
JP2022177043A (en) Ophthalmic examination system and ophthalmic examination apparatus
JP6788723B2 (en) Ophthalmic examination system and ophthalmic examination management server
JP6788724B2 (en) Ophthalmic examination system and ophthalmic examination management server
JP7150000B2 (en) ophthalmic examination system
JP7237219B2 (en) Ophthalmic system, ophthalmic information processing device, program, and recording medium
US20240099581A1 (en) Patient home monitoring and physician alert for ocular anatomy
JP2020044355A (en) Ophthalmic examination system and ophthalmic examination management server
JP2020036983A (en) Ophthalmic examination system and ophthalmic examination management server
JP2023142781A (en) ophthalmology system
WO2025235896A1 (en) Wearable comprehensive eye examination device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18872745

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18872745

Country of ref document: EP

Kind code of ref document: A1