[go: up one dir, main page]

WO2019018258A1 - Capture d'image rétinienne à foyer traversant - Google Patents

Capture d'image rétinienne à foyer traversant Download PDF

Info

Publication number
WO2019018258A1
WO2019018258A1 PCT/US2018/042223 US2018042223W WO2019018258A1 WO 2019018258 A1 WO2019018258 A1 WO 2019018258A1 US 2018042223 W US2018042223 W US 2018042223W WO 2019018258 A1 WO2019018258 A1 WO 2019018258A1
Authority
WO
WIPO (PCT)
Prior art keywords
fundus
images
focus
image
diopters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2018/042223
Other languages
English (en)
Other versions
WO2019018258A9 (fr
Inventor
Ynjiun Paul Wang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Welch Allyn Inc
Original Assignee
Welch Allyn Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/651,853 external-priority patent/US10799115B2/en
Application filed by Welch Allyn Inc filed Critical Welch Allyn Inc
Priority to CN201880047622.6A priority Critical patent/CN111328270B/zh
Priority to EP18834961.7A priority patent/EP3654826A4/fr
Priority to AU2018304105A priority patent/AU2018304105B2/en
Publication of WO2019018258A1 publication Critical patent/WO2019018258A1/fr
Anticipated expiration legal-status Critical
Publication of WO2019018258A9 publication Critical patent/WO2019018258A9/fr
Ceased legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14—Arrangements specially adapted for eye photography
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/0016—Operational features thereof
    • A61B3/0041—Operational features thereof characterised by display arrangements
    • A61B3/0058—Operational features thereof characterised by display arrangements for multiple images
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/12—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/12—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
    • A61B3/1208—Multiple lens hand-held instruments

Definitions

  • diabetic retinopathy which is damage to the blood vessels of the light-sensitive tissue at the back of the eye, known as the retina.
  • Trained medical professionals use cameras during eye examinations for diabetic retinopathy screening.
  • the cameras can produce images of the back of the eye and trained medical professionals use those images to diagnose and treat diabetic retinopathy.
  • a non-mydriatic fundus imaging apparatus includes a processor and memory and a camera including a lens, where the camera is operatively coupled to the processor.
  • the memory may store instructions that, when executed by the processor, cause the apparatus to: adjust a focus of the lens to a plurality of different diopter ranges, capture a plurality of images of a fundus, wherein the camera captures at least one image at each of the plurality of different diopter ranges; and, after capturing each of the plurality of images of the fundus, generate a three-dimensional map of the fundus.
  • a method for screening for optic nerve edema with a non-mydriatic fundus imaging apparatus includes adjusting a lens of a camera to focus on each of a plurality of zones in a depth of field, capturing at least one image at each of the plurality of zones, generating a three-dimensional map of a fundus using the at least one image captured at each of the plurality of zones, and, based on the three-dimensional map, screening for optic nerve edema.
  • a non-mydriatic fundus image capture system is disclosed. The system includes a housing, an image capture device coupled to the housing, a display, a processing unit, and memory.
  • the memory may store instructions that, when executed by the processing unit, cause the system to: capture a plurality of images of a fundus in an image capture mode, where the image capture mode includes a plurality of adjustments of a lens of the image capture device such that the image capture device captures an image at each of the plurality of adjustments in a depth of field focus range; after capturing each of the plurality of images of the fundus, generate a three-dimensional map of the fundus, including identifying a first region, each of the plurality of images having corresponding first regions; and applying a focus metric on each of the respective first regions of each of the plurality of images, thereby generating a focus metric score for each of the respective first regions of each of the plurality of images; identify one or more areas of interest on the three-dimensional map of the fundus; and screen the one or more areas of interest for indications of disease.
  • FIG. 1 is an embodiment of an example system for recording and viewing an image of a patient's fundus
  • FIG. 2 is an embodiment of an example fundus imaging system
  • FIG. 3 is an embodiment of an example method for imaging a patient's fundus using a fundus imaging system
  • FIG. 4 is an embodiment of an example fundus imaging system
  • FIG. 5 illustrates an example method of initiating a fundus imaging using passive eye tracking
  • FIG. 6 is an embodiment of an example use of a fundus imaging system
  • FIG. 7 is an example computing device used within the fundus imaging system.
  • FIG. 8 illustrates logical components of another embodiment of the fundus imaging system.
  • FIG. 9 is an embodiment of an example method for processing a set of images captured by a fundus imaging system.
  • FIG. 10A is an example image captured with an embodiment of the fundus imaging system at a first focus.
  • FIG. 10B is an example image captured with an embodiment of the fundus imaging system at a second focus.
  • FIG. IOC is an example image captured with an embodiment of the fundus imaging system at a third focus.
  • FIG. 10D is an example image captured with an embodiment of the fundus imaging system at a fourth focus.
  • FIG. 10E is an example image captured with an embodiment of the fundus imaging system at a fifth focus.
  • FIG. 1 is a schematic block diagram illustrating an example system 100 for recording and viewing an image of a patient's fundus.
  • the system 100 includes a patient P, a fundus imaging system 102, a computing device 1800 including an image processor 106, a camera 104 in communication with the computing device 1800, a display 108 in communication with the computing device 1800 and used by clinician C, and a network 110.
  • An embodiment of the example fundus imaging system 102 is shown and described in more detail below with reference to FIG. 4.
  • the fundus imaging system 102 functions to create a set of digital image of a patient's P eye fundus.
  • fundus refers to the eye fundus and includes the retina, optic nerve, macula, vitreous, choroid and posterior pole.
  • one or more images of the eye are desired.
  • the patient P is being screened for an eye disease, such as diabetic retinopathy.
  • the fundus imaging system 102 can also be used to provide images of the eye for other purposes, such as to diagnose or monitor the progression of a disease such as diabetic retinopathy.
  • the fundus imaging system 102 includes a handheld housing that supports the system's components.
  • the housing supports one or two apertures for imaging one or two eyes at a time.
  • the housing supports positional guides for the patient P, such as an optional adjustable chin rest. The positional guide or guides help to align the patient's P eye or eyes with the one or two apertures.
  • the housing supports means for raising and lowering the one or more apertures to align them with the patient's P eye or eyes. Once the patient's P eyes are aligned, the clinician C then initiates the image captures by the fundus imaging system 102.
  • Example system 100 does not require a mydriatic drug to be administered to the patient P before imaging, although the system 100 can image the fundus if a mydriatic drug has been administered.
  • the system 100 can be used to assist the clinician C in screening for, monitoring, or diagnosing various eye diseases, such as hypertension, diabetic retinopathy, glaucoma and papilledema. It will be appreciated that the clinician C that operates the fundus imaging system 102 can be different from the clinician C evaluating the resulting image.
  • the fundus imaging system 102 includes a camera 104 in communication with an image processor 106.
  • the camera 104 is a digital camera including a lens, an aperture, and a sensor array.
  • the camera 104 lens is a variable focus lens, such as a lens moved by a step motor, or a fluid lens, also known as a liquid lens in the art.
  • the camera 104 is configured to record images of the fundus one eye at a time. In other embodiments, the camera 104 is configured to record an image of both eyes substantially simultaneously.
  • the fundus imaging system 102 can include two separate cameras, one for each eye.
  • the image processor 106 is operatively coupled to the camera 104 and configured to communicate with the network 110 and display 108.
  • the image processor 106 regulates the operation of the camera 104.
  • Components of an example computing device, including an image processor, are shown in more detail in FIG. 7, which is described further below.
  • the display 108 is in communication with the image processor 106.
  • the housing supports the display 108.
  • the display connects to the image processor, such as a smart phone, tablet computer, or external monitor.
  • the display 108 functions to reproduce the images produced by the fundus imaging system 102 in a size and format readable by the clinician C.
  • the display 108 can be a liquid crystal display (LCD) and active matrix organic light emitting diode (AMOLED) display.
  • the display can be touch sensitive.
  • the example fundus imaging system 102 is connected to a network 110.
  • the network 110 may include any type of wireless network, a wired network, or any communication network known in the art.
  • wireless connections can include cellular network connections and connections made using protocols such as 802.1 la, b, and/or g.
  • a wireless connection can be accomplished directly between the fundus imaging system 102 and an external display using one or more wired or wireless protocols, such as Bluetooth, Wi-Fi Direct, radio- frequency identification (RFID), or Zigbee. Other configurations are possible.
  • FIG. 2 illustrates components of an example fundus imaging system 102.
  • the example fundus imaging system 102 includes a variable focus lens 180, an illumination LED 182, an image sensor array 186, a fixation LED 184, a computing device 1800, and a display 108. Each component is in electrical communication with, at least, the computing device 1800. Other embodiments can include more or fewer components.
  • variable focus lens 180 is a liquid lens.
  • a liquid lens is an optical lens whose focal length can be controlled by the application of an external force, such as a voltage.
  • the lens includes a transparent fluid, such as water or water and oil, sealed within a cell and a transparent membrane. By applying a force to the fluid, the curvature of the fluid changes, thereby changing the focal length. This effect is known as electro wetting.
  • a liquid lens can focus between about -10 diopters to about +30 diopters.
  • the focus of a liquid lens can be made quickly, even with large changes in focus. For instance, some liquid lenses can autofocus in tens of milliseconds or faster.
  • Liquid lenses can focus from about 10 cm to infinity and can have an effective focal length of about 16 mm or shorter.
  • variable focus lens 180 is one or more movable lenses that are controlled by a stepping motor, a voice coil, an ultrasonic motor, or a piezoelectric actuator. Additionally, a stepping motor can also move the image sensor array 186. In those embodiments, the variable focus lens 180 and/or the image sensor array 186 are oriented normal to an optical axis of the fundus imaging system 102 and move along the optical axis.
  • An example stepping motor is shown and described below with reference to FIG. 4.
  • the example fundus imaging system 102 also includes an illumination light-emitting diode (LED) 182.
  • the illumination LED 182 can be single color or multi-color. For example, the illumination LED 182 can be a three-channel RGB LED, where each die is capable of independent and tandem operation.
  • the illumination LED 182 is an assembly including one or more visible light LEDs and a near-infrared LED.
  • the optional near-infrared LED can be used in a preview mode, for example, for the clinician C to determine or estimate the patient's P eye focus without illuminating visible light that could cause the pupil to contract or irritate the patient P.
  • the illumination LED 182 is in electrical communication with the computing device 1800. Thus, the illumination of illumination LED 182 is coordinated with the adjustment of the variable focus lens 180 and image capture.
  • the illumination LED 182 can be overdriven to draw more than the maximum standard current draw rating.
  • the illumination LED 182 can also include a near-infrared LED. The near- infrared LED is illuminated during a preview mode.
  • the example fundus imaging system 102 also optionally includes a fixation LED 184.
  • the fixation LED 184 is in communication with the computing device 1800 and produces a light to guide the patient's P eye for alignment.
  • the fixation LED 184 can be a single color or multicolor LED.
  • the fixation LED 184 can produce a beam of green light that appears as a green dot when the patient P looks into the fundus imaging system 102.
  • Other colors and designs, such as a cross, "x" and circle are possible.
  • the example fundus imaging system 102 also includes an image sensor array 186 that receives and processes light reflected by the patient's fundus.
  • the image sensor array 186 is, for example, a complementary metal-oxide semiconductor (CMOS) sensor array, also known as an active pixel sensor (APS), or a charge coupled device (CCD) sensor.
  • CMOS complementary metal-oxide semiconductor
  • APS active pixel sensor
  • CCD charge coupled device
  • the image sensor array 186 has a plurality of rows of pixels and a plurality of columns of pixels. In some embodiments, the image sensor array has about 1280 by 1024 pixels, about 640 by 480 pixels, about 1500 by 1152 pixels, about 2048 by 1536 pixels, or about 2560 by 1920 pixels.
  • the pixel size in the image sensor array 186 is from about four micrometers by about four micrometers; from about two micrometers by about two micrometers; from about six micrometers by about six micrometers; or from about one micrometer by about one micrometer.
  • the example image sensor array 186 includes photodiodes that have a light-receiving surface and have substantially uniform length and width. During exposure, the photodiodes convert the incident light to a charge.
  • the image sensor array 186 can be operated as a global reset, that is, substantially all of the photodiodes are exposed simultaneously and for
  • the example fundus imaging system 102 also includes a display 108, discussed in more detail above with reference to FIG. 1. Additionally, the example fundus imaging system 102 includes a computing device 1800, discussed in more detail below with reference to FIG. 7.
  • FIG. 3 is an embodiment of a method 200 for imaging a patient's fundus using a fundus imaging system.
  • the lighting is optimally dimmed prior to execution, although lowering the lighting is optional.
  • the embodiment shown includes a set depth of field operation 204, a set number of zones operation 206, an illuminate lighting operation 208, an adjust lens focus operation 210, a capture image operation 212, repeat operation(s) 213, a show images operation 214 and a determine representative image operation 216.
  • Other embodiments can include more or fewer steps.
  • the embodiment of method 200 begins with setting a depth of field operation 204.
  • the variable focus lens 180 is capable of focusing from about -20 diopters to about +20 diopters.
  • Set depth of field operation 204 defines the lower and upper bounds in terms of diopters.
  • the depth of field range could be set to about -10 to +10 diopters; about -5 to about +5 diopters; about -10 to about +20 diopters; about -5 to about +20 diopters; about - 20 to about +0 diopters; or about -5 to about +5 diopters.
  • Other settings are possible.
  • the depth of field can be preprogrammed by the manufacturer. Alternatively, the end user, such as the clinician C, can set the depth of field.
  • zones operation 206 can occur before or concurrent with field operation 204.
  • the depth of field is divided into equal parts, where each part is called a zone. In other embodiments, the zones are not all equal.
  • the number of zones is equal to the number of images captured in capture image operation 212.
  • the focus of the variable focus lens can be changed by 4 diopters before each image capture. Thus, in this example, images would be captured at -10, -6, -2, +2, +6 and +10 diopters.
  • images could be captured at -8, -4, 0, +4 and +8 diopters, thereby capturing an image in zones -10 to -6 diopters, - 6 to -2 diopters, -2 to +2 diopters, +2 to +6 diopters and +6 to +10 diopters, respectively.
  • the depth of focus is about +/- 2 diopters.
  • the number of zones and the depth of field can vary, resulting in different ranges of depth of field image capture.
  • both depth of field and number of zones are predetermined. For example, -10D to +10D and 5 zones. Both can be changed by a user.
  • embodiment of method 200 is the image capture process, which includes illuminate lighting operation 208, adjust lens focus operation 210 and capture image operation 212. As shown in FIG. 3, the lighting component is illuminated (lighting operation 208) before the lens focus is adjusted (lens focus operation 210). However, lens focus operation 210 can occur before or concurrent with lighting operation 208.
  • the illumination LED 182 is illuminated in lighting operation 208.
  • the illumination LED 182 can remain illuminated throughout the duration of each image capture.
  • the illumination LED 182 can be turned on and off for each image capture.
  • the illumination LED 182 only turns on for the same period of time as the image sensor array 186 exposure time period.
  • lighting operation 208 can additionally include illuminating a near- infrared LED.
  • the clinician C can use the illumination of the near-infrared LED as a way to preview the position of the patient's P pupil.
  • variable focus lens 180 is adjusted in lens focus operation 210.
  • the embodiment of method 200 results in a plurality of images at least one of which, or a
  • variable focus lens 180 can be set to a particular diopter range and an image captured without the system verifying that the particular focus level will produce an in-focus image, as is found in autofocusing systems. Because the system does not attempt to autofocus, and the focus of the variable focus lens 180 can be altered in roughly tens of milliseconds, images can be captured throughout the depth of field in well under a second, in embodiments.
  • the fundus imaging system 102 can capture images of the entire depth of field before the patient' s P eye can react to the illuminated light. Without being bound to a particular theory, depending on the patient P, the eye might react to the light from illumination LED 182 in about 150 milliseconds.
  • the image sensor array 186 captures an image of the fundus in capture image operation 212.
  • the embodiment of method 200 includes multiple image captures of the same fundus at different diopter foci.
  • the example fundus imaging system 102 uses a global reset or global shutter array, although other types of shutter arrays, such as a rolling shutter, can be used.
  • the entire image capture method 200 can also be triggered by passive eye tracking and automatically capture, for example, 5 frames of images. An embodiment of example method for passive eye tracking is shown and described in more detail with reference to FIG. 5, below.
  • method 200 returns in loop 213 to either the illuminate lighting operation 208 or the adjust lens focus operation 210. That is, operations 208, 210 and 212 are repeated until an image is captured in each of the preset zones from zones operation 206. It is noted that the image capture does not need to be sequential through the depth of field. Additionally, each of the images does not need to be captured in a single loop; a patient could have one or more fundus images captured and then one or more after a pause or break.
  • Show images operation 214 can include showing all images simultaneously or sequentially on display 108.
  • a user interface shown on display 108 can then enable the clinician C or other reviewing medical professional to select or identify the best or a representative image of the patient's P fundus.
  • the computing device can determine a representative fundus image in operation 216.
  • Operation 216 can also produce a single image by compiling aspects of one or more of the images captured. This can be accomplished by, for example, using a wavelet feature reconstruction method to select, interpolate, and/or synthesize the most representative frequency or location components.
  • the fundus imaging system 102 can also produce a three-dimensional image of the fundus by compiling the multiple captured images. Because the images are taken at different focus ranges of the fundus, the compilation of the pictures can contain three-dimensional information about the fundus.
  • the image or images from operation 214 or 216 can be sent to a patient's electronic medical record or to a different medical professional via network 110.
  • FIG. 4 illustrates an embodiment of example fundus imaging system 400.
  • the embodiment 400 includes a housing 401 that supports an optional fixation LED 402, an objective lens 404, fixation LED mirrors 405, variable focus lens assembly 406, display 408, printed circuit board 410, step motor 412, image sensor array 414, and illumination LED 416.
  • light paths L that include potential light paths from optional fixation LED 402 and incoming light paths from outside the fundus imaging system 400.
  • the illustrated components have the same or similar functionality to the corresponding components discussed above with reference to FIGs. 1-3 above. Other embodiments can include more or fewer components.
  • the housing 401 of example fundus imaging system 400 is sized to be hand held.
  • the housing 401 additionally supports one or more user input buttons near display 408, not shown in FIG. 4.
  • the user input button can initiate the image capture sequence, at least a portion of which is shown and discussed with reference to FIG. 3, above.
  • the fundus imaging system 400 is capable of being configured such that the clinician C does not need to adjust the lens focus.
  • Fixation LED 402 is an optional component of the fundus imaging system 400.
  • the fixation LED 402 is a single or multi-colored LED.
  • Fixation LED 402 can be more than one LED.
  • pivoting mirrors 405 can be used to direct light from the fixation LED 402 towards the patient's pupil. Additionally, an overlay or filter can be used to project a particular shape or image, such as an "X", to direct the patient's focus. The pivoting mirrors 405 can control where the fixation image appears in the patient's view. The pivoting mirrors 405 do not affect the light reflected from the patient's fundus.
  • the embodiment of example fundus imaging system 400 also includes a variable focus lens assembly 406. As shown in FIG. 4, the variable focus lens assembly 406 is substantially aligned with the longitudinal axis of the housing 401. Additionally, the variable focus lens assembly 406 is positioned between the objective lens 404 and the image sensor array 414 such that it can control the focus of the incident light L onto the image sensor array.
  • the example printed circuit board 410 is shown positioned within one distal end of the housing 401 near the display 408. However, the printed circuit board 410 can be positioned in a different location.
  • the printed circuit board 410 supports the components of the example computing device 1800.
  • a power supply can also be positioned near printed circuit board 410 and configured to power the components of the embodiment of example fundus imaging system 400.
  • Step motor 412 is an optional component in the example embodiment 400.
  • Step motor 412 can also be, for example, a voice coil, an ultrasonic motor, or a piezoelectric actuator.
  • step motor 412 moves the variable focus lens assembly 406 and/or the sensor array 414 to achieve variable focus.
  • the step motor 412 moves the variable focus lens assembly 406 or the sensor array 414 in a direction parallel to a longitudinal axis of the housing 401 (the optical axis).
  • the movement of step motor 412 is actuated by computing device 1800.
  • the example image sensor array 414 is positioned normal to the longitudinal axis of the housing 401. As discussed above, the image sensor array 414 is in electrical communication with the computing device. Also, as discussed above, the image sensor array can be a CMOS (APS) or CCD sensor.
  • An illumination LED 416 is positioned near the variable focus lens assembly 406.
  • the illumination LED 416 can be positioned in other locations, such as near or with the fixation LED 402.
  • FIG. 5 illustrates an alternate embodiment of initiate retinal imaging step 306 using passive eye tracking.
  • the initiate retinal imaging step 306 operates to image the fundus of the patient P using passive eye tracking.
  • the fundus imaging system 102 monitors the pupil/fovea orientation of the patient P.
  • the initiate retinal imaging step 306 is described with respect to fundus imaging system 102, the initiate retinal imaging step 306 may be performed using a wearable or nonwearable fundus imaging system, such as a handheld digital fundus imaging system.
  • the pupil or fovea or both of the patient P are monitored.
  • the fundus imaging system 102 captures images in a first image capture mode. In the first image capture mode, the fundus imaging system 102 captures images at a higher frame rate. In some embodiments, in the first image capture mode, the fundus imaging system 102 captures images with infra-red illumination and at lower resolutions. In some embodiments, the infra-red illumination is created by the illumination LED 182 operating to generate and direct light of a lower intensity towards the subject.
  • the first image capture mode may minimize discomfort to the patient P, allow the patient P to relax, and allow for a larger pupil size without dilation (non- mydriatic).
  • the computing system 1800 processes at least a portion of the images captured by the fundus imaging system 102.
  • the computing system 1800 processes the images to identify the location of the pupil or fovea or both of the patient P.
  • a vector corresponding to the pupil/fovea orientation is calculated.
  • the pupil/fovea orientation is approximated based on the distance between the pupil and fovea in the image.
  • the pupil/fovea orientation is calculated by approximating the position of the fovea relative to the pupil in three dimensions using estimates of the distance to the pupil and the distance between the pupil and the fovea.
  • the pupil/fovea orientation is approximated from the position of the pupil alone.
  • other methods of approximating the pupil/fovea orientation are used.
  • the pupil/fovea orientation is compared to the optical axis of the fundus imaging system 102. If the pupil/fovea orientation is substantially aligned with the optical axis of the fundus imaging system 102, the process proceeds to step 309 to capture a fundus image. If not, the process returns to step 303 to continue to monitor the pupil or fovea. In some embodiments, the pupil/fovea orientation is substantially aligned with the optical axis when the angle between them is less than two to fifteen degrees.
  • fundus images are captured by triggering the embodiment of example thru focusing image capturing method 200. In embodiments, five images are captured at step 309.
  • the fundus image is captured in a second image capture mode.
  • the fundus imaging system 102 captures images with visible illumination and at higher resolutions.
  • the visible illumination is created by the illumination LED 182 operating to generate and direct light of a higher intensity towards the subject.
  • the higher illumination is created by an external light source or ambient light.
  • the second image capture mode may facilitate capturing a clear, well-illuminated, and detailed fundus image.
  • the initiate retinal imaging step 306 returns to step 303 to continue to monitor the pupil/fovea orientation.
  • the initiate retinal imaging step 306 may continue to collect fundus images indefinitely or until a specified number of images have been collected. Further information regarding passive eye tracking can be found in U.S. Patent Application 14/177,594, attorney docket number 10156.0082US01, titled Ophthalmoscope Device, which is hereby incorporated by reference in its entirety
  • FIG. 6 is an embodiment of example use 500 of fundus imaging system 102.
  • a clinician positions the fundus imaging system (operation 502), initiates image capture (operation 504), positions the fundus imaging system over the other eye (operation 506), initiates image capture (operation 508), and views images (operation 520).
  • operation 502 positions the fundus imaging system
  • operation 504 positions the fundus imaging system over the other eye
  • operation 506 positions the fundus imaging system over the other eye
  • operation 508 initiates image capture
  • views images operation 520.
  • the example use 500 can also be performed for a patient who has taken a pupil- dilating compound.
  • the embodiment of example use 500 can also include lowering the lighting.
  • the embodiment of example use 500 is conducted using the same or similar components as those described above with reference to FIGs. 1-3. Other embodiments can include more or fewer operations.
  • the embodiment of example use 500 begins by positioning the fundus imaging system (operation 502).
  • the clinician first initiates an image capture sequence via a button on the housing or a graphical user interface shown by the display.
  • the graphical user interface can instruct the clinician to position the fundus imaging system over a particular eye of the patient.
  • the clinician can use the graphical user interface to indicate which eye fundus is being imaged first.
  • the clinician positions the fundus imaging system near the patient's eye socket.
  • the clinician positions the aperture of the system flush against the patient's eye socket such that the aperture, or a soft material eye cup extending from the aperture, seals out most of the ambient light.
  • the example use 500 does not require positioning the aperture flush against the patient's eye socket.
  • the system captures more than one image of the fundus in operation 504.
  • the system does not require the clinician to manually focus the lens. Additionally, the system does not attempt to autofocus on the fundus. Rather, the clinician simply initiates the image capture, via a button or the GUI, and the fundus imaging system controls when to capture the images and the focus of the variable focus lens. Also, as discussed above at least with reference to FIG. 5, the system can initiate image capture using passive eye tracking.
  • the patient may require the fundus imaging system to be moved away from the eye socket during image capture operation 504.
  • the clinician can re-initiate the image capture sequence of the same eye using the button or the GUI on the display.
  • the fundus imaging system After capturing an image in each of the specified zones, the fundus imaging system notifies the clinician that the housing should be positioned over the other eye (operation 506).
  • the notification can be audible, such as a beep, and/or the display can show a notification.
  • the system is configured to capture a set of images of only one eye, wherein the example method 500 proceeds to view images operation 520 after image capture operation 504.
  • the clinician then positions the fundus imaging system near or flush with the patient's other eye socket in operation 506. Again, when the system is in place, an image is captured in every zone in operation 508.
  • the clinician can view the resulting images in operation 520.
  • the images can be post-processed before the clinician views the images to select or synthesize a
  • the fundus images can be sent to a remote location for viewing by a different medical professional.
  • FIG. 7 is a block diagram illustrating physical components (i.e., hardware) of a computing device 1800 with which embodiments of the disclosure may be practiced.
  • the computing device components described below may be suitable to act as the computing devices described above, such as wireless computing device and/or medical device of Figure 1.
  • the computing device 1800 may include at least one processing unit 1802 and a system memory 1804.
  • the system memory 1804 may comprise, but is not limited to, volatile storage (e.g., random access memory), non-volatile storage (e.g., read-only memory), flash memory, or any combination of such memories.
  • the system memory 1804 may include an operating system 1805 and one or more program modules 1806 suitable for running software applications 1820.
  • the operating system 1805 may be suitable for controlling the operation of the computing device 1800.
  • embodiments of the disclosure may be practiced in conjunction with a graphics library, other operating systems, or any other application program and is not limited to any particular application or system.
  • This basic configuration is illustrated in FIG. 7 by those components within a dashed line 1808.
  • the computing device 1800 may have additional features or functionality.
  • the computing device 1800 may also include additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape.
  • additional storage is illustrated in FIG. 7 by a removable storage device 1809 and a non-removable storage device 1810.
  • a number of program modules and data files may be stored in the system memory 1804. While executing on the processing unit 1802, the program modules 1806 may perform processes including, but not limited to, generate list of devices, broadcast user- friendly name, broadcast transmitter power, determine proximity of wireless computing device, connect with wireless computing device, transfer vital sign data to a patient's EMR, sort list of wireless computing devices within range, and other processes described with reference to the figures as described herein.
  • Other program modules that may be used in accordance with embodiments of the present disclosure, and in particular to generate screen content, may include electronic mail and contacts applications, word processing applications, spreadsheet applications, database applications, slide presentation applications, drawing or computer-aided application programs, etc.
  • embodiments of the disclosure may be practiced in an electrical circuit comprising discrete electronic elements, packaged or integrated electronic chips containing logic gates, a circuit utilizing a microprocessor, or on a single chip containing electronic elements or microprocessors.
  • an electrical circuit comprising discrete electronic elements, packaged or integrated electronic chips containing logic gates, a circuit utilizing a microprocessor, or on a single chip containing electronic elements or microprocessors.
  • embodiments of the disclosure may be practiced via a system-on- a-chip (SOC) where each or many of the components illustrated in FIG. 7 may be integrated onto a single integrated circuit.
  • SOC device may include one or more processing units, graphics units, communications units, system virtualization units and various application functionality all of which are integrated (or "burned") onto the chip substrate as a single integrated circuit.
  • the functionality, described herein, may be operated via application- specific logic integrated with other components of the computing device 1800 on the single integrated circuit (chip).
  • Embodiments of the disclosure may also be practiced using other technologies capable of performing logical operations such as, for example, AND, OR, and NOT, including but not limited to mechanical, optical, fluidic, and quantum
  • embodiments of the disclosure may be practiced within a general purpose computer or in any other circuits or systems.
  • the computing device 1800 may also have one or more input device(s) 1812 such as a keyboard, a mouse, a pen, a sound or voice input device, a touch or swipe input device, etc.
  • the output device(s) 1814 such as a display, speakers, a printer, etc. may also be included.
  • the aforementioned devices are examples and others may be used.
  • the computing device 1800 may include one or more communication connections 1816 allowing communications with other computing devices. Examples of suitable communication connections 1816 include, but are not limited to, RF transmitter, receiver, and/or transceiver circuitry; universal serial bus (USB), parallel, and/or serial ports.
  • Computer readable media may include non-transitory computer storage media.
  • Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, or program modules.
  • the system memory 1804, the removable storage device 1809, and the non-removable storage device 1810 are all computer storage media examples (i.e., memory storage.)
  • Computer storage media may include RAM, ROM, electrically erasable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other article of manufacture which can be used to store information and which can be accessed by the computing device 1800. Any such computer storage media may be part of the computing device 1800.
  • Computer storage media does not include a carrier wave or other propagated or modulated data signal.
  • Communication media may be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and includes any information delivery media.
  • modulated data signal may describe a signal that has one or more characteristics set or changed in such a manner as to encode information in the signal.
  • communication media may include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio frequency (RF), infrared, and other wireless media.
  • RF radio frequency
  • the example medical devices described herein are devices used to monitor patients, other types of medical devices can also be used.
  • the different components of the CONNEXTM system such as the intermediary servers that communication with the monitoring devices, can also require maintenance in the form of firmware and software updates.
  • These intermediary servers can be managed by the systems and methods described herein to update the maintenance requirements of the servers.
  • FIG. 8 shows another embodiment of logical components of the fundus imaging system 102.
  • the fundus imaging system 102 includes image capture module 602, 3-dimensional map module 604, and screening module 606.
  • Other embodiments can include more or fewer modules.
  • the fundus imaging system 102 is programmed to execute the modules 602, 604, 606 according to firmware and/or software accessible to the fundus imaging system 102.
  • a processing unit of the fundus imaging system 102 executes software stored on computer readable media to implement the modules 602, 604, 606.
  • Image capture module 602 receives image capture requests and coordinates capturing of a plurality of images. For instance, image capture module 602 receives a screening request and coordinates image capture by camera 104 at various focal lengths. In some embodiments, image capture module 602 also coordinates illumination of a visible light component during or before image capture.
  • image capture module 602 defines a depth of field or receives a depth of field from a user.
  • the depth of field is from -6 diopters to +6 diopters.
  • Another example depth of field is from -10 diopters to +10 diopters.
  • Other depths of field are contemplated.
  • Image capture module 602 also determines, or receives instructions, the incremental focus changes within the depth of field. As an example, the focus is altered by +/- 3 diopters between each image capture. Other incremental focus changes, such as +/- 1 diopter, +/- 2 diopters, etc., are contemplated. Of note is that the image capture module 602 does not use autofocusing during image capture. Thus, various aspects of the imaged fundus may be in focus or out of focus in the captured images.
  • image capture module 602 instructs camera 104 to capture an image at a starting focus, at each incremental focus within the depth of field, and at an ending focus. For example, in a depth of field of -6 diopters to +6 diopters, and with an incremental focus change of +/- 3 diopters, image capture module 602 causes camera 104 to capture an image at -6 diopters, -3 diopters, 0 diopters, 3 diopters, and 6 diopters. As described above, all of the images are captured in a period of time that is typically less than about 150 milliseconds.
  • Three-dimensional map module 604 receives the captured images and generates a three-dimensional map of the fundus. Generally, three-dimensional maps are generated by comparing specific pixels and/or regions across the corresponding pixels and/or regions of all the captured images. Based on which attributes are in focus or out of focus in the captured images, relative peaks and valleys can be determined and a topography of the fundus generated.
  • three-dimensional maps are generated by defining a first region and grading a focus quality of that region for each of the captured images.
  • the first region may include one or more pixels.
  • An example region is a 5 pixel by 5 pixel region, where one corner starts at coordinates (0,0) and a diagonal corner is located at (4, 4).
  • Each image captured in the sequence has a 5 pixel by 5 pixel region at those coordinates.
  • Each region is evaluated for focus quality on a scale, such as 0-100.
  • Focus quality may be determined using a local focus metric such as sum of modified Laplacian (SML). Based on the change of the focus quality of that region across the images a slope of the imaged surface can be determined. Additionally, or alternatively, the images where the region is most in focus can be used to determine peaks and/or valleys.
  • a pixel at (i, j) has a de-focused image (by SML) at -6 diopters, so the pixel (i, j) corresponds to a best focus in the 0 diopter image, which is the lowest valley point. Accordingly, -3 diopters corresponds to a median valley point, +3 diopters corresponds to a median ridge point, and +6 diopters corresponds to the highest ridge point.
  • Neighboring regions, and the slopes determined thereof, can be used to cross-check the determined slope for a given region. The process is repeated for all regions in each corresponding image. Then, the slopes of all the regions can be used to generate a three- dimensional map of the fundus.
  • Screening module 606 analyzes the three-dimensional map of the fundus generated by three-dimensional map module 604. Screening module 606 can be used to screen for various conditions or diseases. Additionally, screening module 606 can be used to diagnose various conditions or diseases. For example, screening module 606 may screen or diagnose macular edema (by detecting unusual swelling in foveal area), papilledema (by detecting unusual swelling in an optic nerve), epi-retinal membrane (by detecting translucent membrane structure on top of foveal/macular area), and/or glaucoma (by detecting unusual cup-to-disc ratio three- dimensionally). Screening module 606 may also determine a disease stage, such as the stage of papilledema and/or optic nerve edema.
  • screening module 606 screens for, or diagnoses, based on analyzing one or more areas of interest on the three-dimensional map. For instance, screening module 606 may start the analysis by identifying irregularities in the fundus surface, such as peaks and/or valleys. In some instances, peaks may correspond to swelling and the swelling may be related to one or more diseases.
  • Screening module 606 may use one or more thresholds in the disease screening and/or diagnosis. For example, any peak in foveal area greater than 100 microns is flagged for physician review. As another example, any swelling in foveal area greater than 300 microns is diagnosed as indicative of macular edema. In some instances, screening module 606 causes a display to show an image or text representative of the screening and/or diagnosis result.
  • FIG. 9 is an example method 700 of processing a set of fundus images captured by fundus imaging system 102.
  • the example method 700 includes determining a pixel location (operation 702), calculating a focus quality score (operation 704), determining a best focus quality score plane (operation 706), and scaling using a best focus quality score plane (operation 708).
  • Example method 700 is typically repeated for other pixel locations. Other embodiments can include more or fewer operations.
  • FIGs. 10A-10E discussed in conjunction with FIG. 9 below, are an example set of fundus images 800, 810, 820, 830, 840 captured by an embodiment of fundus imaging system 102.
  • the example fundus images 800, 810, 820, 830, 840 were captured with a focus at -2 diopters, -1 diopter, 0 diopter, +1 diopter, and +2 diopters, respectively.
  • Example method 700 begins by determining a pixel location (operation 702) for analysis.
  • the pixel location may be identified by coordinates, such as (i, j).
  • the pixel location 802, 812, 822, 832, 842 shown in FIGs. 10A-10E includes a pixel and a neighborhood window. In FIGs. 10A-10E, a neighborhood window of 5 pixels by 5 pixels is used, however, other neighborhood window sizes are contemplated.
  • a focus quality score is calculated (operation 704).
  • a focus quality score is calculated (operation 704) for each pixel location 802, 812, 822, 832, 842, usually including the neighborhood window.
  • a focus quality score is determined using sum of modified Laplacian (SML).
  • a focus quality score is determined using variance of Laplacian (VOL). Methods and techniques for calculating a focus quality score are described in more detail above with reference, at least, to FIG. 8.
  • Various scoring scales may be used, such as a numerical scale, for example, a range of 0.0-1.0 or 0-100.
  • a best focus quality score plane is determined (operation 706).
  • determining a best focus quality score includes determining which image in the set of images has the highest focus quality score at the identified pixel location. In effect, determining the image with the best focus quality also determines the plane (perpendicular to the focal axis) that is best in focus at the pixel location.
  • operation 706 can include determining a location between frames (images) where the best focus is likely present. For example, operation 706 may determine that between the image captured at +1 diopter and +2 diopters lies the best focus.
  • the images are scaled (operation 708).
  • Scaling the images using the best focus quality score includes determining a multiplier, where the multiplier may be based on the image resolution. In the example shown in FIGs. 10A-10E, the images are scaled by a multiplier of 370 microns per diopter. The scaled values are then used when generating the three-dimensional image.
  • a determination is made whether additional pixel locations need to be analyzed (operation 710). If the determination is that more pixel locations need to be analyzed, example method 700 returns to determine a pixel location (operation 702) that has not yet been analyzed. If the determination is that no more pixel locations need to be analyzed, then example method 700 proceeds to generate a three- dimensional image (operation 712).
  • Generating a three-dimensional image includes using the best focus images and scaling determined in operations 706 and 708.
  • the best focus score was at the image captured at -2 diopters
  • the best focus score was at the image captured at 0 diopters
  • the best focus score was at the image captured at -1 diopter.
  • the three- dimensional map of PI, P2, P3 will be at -740 microns, 0 micron, and -370 microns.
  • Embodiments of the present invention may be utilized in various distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network in a distributed computing environment.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

L'invention concerne un appareil pour produire une image de fond d'œil non mydriatique. L'appareil peut comprendre un processeur et une mémoire, ainsi qu'un élément d'éclairage et un appareil de prise de vues ayant un objectif à foyer variable. L'appareil peut être configuré pour régler le foyer de l'objectif à une pluralité de plages de dioptries différentes et capturer au moins une image à chacune de la pluralité de plages de dioptries différentes. A l'aide des images capturées, des cartes tridimensionnelles du fond d'oeil peuvent être générées. Des cartes tridimensionnelles du fond d'oeil peuvent être utilisées pour cribler ou diagnostiquer diverses maladies.
PCT/US2018/042223 2017-07-17 2018-07-16 Capture d'image rétinienne à foyer traversant Ceased WO2019018258A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201880047622.6A CN111328270B (zh) 2017-07-17 2018-07-16 通过聚焦视网膜图像捕获
EP18834961.7A EP3654826A4 (fr) 2017-07-17 2018-07-16 Capture d'image rétinienne à foyer traversant
AU2018304105A AU2018304105B2 (en) 2017-07-17 2018-07-16 Through focus retinal image capturing

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/651,853 US10799115B2 (en) 2015-02-27 2017-07-17 Through focus retinal image capturing
US15/651,853 2017-07-17

Publications (2)

Publication Number Publication Date
WO2019018258A1 true WO2019018258A1 (fr) 2019-01-24
WO2019018258A9 WO2019018258A9 (fr) 2020-03-26

Family

ID=65015821

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2018/042223 Ceased WO2019018258A1 (fr) 2017-07-17 2018-07-16 Capture d'image rétinienne à foyer traversant

Country Status (4)

Country Link
EP (1) EP3654826A4 (fr)
CN (1) CN111328270B (fr)
AU (1) AU2018304105B2 (fr)
WO (1) WO2019018258A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210386289A1 (en) * 2020-06-12 2021-12-16 Optotune Ag Camera and method for operating a camera
CN111714080B (zh) * 2020-06-30 2021-03-23 重庆大学 一种基于眼动信息的疾病分类系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050012899A1 (en) * 2002-06-14 2005-01-20 Physical Sciences, Inc. Line-scan laser ophthalmoscope
US20100208961A1 (en) * 2006-12-11 2010-08-19 Cytyc Corporation Method for assessing image focus quality
US20110028513A1 (en) * 2008-03-31 2011-02-03 Lang Zhuo Method for treating neurological disorders with imidazolium and imidazolinium compounds
US20130211285A1 (en) * 2011-12-02 2013-08-15 Terry A. Fuller Devices and Methods for Noninvasive Measurement of Intracranial Pressure
US20160249804A1 (en) 2015-02-27 2016-09-01 Welch Allyn, Inc. Through Focus Retinal Image Capturing

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100349542C (zh) * 2004-05-29 2007-11-21 倪蔚民 实时自动无侵害的虹膜光学成像装置
US9055892B2 (en) * 2011-04-27 2015-06-16 Carl Zeiss Meditec, Inc. Systems and methods for improved ophthalmic imaging
US9078612B2 (en) * 2011-12-02 2015-07-14 Third Eye Diagnostics, Inc. Devices and methods for noninvasive measurement of intracranial pressure
JP6460618B2 (ja) * 2013-01-31 2019-01-30 キヤノン株式会社 光干渉断層撮像装置およびその制御方法
JP6220248B2 (ja) * 2013-11-29 2017-10-25 キヤノン株式会社 眼科装置及び制御方法
JP6588462B2 (ja) * 2013-12-23 2019-10-09 アールエスビーブイ，リミティド ライアビリティ カンパニー 広視野網膜画像取得システム及び方法
CN105357426B (zh) * 2014-11-03 2019-01-15 苏州思源科安信息技术有限公司 用于移动终端可见光和生物识别组合系统的光电成像方法及移动终端

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050012899A1 (en) * 2002-06-14 2005-01-20 Physical Sciences, Inc. Line-scan laser ophthalmoscope
US20100208961A1 (en) * 2006-12-11 2010-08-19 Cytyc Corporation Method for assessing image focus quality
US20110028513A1 (en) * 2008-03-31 2011-02-03 Lang Zhuo Method for treating neurological disorders with imidazolium and imidazolinium compounds
US20130211285A1 (en) * 2011-12-02 2013-08-15 Terry A. Fuller Devices and Methods for Noninvasive Measurement of Intracranial Pressure
US20160249804A1 (en) 2015-02-27 2016-09-01 Welch Allyn, Inc. Through Focus Retinal Image Capturing

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3654826A4

Also Published As

Publication number Publication date
EP3654826A1 (fr) 2020-05-27
WO2019018258A9 (fr) 2020-03-26
CN111328270B (zh) 2023-01-03
EP3654826A4 (fr) 2021-03-24
AU2018304105A1 (en) 2020-01-30
AU2018304105B2 (en) 2020-11-19
CN111328270A (zh) 2020-06-23

Similar Documents

Publication Publication Date Title
US11045088B2 (en) Through focus retinal image capturing
US10799115B2 (en) Through focus retinal image capturing
EP3669754B1 (fr) Évaluation d'images de fond
US11819272B2 (en) Retinal image capturing
EP3518734B1 (fr) Capture d'image rétinienne à mise au point directe
US11403756B2 (en) Fundus image capturing
US11779209B2 (en) Retinal image capturing
AU2018304105B2 (en) Through focus retinal image capturing

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18834961

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2018304105

Country of ref document: AU

Date of ref document: 20180716

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2018834961

Country of ref document: EP

Effective date: 20200217