WO2023001007A1 - 成像调整装置及方法、可穿戴设备、存储介质 - Google Patents
成像调整装置及方法、可穿戴设备、存储介质 Download PDFInfo
- Publication number
- WO2023001007A1 WO2023001007A1 PCT/CN2022/104878 CN2022104878W WO2023001007A1 WO 2023001007 A1 WO2023001007 A1 WO 2023001007A1 CN 2022104878 W CN2022104878 W CN 2022104878W WO 2023001007 A1 WO2023001007 A1 WO 2023001007A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- imaging
- user
- eyes
- adjustment
- photoelectric conversion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
- A61B3/028—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing visual acuity; for determination of refraction, e.g. phoropters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0176—Head mounted characterised by mechanical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
- G02B7/04—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Definitions
- Embodiments of the present disclosure relate to, but are not limited to, the field of smart wearable technology, and in particular, relate to an imaging adjustment device and method, a wearable device, and a storage medium.
- VR Virtual Reality, virtual reality
- AR Augmented Reality, augmented reality
- Various audio-visual entertainment equipment The fun is greatly improved.
- the birth of VR/AR eye protection device enables patients with pseudomyopia to use VR or AR equipment for entertainment while also performing myopia correction.
- the VR/AR eye protection device has brought good news to myopia patients, the basic version of the VR/AR eye protection device still has defects in the distance adjustment strategy, which makes the correction effect of the VR/AR eye protection device great. discount.
- an embodiment of the present disclosure provides an imaging adjustment device, which is applied to adjust the imaging surface of an imaging system composed of an optical system and a user's eyes, including: a light emitting device, a photoelectric conversion device, a control device, and a driving device;
- the light emitting device is configured to emit a first light so that the first light irradiates the user's eyes;
- the photoelectric conversion device is configured to perform photoelectric conversion based on the second light reflected by the user's eyes to generate an electrical signal, and provide the generated electrical signal to the control device;
- the control device is configured to judge the user's eye state based on the electrical signal, and control the driving device to work according to the user's eye state;
- the driving device is configured to adjust the position of the imaging plane of the imaging system under the control of the control device.
- the wavelength of the first light emitted by the light emitting device is within the spectral response range of the photoelectric conversion device.
- the light emitting device and the photoelectric conversion device are arranged on the side of the optical imaging system, so as to avoid blocking the optical path of the optical imaging system.
- the imaging adjustment device further includes a comparison device
- the photoelectric conversion device is configured to provide the generated electrical signal to the comparison device;
- the comparison device is configured to compare the electrical signal generated by the photoelectric conversion device with a preset electrical signal, generate a comparison result signal, and send the comparison result signal to the control device;
- the control device is configured to control the driving device to work according to the comparison result signal.
- the imaging adjustment device further includes a filtering device and a signal amplification device
- the filtering device is connected to the photoelectric conversion device and the signal amplification device, and is configured to filter the electrical signal generated by the photoelectric conversion device;
- the signal amplifying device is connected to the filtering device and the comparing device, and is configured to amplify the filtered signal and provide the amplified signal to the comparing device.
- the photoelectric conversion device includes a photosensitive triode and a signal conversion resistor
- the collector of the photosensitive transistor is connected to the signal conversion resistor, and the connection node between the photosensitive transistor and the signal conversion resistor is used as the output terminal of the photoelectric conversion device.
- the driving device includes an object distance adjusting motor
- the object distance adjusting motor is configured to adjust the position of the imaging lens in the optical system under the control of the control device.
- the imaging adjustment device further includes an eye state acquisition device
- the eye state acquiring device is configured to acquire eye state information
- the control device is configured to control the driving device to work based on the electrical signal and the eye state information.
- an embodiment of the present disclosure also provides a wearable device, including an optical system and the above-mentioned imaging adjustment device, where the imaging adjustment device is configured to adjust the imaging plane of the imaging system formed by the optical system and the user's eyes.
- the wearable device also includes a screen
- the display surface of the screen faces the optical system.
- the imaging adjusting device adjusts the imaging plane of the imaging system by adjusting the position of the imaging lens in the optical system.
- the optical system includes a first imaging lens and a second imaging lens
- the first imaging lens is arranged between the eye and the second imaging lens
- the second imaging lens is arranged between the first imaging lens and the screen;
- the imaging adjustment device is configured to adjust the position of the first imaging lens or the second imaging lens, thereby adjusting the position of the imaging plane of the imaging system formed by the optical system and the eye.
- an embodiment of the present disclosure also provides an imaging adjustment method, which is applied to the imaging adjustment device described in any one of the above embodiments, and the method includes:
- the second light is the light reflected by the user's eyes after the first light is irradiated on the user's eyes;
- the position of the imaging surface of the imaging system is adjusted according to the state of the user's eyes.
- the method also includes:
- the initial position of the imaging surface of the imaging system is set, and the initial position is matched with the user's initial vision.
- the user's eye state includes: the user's squinting state, the user's eye-opening state, and the user's visual acuity evaluation result.
- the method further includes: adjusting the position of the imaging surface according to a preset period according to the vision evaluation result.
- the setting the initial position of the imaging plane of the imaging system includes: when a trigger condition is met, setting the initial position of the imaging plane of the imaging system, wherein the trigger condition includes one of the following Kind or more:
- the use time is greater than or equal to the preset adjustment period
- the time interval from the last adjustment is greater than or equal to N times the preset adjustment period, N ⁇ 1;
- the determined eye state is a preset eye state.
- the optical system includes a first imaging lens and a second imaging lens; the imaging system further includes a screen, the first imaging lens is located between the screen and the user's eyes, and the second an imaging lens is located between the first imaging lens and the screen;
- the adjusting the distance between the imaging plane of the imaging system and the user's eyes includes:
- the adjusting the position of the imaging plane of the imaging system according to the state of the user's eyes includes: when a trigger condition is met, adjusting the position of the imaging plane of the imaging system according to the state of the user's eyes, wherein,
- the trigger conditions include one or more of the following:
- the use time is greater than or equal to the preset adjustment period
- the time interval from the last adjustment is greater than or equal to N times the preset adjustment period, N ⁇ 1;
- the determined eye state is a preset eye state.
- an embodiment of the present disclosure also provides a non-transitory computer-readable storage medium, the storage medium is configured to store computer program instructions, wherein, when the computer program instructions run, the computer program instructions can implement any of the above-mentioned image adjustment method.
- FIG. 1 is a schematic structural diagram of an adjustment device for an imaging plane provided by an embodiment of the present disclosure
- FIG. 2 is a schematic diagram of an application structure of an adjustment device for an imaging surface provided by an embodiment of the present disclosure
- Fig. 3 is a schematic structural diagram of a light emitting device provided by an embodiment of the present disclosure.
- Figures 4a-4c are structural schematic diagrams of light emitting devices and photoelectric conversion devices provided by embodiments of the present disclosure.
- FIG. 5 is a schematic structural diagram of an imaging adjustment device provided by an embodiment of the present disclosure.
- FIG. 6 is a schematic structural diagram of an imaging adjustment device provided by an embodiment of the present disclosure.
- FIG. 7 is a schematic diagram of an application structure of an imaging adjustment device provided by an embodiment of the present disclosure.
- FIG. 8 is a voltage timing diagram of a photoelectric conversion device received by a comparison device provided by an embodiment of the present disclosure
- FIG. 9 is a timing diagram of the output level of the comparison device to the control device provided by an embodiment of the present disclosure.
- FIG. 10 is a schematic structural diagram of an imaging adjustment device provided by an embodiment of the present disclosure.
- FIG. 11 is a schematic structural diagram of a wearable device provided by an embodiment of the present disclosure.
- FIG. 12 is a schematic structural diagram of a wearable device provided by an embodiment of the present disclosure.
- FIG. 13 is a schematic diagram of an application structure of a wearable device provided by an embodiment of the present disclosure.
- 15a-15c are schematic diagrams of another optical path adjustment provided by an embodiment of the present disclosure.
- 16a-16c are schematic diagrams of another optical path adjustment provided by an embodiment of the present disclosure.
- 17a-17c are schematic diagrams of another optical path adjustment provided by an embodiment of the present disclosure.
- FIG. 18 is a flowchart of an imaging adjustment method provided by an embodiment of the present disclosure.
- FIG. 19 is a schematic diagram of an application structure of a wearable device provided by an embodiment of the present disclosure.
- FIG. 20 is a flowchart of an imaging adjustment method provided by an embodiment of the present disclosure.
- FIG. 21 is a flowchart of another imaging adjustment method provided by an embodiment of the present disclosure.
- connection should be interpreted in a broad sense.
- it can be a fixed connection, or it can be a detachable connection, or an integral connection; it can be a mechanical connection, or it can be an electrical connection; it can be directly connected, or it can be indirectly connected through an intermediate piece, and it can be internal to the two components connected.
- the correction strategy of VR or AR eye protection devices is based on the adjustment distance correction strategy preset according to the patient's myopia condition on the one hand; on the other hand, it is based on the user's manual active adjustment.
- these two correction strategies ignore two facts.
- One is that the myopia of the patient changes dynamically, and the preset distance adjustment correction strategy will no longer be suitable for the patient's eyes after a period of time, and will instead cause damage to the patient's vision;
- an embodiment of the present disclosure provides an imaging adjustment device 10 , which is applied to adjust an imaging plane of an imaging system composed of an optical system and an eye of a user.
- the imaging adjustment device 10 includes: a light emitting device 101, a photoelectric conversion device 102, a control device 103, and a driving device 104;
- the light emitting device 101 is configured to emit a first light so that the first light irradiates the user's eyes;
- the photoelectric conversion device 102 is configured to perform photoelectric conversion based on the second light reflected by the user's eyes to generate an electrical signal, and provide the generated electrical signal to the control device 103;
- the control device 103 is configured to judge the state of the eye based on the electric signal, and control the operation of the driving device 104 according to the state of the user's eye;
- the driving device 104 is configured to adjust the position of the imaging surface of the imaging system under the control of the control device 103 .
- the imaging adjustment device can judge the state of the eye based on the electric signal generated by the photoelectric conversion of the second light reflected by the user's eye, and adjust the imaging surface of the imaging system composed of the optical system and the eye according to the state of the eye. ;
- the position of the imaging surface of the imaging system can be adjusted through the user's eye state such as squinting or opening the eyes, so that the user's vision can be monitored in time and automatically, so that the position of the imaging surface can be adjusted in time and automatically according to the monitoring results, and the user's usability can be improved. comfort.
- myopia will subconsciously squint to see objects clearly when their vision suddenly becomes blurred.
- squinting can reduce the area of external light entering the cornea, thereby causing a small hole to focus;
- the contraction of the orbicularis oculi muscle can make the eyes exert a certain pressure on the cornea, forcing the cornea to change the refractive plane, thereby , so that the angle of refraction of the light entering the eye changes, and it forms a focus when it reaches the retina.
- the vision when the vision is zoomed in, it will become blurred, and they will squint subconsciously.
- the user's eyesight can be monitored by monitoring the user's eyes open or squinted, or the user's comfort level can be monitored.
- the user squints it means that the current imaging surface position is not suitable and the user is uncomfortable.
- the eye is closed it means that the current imaging surface is in a suitable position, and relatively speaking, the user is more comfortable.
- the embodiment of the present disclosure detects the user's eye state of squinting or opening according to the magnitude of the electrical signal of the photoelectric conversion device.
- the imaging adjustment device provided by the embodiments of the present disclosure can be applied to glasses (such as nearsighted glasses, farsighted glasses, 3D glasses, etc.), vision correction equipment, head-mounted equipment (such as helmets, VR eye protection devices, AR eye protection devices, other VR Or AR equipment, etc.) and the imaging plane position adjustment of the imaging system composed of eyes, but not limited to these equipment and scenes.
- glasses such as nearsighted glasses, farsighted glasses, 3D glasses, etc.
- vision correction equipment such as nearsighted glasses, farsighted glasses, 3D glasses, etc.
- head-mounted equipment such as helmets, VR eye protection devices, AR eye protection devices, other VR Or AR equipment, etc.
- the imaging plane position adjustment of the imaging system composed of eyes but not limited to these equipment and scenes.
- the power of the glasses can be adjusted by adjusting the position of the imaging surface.
- the power of the original lenses is not suitable, there is no need to reconfigure the glasses, which greatly reduces the waste of lenses.
- the imaging surface adjustment device provided by the embodiment of the present disclosure is installed in the helmet, which can monitor and correct vision in real time without wearing glasses.
- the eye state includes an eye open state and a squinted eye state, or the eye state is a user vision evaluation result.
- the result of the user's visual acuity evaluation can be obtained by using the imaging adjustment device 10 to evaluate the user's visual acuity.
- the visual acuity evaluation result can be the user's visual acuity limit obtained according to the monitored user's eye state, which can be referred to later
- the imaging adjustment method will not be described in detail here.
- the imaging adjustment device uses the imaging adjustment device 10 to adjust the imaging plane of the imaging system composed of the optical system and the eye according to the state of the user's eyes, so that the imaging system composed of the eye and the optical system can be adjusted in a timely and automatic manner. Adjusting distance or focusing can improve user comfort. Embodiments of the present disclosure may be used to correct a user's vision.
- the position of the imaging surface of the imaging system composed of the optical system and the eyes can be adjusted in real time according to the state of the user's eyes open or squinted, so as to adapt to the power of the user's current eyes. It is equivalent to monitoring and/or correcting vision in real time.
- control device 103 in the imaging plane adjustment device 10 can set a preset time, and trigger the imaging adjustment device 10 to adjust the position of the imaging plane after the preset time is reached. Equivalent to regular vision monitoring and/or correction.
- the control device 103 in the imaging plane adjustment device 10 can set a preset time, and after the preset time is reached, the imaging adjustment device 10 is triggered to adjust the position of the imaging plane to obtain a visual acuity assessment As a result, the position of the imaging plane is adjusted according to the results of the visual acuity assessment. Equivalent to periodic vision evaluations and/or corrections.
- the driving device 104 adjusts the position of the imaging surface on the side of the optical system close to the eye under the control of the control device 103 , so that the adjusted position of the imaging surface falls on the retina of the eye as much as possible.
- the wavelength of the first light emitted by the light emitting device 101 is within the spectral response range of the photoelectric conversion device 102, so that the photoelectric conversion device 102 can perform photoelectric conversion based on the second light.
- the spectral range of the light-emitting device 101 and the photoelectric conversion device 102 should not fall into the spectral range of the light received by the eyes when observing things, and will not cause damage to the eyes.
- visible light can be avoided
- the spectral range of the infrared light is selected (the wavelength range is 760nm-1400nm), for example, the light emitting wavelength of the light emitting device 101 and the response wavelength of the photoelectric conversion device are both 850nm.
- the wavelength range is 760nm-1400nm
- the light-emitting device 101 selects an infrared light-emitting diode
- the corresponding photoelectric conversion device 102 selects a photosensitive diode or a photosensitive triode that senses infrared light
- the light-emitting device 101 selects an infrared light-emitting triode
- the corresponding photoelectric conversion device 102 selects an infrared light Photosensitive diode or photosensitive triode.
- the photoelectric conversion device 102 includes a phototransistor and a signal conversion resistor; the collector of the phototransistor is connected to the electrical signal conversion resistor R1, and the phototransistor and the signal conversion resistor R1
- the connection node serves as an output terminal of the photoelectric conversion device 102 .
- the function of the signal conversion resistor R1 is to convert the current signal generated by the photoelectric conversion of the photosensitive triode into a voltage signal.
- the light emitting device 101 can emit light under the control of the control device 103 .
- the photoelectric conversion device 102 can perform photoelectric conversion under the control of the control device 103 .
- Another feasible implementation is to set a first switch for controlling the photoelectric conversion device 102 to control the photoelectric conversion device 102 to perform photoelectric conversion, and set a second switch for controlling the light emitting device 101 to control the light emitting device 101 to emit light.
- the first switch and the second switch can be the same switch, and the photoelectric conversion device 102 and the light emitting device start to work at the same time after the switch is closed, or can be set separately.
- the light emitting device 101 and the photoelectric converter 102 are arranged on the side of the optical system 20 to avoid blocking the light path of the optical system 20 .
- FIG. 2 is a schematic diagram of an application of the imaging adjustment device 10 , including a structural diagram among the user's eyes, the optical system 20 , and the imaging adjustment device 10 .
- the light emitting device 101 and the photoelectric conversion device 102 can be arranged around the optical system 20, and the relative positions of the light emitting device 101 and the photoelectric conversion device 102 are not limited thereto, as long as they emit light
- the first light emitted by the device 101 can be irradiated to the user's eyes, and the second light reflected by the user's eyes can be irradiated to the photoelectric conversion device 102 .
- a plurality of light emitting devices 101 may be arranged in the peripheral area 201 of the optical system 20 , and the plurality of light emitting devices 101 may be arranged around the optical system 20 .
- FIG. 3 it is a schematic structural diagram of disposing a plurality of light emitting devices 101 in the peripheral area 201 of the optical system 20 .
- one photoelectric conversion device 102 may be provided, or multiple photoelectric conversion devices 102 may be provided.
- a plurality of photoelectric conversion devices 102 may be provided.
- a plurality of photoelectric conversion devices 102 may be arranged in the peripheral area 201 of the optical system 20 .
- the arrangement of the photoelectric conversion device 102 and the light emitting device 101 is not limited to the structure shown in FIG. 4a; as shown in FIG. 4b and FIG.
- the position of the photoelectric conversion device 102 and the arrangement of the light emitting device 101 are not limited, as long as the corresponding functions can be realized.
- the photoelectric conversion device 102 and the light emitting device 101 can be arranged in the peripheral area 201 of the optical system 20 as shown in FIGS. On other devices, as long as the corresponding functions can be realized.
- the photoelectric conversion device 102 and the light emitting device 101 can be arranged on the frame of the glasses, as long as the light path of the optical system 20 can be avoided and the corresponding functions can be realized at the same time. .
- the fixing method of the optical system 20 can be set in combination with the application scene and equipment. If it is applied to glasses, the optical system 20 can be fixed on the frame; Inside the wearable.
- the positions of the driving device 104 and the control device 103 in the embodiment of the present disclosure are not limited, as long as the corresponding functions can be realized without blocking the optical path transmission.
- the light emitting device 101 may be connected with the control device 103, and the control device may provide electric energy thereto, or other power supply equipment may provide electric energy thereto.
- the imaging adjustment device 10 further includes a comparison device 105;
- the photoelectric conversion device 101 is configured to provide the generated electrical signal to the comparison device 105;
- the comparison device 105 is configured to compare the electrical signal generated by the photoelectric conversion device 101 with a preset electrical signal, generate a comparison result signal, and send the comparison result signal to the control device 103;
- the control device 103 is configured to control the driving device 104 to work according to the comparison result signal.
- a signal enhancement device in order to enhance the intensity of the electrical signal output by the photoelectric conversion device 102 so that the comparison device 105 can accurately obtain the comparison result signal, a signal enhancement device may also be provided.
- the signal enhancing device may include a filtering device 106 and a signal amplifying device 107;
- the filtering device 106 is connected to the photoelectric conversion device 102 and the signal amplification device 107, and is configured to filter the electrical signal generated by the photoelectric conversion device 102;
- the signal amplifying device 107 is connected with the filtering device 106 and the comparing device 105 , and is configured to amplify the filtered signal and provide the amplified signal to the comparing device 105 .
- the comparing means 105, the filtering means 106 and the signal amplifying means 107 may adopt circuits capable of realizing corresponding functions in the related art.
- FIG. 7 it is another application schematic diagram of the imaging adjustment device 10 , which is another structural schematic diagram including the user's eyes, the optical system 20 , and the imaging adjustment device 10 .
- the electrical signal output by the photosensitive triode in the photoelectric conversion device 102 is filtered by the filter device 106 and amplified by the signal amplifier 107 in sequence, and then the comparison device 105 is used to compare the signals and output the comparison result signal to the control device 103 . For example, if the voltage signal output by the phototransistor in the photoelectric conversion device 102 is filtered and amplified, and the signal output to the comparison device 105 is higher than the preset electrical signal, the comparison result signal output by the comparison device 105 to the control device 103 is a high voltage.
- the voltage in Table 1 is the photovoltage generated by the photoelectric conversion device 102 through photoelectric conversion, which is filtered and amplified and then transmitted to the control comparison device.
- 680mV is the preset electrical signal set by the comparison device 105 (the preset electrical signal can be called is the threshold voltage), wherein the threshold voltage can be set according to the actual situation, and is not limited to 680mV.
- FIG. 9 shows the logic values corresponding to the comparison result signal sent by the comparison device 105 to the control device 103 at different time periods.
- the comparison device 105 determines that the user's eye state is squinting based on the comparison result signal with a logic value of 1; at t1-t2, t3-t4, During t5-t6, t7-t8, t9-t10 period, the voltage received by the input terminal of the comparison device 105 is lower than the threshold voltage, the comparison device 105 generates a comparison result signal with a logic value of 0, and sends the comparison result signal with a logic value of 0 For the control device 103, the control device 103 judges that the user's eye state is open eyes based on the comparison result
- the comparison device 105 may be a voltage comparator, and correspondingly, the signal obtained after the photoelectric conversion by the photoelectric conversion device 102 is a voltage signal.
- the comparison result signal is obtained by the comparison device 105 according to the threshold voltage and the received voltage, wherein the voltage signal obtained after the photoelectric conversion device 102 performs photoelectric conversion is filtered and amplified and then output to the comparison device
- the voltage input end of 105, what the reference end input of comparison device 105 is threshold voltage (preset electric signal is threshold voltage) compares the threshold voltage of reference end input with the voltage that input end receives, when the input of comparison device 105
- the comparison result signal is output to the control device 103 as logic value 1
- the comparison result signal is output to the control device 103.
- the resulting signal is logic value 0.
- the comparison device 105 is not limited to be a voltage comparator, or may be a current comparator, and the final comparison is a current value; correspondingly, the output of the photoelectric conversion device 102 to the comparison device 105 is a current signal.
- the imaging adjustment device may further include an eye state acquisition device;
- the eye state acquiring device is configured to acquire eye state information
- the control device 103 is configured to control the operation of the drive device 104 based on the electric signal and eye state information.
- the eye state information acquired by the eye state acquisition device includes eye open state information, squint state information, eye close state information, blink state information, and the like.
- the eye state acquisition device may be an eye state acquisition device in the related art, which will not be described in detail here.
- the function of the eye state obtaining device is to obtain the user's eye state information, and the control device 103 can assist in judging whether the user's eyes are open or squinted based on the eye state information.
- the eye state information provided by the eye state acquisition device is used to assist in judging the eye state, so as to prevent the control device 103 from misjudging the blink state as a squint state, thereby avoiding wrongly controlling the driving device 104 to perform related operations .
- the above-mentioned eye state acquisition device may be a camera device, and the user's eye state information is acquired through the camera device, and the control device 103 controls the driving device 104 to work based on the eye state information and electrical signals.
- the camera device can acquire the user's eye state information by taking pictures or recording videos.
- the above-mentioned imaging adjustment device 10 may be set on an eye-tracking device of the related art, so that the eye-tracking device has the functions of the above-mentioned imaging adjustment device 10 .
- a preset voltage can be set, and the second light reflected by the light-emitting device 101 when the eyes are closed passes through the photoelectric conversion device 102
- the converted electrical signal is higher than the preset voltage, it is determined that the eyes are closed, not squinting. Or it can be judged whether the eyes are squinted or closed by combining with the eye state acquisition device.
- the state of the eye can be determined according to the electrical signal and the duration or times of receiving the electrical signal. For example, when it is determined that the duration of the squinting state is maintained for more than a preset duration or a preset number of times, it is determined that the eye state is a squinting state, not a blinking state.
- the driving device 104 includes an object distance adjustment motor configured to adjust the position of the imaging lens in the optical system under the control of the control device 103 .
- the object distance adjustment motor can be configured to adjust the position of the imaging lens L2 in the optical system 20 .
- the object distance adjusting motor may be configured to adjust the position of the optical lens L1 , which is not limited here.
- Embodiments of the present disclosure also provide a wearable device, including an optical system and the imaging adjustment device 10 described in any one of the above embodiments.
- the imaging adjustment device 10 is configured to adjust the imaging surface of the imaging system composed of the optical system and the user's eyes.
- FIG. 11 it is a block diagram of an exemplary module composition of a wearable device.
- the optical system 20 is connected to the driving device 104 in the imaging surface adjustment device 10 , and can adjust the position of the imaging surface under the driving of the driving device 104 .
- the wearable device may be a VR or AR device (including a VR or AR eye protection device), a helmet, glasses, and the like.
- the wearable device can be set as a closed structure, so that the light-emitting device can reflect multiple times in the closed space, so that the photoelectric conversion device 102 in the imaging adjustment device 10 can receive more second light, so that Increases the electrical signal generated by photoelectric conversion.
- the wearable device provided by the embodiment of the present disclosure can adjust the imaging surface of the imaging system composed of the optical system and the eye according to the state of the user's eyes through the imaging adjustment device 10, so that the imaging surface of the imaging system composed of the eye and the optical system can be adjusted in time and automatically. Adjusting distance or focusing can improve user comfort. Embodiments of the present disclosure may be used to correct a user's vision.
- the position of the imaging surface of the imaging system composed of the optical system and the eyes can be adjusted in real time according to the state of the user's eyes open or squinted, so as to adapt to the power of the user's current eyes. It is equivalent to monitoring and/or correcting vision in real time.
- control device 103 in the imaging plane adjustment device 10 can set a preset time, and trigger the imaging adjustment device 10 to adjust the position of the imaging plane after the preset time is reached. Equivalent to regular vision monitoring and/or correction.
- the control device 103 in the imaging plane adjustment device 10 can set a preset time, and after the preset time is reached, the imaging adjustment device 10 is triggered to adjust the position of the imaging plane to obtain a visual acuity assessment As a result, the position of the imaging plane is adjusted according to the result of the visual acuity assessment. Equivalent to periodic vision evaluations and/or corrections.
- the wearable device may further include a screen 21 ; the display surface of the screen 21 faces the optical system 20 .
- the screen 21 is arranged on the side of the optical system 20 away from the eyes of the wearer of the wearable device.
- FIG. 13 which is a schematic diagram of an application scenario of a wearable device
- the picture displayed on the screen 21 enters the eyes of the wearer of the wearable device through the optical system 20 .
- the fixing method of the screen 21 can be set according to actual application scenarios, as long as its functions can be realized, and there is no limitation here.
- the imaging adjustment device 10 adjusts the position of the imaging plane on the eye side of the imaging system composed of the eye and the optical system 20 by adjusting the position of the imaging lens in the optical system 20 .
- Figure 14a, Figure 14b, and Figure 14c are a schematic diagram of imaging adjustment (that is, the position adjustment of the imaging surface).
- the optical system 20 includes an imaging lens L1, 30 represents the eyeball, 31 represents the retina, and 32 represents the lens.
- the intersection point after the light converges through the lens L1 and the lens 32 falls in front of the retina 31; in Figs. The last intersection point falls on the retina 31.
- the dotted line part in Fig. 14b is the position of lens L1 in Fig. 14a and the light propagation path.
- Fig. 14c is after removing the lens and light propagation path of the dotted line part in Fig. 14b Schematic diagram of the light path.
- the position of the imaging lens (such as the imaging lens L1) in the optical system 20
- the position of the imaging surface of the imaging system formed by the object through the optical system 20 and the eye can be adjusted on the side close to the eye. It is possible to make the position of the image plane fall on the retina of the eye.
- the optical system 20 can include two imaging lenses L1 and L2, and the distance M between the imaging lens L2 or L1 and the screen 21 can be adjusted to adjust the distance between the optical system 20 and the eye.
- Fig. 15a-Fig. 15c are schematic diagrams showing that the position of imaging lens L1 remains unchanged and only the position of imaging lens L2 is adjusted.
- the driving device 104 in the imaging adjustment device 10 adjusts the distance between the imaging lens L2 and the screen 21 under the control of the control device 103 The distance between them is used to adjust the position of the imaging surface of the imaging system.
- Figure 15b is a schematic diagram of optical path transmission after the distance between the imaging lens L2 and the screen 21 in Figure 15a is adjusted from M1 to M2, and the dotted line in Figure 15b corresponds to Figure 15a
- FIG. 15c is a schematic diagram of the light path with the dotted line in FIG. 15b removed.
- the driving device 104 can either adjust the position of the imaging lens L1, or the driving device 104 can simultaneously adjust the positions of the imaging lenses L1 and L2.
- the setting method is not limited here, as long as the intended function can be realized.
- the number of imaging lenses in the optical system 20 is not limited to one or two as shown in FIG. 14-FIG. 15 , and multiple imaging lenses can be set according to actual needs.
- the imaging lens in the optical system 20 is not limited to being a convex lens, and a concave lens (as shown in FIGS. It is limited, as long as the corresponding functions can be realized.
- the position of one or more lenses can be adjusted according to actual needs, which is not limited here.
- the optical system includes a first imaging lens and a second imaging lens
- the first imaging lens is arranged between the eye and the second imaging lens
- the second imaging lens is arranged between the first imaging lens and the screen 21;
- the imaging adjustment device 10 is configured to adjust the position of the first imaging lens or the second imaging lens, thereby adjusting the position of the imaging plane of the imaging system composed of the optical system and the eye.
- the first imaging lens is L1
- the second imaging lens is L2
- the imaging adjustment device 10 adjusts the position of the imaging plane of the imaging system by adjusting the position of the second imaging lens L2.
- An embodiment of the present disclosure also provides an imaging adjustment method, which is applied to adjust the imaging plane of the imaging system composed of the optical system and the user's eyes, as shown in FIG. 18 , including:
- Step S1 emitting the first light so that the first light hits the user's eyes
- Step S2 judging the state of the user's eyes based on the electrical signal generated after the photoelectric conversion of the second light, which is the light reflected by the user's eyes after the first light irradiates the user's eyes;
- Step S3 adjusting the position of the imaging plane of the imaging system according to the state of the user's eyes.
- the imaging adjustment method provided by the embodiment of the present disclosure can be applied to the above imaging adjustment device, or can be applied to the above-mentioned wearable device.
- the imaging adjustment method provided by the embodiments of the present disclosure can judge the state of the eye based on the electrical signal generated by the photoelectric conversion of the second light reflected by the user’s eye, and adjust the imaging surface of the imaging system composed of the optical system and the eye according to the state of the eye ;According to the user's eye state, the user's vision can be monitored in real time, and the position of the imaging surface of the system can be adjusted by squinting or opening the eye state, which can automatically adjust the distance or focus in real time, bringing users a better experience .
- the state of the user's eyes is judged based on the electrical signal, and the position of the imaging surface of the imaging system is adjusted according to the state of the user's eye. Adjust the position of one or more imaging lenses in the optical system according to the internal state, thereby adjusting the position of the imaging surface of the imaging system.
- adjusting the position of the imaging plane of the imaging system according to the state of the user's eyes includes: when a trigger condition is met, adjusting the position of the imaging plane of the imaging system according to the state of the user's eyes, wherein the trigger condition includes one of the following or Various:
- the use time is greater than or equal to the preset adjustment period
- the time interval from the last adjustment is greater than or equal to N times the preset adjustment period, N ⁇ 1;
- the determined eye state is a preset eye state.
- the preset eye state is a squinting state.
- the state of the user's eyes includes: the state of the user's eyes squinting, the state of the user's eyes opening, and the result of the user's vision evaluation.
- the method further includes: adjusting the position of the imaging surface according to a preset cycle according to the vision evaluation result.
- a vision evaluation result can be obtained, and the correction strategy can be adjusted according to the vision evaluation result, and the vision correction can be performed automatically and in real time according to the adjusted correction strategy.
- the vision correction can be performed automatically and in real time according to the adjusted correction strategy.
- the position of the imaging surface is adjusted according to a preset cycle according to the vision evaluation result, which can avoid eye fatigue of the user and improve comfort.
- the preset period is 30 minutes or 10 minutes
- the position of the imaging plane can be adjusted by adjusting the position of the imaging lens in the imaging system.
- the imaging adjustment method further includes:
- setting the initial position of the imaging plane of the imaging system is equivalent to initializing the position of the imaging plane.
- An optional manner is to adjust the position of one or more imaging lenses in the optical lens to an initial position, and the initial position of the imaging lens may match the position of the user's initial vision lens.
- setting the initial position of the imaging plane of the imaging system includes: when a trigger condition is met, setting the initial position of the imaging plane of the imaging system, wherein the trigger condition includes one or more of the following:
- the use time is greater than or equal to the preset adjustment period
- the time interval from the last adjustment is greater than or equal to N times the preset adjustment period, N ⁇ 1;
- the determined eye state is a preset eye state.
- the preset eye state is a squinting state.
- the user's visual acuity limit or visual acuity evaluation result may be acquired according to the monitored position of the imaging lens corresponding to the preset eye state.
- the optical system includes a first imaging lens and a second imaging lens; the imaging system further includes a screen, the first imaging lens is located between the screen and the user's eyes, and the second imaging lens is located between the first imaging lens and the user's eyes. between screens;
- Adjusting the distance between the imaging surface of the imaging system and the user's eyes includes: adjusting the distance between the second imaging lens and the screen.
- adjusting the distance between the second imaging lens and the screen may be moving the second imaging lens by a preset diopter to adjust the distance between the second imaging lens and the screen.
- the preset diopter can be myopia diopter or hyperopia diopter. Take the myopia diopter as an example for illustration. If the preset diopter is 0.01D (diopter is the unit for measuring the refractive power of the lens, the English full name is Dioptre, abbreviated as D) , that is, the degree of adjustment for one move is 0.01D.
- the distance between the second imaging lens and the screen is referred to as the object distance for short, as shown in Table 2, which shows the adjustment relationship between the myopia diopter and the object distance:
- the corresponding myopia diopter is 0.2D, that is, Table 2 can be understood as the corresponding relationship between the myopia diopter and the object distance.
- the object distance can be converted into the corresponding diopter value, or the diopter can be converted into the corresponding object distance.
- the screen distance can be adjusted according to the relationship between the screen distance, the object distance M, and the myopia diopter.
- the adjustment relationship between the object distance M, the screen distance, and the myopia diopter is shown in Table 3.
- the object distance and the screen distance can be adjusted according to the adjustment relationship between the object distance M, screen distance, and myopia diopter in Table 3, such as adjusting the screen distance and object distance in a VR or AR eye protection device M.
- the screen can be zoomed out or zoomed in timely and strategically, and the user's vision limit can be tested according to whether the squinting action is detected, so as to judge the user's vision improvement. , and then adjust the distance correction strategy in real time.
- Table 2 and Table 3 correspond to the adjustment relationship of the imaging system in Fig. 15a-Fig. 15c.
- infrared light-emitting devices are used to irradiate the human eyes, and then photoelectric conversion devices are used to sense the changes in reflection, through the imaging adjustment device, or on the basis of the imaging adjustment device
- Photoelectric conversion devices are used to sense the changes in reflection, through the imaging adjustment device, or on the basis of the imaging adjustment device
- Build a sensor-based eye tracking circuit or build an imaging adjustment device based on an eye tracking device of related technologies, or build an eye state acquisition device on the basis of an imaging adjustment device, which can effectively identify squinting or opening eyes action.
- the corresponding feedback framework including vision assessment program and distance adjustment strategy program
- the feedback framework is shown in Figure 19.
- a timing register is assigned to store timing information in the control device that executes the above method, and a visual acuity evaluation program and a distance adjustment strategy adjustment program are configured in the control device.
- the imaging adjustment method is shown in FIG. 20 . display, including:
- Step S11 triggering the vision assessment program
- step S11 when the status stored in the timing register indicates that the timer has arrived, the visual acuity evaluation program is triggered. If the user's use time is greater than or equal to the preset adjustment period to trigger the vision assessment program, or the time interval from the last adjustment is greater than or equal to N times the preset adjustment period (N ⁇ 1), the vision assessment program can be triggered.
- the eyesight evaluation program may be triggered when it is determined that the eye state is a squint state based on the electrical signal.
- Determining the state of the eye based on the electrical signal may be based on the electrical signal and the duration or number of times the electrical signal is received continuously. For example, if the relationship between the received electrical signal and the state of the eye is set such that when the electrical signal is at a high level, the corresponding eye state is a squinting state, then when the received electrical signal is at a high level and the high level is continuously received When the number of times exceeds the preset number of times or exceeds the preset duration, it is determined that the eye state is a squint state.
- the preset adjustment cycle can be set according to actual needs, and is not limited here.
- the preset adjustment period is 2 days, 2 months or 2 hours.
- the imaging adjustment method may further include clearing the timer and entering the next period of timing.
- the timer can be reset to zero and enter the next period of timing.
- Step S12 Set the initial position of the imaging surface of the imaging system.
- Step S12 includes: the eyesight evaluation program adjusts the object distance to match the user's initial eyesight.
- the distance at which the user's initial vision is matched may be the distance of the object distance at the normal vision level, or may be the object distance initially set for a certain user, or the object distance after the user's last correction.
- the relationship between the myopia diopter and the object distance can be referred to in Table 2 above.
- the initial visual acuity is 1D
- the matching distance is 4.0mm
- the current visual acuity is 2D
- the matching distance is 4.8mm.
- the movement is not limited to the unit of 0.01D, or the driving device can be directly controlled to move to the distance matching the initial vision at one time.
- Step S13 Control the driving device to adjust the imaging lens in the imaging system according to the monitored eye state of the user to adjust the position of the imaging surface of the imaging system.
- Step S13 includes: the visual acuity assessment program receives the electric signal, judges the state of the eye according to the electric signal, and adjusts the position of the imaging surface of the imaging system according to the state of the eye.
- Adjusting and adjusting the position of the imaging surface of the imaging system according to the eye state includes: the visual acuity assessment program controls the driving device to adjust the object distance in units of preset myopia diopters according to the monitored eye state of the user.
- step S13 the visual acuity assessment program detects the logical value received by the control device from the comparison device. If the logical value is 1, it is judged as squinting, and if the logical value is 0, it is judged as open eyes.
- the monitoring of eye opening or squinting is carried out by the light emitter, photoelectric conversion device, comparison device, and control device described in the above embodiments. Refer to the description of the above embodiments, and details will not be repeated here.
- the preset myopia diopter may be, but not limited to, 0.01D.
- the optical relationship between the myopia diopter and the object distance refer to the above description, which will not be repeated here.
- the imaging system shown in 15a-15c is taken as an example for illustration.
- the driving device is continuously controlled to use the preset myopia diopter.
- the second imaging lens L2 is moved in units of 1; when it is detected that the user squints, it is determined that the upper limit of the user's eyes has been reached, and the driving device is controlled to stop moving the second imaging lens L2.
- the vision evaluation program controls the driving device to adjust the position of the imaging lens L2 so that the object distance M gradually decreases.
- the value of the distance M is M1 (as shown in FIG. 15 a )
- the movement of the second imaging lens L2 is stopped.
- the visual acuity after initialization is 3D
- the corresponding object distance M is 5.6 mm (M2 in Fig. 15 )
- the control drive device will reduce the object distance M in units of myopia diopter 0.01D
- the driving device is controlled to stop moving the second imaging lens L2. For example, when the user's squinting is detected, the number of movements is 200 times, then the corresponding diopter at this time is 1D, and the corresponding object distance is M. 4.0mm (M1 in Figure 15).
- the method further includes: sending the number of times of movement to the distance adjustment strategy adjustment program.
- the number of movements recorded by the visual assessment program is the upper limit of the user's eye use.
- the initial object distance is 5.6mm, and the corresponding diopter is 3D; after 200 movements, the upper limit of eye use is detected, which can be understood as the user's
- the corresponding object distance is 4mm, and the corresponding diopter is 1D.
- the method further includes: the distance adjustment strategy adjustment program performs strategy adjustment according to the number of movements from the vision evaluation program.
- the above-mentioned performing strategy adjustment according to the adjusted position of the imaging surface includes: the distance adjustment strategy adjustment program executes the strategy adjustment according to the movement times from the vision evaluation program.
- the distance adjustment program executes the strategy adjustment according to the adjustment relationship of the object distance M, the screen distance, the myopia diopter, the initial object distance and the number of movements in Table 3 above. For example, when the number of movements is 200, the distance adjustment program determines that the myopia diopter corresponding to the user's visual acuity evaluation result is 1D according to the initial vision of 3D and the number of movements of 200, and then adjusts the strategy according to the myopia diopter of 1D. Adjust the strategy according to the myopia diopter corresponding to the user's visual acuity evaluation result, and adjust the object distance according to the preset cycle (that is, adjust the position of the imaging surface according to the preset cycle).
- the adjustment strategy corresponding to the myopia diopter 1D is: the preset cycle is 30 minutes, 10 minutes by adjusting the object distance to adjust the screen distance to 800mm, the next ten minutes by adjusting the object distance to adjust the plane screen distance to 400mm, and then the next ten minutes to adjust the screen distance to 600mm, the second At the beginning of the first cycle, adjust the screen distance to 800mm, and reciprocate in turn.
- the distance adjustment strategy adjustment program in the embodiment of the present disclosure is embedded in the original object distance adjustment program in the form of a sub-function, and the distance adjustment function in the main function is biased according to the number of movements returned by the vision evaluation program. displacement.
- Step S11-Step S13 shown in Figure 20 can be understood as performing vision assessment based on the monitored squint or eye-opening state, and finally obtain a user vision assessment result, and then the adjustment distance adjustment program performs strategic adjustment based on the vision assessment result , and perform real-time and automatic vision correction according to the adjusted correction strategy. Since the timing register and the visual acuity evaluation device are all set in the control device, the main body performing steps S11-S13 can be understood as being executed by the control device.
- the adjusted correction strategy may include: adjusting the position of the imaging plane according to a preset period according to the vision evaluation result, and adjusting the position of the imaging plane according to a preset distance within the preset period.
- the preset period is 30 minutes or 10 minutes
- the position of the imaging surface can be adjusted by adjusting the position of the imaging lens in the imaging system. If it is a VA or AR eye protection device, adjusting the position of the imaging lens also adjusts the screen distance. For example, by adjusting the position of the imaging lens, the preset cycle is 30 minutes, and the screen distance in one cycle is 10 minutes and 300 meters, 800 meters in 10 minutes, 600 meters in 10 minutes.
- the vision evaluation program when the distance adjustment program executes strategy adjustment according to the vision evaluation result, and corrects according to the adjusted correction strategy, when the user's eye state is detected as squinting, the vision evaluation program can be triggered Carry out visual acuity assessment, and after the new visual acuity assessment result is obtained by the visual acuity assessment program, the adjustment program adjusts the vision correction according to the strategy corresponding to the new visual acuity assessment result.
- the distance adjustment procedure and the vision assessment results obtained from the vision assessment procedure all have corresponding adjustment strategies, and the correction adjustment strategy can be set according to the actual situation, which is not limited here.
- the imaging plane adjustment method of the present disclosure can be applied to real-time monitoring of the user's eyesight, as shown in FIG. 21 , including:
- Step S21 triggering the adjustment of the imaging plane when it is detected that the user squints.
- Step S21 may include controlling the driving device to drive the imaging lens in the optical system to adjust the optical path when the control device receives that the level of the comparison device is a high level, or the received electrical signal is higher than the first preset electrical signal.
- the first preset electrical signal is 680mV.
- Adjust the optical path as above to adjust the relationship between the object distance between the imaging lens and the screen and the diopter of myopia, such as moving the imaging lens in the optical system in units of 0.01D.
- step S21 When the imaging lens is driven to adjust the optical path (that is, the position of the imaging plane of the imaging system is adjusted) in step S21, the number of times the imaging lens is moved is also recorded.
- Step S22 Stop adjusting the imaging plane when it is detected that the user's eyes are open.
- Step S22 may include: the control device controls the driving device to stop driving the imaging lens in the optical system when the control device receives that the level of the comparison device is a low level, or the received electrical signal is lower than the second preset electrical signal.
- the myopia diopter before triggering the imaging plane adjustment is 1D
- the corresponding object distance is 4.0mm
- the adjustment is stopped after moving 100 times.
- the myopia diopter after adjustment is 2D
- the corresponding object distance is 4.8mm.
- the correction can be performed according to the correction strategy corresponding to the diopter of the eye corresponding to the stop of the adjustment of the imaging plane.
- performing vision correction according to the correction strategy corresponding to the myopia diopter 2D may include adjusting the screen image distance according to a period corresponding to the myopia diopter 2D.
- the screen distance may correspond to the myopia diopter and the object distance, and the corresponding relationship is shown in Table 3.
- the corrective strategy is implemented to better protect the eyes on the basis of comfortable use
- the screen distance can be set according to the preset cycle.
- the preset cycle is 40 minutes, and the screen distance in 10 minutes is 500mm, the screen distance for the next 10 minutes is 1000mm, the screen distance for the next 10 minutes is 1500mm, and the screen distance for the next 10 minutes is 1000mm respectively.
- An embodiment of the present disclosure also provides a non-transitory computer-readable storage medium, the storage medium is configured to store computer program instructions, wherein the imaging adjustment method described in any one of the above can be implemented when the computer program instructions run.
- An imaging adjustment device and method, a wearable device, and a storage medium provided by the embodiments of the present disclosure generate electrical signals through photoelectric conversion based on the second light reflected by the user's eyes, judge the state of the eyes according to the electrical signals, and judge the state of the eyes according to the state of the eyes.
- the position of the imaging surface of the optical system can be adjusted through the user's squinting and eye opening behaviors, so that the user's vision can be monitored and corrected in time and automatically, so that According to the monitoring results, the imaging position is adjusted automatically and in time to improve user comfort.
- the functional modules/units in the system, and the device can be implemented as software, firmware, hardware, and an appropriate combination thereof.
- the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical components. Components cooperate to execute.
- Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit.
- Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media).
- computer storage media includes both volatile and nonvolatile media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. permanent, removable and non-removable media.
- Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, tape, magnetic disk storage or other magnetic storage devices, or can Any other medium used to store desired information and which can be accessed by a computer.
- communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Biophysics (AREA)
- Ophthalmology & Optometry (AREA)
- General Engineering & Computer Science (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Theoretical Computer Science (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Human Computer Interaction (AREA)
- Eye Examination Apparatus (AREA)
Abstract
Description
| 眼部状态 | 电压(mV) | 比较结果信号 |
| 睁眼状态 | <680mV | 0 |
| 眯眼状态 | ≥680mV | 1 |
| 物距M/mm | 近视屈光度 |
| 3.4 | 0.2D |
| 3.5 | 0.3D |
| 3.7 | 0.7D |
| 4.0 | 1D |
| 4.8 | 2D |
| 5.6 | 3D |
| 6.3 | 4D |
| 10.1 | 10D |
| 物距M/mm | 屏幕画面距离/mm | 近视屈光度 |
| 3.4 | 5000 | 0.2D |
| 3.5 | 3000 | 0.3D |
| 3.7 | 1500 | 0.7D |
| 4.0 | 1000 | 1D |
| 4.8 | 500 | 2D |
| 5.6 | 330 | 3D |
| 6.3 | 250 | 4D |
| 10.1 | 100 | 10D |
Claims (15)
- 一种成像调整装置,应用于调整由光学系统与用户眼睛构成的成像系统的成像面,包括:发光器件、光电转换器件、控制装置、驱动装置;所述发光器件,设置为发射第一光线,使所述第一光线照射到用户眼部;所述光电转换器件,设置为基于用户眼部反射的第二光线进行光电转换生成电信号,并将生成的电信号提供给所述控制装置;所述控制装置,设置为基于所述电信号判断用户眼部状态,根据用户眼部状态控制所述驱动装置工作;所述驱动装置,设置为在所述控制装置的控制下调整所述成像系统成像面的位置。
- 根据权利要求1所述的成像调整装置,还包括比较装置;所述光电转换器件,设置为将生成的所述电信号提供给所述比较装置;所述比较装置,设置为将所述光电转换器件生成的所述电信号与预设的电信号比较,生成比较结果信号,将所述比较结果信号发送给所述控制装置;所述控制装置,是设置为根据所述比较结果信号控制所述驱动装置工作。
- 根据权利要求2所述的成像调整装置,还包括滤波装置和信号放大装置;所述滤波装置,与所述光电转换器件和所述信号放大装置连接,设置为对所述光电转换器件生成的所述电信号进行滤波;所述信号放大装置,与所述滤波装置连接和所述比较装置连接,设置为对滤波后的信号进行信号放大后,将放大后的信号提供给所述比较装置。
- 根据权利要求1-3任意一项所述的成像调整装置,其中,所述光电转换器件包括光敏三级管和信号转换电阻;所述光敏三极管的集电极连接至所述信号转换电阻,所述光敏三级管与所述信号转换电阻的连接节点作为所述光电转换器件的输出端。
- 根据权利要求1所述的成像调整装置,其中,所述驱动装置包括物距调节电机;所述物距调节电机,设置为在所述控制装置的控制下调整所述光学系统中成像透镜的位置。
- 一种可穿戴设备,包括光学系统以及如权利要求1-5任意一项所述的成像调整装置,所述成像调整装置设置为调整由光学系统与用户眼睛构成的成像系统的成像面。
- 根据权利要求6所述的可穿戴设备,还包括屏幕;所述屏幕的显示面朝向所述光学系统。
- 根据权利要求7所述的可穿戴设备,其中,所述光学系统包括第一成像透镜、第二成像透镜;所述第一成像透镜,设置于眼部与所述第二成像透镜之间;所述第二成像透镜,设置于所述第一成像透镜与所述屏幕之间;所述成像调整装置,设置为调整所述第一成像透镜或所述第二成像透镜的位置,从而调整由所述光学系统和眼睛构成的成像系统成像面的位置。
- 一种成像调整方法,应用于如权利要求1-5任一项所述的成像调整装置,包括:发射第一光线,使所述第一光线照射到用户眼部;基于对第二光线光电转换后生成的电信号判断用户眼部状态,所述第二光线为第一光线照射到用户眼部后,用户眼部反射的光线;根据用户眼部状态调整所述成像系统成像面的位置。
- 根据权利要求9所述的成像调整方法,还包括:设置所述成像系统成像面的初始位置,所述初始位置为与用户初始视力相匹配的位置。
- 根据权利要求9所述的成像调整方法,其中,所述用户眼部状态包括:用户眯眼状态、用户睁眼状态、用户视力评估结果。
- 根据权利要求11所述的成像调整方法,根据用户眼部状态调整所述成像系统成像面的位置之后,还包括:根据所述视力评估结果按照预设周期调整成像面的位置。
- 根据权利要求10所述的成像调整方法,其中,所述设置所述成像系统成像面的初始位置,包括:在满足触发条件时,设置所述成像系统成像面的初始位置,其中,所述触发条件包括以下其中一种或多种:使用时长大于或等于预设的调整周期;距离上一次调整的时间间隔大于或等于预设的调整周期的N倍,N≥1;所判定的眼部状态为预设的眼部状态。
- 根据权利要求10所述的成像调整方法,其中,所述光学系统包括第一成像透镜、第二成像透镜;所述成像系统还包括屏幕,所述第一成像透镜位于所屏幕与用户眼睛之间,所述第二成像透镜位于所述第一成像透镜与所述屏幕之间;所述调整所述成像系统成像面与用户眼部之间的距离,包括:调整所述第二成像透镜与所述屏幕之间的距离。
- 一种非瞬态计算机可读存储介质,所述存储介质设置为存储计算机程序指令,其中,所述计算机程序指令运行时可实现权利要求9-14中任意一项所述的成像调整方法。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US18/276,653 US20240118539A1 (en) | 2021-07-23 | 2022-07-11 | Imaging adjustment apparatus and method, wearable device and storage medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110836879.3A CN115670368A (zh) | 2021-07-23 | 2021-07-23 | 一种成像调整装置及方法、可穿戴设备、存储介质 |
| CN202110836879.3 | 2021-07-23 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023001007A1 true WO2023001007A1 (zh) | 2023-01-26 |
Family
ID=84978865
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/104878 Ceased WO2023001007A1 (zh) | 2021-07-23 | 2022-07-11 | 成像调整装置及方法、可穿戴设备、存储介质 |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20240118539A1 (zh) |
| CN (1) | CN115670368A (zh) |
| WO (1) | WO2023001007A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116980728B (zh) * | 2023-07-28 | 2025-03-11 | 襄阳达安汽车检测中心有限公司 | 仿生机器人图像识别设备 |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS63217880A (ja) * | 1987-03-06 | 1988-09-09 | Fuji Photo Optical Co Ltd | オ−トフオ−カス装置 |
| US5739797A (en) * | 1994-06-23 | 1998-04-14 | Seiko Epson Corporation | Head-mounted virtual image display device having switching means enabling user to select eye to view image |
| CN101133942A (zh) * | 2006-08-31 | 2008-03-05 | 株式会社多美 | 角膜成像设备 |
| CN102885607A (zh) * | 2011-07-21 | 2013-01-23 | 上海美沃精密仪器有限公司 | 一种眼部成像的系统和方法 |
| CN103767672A (zh) * | 2012-10-18 | 2014-05-07 | 佳能株式会社 | 眼科装置及眼科装置的控制方法 |
| CN105006105A (zh) * | 2015-08-04 | 2015-10-28 | 三峡大学 | 一种基于红外探测的眼睛状态识别装置及方法 |
| CN105378598A (zh) * | 2013-07-19 | 2016-03-02 | 索尼公司 | 检测装置和方法 |
| CN109256042A (zh) * | 2018-11-22 | 2019-01-22 | 京东方科技集团股份有限公司 | 显示面板、电子设备及人眼追踪方法 |
| CN110352033A (zh) * | 2017-02-27 | 2019-10-18 | 托比股份公司 | 用眼睛追踪装置确定眼睛睁开度 |
| CN111670001A (zh) * | 2018-01-31 | 2020-09-15 | 索尼互动娱乐股份有限公司 | 用于眼睛跟踪系统的图像调整 |
| CN111754728A (zh) * | 2019-03-29 | 2020-10-09 | 京东方科技集团股份有限公司 | 检测组件、检测装置、疲劳驾驶的检测方法 |
| CN112558751A (zh) * | 2019-09-25 | 2021-03-26 | 武汉市天蝎科技有限公司 | 一种智能眼镜基于mems和光波导镜片的视线追踪方法 |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07244253A (ja) * | 1994-03-07 | 1995-09-19 | Olympus Optical Co Ltd | 頭部装着型映像表示装置 |
| US8446341B2 (en) * | 2007-03-07 | 2013-05-21 | University Of Washington | Contact lens with integrated light-emitting component |
| US8629815B2 (en) * | 2011-08-09 | 2014-01-14 | Google Inc. | Laser alignment of binocular head mounted display |
| US9087471B2 (en) * | 2011-11-04 | 2015-07-21 | Google Inc. | Adaptive brightness control of head mounted display |
| US9171198B1 (en) * | 2012-04-02 | 2015-10-27 | Google Inc. | Image capture technique |
| US9223136B1 (en) * | 2013-02-04 | 2015-12-29 | Google Inc. | Preparation of image capture device in response to pre-image-capture signal |
| KR101894155B1 (ko) * | 2016-12-09 | 2018-08-31 | 건양대학교산학협력단 | 자가조절 안경 시스템 |
| CN107656371A (zh) * | 2017-10-16 | 2018-02-02 | 苏州耐德佳天成光电科技有限公司 | 具有视度调节功能的光学系统 |
| JP7302342B2 (ja) * | 2018-07-02 | 2023-07-04 | 株式会社ニデック | 眼底撮影装置 |
| CN110095870B (zh) * | 2019-05-28 | 2022-04-19 | 京东方科技集团股份有限公司 | 光学显示系统、显示控制装置和增强现实设备 |
| CN110727111A (zh) * | 2019-10-23 | 2020-01-24 | 深圳惠牛科技有限公司 | 一种头戴显示光学系统及头戴显示设备 |
-
2021
- 2021-07-23 CN CN202110836879.3A patent/CN115670368A/zh active Pending
-
2022
- 2022-07-11 US US18/276,653 patent/US20240118539A1/en active Pending
- 2022-07-11 WO PCT/CN2022/104878 patent/WO2023001007A1/zh not_active Ceased
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS63217880A (ja) * | 1987-03-06 | 1988-09-09 | Fuji Photo Optical Co Ltd | オ−トフオ−カス装置 |
| US5739797A (en) * | 1994-06-23 | 1998-04-14 | Seiko Epson Corporation | Head-mounted virtual image display device having switching means enabling user to select eye to view image |
| CN101133942A (zh) * | 2006-08-31 | 2008-03-05 | 株式会社多美 | 角膜成像设备 |
| CN102885607A (zh) * | 2011-07-21 | 2013-01-23 | 上海美沃精密仪器有限公司 | 一种眼部成像的系统和方法 |
| CN103767672A (zh) * | 2012-10-18 | 2014-05-07 | 佳能株式会社 | 眼科装置及眼科装置的控制方法 |
| CN105378598A (zh) * | 2013-07-19 | 2016-03-02 | 索尼公司 | 检测装置和方法 |
| CN105006105A (zh) * | 2015-08-04 | 2015-10-28 | 三峡大学 | 一种基于红外探测的眼睛状态识别装置及方法 |
| CN110352033A (zh) * | 2017-02-27 | 2019-10-18 | 托比股份公司 | 用眼睛追踪装置确定眼睛睁开度 |
| CN111670001A (zh) * | 2018-01-31 | 2020-09-15 | 索尼互动娱乐股份有限公司 | 用于眼睛跟踪系统的图像调整 |
| CN109256042A (zh) * | 2018-11-22 | 2019-01-22 | 京东方科技集团股份有限公司 | 显示面板、电子设备及人眼追踪方法 |
| CN111754728A (zh) * | 2019-03-29 | 2020-10-09 | 京东方科技集团股份有限公司 | 检测组件、检测装置、疲劳驾驶的检测方法 |
| CN112558751A (zh) * | 2019-09-25 | 2021-03-26 | 武汉市天蝎科技有限公司 | 一种智能眼镜基于mems和光波导镜片的视线追踪方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| US20240118539A1 (en) | 2024-04-11 |
| CN115670368A (zh) | 2023-02-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11669161B2 (en) | Enhancing the performance of near-to-eye vision systems | |
| TWI710800B (zh) | 頭戴式個人多媒體系統與視覺輔助裝置 | |
| CN104133299B (zh) | 用于制造和使用具有自适应透镜的眼镜的系统、方法和设备 | |
| US10551638B2 (en) | Imaging apparatus and imaging method | |
| CN107526165B (zh) | 头戴式个人多媒体系统、视觉辅助装置以及相关眼镜 | |
| CN104620161B (zh) | 用于适配自适应眼镜片系统的光学功能的方法 | |
| EP3214993B1 (en) | Methods and apparatus for making a determination about an eye in ambient lighting conditions | |
| WO2015024327A1 (zh) | 视力保护成像装置及视力保护成像方法 | |
| CN107850793A (zh) | 控制用于可调节视力矫正的镜片 | |
| JP2010535067A (ja) | 多重焦点眼内レンズシステムおよび方法 | |
| CN110262074B (zh) | 一种智能护眼仪 | |
| CN105611869A (zh) | 用于确定儿童的眼睛的屈光特性的方法和系统 | |
| KR20190110461A (ko) | 근시 발생 및/또는 근시 진행에 대한 근거리 시야의 영향을 감소시키기 위한 시스템을 갖는 디바이스 | |
| US12436410B2 (en) | Eyeglass devices and related methods | |
| WO2023001007A1 (zh) | 成像调整装置及方法、可穿戴设备、存储介质 | |
| KR102063780B1 (ko) | 가상현실을 이용한 근시 억제 장치 | |
| US11969210B2 (en) | Methods and apparatus for making a determination about an eye using color temperature adjusted lighting | |
| CN114816065A (zh) | 屏幕背光的调节方法、虚拟现实设备以及可读存储介质 | |
| CN104615238A (zh) | 一种信息处理方法及穿戴式电子设备 | |
| CN109008938B (zh) | 一种视力检测装置和系统 | |
| US20230210366A1 (en) | Methods and apparatus for detecting a presence and severity of a cataract in ambient lighting | |
| JP6467293B2 (ja) | 視覚検査装置 | |
| WO2022123237A1 (en) | Vision aid device | |
| EP3440990A1 (en) | System for imaging a fundus of an eye | |
| CN205750126U (zh) | 虚拟现实头戴设备 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22845172 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18276653 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 29/05/2024) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22845172 Country of ref document: EP Kind code of ref document: A1 |