[go: up one dir, main page]

WO2018120928A1 - Smart virtual glasses control method based on conditions of eyeballs - Google Patents

Smart virtual glasses control method based on conditions of eyeballs Download PDF

Info

Publication number
WO2018120928A1
WO2018120928A1 PCT/CN2017/102189 CN2017102189W WO2018120928A1 WO 2018120928 A1 WO2018120928 A1 WO 2018120928A1 CN 2017102189 W CN2017102189 W CN 2017102189W WO 2018120928 A1 WO2018120928 A1 WO 2018120928A1
Authority
WO
WIPO (PCT)
Prior art keywords
eyeball
lens
human
image
controlling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/102189
Other languages
French (fr)
Chinese (zh)
Inventor
蔡哲宇
林培群
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Tuweihui Information Technology Co Ltd
Original Assignee
Guangzhou Tuweihui Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Tuweihui Information Technology Co Ltd filed Critical Guangzhou Tuweihui Information Technology Co Ltd
Publication of WO2018120928A1 publication Critical patent/WO2018120928A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • G02B2027/0187Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Definitions

  • the invention belongs to the field of virtual glasses, and in particular relates to a smart virtual glasses control method based on an eyeball situation.
  • Virtual glasses use a head-mounted display device to close a person's vision and hearing to the outside world, and guide the user to create a feeling in a virtual environment.
  • the display principle is that the left and right eye screens respectively display the images of the left and right eyes, and the human eye obtains such a difference information and generates a stereoscopic effect in the mind.
  • most of the existing virtual glasses can not be automatically adjusted according to the eyeball situation, and manual adjustment is needed, which is relatively easy to have errors.
  • the adjusted image is not quite matched with the human eyeball. After all, the human body feels less accurate and easy to wear. Eye fatigue occurs for a while; at the same time, there are still some problems in the smoothness of the existing virtual glasses. Similarly, the user is prone to visual fatigue due to smoothness problems.
  • the present invention provides an intelligent virtual glasses control method based on eyeball conditions, which can realize adaptive adjustment of virtual glasses according to the user's eye condition, while keeping the video images playing smoothly, so that the eyes of the user are not easy to appear. Fatigue, the user's eyes are better protected; when the camera zoom control of the smart glasses toward the user's viewing direction is achieved, the eye is controlled by the enlargement and lifting of the eyes. Increased user experience.
  • a smart virtual glasses control method based on eyeball conditions comprising:
  • the relative position of the wearer's eyeball and the lens is recognized, and the image is clearly displayed in the human eyeball by adjusting the relative position of the lens of the virtual glasses and the human eyeball.
  • the virtual glasses wearer is wide or squinted.
  • the corresponding distance between the upper and lower eyelids can be collected, and the image pause and play displayed by the virtual glasses display component can be controlled according to the control, and the participation can be separated from the hand, the control is more convenient, and the user hand can be released for other operations.
  • controlling the playing state of the smart glasses according to the distance between the upper and lower eyelids specifically includes the following:
  • the smart glasses are controlled to play the image.
  • steps of adjusting the relative positions of the lenses of the virtual glasses and the human eyeballs include the following:
  • the lens position of the virtual glasses is dynamically adjusted according to the position of the human eye and the visual acuity, so that the object image in the lens display screen exhibits sharpness in the human eyeball.
  • steps S1 and S2 the specific steps include the following:
  • the light emitted from the lens is controlled to emit light for a short time and the brightness of the light is slowly increased.
  • the intelligent virtual glasses control method for the eyeball condition further includes smoothing the image playback by processing the number of frames of the played image.
  • Frame is used to calculate the current frame: if the current frame is the first frame, it is 0, indicating immediate display; otherwise, it indicates the waiting time of the current frame, indicating the acquisition time of the current frame, indicating the acquisition time of the previous frame, T Indicates the current time, indicating the time displayed in the previous frame, indicating the threshold according to the number of frames not displayed; if the calculated waiting time is greater than 0, it continues to wait and does not display; if equal to 0, the current frame is displayed.
  • the reference value of the number of frames to be displayed is dynamically set according to the condition of the human eyeball. If the stored number of frames to be displayed is a reference value, the threshold is 0; if less than the reference value, the threshold is increased to be greater than 0. Indicates that the wait is increased, and the display is slowed down. If it is greater than this reference value, the value is decreased to be less than 0, indicating that the wait is reduced and the display is accelerated.
  • the present invention has the beneficial effects:
  • Figure 1 Schematic diagram 1 of the embodiment of the present invention
  • FIG. 2 is a schematic structural view 2 of an embodiment of the present invention.
  • FIG. 3 is a schematic structural view 3 of an embodiment of the present invention.
  • FIG. 4 is a schematic structural view 4 of an embodiment of the present invention.
  • a smart virtual glasses control method based on eyeball conditions as shown in FIG.
  • the relative position of the wearer's eyeball and the lens is recognized, and the image is clearly displayed in the human eyeball by adjusting the relative position of the lens of the virtual glasses and the human eyeball.
  • Controlling the playing status of the smart glasses according to the distance between the upper and lower eyelids includes the following:
  • the smart glasses are controlled to be closed, and the image display is stopped;
  • the smart glasses are controlled to play the image.
  • the steps of adjusting the relative positions of the lens of the virtual glasses and the human eyeball include the following:
  • the lens position of the virtual glasses is dynamically adjusted according to the position of the human eye and the visual acuity, so that the object image in the lens display screen exhibits sharpness in the human eyeball.
  • steps S1 and S2 the specific steps include the following:
  • the method for controlling the intelligent virtual glasses according to the eyeball condition further includes: 1. in the process of adjusting the lens according to the position of the human eye and the condition of the eyesight, simultaneously controlling the light emitted by the lens to emit light for a short time and the brightness of the light is slowly increased; The processing of the number of playback image frames makes the image playback smooth.
  • the specific steps of processing the number of frames of the played image include:
  • Frame is used to calculate the current frame: if the current frame is the first frame, it is 0, indicating immediate display; otherwise, it indicates the waiting time of the current frame, indicating the acquisition time of the current frame, indicating the acquisition time of the previous frame, T Indicates the current time, indicating the time displayed in the previous frame, indicating the threshold according to the number of frames not displayed; if the calculated waiting time is greater than 0, it continues to wait and does not display; if equal to 0, the current frame is displayed.
  • the threshold is 0; if less than the reference value, the threshold is increased to be greater than 0, indicating an increase Wait, the display slows down. If it is greater than this reference value, decrease the value to less than 0, indicating that the wait is reduced and the display is accelerated.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

A control method for the clear and smooth playing of VR glasses-based images, the method comprising: adjusting the position of the lens of VR glasses relative to the human eyeballs so that images are clearly presented on human eyeballs, processing the number of played image frames so that the images are played smoothly. The control method can implement the adaptive adjustment of VR glasses on the basis of conditions of user's eyeballs, while maintaining smooth playing of video images so that the user won't easily suffer eye fatigue, protecting the user's eyes, and improving user experience.

Description

一种基于眼球情况的智能虚拟眼镜控制方法Intelligent virtual glasses control method based on eyeball situation 技术领域Technical field

本发明属于虚拟眼镜领域,尤其涉及一种基于眼球情况的智能虚拟眼镜控制方法。The invention belongs to the field of virtual glasses, and in particular relates to a smart virtual glasses control method based on an eyeball situation.

背景技术Background technique

虚拟眼镜是利用头戴式显示设备将人的对外界的视觉、听觉封闭,引导用户产生一种身在虚拟环境中的感觉。其显示原理是左右眼屏幕分别显示左右眼的图像,人眼获取这种带有差异的信息后在脑海中产生立体感。但现有的虚拟眼镜大多实现不了依据眼球情况进行自动调节,需要人工手动调节,这样比较容易存在误差,调节后的镜像跟人体眼球还是不太匹配,毕竟人体感觉还是不太准确的,容易佩戴一段时间就出现眼睛疲惫;同时现有的虚拟眼镜在播放顺畅度上也还存在一些问题,同样用户看久了由于顺畅度问题也容易产生视觉疲劳。Virtual glasses use a head-mounted display device to close a person's vision and hearing to the outside world, and guide the user to create a feeling in a virtual environment. The display principle is that the left and right eye screens respectively display the images of the left and right eyes, and the human eye obtains such a difference information and generates a stereoscopic effect in the mind. However, most of the existing virtual glasses can not be automatically adjusted according to the eyeball situation, and manual adjustment is needed, which is relatively easy to have errors. The adjusted image is not quite matched with the human eyeball. After all, the human body feels less accurate and easy to wear. Eye fatigue occurs for a while; at the same time, there are still some problems in the smoothness of the existing virtual glasses. Similarly, the user is prone to visual fatigue due to smoothness problems.

发明内容Summary of the invention

为了克服现有技术存在的不足,本发明提供了一种基于眼球情况的智能虚拟眼镜控制方法,它能够实现虚拟眼镜依据用户眼球情况自适应调节,同时保持视频图像播放顺畅,使用户眼睛不易出现疲劳,较好保护了用户眼睛;实现了在对智能眼镜朝向用户观察方向的摄像头变焦控制时,通过眼睛的睁大、眯起进行控制。增加了用户体验感。In order to overcome the deficiencies of the prior art, the present invention provides an intelligent virtual glasses control method based on eyeball conditions, which can realize adaptive adjustment of virtual glasses according to the user's eye condition, while keeping the video images playing smoothly, so that the eyes of the user are not easy to appear. Fatigue, the user's eyes are better protected; when the camera zoom control of the smart glasses toward the user's viewing direction is achieved, the eye is controlled by the enlargement and lifting of the eyes. Increased user experience.

本发明采用的技术方案如下:The technical solution adopted by the present invention is as follows:

一种基于眼球情况的智能虚拟眼镜控制方法,其特征在于,包括:A smart virtual glasses control method based on eyeball conditions, comprising:

采集佩戴者的眼部图像,所述眼部图像包括上眼睑和下眼睑,根据上下眼睑之间的距离控制智能眼镜的播放状态;Collecting an eye image of the wearer, the eye image including an upper eyelid and a lower eyelid, and controlling a playing state of the smart glasses according to a distance between the upper and lower eyelids;

识别佩戴者眼球与透镜的相对位置,通过调整虚拟眼镜的透镜与人体眼球的相对位置使图像清晰在人体眼球清晰显示。The relative position of the wearer's eyeball and the lens is recognized, and the image is clearly displayed in the human eyeball by adjusting the relative position of the lens of the virtual glasses and the human eyeball.

对于目前的虚拟眼镜,当采集图像过程中需要实现实时图像的播放和停止,可采用滑动触摸、手势控制等方式,但都需要手的配合;本发明中虚拟眼镜佩戴者睁大或眯起眼睛时,可采集到上下眼睑的相应的距离,并据此控制虚拟眼镜显示部件所显示图像暂停和播放,可脱离手的参与,控制更为方便,且可释放出用户手以进行其他操作。For the current virtual glasses, when the image is captured and the real-time image needs to be played and stopped, sliding touch, gesture control, etc. can be adopted, but all of the hands need to cooperate; in the present invention, the virtual glasses wearer is wide or squinted. At the same time, the corresponding distance between the upper and lower eyelids can be collected, and the image pause and play displayed by the virtual glasses display component can be controlled according to the control, and the participation can be separated from the hand, the control is more convenient, and the user hand can be released for other operations.

进一步地,根据上下眼睑之间的距离控制智能眼镜的播放状态具体包括如下:Further, controlling the playing state of the smart glasses according to the distance between the upper and lower eyelids specifically includes the following:

判断上下眼睑之间的距离小于或等于一限定值且不为零,维持超过第一特定时间,则控制智能眼镜暂停图像播放;Determining that the distance between the upper and lower eyelids is less than or equal to a limit value and is not zero, and maintaining the time exceeding the first specific time, controlling the smart glasses to pause the image playing;

判断上下眼睑之间的距离为零,维持超过第二特定时间,则控制智能眼镜关闭,停止图 像显示;Judging that the distance between the upper and lower eyelids is zero, and maintaining the second specific time, then controlling the smart glasses to close, stopping the map Like display

判断上下眼睑之间的距离大于限定值,维持超过第三特定时间,则控制智能眼镜播放图像。It is judged that the distance between the upper and lower eyelids is greater than the limit value, and if the third specific time is maintained, the smart glasses are controlled to play the image.

进一步地,调整虚拟眼镜的透镜与人体眼球的相对位置的步骤包括如下:Further, the steps of adjusting the relative positions of the lenses of the virtual glasses and the human eyeballs include the following:

S1.检测人体眼球相对透镜的位置与人体眼球的视力情况;S1. detecting the position of the human eyeball relative to the lens and the visual acuity of the human eyeball;

S2.根据人体眼球位置与视力情况动态调整虚拟眼镜的透镜位置,使镜片显示屏中的物象在人体眼球内呈现清晰度。S2. The lens position of the virtual glasses is dynamically adjusted according to the position of the human eye and the visual acuity, so that the object image in the lens display screen exhibits sharpness in the human eyeball.

进一步地,对于步骤S1和S2,具体步骤包括如下:Further, for steps S1 and S2, the specific steps include the following:

S41.获取人体眼球位置,判断人体眼球的中心位置与虚拟眼镜内的透镜的中心位置是否重合;若重合则继续S42,若不重合则控制透镜位置移至与人体眼球的中心位置重合;S41. Obtaining the position of the human eyeball, determining whether the center position of the human eyeball coincides with the center position of the lens in the virtual glasses; if coincident, proceeding to S42, if not coincident, controlling the lens position to coincide with the center position of the human eyeball;

S42.获取人体眼球的曲度参数,判断人体眼球是否存在视力异常,若异常则控制透镜沿与眼球的中心位置重合的轴线上移动一定距离,使眼球到透镜之间的距离能够保证眼球正常看清透镜反射出来的物象。S42. Obtaining the curvature parameter of the human eyeball, determining whether there is abnormal vision in the human eyeball, and if the abnormality is, controlling the lens to move a certain distance along the axis coincident with the center position of the eyeball, so that the distance between the eyeball and the lens can ensure that the eyeball looks normal. The object reflected by the clear lens.

进一步地,在依据人体眼球位置与视力情况对透镜调整过程中,同时对透镜发射出来的光线控制短时间延时发亮和光线亮度缓慢提高。Further, in the process of adjusting the lens according to the position of the human eye and the condition of the eyesight, the light emitted from the lens is controlled to emit light for a short time and the brightness of the light is slowly increased.

进一步地,眼球情况的智能虚拟眼镜控制方法还包括通过对播放图像帧数的处理使图像播放顺畅。Further, the intelligent virtual glasses control method for the eyeball condition further includes smoothing the image playback by processing the number of frames of the played image.

进一步地,对播放图像帧数的处理具体步骤包括:Further, the specific steps of processing the number of frames of the played image include:

对视频图像采集取帧,进行解码存储;Capture frames for video image acquisition, and decode and store them;

取帧计算当前帧的:若当前帧是第一帧,则为0,表示立即显示;否则,,其中表示当前帧的等待时间,表示当前帧的采集时间,表示上一帧的采集时间,T表示当前时间,表示上一帧显示的时间,表示根据未显示的帧数变化的阈值;若计算出的等待时间是大于0,则继续等待,不做显示;若等于0,显示当前帧。Frame is used to calculate the current frame: if the current frame is the first frame, it is 0, indicating immediate display; otherwise, it indicates the waiting time of the current frame, indicating the acquisition time of the current frame, indicating the acquisition time of the previous frame, T Indicates the current time, indicating the time displayed in the previous frame, indicating the threshold according to the number of frames not displayed; if the calculated waiting time is greater than 0, it continues to wait and does not display; if equal to 0, the current frame is displayed.

进一步地,依据人体眼球情况动态设置待显示帧数的参考值,如果存储的待显示的帧数是参考值,这个阈值就是0;若少于这个参考值就加大这个阈值使其大于0,表示增加等待,显示放慢,若大于这个参考值就减少这个值使其小于0,表示减少等待,显示加快。Further, the reference value of the number of frames to be displayed is dynamically set according to the condition of the human eyeball. If the stored number of frames to be displayed is a reference value, the threshold is 0; if less than the reference value, the threshold is increased to be greater than 0. Indicates that the wait is increased, and the display is slowed down. If it is greater than this reference value, the value is decreased to be less than 0, indicating that the wait is reduced and the display is accelerated.

与现有技术相比,本发明具有的有益效果:Compared with the prior art, the present invention has the beneficial effects:

1、实现虚拟眼镜依据用户眼球情况自适应调节;1. Realize virtual glasses to be adaptively adjusted according to the user's eye condition;

2、保证了视频图像播放顺畅; 2, to ensure that the video image playback is smooth;

3、较好保护了用户眼睛,增加了用户体验感,使用户眼睛不易出现疲劳;3, better protect the user's eyes, increase the user experience, so that the user's eyes are not easy to fatigue;

4、通过检测上下眼睑的距离,控制图像的暂停和播放,操作简单,解放双手。4, by detecting the distance between the upper and lower eyelids, control the pause and play of the image, the operation is simple, free hands.

附图说明DRAWINGS

图1:本发明实施例的结构示意图一;Figure 1: Schematic diagram 1 of the embodiment of the present invention;

图2:本发明实施例的结构示意图二;2 is a schematic structural view 2 of an embodiment of the present invention;

图3:本发明实施例的结构示意图三;3 is a schematic structural view 3 of an embodiment of the present invention;

图4:本发明实施例的结构示意图四。FIG. 4 is a schematic structural view 4 of an embodiment of the present invention.

具体实施方式detailed description

下面结合附图和实施例对本发明作进一步详细说明。The present invention will be further described in detail below with reference to the accompanying drawings and embodiments.

实施例:Example:

一种基于眼球情况的智能虚拟眼镜控制方法,如图1所示包括:A smart virtual glasses control method based on eyeball conditions, as shown in FIG.

采集佩戴者的眼部图像,所述眼部图像包括上眼睑和下眼睑,根据上下眼睑之间的距离控制智能眼镜的播放状态;Collecting an eye image of the wearer, the eye image including an upper eyelid and a lower eyelid, and controlling a playing state of the smart glasses according to a distance between the upper and lower eyelids;

识别佩戴者眼球与透镜的相对位置,通过调整虚拟眼镜的透镜与人体眼球的相对位置使图像清晰在人体眼球清晰显示。The relative position of the wearer's eyeball and the lens is recognized, and the image is clearly displayed in the human eyeball by adjusting the relative position of the lens of the virtual glasses and the human eyeball.

根据上下眼睑之间的距离控制智能眼镜的播放状态具体包括如下:Controlling the playing status of the smart glasses according to the distance between the upper and lower eyelids includes the following:

判断上下眼睑之间的距离小于或等于一限定值且不为零,维持超过第一特定时间,则控制智能眼镜暂停图像播放;Determining that the distance between the upper and lower eyelids is less than or equal to a limit value and is not zero, and maintaining the time exceeding the first specific time, controlling the smart glasses to pause the image playing;

判断上下眼睑之间的距离为零,维持超过第二特定时间,则控制智能眼镜关闭,停止图像显示;Judging that the distance between the upper and lower eyelids is zero, and maintaining the second specific time, the smart glasses are controlled to be closed, and the image display is stopped;

判断上下眼睑之间的距离大于限定值,维持超过第三特定时间,则控制智能眼镜播放图像。It is judged that the distance between the upper and lower eyelids is greater than the limit value, and if the third specific time is maintained, the smart glasses are controlled to play the image.

如图2所示,调整虚拟眼镜的透镜与人体眼球的相对位置的步骤包括如下:As shown in FIG. 2, the steps of adjusting the relative positions of the lens of the virtual glasses and the human eyeball include the following:

S1.检测人体眼球相对透镜的位置与人体眼球的视力情况;S1. detecting the position of the human eyeball relative to the lens and the visual acuity of the human eyeball;

S2.根据人体眼球位置与视力情况动态调整虚拟眼镜的透镜位置,使镜片显示屏中的物象在人体眼球内呈现清晰度。S2. The lens position of the virtual glasses is dynamically adjusted according to the position of the human eye and the visual acuity, so that the object image in the lens display screen exhibits sharpness in the human eyeball.

如图3所示,对于步骤S1和S2,具体步骤包括如下:As shown in FIG. 3, for steps S1 and S2, the specific steps include the following:

S41.获取人体眼球位置,判断人体眼球的中心位置与虚拟眼镜内的透镜的中心位置是否重合;若重合则继续S42,若不重合则控制透镜位置移至与人体眼球的中心位置重合;S41. Obtaining the position of the human eyeball, determining whether the center position of the human eyeball coincides with the center position of the lens in the virtual glasses; if coincident, proceeding to S42, if not coincident, controlling the lens position to coincide with the center position of the human eyeball;

S42.获取人体眼球的曲度参数,判断人体眼球是否存在视力异常,若异常则控制透镜沿 与眼球的中心位置重合的轴线上移动一定距离,使眼球到透镜之间的距离能够保证眼球正常看清透镜反射出来的物象。S42. Obtaining the curvature parameter of the human eyeball, determining whether there is abnormal vision in the human eyeball, and controlling the lens edge if abnormal A certain distance is moved on the axis coincident with the center position of the eyeball, so that the distance between the eyeball and the lens can ensure that the eyeball normally sees the object reflected by the lens.

根据眼球情况控制智能虚拟眼镜的方法,还包括:1.在依据人体眼球位置与视力情况对透镜调整过程中,同时对透镜发射出来的光线控制短时间延时发亮和光线亮度缓慢提高;2.对播放图像帧数的处理使图像播放顺畅。The method for controlling the intelligent virtual glasses according to the eyeball condition further includes: 1. in the process of adjusting the lens according to the position of the human eye and the condition of the eyesight, simultaneously controlling the light emitted by the lens to emit light for a short time and the brightness of the light is slowly increased; The processing of the number of playback image frames makes the image playback smooth.

如图4所示,对播放图像帧数的处理具体步骤包括:As shown in FIG. 4, the specific steps of processing the number of frames of the played image include:

对视频图像采集取帧,进行解码存储;Capture frames for video image acquisition, and decode and store them;

取帧计算当前帧的:若当前帧是第一帧,则为0,表示立即显示;否则,,其中表示当前帧的等待时间,表示当前帧的采集时间,表示上一帧的采集时间,T表示当前时间,表示上一帧显示的时间,表示根据未显示的帧数变化的阈值;若计算出的等待时间是大于0,则继续等待,不做显示;若等于0,显示当前帧。Frame is used to calculate the current frame: if the current frame is the first frame, it is 0, indicating immediate display; otherwise, it indicates the waiting time of the current frame, indicating the acquisition time of the current frame, indicating the acquisition time of the previous frame, T Indicates the current time, indicating the time displayed in the previous frame, indicating the threshold according to the number of frames not displayed; if the calculated waiting time is greater than 0, it continues to wait and does not display; if equal to 0, the current frame is displayed.

依据人体眼球情况动态设置待显示帧数的参考值时,如果存储的待显示的帧数是参考值,这个阈值就是0;若少于这个参考值就加大这个阈值使其大于0,表示增加等待,显示放慢,若大于这个参考值就减少这个值使其小于0,表示减少等待,显示加快。 When the reference value of the number of frames to be displayed is dynamically set according to the condition of the human eye, if the number of frames to be displayed is a reference value, the threshold is 0; if less than the reference value, the threshold is increased to be greater than 0, indicating an increase Wait, the display slows down. If it is greater than this reference value, decrease the value to less than 0, indicating that the wait is reduced and the display is accelerated.

Claims (8)

一种基于眼球情况的智能虚拟眼镜控制方法,其特征在于,包括:A smart virtual glasses control method based on eyeball conditions, comprising: 采集佩戴者的眼部图像,所述眼部图像包括上眼睑和下眼睑,根据上下眼睑之间的距离控制智能眼镜的播放状态;Collecting an eye image of the wearer, the eye image including an upper eyelid and a lower eyelid, and controlling a playing state of the smart glasses according to a distance between the upper and lower eyelids; 识别佩戴者眼球与透镜的相对位置,通过调整虚拟眼镜的透镜与人体眼球的相对位置使图像清晰在人体眼球清晰显示。The relative position of the wearer's eyeball and the lens is recognized, and the image is clearly displayed in the human eyeball by adjusting the relative position of the lens of the virtual glasses and the human eyeball. 根据权利要求1所述的基于眼球情况的智能虚拟眼镜控制方法,其特征在于,根据上下眼睑之间的距离控制智能眼镜的播放状态具体包括如下:The method for controlling an intelligent virtual glasses based on an eyeball condition according to claim 1, wherein the controlling the playing state of the smart glasses according to the distance between the upper and lower eyelids comprises the following: 判断上下眼睑之间的距离小于或等于一限定值且不为零,维持超过第一特定时间,则控制智能眼镜暂停图像播放;Determining that the distance between the upper and lower eyelids is less than or equal to a limit value and is not zero, and maintaining the time exceeding the first specific time, controlling the smart glasses to pause the image playing; 判断上下眼睑之间的距离为零,维持超过第二特定时间,则控制智能眼镜关闭,停止图像显示;Judging that the distance between the upper and lower eyelids is zero, and maintaining the second specific time, the smart glasses are controlled to be closed, and the image display is stopped; 判断上下眼睑之间的距离大于限定值,维持超过第三特定时间,则控制智能眼镜播放图像。It is judged that the distance between the upper and lower eyelids is greater than the limit value, and if the third specific time is maintained, the smart glasses are controlled to play the image. 根据权利要求1所述的基于眼球情况的智能虚拟眼镜控制方法,其特征在于,调整虚拟眼镜的透镜与人体眼球的相对位置的步骤包括如下:The method for controlling an intelligent virtual glasses based on an eyeball condition according to claim 1, wherein the step of adjusting a relative position of the lens of the virtual glasses and the eyeball of the human body comprises the following steps: S1.检测人体眼球相对透镜的位置与人体眼球的视力情况;S1. detecting the position of the human eyeball relative to the lens and the visual acuity of the human eyeball; S2.根据人体眼球位置与视力情况动态调整虚拟眼镜的透镜位置,使镜片显示屏中的物象在人体眼球内呈现清晰度。S2. The lens position of the virtual glasses is dynamically adjusted according to the position of the human eye and the visual acuity, so that the object image in the lens display screen exhibits sharpness in the human eyeball. 根据权利要求3所述的种基于眼球情况的智能虚拟眼镜控制方法,其特征在于,具体步骤包括如下:The method for controlling an intelligent virtual glasses based on an eyeball condition according to claim 3, wherein the specific steps comprise the following: S41.获取人体眼球位置,判断人体眼球的中心位置与虚拟眼镜内的透镜的中心位置是否重合;若重合则继续S42,若不重合则控制透镜位置移至与人体眼球的中心位置重合;S41. Obtaining the position of the human eyeball, determining whether the center position of the human eyeball coincides with the center position of the lens in the virtual glasses; if coincident, proceeding to S42, if not coincident, controlling the lens position to coincide with the center position of the human eyeball; S42.获取人体眼球的曲度参数,判断人体眼球是否存在视力异常,若异常则控制透镜沿与眼球的中心位置重合的轴线上移动一定距离,使眼球到透镜之间的距离能够保证眼球正常看清透镜反射出来的物象。S42. Obtaining the curvature parameter of the human eyeball, determining whether there is abnormal vision in the human eyeball, and if the abnormality is, controlling the lens to move a certain distance along the axis coincident with the center position of the eyeball, so that the distance between the eyeball and the lens can ensure that the eyeball looks normal. The object reflected by the clear lens. 根据权利要求1所述的基于眼球情况的智能虚拟眼镜控制方法,其特征在于,在依据人体眼球位置与视力情况对透镜调整过程中,同时对透镜发射出来的光线控制短时间延时发亮和光线亮度缓慢提高。The method for controlling an intelligent virtual glasses based on an eyeball condition according to claim 1, wherein in the process of adjusting the lens according to the position of the human eye and the condition of the eyesight, the light emitted by the lens is simultaneously controlled to emit light for a short time. The brightness of the light is slowly increasing. 根据权利要求1所述的基于眼球情况的智能虚拟眼镜控制方法,其特征在于,还包括通过对播放图像帧数的处理使图像播放顺畅。The method for controlling an intelligent virtual glasses based on an eyeball condition according to claim 1, further comprising smoothing the image playback by processing the number of frames of the played image. 根据权利要求6所述的基于眼球情况的智能虚拟眼镜控制方法,其特征在于,对播放图像帧数的处理具体步骤包括: The method for controlling an intelligent virtual glasses based on an eyeball condition according to claim 6, wherein the specific steps of processing the number of frames of the played image include: 对视频图像采集取帧,进行解码存储;Capture frames for video image acquisition, and decode and store them; 取帧计算当前帧的T:若当前帧是第一帧,则T为0,表示立即显示;否则,T=(T-T′)-(T-T)+ε,其中T表示当前帧的等待时间,T表示当前帧的采集时间,T′表示上一帧的采集时间,T表示当前时间,T表示上一帧显示的时间,ε表示根据未显示的帧数变化的阈值;若计算出的等待时间是大于0,则继续等待,不做显示;若等于0,显示当前帧。Calculation of the current frame framing the like T: if the current frame is the first frame, the other is 0 T, represents displayed immediately; otherwise, like T = (T mining -T 'mining) - (a TT) + ε, where T etc., indicate that the waiting time of the current frame, T mining represents the acquisition time of the current frame, T 'collected represented on an acquisition time, T represents the current time, the T represents the time on a display, [epsilon] represents a frame according to not shown The threshold of the number change; if the calculated waiting time is greater than 0, it continues to wait and does not display; if equal to 0, the current frame is displayed. 根据权利要求6所述的基于虚拟眼镜图像清晰顺畅播放控制方法,其特征在于,依据人体眼球情况动态设置待显示帧数的参考值,如果存储的待显示的帧数是参考值,这个阈值就是0;若少于这个参考值就加大这个阈值使其大于0,表示增加等待,显示放慢,若大于这个参考值就减少这个值使其小于0,表示减少等待,显示加快。 The clear and smooth playback control method based on the virtual glasses image according to claim 6, wherein the reference value of the number of frames to be displayed is dynamically set according to the condition of the human eyeball, and if the stored number of frames to be displayed is a reference value, the threshold is 0; if less than this reference value, the threshold is increased to be greater than 0, indicating that the waiting is increased, and the display is slowed down. If it is greater than the reference value, the value is decreased to be less than 0, indicating that the waiting is reduced and the display is accelerated.
PCT/CN2017/102189 2016-12-28 2017-09-19 Smart virtual glasses control method based on conditions of eyeballs Ceased WO2018120928A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611238061.7 2016-12-28
CN201611238061.7A CN106873157A (en) 2016-12-28 2016-12-28 Intelligent virtual glasses control method based on eyeball condition

Publications (1)

Publication Number Publication Date
WO2018120928A1 true WO2018120928A1 (en) 2018-07-05

Family

ID=59164499

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/102189 Ceased WO2018120928A1 (en) 2016-12-28 2017-09-19 Smart virtual glasses control method based on conditions of eyeballs

Country Status (2)

Country Link
CN (1) CN106873157A (en)
WO (1) WO2018120928A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106873157A (en) * 2016-12-28 2017-06-20 广州途威慧信息科技有限公司 Intelligent virtual glasses control method based on eyeball condition
CN108108022B (en) * 2018-01-02 2021-05-18 联想(北京)有限公司 Control method and auxiliary imaging device
CN109144250B (en) * 2018-07-24 2021-12-21 北京七鑫易维信息技术有限公司 Position adjusting method, device, equipment and storage medium
CN109618200A (en) * 2018-12-24 2019-04-12 上海闻泰电子科技有限公司 VR video playing control method and device
CN111623751B (en) * 2020-05-31 2021-11-30 上海域唯医疗科技有限公司 System for identifying the inclination of a visor and corresponding terminal

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103698904A (en) * 2013-12-04 2014-04-02 全蕊 Smart glasses and control method
CN103747317A (en) * 2013-12-27 2014-04-23 高新兴科技集团股份有限公司 A smooth playing control method of a play database in an instable network
US9116545B1 (en) * 2012-03-21 2015-08-25 Hayes Solos Raffle Input detection
CN106199958A (en) * 2015-05-07 2016-12-07 尚立光电股份有限公司 Automatic focusing head-mounted display device
CN106873157A (en) * 2016-12-28 2017-06-20 广州途威慧信息科技有限公司 Intelligent virtual glasses control method based on eyeball condition

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011107382A (en) * 2009-11-17 2011-06-02 Nippon Seiki Co Ltd Display device for vehicle
CN105653227A (en) * 2016-03-22 2016-06-08 北京全景思维科技有限公司 Head-mounted virtual reality display device and method for tracking focal length of eyeballs

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9116545B1 (en) * 2012-03-21 2015-08-25 Hayes Solos Raffle Input detection
CN103698904A (en) * 2013-12-04 2014-04-02 全蕊 Smart glasses and control method
CN103747317A (en) * 2013-12-27 2014-04-23 高新兴科技集团股份有限公司 A smooth playing control method of a play database in an instable network
CN106199958A (en) * 2015-05-07 2016-12-07 尚立光电股份有限公司 Automatic focusing head-mounted display device
CN106873157A (en) * 2016-12-28 2017-06-20 广州途威慧信息科技有限公司 Intelligent virtual glasses control method based on eyeball condition

Also Published As

Publication number Publication date
CN106873157A (en) 2017-06-20

Similar Documents

Publication Publication Date Title
US11669160B2 (en) Predictive eye tracking systems and methods for foveated rendering for electronic displays
US10871825B1 (en) Predictive eye tracking systems and methods for variable focus electronic displays
US11507184B2 (en) Gaze tracking apparatus and systems
CN207181829U (en) Virtual implementing helmet
CN107506036B (en) VR interpupillary distance adjusting method and device
WO2018120928A1 (en) Smart virtual glasses control method based on conditions of eyeballs
CN104793741A (en) Imaging system and method for guiding eyeballs to trace virtual reality
JP2014219621A (en) Display device and display control program
JP7081599B2 (en) Information processing equipment, information processing methods, and programs
US10775624B2 (en) Binocular device comprising a monocular display device
US20250355492A1 (en) Gaze tracking system and method
CN110262074A (en) A kind of intelligent eyeshield instrument
WO2018120929A1 (en) Clear and smooth image playback control method based on vr glasses
US10459255B2 (en) Compensating visual impairment by using an eye-mounted display
CN204964878U (en) Can eliminate head -mounted display apparatus of colour difference
CN110162185A (en) A kind of intelligent display method and device
US12393027B2 (en) Head-mountable display apparatus and methods
US20140225994A1 (en) Three-dimensional image adjusting device and method thereof
CN106066538A (en) Frivolous Fresnel Lenses for the Virtual Reality helmet
CN209564367U (en) Eyesight correction device
CN104062772B (en) A kind of method and device determining adjustment region, adjustment light transmission rate
TWI683134B (en) Image display method of head-mounted display apparatus and head-mounted display apparatus
KR20190049186A (en) Visual enhancement training device
CN106954056A (en) Intelligent virtual glasses image display control method
JP2015169920A (en) Retina projection system and spectacle type display

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17888408

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17888408

Country of ref document: EP

Kind code of ref document: A1