CN107451529A - Eye protection method and device for mobile terminal, mobile terminal and storage medium - Google Patents

Abstract

The present invention is applicable to the field of computer technology, and provides an eye protection method, device, mobile terminal and storage medium for a mobile terminal. The method includes: acquiring an image in front of the mobile terminal screen, performing face recognition on the image, determining the position of the user's eyes in the image according to the face recognition result, acquiring the number of times the user blinks within a preset time period according to the position of the user's eyes in the image, determining whether the number of blinks is less than a preset number, and executing a preset eye protection instruction when the number of blinks is less than the preset number, thereby solving the problem of the user's vision being affected by staring at the electronic screen for a long time, and improving the eye protection effect of the mobile terminal.

Description

Eye protection method and device for mobile terminal, mobile terminal and storage medium

technical field

The invention belongs to the technical field of computers, and in particular relates to an eye protection method and device for a mobile terminal, a mobile terminal and a storage medium.

Background technique

With the popularization of Internet electronic products, mobile terminals such as tablet computers and mobile phones have become the daily necessities of users. However, electronic products are a double-edged sword. While helping users surf the Internet and learn, they will also have a negative impact on the user's vision, especially when users (for example, children) lack self-control and vision protection awareness, they often have a long Staring at electronic screens for a long time causes users to suffer from eye diseases such as myopia and astigmatism.

In order to solve the impact on eyesight caused by users staring at the electronic screen for a long time, the most commonly used solution in the prior art is to lower the parameters of the blue light in the mobile terminal to reduce the damage of the blue light to the user, but this will make the display of the mobile terminal The color effect is greatly reduced, which makes the user experience drop a lot, and at the same time, it cannot solve the problem of excessive eye fatigue when the user concentrates on using the mobile terminal. In addition, some mobile terminals directly control the user's use time of the mobile terminal. When the use time exceeds the preset threshold, only an eye protection prompt box pops up, and the eye protection effect is not good.

Contents of the invention

The object of the present invention is to provide an eye protection method and device for a mobile terminal, a mobile terminal and a storage medium, aiming at solving the problem of poor eye protection effect of existing eye protection methods.

In one aspect, the present invention provides an eye protection method for a mobile terminal, the method comprising the following steps:

Acquire the image in front of the screen of the mobile terminal, perform face recognition on the image, and determine the position of the user's eyes in the image according to the face recognition result;

According to the position of the user's eyes in the image, the number of blinks of the user within a preset time period is obtained;

It is determined whether the number of blinks is less than a preset number, and when the number of blinks is less than the preset number, a preset eye protection instruction is executed.

In another aspect, the present invention provides an eye protection device for a mobile terminal, the device comprising:

An eye position determining unit, configured to acquire an image in front of the screen of the mobile terminal, perform face recognition on the image, and determine the position of the user's eyes in the image according to the face recognition result;

A blink count acquisition unit, configured to acquire the blink count of the user within a preset time period according to the position of the user's eyes in the image; and

An eye protection instruction executing unit, configured to determine whether the number of blinks is less than a preset number, and execute a preset eye protection instruction when the number of blinks is less than the preset number.

On the other hand, the present invention also provides a mobile terminal, including a memory, a processor, and a computer program stored in the memory and operable on the processor. When the processor executes the computer program, the Such as the steps of the eye protection method for the mobile terminal.

On the other hand, the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the eye protection method for the mobile terminal are implemented. .

The present invention acquires the image in front of the screen of the mobile terminal, performs face recognition on the image, determines the position of the user's eyes in the image according to the face recognition result, and obtains the position of the user's eyes in the preset time period according to the position of the user's eye in the image. The number of blinks is determined to determine whether the number of blinks is less than the preset number. When the number of blinks is less than the preset number, the preset eye protection instruction is executed to realize the automatic and intelligent eye protection function of the mobile terminal, thereby solving the problem of users staring at the computer for a long time. The problem of affecting eyesight caused by looking at the electronic screen has improved the eye protection effect of the mobile terminal.

Description of drawings

FIG. 1 is a flow chart of an eye protection method for a mobile terminal provided in Embodiment 1 of the present invention;

FIG. 2 is a schematic structural diagram of an eye protection device for a mobile terminal provided in Embodiment 2 of the present invention;

FIG. 3 is a schematic structural diagram of an eye protection device for a mobile terminal provided in Embodiment 3 of the present invention; and

FIG. 4 is a schematic structural diagram of a mobile terminal provided by Embodiment 4 of the present invention.

detailed description

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

The specific realization of the present invention is described in detail below in conjunction with specific embodiment:

Embodiment one:

Figure 1 shows the implementation process of the eye protection method for a mobile terminal provided by Embodiment 1 of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown, and the details are as follows:

In step S101, the image in front of the screen of the mobile terminal is acquired, face recognition is performed on the image, and the position of the user's eyes in the image is determined according to the face recognition result.

The embodiments of the present invention are applicable to portable mobile terminals such as mobile phones, tablet computers, or learning machines, so as to conveniently protect the eyes of mobile terminal users. In the embodiment of the present invention, when the mobile terminal is in use, first acquire the image in front of the screen of the mobile terminal, then perform face recognition on the acquired image, and determine the position of the user's eyes in the image according to the face recognition result, To lock the position of the user's eyes, so as to facilitate the tracking and detection of the user's eyes.

Preferably, before acquiring the image in front of the screen of the mobile terminal, monitor the distance between the user in front of the screen of the mobile terminal and the screen of the mobile terminal, determine whether to acquire the image in front of the screen of the mobile terminal according to the distance, when it is determined to acquire the image in front of the screen of the mobile terminal Only when the camera of the mobile terminal is triggered to acquire the image in front of the screen of the mobile terminal, thereby improving the effectiveness of image acquisition, thereby reducing the energy consumption of the mobile terminal, further preferably, determining whether to acquire the image in front of the screen of the mobile terminal according to the distance , the acquisition distance continues to be less than the duration of the preset threshold, and when the duration is greater than the preset duration (for example, the distance between the user and the screen of the mobile terminal is less than 12cm within 4s), it is determined to acquire the image in front of the screen of the mobile terminal, Otherwise, the image in front of the screen of the mobile terminal is not acquired, thereby improving the accuracy of image acquisition while reducing the energy consumption of the mobile terminal.

Specifically, a distance sensor may be used to monitor the distance between the user in front of the screen of the mobile terminal and the screen of the mobile terminal.

In step S102, according to the position of the user's eyes in the image, the number of blinks of the user within a preset time period is obtained.

In the embodiment of the present invention, after the position of the user's eyes is locked, the state of the user's eyes is monitored according to the position of the user's eyes in the image, and the number of blinks of the user within a preset time period (for example, 1 minute) is obtained, thereby determining Whether the user's eyes need automatic protection of the mobile terminal.

In step S103, it is determined whether the number of blinks of the user within a preset time period is less than the preset number, and when the number of blinks is less than the preset number, a preset eye protection instruction is executed.

In the embodiment of the present invention, after obtaining the number of blinks of the user within a preset time period (for example, 1 minute), the obtained number of blinks is compared with the preset number of blinks (for example, 15 times), when the obtained number of blinks When the number of blinks is less than the preset number of times, it means that the user's eyes need to be automatically protected by the mobile terminal. At this time, the preset eye protection instruction is executed. Preferably, a plurality of eye protection instructions can be preset, and when the preset eye protection instructions are executed, different eye protection instructions are executed according to the obtained number of blinks, thereby improving the accuracy of eye protection.

In the embodiment of the present invention, the eye protection instruction may be an instruction to lock the screen of the mobile terminal, an instruction to black the screen, or an instruction to shut down the mobile terminal. Lock the screen of the mobile terminal according to the number of blinks obtained (for example, 12 times). Further preferably, the lock screen duration (for example, 3 minutes, 5 minutes or 6 minutes, etc.) can be preset, and when the lock screen duration reaches the preset The user can unlock the screen only after the lock screen duration is set, thereby improving the eye protection effect of the mobile terminal.

Optionally, after locking the screen of the mobile terminal, it is detected whether the user has performed a preset eye protection operation according to the image in front of the screen of the mobile terminal, and when it is detected that the user has performed the eye protection operation, the screen of the mobile terminal is locked. unlock. Wherein, the preset eye protection operation may be for the user to perform preset eye movements (for example, eyeballs rotate regularly) or for the user to watch eye protection images (for example, natural scenery or other green scene images). Preferably, after locking the screen of the mobile terminal, an eye protection reminder is output, and according to the image in front of the screen of the mobile terminal, it is determined whether the user has performed the eye movement, and if the user has performed the eye movement, then the mobile terminal is checked. The screen is unlocked, thereby realizing automatic unlocking after the screen is locked, and improving the degree of humanization and intelligence of the mobile terminal.

As an example, after locking the screen of the mobile terminal, output the eye protection image specified by the user and the reminder to watch the eye protection image, and then determine whether the user watches the output eye protection image according to the image in front of the screen of the mobile terminal acquired in real time , when the duration of the user watching the output eye protection image reaches a preset viewing time, unlock the screen of the mobile terminal.

In the embodiment of the present invention, according to the number of times the user blinks within a preset time period, it is determined whether the user needs eye protection. The eye protection function improves the eye protection effect of the mobile terminal.

Embodiment two:

Fig. 2 shows the structure of the eye protection device of the mobile terminal provided by the second embodiment of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown, including:

The eye position determining unit 21 is configured to acquire an image in front of the screen of the mobile terminal, perform face recognition on the image, and determine the position of the user's eyes in the image according to the face recognition result.

In the embodiment of the present invention, when the mobile terminal is in use, the image in front of the screen of the mobile terminal is first acquired, and then face recognition is performed on the acquired image, and the eye position determining unit determines that the user's eyes are in the image according to the face recognition result. position to lock the position of the user's eyes, so as to facilitate the tracking and detection of the user's eyes.

The number of blinks acquisition unit 22 is configured to acquire the number of blinks of the user within a preset time period according to the position of the user's eyes in the image.

In the embodiment of the present invention, after the position of the user's eyes is locked, the state of the user's eyes is monitored according to the position of the user's eyes in the image, and the number of blink acquisition unit acquires the blinks of the user within a preset time period (for example, 1 minute) times, so as to determine whether the user's eyes need the automatic protection of the mobile terminal.

The eye protection instruction execution unit 23 is configured to determine whether the number of blinks is less than a preset number, and execute a preset eye protection instruction when the number of blinks is less than the preset number.

In the embodiment of the present invention, after obtaining the number of blinks of the user within a preset time period (for example, 1 minute), the obtained number of blinks is compared with the preset number of blinks (for example, 15 times), when the obtained number of blinks When the number of blinks is less than the preset number of times, it means that the user's eyes need to be automatically protected by the mobile terminal. At this time, the eye protection instruction execution unit executes the preset eye protection instruction. Preferably, there are multiple preset eye protection instructions, and when the preset eye protection instructions are executed, different eye protection instructions are executed according to the obtained number of blinks, thereby improving the accuracy of eye protection.

In the embodiment of the present invention, the eye protection instruction may be an instruction to lock the screen of the mobile terminal, an instruction to black the screen, or an instruction to shut down the mobile terminal. Lock the screen of the mobile terminal according to the number of blinks obtained (for example, 12 times). Further preferably, the lock screen duration (for example, 3 minutes, 5 minutes or 6 minutes, etc.) can be preset, and when the lock screen duration reaches the preset The user can unlock the screen only after the lock screen duration is set, thereby improving the eye protection effect of the mobile terminal.

Optionally, after locking the screen of the mobile terminal, it is detected whether the user has performed a preset eye protection operation according to the image in front of the screen of the mobile terminal, and when it is detected that the user has performed the eye protection operation, the screen of the mobile terminal is locked. unlock. Wherein, the preset eye protection operation may be for the user to perform preset eye movements (for example, eyeballs rotate regularly) or for the user to watch eye protection images (for example, natural scenery or other green scene images). Preferably, after locking the screen of the mobile terminal, an eye protection reminder is output, and according to the image in front of the screen of the mobile terminal, it is determined whether the user has performed the eye movement, and if the user has performed the eye movement, then the mobile terminal is checked. The screen is unlocked, thereby realizing automatic unlocking after the screen is locked, and improving the degree of humanization and intelligence of the mobile terminal.

In the embodiment of the present invention, the eye position determination unit acquires the image in front of the screen of the mobile terminal, performs face recognition on the image, and determines the position of the user's eyes in the image according to the face recognition result, and the blink count acquisition unit determines the position of the user's eyes according to the position of the user's eyes. position in the image, obtain the number of blinks of the user within a preset time period, determine whether the number of blinks is less than the preset number, and when the number of blinks is less than the preset number, the eye protection instruction execution unit executes the preset eye protection instruction, realizing The automatic and intelligent eye protection function of the mobile terminal solves the problem that the user's vision is affected by staring at the electronic screen for a long time, and improves the eye protection effect of the mobile terminal.

In the embodiment of the present invention, each unit of the eye protection device of the mobile terminal can be realized by a corresponding hardware or software unit, and each unit can be an independent software and hardware unit, or can be integrated into a software and hardware unit. limit the invention.

Embodiment three:

Fig. 3 shows the structure of the eye protection device of the mobile terminal provided by the third embodiment of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown, including:

The distance judging unit 31 is configured to monitor the distance between the user in front of the screen of the mobile terminal and the screen of the mobile terminal, and determine whether to acquire an image in front of the screen of the mobile terminal according to the distance.

The determination execution unit 32 is configured to start the camera of the mobile terminal to acquire the image in front of the screen of the mobile terminal when it is determined to acquire the image in front of the screen of the mobile terminal.

In the embodiment of the present invention, when the mobile terminal is in use, the distance judging unit monitors the distance between the user in front of the screen of the mobile terminal and the screen of the mobile terminal in real time, and determines whether to acquire an image in front of the screen of the mobile terminal according to the distance. When acquiring the image in front of the screen of the mobile terminal, the execution unit is determined to trigger the camera of the mobile terminal to acquire the image in front of the screen of the mobile terminal, thereby improving the effectiveness of image acquisition and reducing energy consumption of the mobile terminal.

Preferably, when determining whether to acquire the image in front of the screen of the mobile terminal according to the distance, the acquisition distance lasts for a duration less than the preset threshold, and when the duration is greater than the preset duration (for example, the distance between the user and the screen of the mobile terminal is within 4s When the duration is less than 12cm), it is determined to acquire the image in front of the screen of the mobile terminal, otherwise the image in front of the screen of the mobile terminal is not acquired, thereby improving the accuracy of image acquisition while reducing the energy consumption of the mobile terminal.

The eye position determining unit 33 is configured to acquire an image in front of the screen of the mobile terminal, perform face recognition on the image, and determine the position of the user's eyes in the image according to the face recognition result.

In the embodiment of the present invention, after starting the camera of the mobile terminal, first acquire the image in front of the screen of the mobile terminal, and then perform face recognition on the acquired image, and the eye position determination unit determines the position of the user's eyes in the image according to the face recognition result. Position to lock the position of the user's eyes, so as to facilitate the tracking and detection of the user's eyes.

The number of blinks acquisition unit 34 is configured to acquire the number of blinks of the user within a preset time period according to the position of the user's eyes in the image.

In the embodiment of the present invention, after the position of the user's eyes is locked, the state of the user's eyes is monitored according to the position of the user's eyes in the image, and the number of blink acquisition unit acquires the blinks of the user within a preset time period (for example, 1 minute) times, so as to determine whether the user's eyes need the automatic protection of the mobile terminal.

The eye protection instruction executing unit 35 is configured to determine whether the number of blinks is less than the preset number, and execute the preset eye protection instruction when the number of blinks is less than the preset number.

In the embodiment of the present invention, after obtaining the number of blinks of the user within a preset time period (for example, 1 minute), the obtained number of blinks is compared with the preset number of blinks (for example, 15 times), when the obtained number of blinks When the number of blinks is less than the preset number of times, it means that the user's eyes need to be automatically protected by the mobile terminal. At this time, the eye protection instruction execution unit executes the preset eye protection instruction. Preferably, there are multiple preset eye protection instructions, and when the preset eye protection instructions are executed, different eye protection instructions are executed according to the obtained number of blinks, thereby improving the accuracy of eye protection.

In the embodiment of the present invention, the eye protection instruction may be an instruction to lock the screen of the mobile terminal, an instruction to black the screen, or an instruction to shut down the mobile terminal. Lock the screen of the mobile terminal according to the number of blinks obtained (for example, 12 times). Further preferably, the lock screen duration (for example, 3 minutes, 5 minutes or 6 minutes, etc.) can be preset, and when the lock screen duration reaches the preset The user can unlock the screen only after the lock screen time is set, realizing the automatic and intelligent eye protection function of the mobile terminal, thereby improving the eye protection effect of the mobile terminal.

Optionally, after locking the screen of the mobile terminal, it is detected whether the user has performed a preset eye protection operation according to the image in front of the screen of the mobile terminal, and when it is detected that the user has performed the eye protection operation, the screen of the mobile terminal is locked. unlock. Wherein, the preset eye protection operation may be for the user to perform preset eye movements (for example, eyeballs rotate regularly) or for the user to watch eye protection images (for example, natural scenery or other green scene images). Preferably, after locking the screen of the mobile terminal, an eye protection reminder is output, and according to the image in front of the screen of the mobile terminal, it is determined whether the user has performed the eye movement, and if the user has performed the eye movement, then the mobile terminal is checked. The screen is unlocked, thereby realizing automatic unlocking after the screen is locked, and improving the degree of humanization and intelligence of the mobile terminal.

Therefore, preferably, the distance judging unit 31 includes:

The distance judging subunit 311 is used to acquire the duration of the distance being less than the preset threshold. When the duration is greater than the preset duration, it is determined to acquire the image in front of the screen of the mobile terminal, otherwise it is determined not to acquire the image in front of the screen of the mobile terminal.

In the embodiment of the present invention, each unit of the eye protection device of the mobile terminal can be realized by a corresponding hardware or software unit, and each unit can be an independent software and hardware unit, or can be integrated into a software and hardware unit. limit the invention.

Embodiment four:

FIG. 4 shows the structure of the mobile terminal provided by Embodiment 3 of the present invention. For convenience of description, only the parts related to the embodiment of the present invention are shown.

The mobile terminal 4 of the embodiment of the present invention includes a processor 40 , a memory 41 and a computer program 42 stored in the memory 41 and operable on the processor 40 . When the processor 40 executes the computer program 42, it realizes the steps in the above embodiment of the eye protection method for the mobile terminal, such as steps S101 to S103 shown in FIG. 1 . Alternatively, when the processor 40 executes the computer program 42, it realizes the functions of the units in the above-mentioned device embodiments, such as the functions of the units 21 to 23 shown in FIG. 2 and the units 31 to 35 shown in FIG. 3 .

In the embodiment of the present invention, when the processor 40 executes the computer program 42 to implement the steps in the above-mentioned embodiments of the screen wake-up control method, it acquires the image in front of the screen of the mobile terminal, performs face recognition on the image, and according to the face recognition As a result, the position of the user's eyes in the image is determined, and according to the position of the user's eyes in the image, the number of blinks of the user within a preset time period is obtained, and it is determined whether the number of blinks is less than the preset number. When the number of blinks is less than the preset number to execute the preset eye protection instructions.

The mobile terminal in the embodiment of the present invention may be a mobile phone, a tablet computer or a learning machine. For the steps implemented by the processor 40 in the mobile terminal 4 when executing the computer program 42 , please refer to the description of the method in the first embodiment, which will not be repeated here.

Embodiment five:

In an embodiment of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned embodiments of the eye protection method for a mobile terminal are implemented, For example, steps S101 to S103 shown in FIG. 1 . Alternatively, when the computer program is executed by the processor, the functions of the units in the above-mentioned device embodiments, such as the functions of the units 21 to 23 shown in FIG. 2 and the units 31 to 35 shown in FIG. 3 , are realized.

In the embodiment of the present invention, the image in front of the screen of the mobile terminal is obtained, face recognition is performed on the image, the position of the user's eyes in the image is determined according to the face recognition result, and the position of the user's eye in the image is obtained according to the position of the user's eye in the image. The number of blinks within the preset time period determines whether the number of blinks is less than the preset number, and when the number of blinks is less than the preset number, the preset eye protection instruction is executed. For the eye protection method of the mobile terminal implemented when the computer program is executed by the processor, further reference may be made to the description of the steps in the foregoing method embodiments, which will not be repeated here.

The computer-readable storage medium in the embodiments of the present invention may include any entity or device or recording medium capable of carrying computer program codes, such as ROM/RAM, magnetic disk, optical disk, flash memory and other memories.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. within range.

Claims (10)

1. a kind of eye care method of mobile terminal, it is characterised in that methods described comprises the steps：

The image in front of mobile terminal screen is obtained, recognition of face is carried out to described image, it is true according to the face recognition result Determine position of the eyes of user in described image；

According to position of the eyes of the user in described image, the user blink in preset time period time is obtained Number；

Determine whether the number of winks is less than preset times, when the number of winks is less than preset times, perform default Eyeshield instructs.

2. the method as described in claim 1, it is characterised in that before the step of obtaining the image in front of mobile terminal screen, Methods described also includes：

The distance between user and described mobile terminal screen in front of the mobile terminal screen is monitored, it is true according to the distance The fixed image whether obtained in front of the mobile terminal screen；

When it is determined that obtaining the image in front of the mobile terminal screen, start the camera of the mobile terminal, to obtain State the image in front of mobile terminal screen.

3. method as claimed in claim 2, it is characterised in that determined whether to obtain the mobile terminal screen according to the distance The step of image in curtain front, including：

Duration of the distance continuously less than predetermined threshold value is obtained, when the duration being more than preset duration, it is determined that The image in front of the mobile terminal screen is obtained, otherwise determines not obtain the image in front of the mobile terminal screen.

4. the method as described in claim 1, it is characterised in that when the number of winks is less than preset times, perform default Eyeshield instruction the step of, including：

When the number of winks is less than preset times, screen locking is carried out to the mobile terminal.

5. method as claimed in claim 4, it is characterised in that when the number of winks is less than preset times, perform default Eyeshield instruction the step of after, methods described also includes：

According to the image in front of the mobile terminal screen, detecting the user, whether the default eyeshield of executed operates；

When detecting that eyeshield described in user's executed operates, unlocking screen is carried out to the mobile terminal.

6. a kind of eye protector of mobile terminal, it is characterised in that described device includes：

Eye position determining unit, for obtaining the image in front of mobile terminal screen, recognition of face, root are carried out to described image Position of the eyes of user in described image is determined according to the face recognition result；

Number of winks acquiring unit, for the position according to the eyes of the user in described image, obtain the user and exist Number of winks in preset time period；And

Eyeshield instruction execution unit, for determining whether the number of winks is less than preset times, when the number of winks is less than During preset times, default eyeshield instruction is performed.

7. device as claimed in claim 6, it is characterised in that described device also includes：

Distance Judgment unit, for monitor between the user in front of the mobile terminal screen and the mobile terminal screen away from From being determined whether to obtain the image in front of the mobile terminal screen according to the distance；

Execution unit is determined, for when it is determined that obtaining the image in front of the mobile terminal screen, starting the mobile terminal Camera, to obtain the image in front of the mobile terminal screen.

8. device as claimed in claim 7, it is characterised in that the Distance Judgment unit includes：

Distance Judgment subelement, for obtaining duration of the distance continuously less than predetermined threshold value, when the duration During more than preset duration, it is determined that obtaining the image in front of the mobile terminal screen, otherwise determine not obtain the mobile terminal Image in front of screen.

9. a kind of mobile terminal, including memory, processor and it is stored in the memory and can be on the processor The computer program of operation, it is characterised in that realize such as claim 1 to 5 described in the computing device during computer program The step of any one methods described.

10. a kind of computer-readable recording medium, the computer-readable recording medium storage has computer program, and its feature exists In when the computer program is executed by processor the step of realization such as any one of claim 1 to 5 methods described.