CN111336644A - An Air Conditioning Adjustment System Based on Eyeball Drive Control - Google Patents

Abstract

The invention discloses an air conditioner adjusting system based on eyeball drive control, which comprises an image acquisition module and an image processing module, wherein the image acquisition module comprises a screen, a camera and a distance sensor, the camera and the distance sensor are arranged above the screen, a functional area is arranged below the screen, the image processing module comprises a processor and a storage, the functional area is in signal connection with the processor, and the processor is in signal connection with an air conditioner control system.

Description

An Air Conditioning Adjustment System Based on Eyeball Drive Control

technical field

The invention relates to the field of image processing and control, in particular to an air-conditioning adjustment system based on eyeball drive control.

Background technique

With the rapid progress of science and technology in the world and the gradual strengthening of my country's comprehensive national strength, the living standards of the people across the country are improving day by day, and people's desire for new technologies is unprecedented. At the same time, the incidence of stroke in my country is also on the rise. The number of strokes in the world accounts for 41% of the world's total. These people will inevitably have sequelae such as limbs and stuttering after recovering. They are weak and have some The need to use air conditioners is also a heavy burden for most families to employ long-term caregivers. In addition, a large number of handicapped persons cannot complete the operation of the buttons on the air conditioner panel and the buttons on the remote control. With the development of science and technology, a large number of voice-controlled air conditioners have emerged on the market. These air conditioners have excellent performance and can be easily controlled.

However, stroke users often have problems with hand and mouth movements. Fortunately, a large number of them can turn their eyes normally. When the nursing staff is not around, if the user wants to adjust the indoor temperature, there is no Any way to do it is to wait for the arrival of the nursing staff. Living in an unsuitable environment for a long time will deepen the patient's condition, and will have adverse effects on both physical and psychological aspects.

SUMMARY OF THE INVENTION

In order to overcome the above-mentioned deficiencies in the background technology, the present invention provides an air-conditioning adjustment system based on eyeball drive control.

To achieve the above object, the present invention provides the following technical solutions:

An air conditioning adjustment system based on eyeball drive control, the system includes an image acquisition module and an image processing module, the image acquisition module includes a screen, a camera and a distance sensor arranged above the screen, and a functional area is provided below the screen, The image processing module includes a processor and a storage, the functional area is signally connected to the processor, and the processor is signally connected to the air conditioning control system.

Preferably, the distance sensor measures the distance from the user to the camera, and the camera collects the face image of the user.

Preferably, the processor determines the relative position of the center of the iris in the orbit to determine the functional area that the user wants to control.

Preferably, the functional areas include opening, closing, heating up, cooling down, increasing wind speed, changing pages and reducing wind speed.

Preferably, in the face image collected by the camera, the center of the iris is located at the upper left corner of the eye socket, the processor sends an air conditioner turn-on signal to the air conditioning control system, and the center of the iris in the face image collected by the camera is located in the upper middle position of the eye socket , the processor sends an air conditioner heating signal to the air conditioner control system, the iris center is located in the upper right corner of the eye socket in the face image collected by the camera, the processor sends an air conditioner wind speed increase signal to the air conditioner control system, and the face image collected by the camera The center of the middle iris is located at the lower left corner of the eye socket, the processor sends a signal to turn off the air conditioner to the air conditioning control system, and in the face image collected by the camera, the center of the iris is located in the lower middle of the eye orbit, and the processor sends a signal to the air conditioning control system to cool down the air conditioner , in the face image collected by the camera, the center of the iris is located at the lower right corner of the eye socket, and the processor sends an air-conditioning wind speed drop signal to the air-conditioning control system.

Preferably, the system working steps are:

(1) The user's face is roughly facing the center of the screen, and the system is activated;

(2) the display area of the screen generates calibration points in turn, the camera collects the face images of the user looking at the specified calibration points respectively, and the processor calculates the iris center and the corners of the eyes in all the face images, thereby constructing the eye feature information, Then determine the mapping relationship between the relative position of the user's iris center in the eyeball and the physical coordinates of the screen display area;

(3) After the calibration is completed, the display area of the screen appears in the functional area of opening, closing, heating, cooling, increasing the wind speed, changing pages and reducing the wind speed, and the camera collects the user's face image in real time and transmits it to the processor, The processor locates the iris center and the canthus position in each frame of the face image in real time, calculates the screen coordinates of the user's eye gaze in real time according to the mapping model determined in step 3, and determines the function that the user wants to realize according to the range of the gaze point screen coordinates;

(4) The processor transmits the function signal that the user wants to realize to the air conditioner control system, and controls the air conditioner to realize the corresponding function.

Compared with the prior art, the beneficial effects of the present invention are:

The present invention proposes an automatic rice cooking system based on eyeball driving and control, which effectively overcomes the problem in the prior art that air-conditioning control requires manual keys or voice commands, and can realize stroke patients and hand-disabled patients who can only watch by eyeballs The air conditioner can be controlled in the designated area of the screen, so that the room temperature can be adjusted to the most suitable state.

Description of drawings

Fig. 1 is the installation position schematic diagram of the present invention;

Fig. 2 is the principle schematic diagram of the present invention;

FIG. 3 is a flow chart of the working principle of the present invention.

In the figure: 101—screen; 102—camera; 103—distance sensor; 201—iris center; 202—image processing module; 203—air conditioning control system.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Referring to FIG. 1 , the present invention is based on an air-conditioning adjustment system based on eyeball drive control. The system includes an image acquisition module and an image processing module 202 . The image acquisition module includes a screen 101 , a camera 102 and a distance sensor 103 disposed above the screen 101 . , there is a functional area below the screen 101 , the image processing module 202 includes a processor and a storage, the functional area is signally connected to the processor, and the processor is signally connected to the air conditioning control system 203 .

The distance sensor 103 measures the distance from the user to the camera 102, the camera 102 collects the user's face image, and the processor determines the relative position of the iris center 201 in the orbit to determine the functional area the user wants to control.

The functional area includes opening, closing, heating, cooling, increasing wind speed, changing pages, and reducing wind speed. In the face image collected by the camera 102, the iris center 201 is located in the upper left corner of the eye socket, and the processor reports to the air-conditioning control system. 203 sends a signal to turn on the air conditioner, the iris center 201 in the face image collected by the camera 102 is located in the upper middle position of the eye socket, the processor sends an air conditioner heating signal to the air conditioner control system 203, and the iris in the face image collected by the camera 102 is located in the iris. The center 201 is located in the upper right corner of the eye socket, and the processor sends a signal of air-conditioning wind speed increase to the air conditioning control system 203. In the face image collected by the camera 102, the iris center 201 is located at the lower left corner of the eye socket, and the processor sends a signal to the air conditioning control system 203. The air conditioner is turned off signal. In the face image collected by the camera 102, the iris center 201 is located in the lower middle of the eye socket. The processor sends an air conditioner cooling signal to the air conditioner control system 203. In the face image collected by the camera 102, the iris center 201 Located at the lower right corner of the eye socket, the processor sends a signal to the air-conditioning control system 203 to decrease the air-conditioning wind speed.

Preferably, the system working steps are:

(1) The user's face is roughly facing the center of the screen 101, and the system is activated;

(2) The display area of the screen 101 generates calibration points in turn, the camera 102 collects the face images of the user looking at the specified calibration points respectively, and the processor calculates the iris center 201 and the corners of the eyes in all face images, thereby constructing the eye feature information, and then determine the mapping relationship between the relative position of the user's iris center 201 in the eyeball and the physical coordinates of the display area of the screen 101;

(3) After the calibration is completed, the display area of the screen 101 appears in the functional area of opening, closing, heating, cooling, increasing the wind speed, changing pages and reducing the wind speed, and the camera 102 collects the user's face image in real time and transmits it to the processor , the processor locates the iris center 201 and the position of the corner of the eye in each frame of the face image in real time, calculates the coordinates of the screen 101 where the user's eyeballs are fixed in real time according to the mapping model determined in step 3, and judges the user according to the coordinate range of the gaze point screen 101 desired function;

(4) The processor transmits the function signal that the user wants to realize to the air conditioner control system 203, and controls the air conditioner to realize the corresponding function.

In the above technical solution, if the user wants to turn on the air conditioner, he only needs to look at the center of the opening function area of the display area of the screen 101. The image processing module 202 determines that the coordinates of the user's gaze point on the screen are within the coordinate range of the opening function area. When the relative position of the center of the iris in the eye socket is the upper left corner, a corresponding command will be sent to the air-conditioning control system 203, and the air-conditioning can be turned on, and the rest of the operations are similar.

For users with hand and mouth diseases, the invention solves the problem that the temperature of the environment can only be adjusted with the help of nursing staff, and realizes that the user can independently control the air conditioner to complete opening, closing, heating, cooling, Increase wind speed, reduce wind speed and other functions.

Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, and substitutions can be made in these embodiments without departing from the principle and spirit of the invention and modifications, the scope of the present invention is defined by the appended claims and their equivalents.

Claims (6)

1. The utility model provides a body system is adjusted to air conditioner based on eyeball drive control, its characterized in that, the system includes image acquisition module and image processing module, image acquisition module includes the screen and sets up camera and the distance sensor in the screen top, the screen below is equipped with the functional area, image processing module include treater and accumulator, the functional area is connected with treater signal, treater and air conditioner control system signal connection.

2. The system of claim 1, wherein the distance sensor measures the distance from the user to a camera, and the camera captures images of the face of the user.

3. The system of claim 2, wherein the processor determines the relative position of the center of the iris in the eye socket to determine the functional area that the user wants to control.

4. The system of claim 3, wherein the functional areas comprise turning on, turning off, warming up, cooling down, increasing wind speed, changing pages, and decreasing wind speed.

5. The system according to claim 4, wherein the iris center of the face image collected by the camera is located at the upper left corner of the eye socket, the processor sends an air-conditioning on signal to the air-conditioning control system, the iris center of the face image collected by the camera is located at the upper middle position of the eye socket, the processor sends an air-conditioning temperature-increasing signal to the air-conditioning control system, the iris center of the face image collected by the camera is located at the upper right corner of the eye socket, the processor sends an air-conditioning wind speed-increasing signal to the air-conditioning control system, the iris center of the face image collected by the camera is located at the lower left corner of the eye socket, the processor sends an air-conditioning off signal to the air-conditioning control system, the iris center of the face image collected by the camera is located at the lower middle position of the eye socket, and the processor sends an air-conditioning temperature-decreasing signal to the air-conditioning control system, the center of the iris in the face image collected by the camera is positioned at the lower right corner of the eye socket, and the processor sends an air conditioner air speed reduction signal to the air conditioner control system.

6. The system according to claim 5, wherein the system comprises the following steps:

(1) the face of the user approximately faces the center of the screen, and the system is started;

(2) the display area of the screen sequentially generates calibration points, the camera respectively collects face images of users watching the specified calibration points, and the processor calculates the iris centers and the eye corners in all the face images so as to construct eye feature information and further determine the mapping relation between the relative position of the iris centers of the users in eyeballs and the physical coordinates of the display area of the screen;

(3) after calibration is finished, a display area of the screen is opened, closed, heated, cooled, increased in wind speed, paged and reduced in wind speed, the camera acquires a face image of the user in real time and transmits the face image into the processor, the processor positions the center of an iris and the position of an eye corner in each frame of face image in real time, screen coordinates watched by eyeballs of the user are calculated in real time according to the mapping model determined in the third step, and functions which the user wants to realize are judged according to the range of the fixation point screen coordinates;

(4) and the processor transmits the functional signal which the user wants to realize to the air conditioner control system, and controls the air conditioner to realize the corresponding function.

Images