TWI671712B - Method for adjusting the aspect ratio of the display and display device thereof - Google Patents

Abstract

A method for automatically adjusting the display screen ratio of a display device includes the steps of capturing an image, analyzing the image to determine whether the image has at least one face, and calculating whether the size of the contour of the face and the distance between the display device meet the standard Distance, if not, adjust the display screen ratio of the display device. With this, the face recognition technology is used to recognize the size of the face contour. As the face is closer to the display device, the face contour is larger; otherwise, the face contour is smaller, thereby automatically adjusting the display screen ratio of the display device or Is the displayed text size.

Description

Method for automatically adjusting display screen ratio and display device thereof

The invention discloses a display device, and more particularly, it relates to a display device that can automatically adjust the display screen ratio according to the distance between a human face and the display device.

At present, display devices on the market, whether in handheld devices such as smart phones or tablets, and large display devices, to adjust the display screen ratio on the display device is nothing more than using a mouse to zoom in or out, or Use your finger to click on the screen of the display device to zoom out or zoom in to adjust the display screen ratio.

In addition, there are also adjustments to the size and display effect of the screen by using the angle of sight between the direction of the line of sight of the face and the plane between the screen of the display device, but because the adjustment methods are manually processed or rely on sensors Adjustment is performed by sensing, so the picture displayed on the display screen may not necessarily meet the needs of the user, and the display screen ratio of the display device may not be adjusted according to the number of people, resulting in defects in use.

According to the shortcomings of the prior art, the present invention discloses a method for automatically adjusting the display screen ratio and a display device thereof, the main purpose of which is to use face recognition technology to detect the face of a person. The size of the contour is that the closer the face is to the display device, the larger the contour of the face is; on the contrary, the smaller it is, so that the display screen ratio or the displayed text size of the display device can be automatically adjusted.

Another object of the present invention is to obtain the size of multiple faces in front of the display device, so as to obtain the average size of the multiple faces, and the average size needs to reach a standard distance from the display device to meet the distance of the viewer viewing the display device. . If the human face is close to the display device, the display ratio of the display device is reduced; if the human face is far from the display device, the display ratio of the display device is enlarged.

According to the above object, the present invention discloses a method for automatically adjusting a display screen ratio of a display device, the steps of which include: capturing an image, analyzing the image to determine whether the image has at least one human face, and calculating the size of the contour of the human face and the display device Whether the distance between them conforms to the standard distance, and if not, adjust the display screen ratio of the display device.

The invention also discloses a display device with automatic adjustment of the display screen ratio, comprising: a display device and an image capturing unit for obtaining an image and a face recognition module, and determining whether there is at least one face image in the image according to the image Or determine the maximum number of face images and calculation modules with the same distance from the display device in the image, and calculate the average width and average height of the contours of these faces based on the face image, or determine the difference between the image and the display device. The maximum number of face images with the same distance between them is used to calculate a distance weight, and the adjustment module adjusts the display screen of the display device according to the average width and average height or distance weight of the contour of the face calculated by the operation module. The scale and display module displays the adjusted image on the display device according to the display screen scale adjusted by the adjustment module.

1‧‧‧ display device

10‧‧‧Image acquisition unit

20‧‧‧Display Module

30‧‧‧ processing unit

302‧‧‧Face recognition module

304‧‧‧ Computing Module

306‧‧‧adjustment module

40‧‧‧ Capture image

42‧‧‧analyze the image and determine if there are faces in this image

44‧‧‧Calculate and judge the distance between the size of the face and the display device is in accordance with the standard distance

46‧‧‧ Maintain the current display screen ratio of the display device

48‧‧‧Adjust display screen ratio of display device

60‧‧‧Capture image

62‧‧‧analyze the image and determine whether there are faces in the image

64‧‧‧ Obtain the distance between multiple faces in the image and the display device

66‧‧‧Calculate distance weight based on the most face images in the image with the same distance from the display device

68‧‧‧Adjust display screen ratio of display device based on distance weight

70‧‧‧ Capture image

72‧‧‧analyze the image and determine whether there are faces in the image

74‧‧‧ Obtain the width and height of the contour of the largest face in the image

76‧‧‧ Adjust the display screen ratio of the display device according to the width and height of the contour of the largest face

80‧‧‧ Capture image

82‧‧‧analyze the image and determine whether there are faces in the image

84‧‧‧ Obtain the width and height of the contours of multiple faces in the image

86‧‧‧Add the width and height of the contours of multiple faces and divide by the number of faces to get the average width and height of the contours of multiple faces

88‧‧‧ Adjust the display screen ratio of the display device based on the average width and height of the contours of multiple faces

P‧‧‧ at most faces

L‧‧‧ Face height

W‧‧‧ Face width

L1, L2, Ln‧‧‧face height

W1, W2, Wn‧‧‧ Face width

D1, D2‧‧‧Face distance from display device

FIG. 1 is a block diagram showing a display device according to the disclosed technology.

FIG. 2 is a flowchart illustrating steps for capturing an image in front of a display device to determine whether a human face is present and adjusting a display screen ratio of the display device according to the technology disclosed in the present invention.

FIG. 3A is a technology disclosed in accordance with the present invention, showing that there is a long distance between a person and a display device.

FIG. 3B is a technology disclosed in accordance with the present invention, showing that there is a short distance between a person and a display device.

FIG. 4A is a flowchart illustrating a step of adjusting a display screen ratio of a display device by using a distance weight according to the technology disclosed in the present invention.

FIG. 4B is a schematic diagram illustrating a technique for adjusting a display screen ratio of a display device using a distance weight according to FIG. 4A according to a technique disclosed in the present invention.

FIG. 5A is a flowchart illustrating a procedure for adjusting a ratio of a screen displayed on a display device by using a width and a height of a contour of a human face according to a technique disclosed in the present invention.

FIG. 5B is a schematic diagram illustrating adjusting the display screen ratio of the display device by using the width and height of the contour of the largest human face according to the technology disclosed in FIG. 5A.

FIG. 6A is a flowchart illustrating a step of adjusting a ratio of a screen displayed on a display device by using an average width and an average height of a contour of a human face according to a technique disclosed in the present invention.

FIG. 6B is a schematic diagram illustrating a technique for adjusting the proportion of a picture displayed on a display device according to FIG. 6A by using the average width and average height of the contours of the most human faces in an image according to FIG. 6A.

Please refer to Figure 1 first. FIG. 1 is a block diagram showing a display device according to the disclosed technology. In FIG. 1, the display device 1 includes an image capturing unit 10, a display module 20, and a processing unit 30. The processing unit 30 is electrically connected to the image capturing unit 10 and the display module 20, respectively. In addition, the processing unit 30 further includes a face recognition module 302, a calculation module 304, and an adjustment module 306. The calculation module 304 is electrically connected to the face recognition module 302 and the adjustment module 306, respectively. More specifically, the display module 20 is electrically connected to the adjustment module 306 in the processing unit 30.

Please also refer to Figure 1. The image capturing unit 10 in FIG. 1 is used to capture an image in front of the display device 1. The image capturing unit 10 is a camera lens or a camera lens without a sensor. The processing unit 30 processes and analyzes the image according to the image captured by the image capturing unit 10, and adjusts the display screen ratio of the display device 1 according to the analysis result. Specifically, the face recognition module 302 in the processing unit 30 is used to identify whether there is a human face in the image. The computing module 304 is used to calculate the distance between the human face and the display device 1. Based on the calculated result, this result is transmitted to the display module 20, and the adjustment module 306 is used to adjust and control the display module. 20 The ratio of the screen to be displayed on the display device 1.

Please refer to FIG. 2. FIG. 2 is a flowchart illustrating steps for capturing an image in front of a display device to determine whether a human face is present and adjusting a display screen ratio of the display device according to the technology disclosed in the present invention. It will be explained with reference to FIG. 1. First, step 40, capturing an image. In this step, the image capturing unit 10 is used to capture an image in front of the display device 1. Next, step 42 analyzes the image and determines whether there is a human face in the image. In step 42, the face recognition module 302 uses the face recognition algorithm to find the face in the image. If it is recognized that it has a face, it proceeds to step 44; if it does not recognize a face, it returns to step 40 and restarts Capture image. Here, it should be explained that using a face recognition algorithm to determine whether an image has a human face or the position of a human face has been widely used in related technical fields, and how to recognize whether a human face is recognized in an image is not The technical features of the present invention, therefore, do not state the calculation principle of the face recognition algorithm.

According to the above step 42, if it is analyzed that there is a human face in the image, step 44 is performed to calculate and judge that the distance between the size of the outline of the human face and the display device is in accordance with the standard distance. If the distance between them does not meet the standard distance, step 48 is performed to adjust the display screen ratio of the display device. In addition, if the size of the contour of the human face and the distance between the display device and the standard distance match the standard distance, step 46 is performed to maintain the current display screen ratio of the screen. It should be noted here that the standard distance between the human face and the display device 1 refers to the display distance. The vertical length of the screen of the display device 1 is three times. For example, if the display device 1 is a 43-inch liquid crystal display screen, the vertical length of the display device 1 is 571 centimeters (mm), so the standard distance is three times the vertical length of the display device 1, which is 571x3. Its standard distance is 1713 cm. Taking the display device 1 as a 49-inch liquid crystal display screen as an example, the vertical length of the 49-inch display device 1 is 646 cm, and the standard distance is 646x3, which is 1938 cm. That is to say, the standard distance defined in the present invention will change with the display device 1 of different sizes. This is also because the ratio of the screen displayed by the display devices 1 of different sizes is different. The size to change. In addition, it should be noted that although the display devices 1 of the same size, for example, a 49-inch liquid crystal display device 1, the vertical length of the screen set by the liquid crystal display screens of different manufacturers is also different, so in the present invention Three times the vertical length of the screen of the display device 1 is used as the standard distance between the human face and the display device 1.

When the computing module 304 calculates and determines that the distance between the face in front of the display device 1 and the display device 1 does not conform to the standard distance, that is, does not meet the definition of three times the vertical length of the screen of the display device 1, the adjustment module 306 adjusts the screen ratio to be displayed on the display device 1, and then the display module 20 displays the adjusted screen ratio on the display device 1. For example, if the computing module 304 calculates and determines that the distance between the face in the captured image and the display device 1 is less than the standard distance, the distance D2 between the person and the display device 1 is shorter, such as Figure 3B. In order that the human face and / or other images other than the human face can also be clearly displayed on the display device 1, the adjustment module 306 adjusts and reduces the ratio of the screen to be displayed on the display device 1, so that the display module 20 is displayed on the display. If the human face in the image displayed on the device 1 is less than the entire display device 1, only one human face can be seen or the size of the human face exceeds the displayed screen ratio. If the computing module 304 calculates and determines that the distance between the face in the captured image and the display device 1 is greater than the standard distance, this means that the distance D1 between the person and the display device 1 is far, as shown in FIG. 3A Show. In order that the human face can be clearly displayed on the display device 1, the adjustment module 306 will be displayed on the display device 1. The screen ratio on the display is enlarged so that the display module 20 can clearly display the human face in the image on the display device 1, because the distance between the human face and the display device 1 is far, which makes the display device 1 The face shown above is very small.

Please refer to FIG. 4A. FIG. 4A is a flowchart illustrating a step of adjusting a display screen ratio of a display device by using a distance weight according to the technology disclosed in the present invention. In FIG. 4A, in step 60, an image is captured. Then, step 62 is performed to analyze the image and determine whether there is a human face in the image. Immediately after step 64, the distances between the multiple faces in the image and the display device are obtained. Next, in step 66, the distance weight is calculated based on the most facial images with the same distance from the display device in the image. Step 68: Adjust the display screen ratio of the display device according to the distance weight.

For example, as shown in FIG. 4B, in FIG. 4B, there are multiple people standing in front of the display device 1, some are closer to the display device 1, and some are farther away, and multiple people are at the same distance from the display device 1. In order to display on the display device 1 the largest number of human faces with the same distance from the display device 1, the image capturing unit 10 (as shown in FIG. 1) Capture. Next, the face recognition module 302 analyzes whether there is a human face in the image. According to this embodiment, there are multiple human faces in the image, and the distance from the display device 1 is far or near. Then, the computing module 304 (as shown in FIG. 1) calculates the distance between each face and the display device 1 according to the faces in the image, as shown by D1 in FIG. 4B. Then, find the most facial image with the same distance from the display device 1 as P shown in FIG. 4B. Then, a distance weight is used to multiply the most human faces with the same distance from the display device 1. Then, the adjustment module 306 (as shown in FIG. 1) uses the distance weight after the multiplication to adjust the screen ratio displayed on the display device 1. It should be explained here that if there are multiple distance weights before the display device 1, the maximum value of the distance weights is used as the main basis for adjusting the display screen ratio of the display device 1. Finally, the display module 20 (as shown in FIG. 1) displays a plurality of human faces with the same distance as the main display screen according to the adjusted screen ratio, and displays the pictures on the display device 1.

Please refer to FIG. 5A. FIG. 5A is a flowchart illustrating a procedure for adjusting a display screen ratio on a display device by using a width and a height of a contour of a human face according to the technology disclosed in the present invention. In FIG. 5A, in step 70, an image is captured. Then, step 72 is performed to analyze the image and determine whether there is a human face in the image. Then, in step 74, the width and height of the contour of the largest face in the image are obtained. In this step, the largest face in the image is used as the main display object. Therefore, the face recognition module 302 is used to find the largest face in the image. Following step 76, the display screen ratio of the display device is adjusted according to the width and height of the contour of the largest face. In this step, since the main displayed object is mainly the largest human face in the image, the largest human face in the image is used to adjust the proportion of the screen displayed on the display device 1.

For example, as shown in FIG. 5B, there are multiple people standing in front of the display device 1, and after the image capturing unit 10 (as shown in FIG. 1) captures the image in front of the display device 1, the face recognition module 302 (as shown in FIG. 5) (Shown in 1) to determine whether there is a human face in this image. Then, the computing module 304 (as shown in FIG. 1) is used to obtain the width W and height L of the contour of the largest human face in the image. In this embodiment, the contours of a human face are different, and each person has a different definition of the size of the face. Therefore, in this embodiment, the width of the contour of each face in the image is Height L to judge. Next, the adjustment module 306 (as shown in FIG. 1) adjusts the display to be displayed according to the width W and height L of the contour of the largest face by the calculation result of the operation module 304 (as shown in FIG. 1). The display screen ratio on the display device 1. Finally, the display module 20 (shown in FIG. 1) uses the human face with the largest image as a main display object and displays it on the display device 1.

Please refer to FIG. 6A. FIG. 6A is a flowchart illustrating a step of adjusting a display screen ratio of a display device by using an average width and an average height of a contour of a human face according to a technique disclosed in the present invention. Refer to FIG. 1 together. In FIG. 6A, in step 80, an image is captured. Then, step 82 is performed to analyze the image and determine whether there is a human face in the image. Immediately after step 84, the widths and heights of the contours of multiple faces in the image are obtained. Step 86: Add the width and height of the contours of multiple faces Then divide by the number of faces to get the average width and height of the contours of multiple faces. Next, in step 88, the display screen ratio of the display device is adjusted according to the average width and height of the contours of the multiple human faces.

For example, as shown in FIG. 6B, in FIG. 6B, there are multiple people standing in front of the display device 1, some are closer to the display device 1, some are farther away, and more than one person is at the same distance from the display device 1. At this time, in order to display all the images appearing in front of the display device 1 on the display device 1, the image capturing unit 10 (as shown in FIG. 1) captures the images in front of the display device 1. Next, the face recognition module 302 (as shown in FIG. 1) analyzes whether there is a human face in the image. According to this embodiment, there are multiple human faces in the image, and the distance from the display device 1 is far or near. Then, the operation module 304 adds the widths W1, W2 ... Wn and the heights L1, L2 ... Ln of the contours of the faces in the image and divides them by the number of faces (n). Get the average height and average width of the contours of multiple faces. Then, the adjustment module 306 (as shown in FIG. 1) uses the average height and average width of multiple faces to adjust the display screen ratio on the display device 1. Finally, the display module 20 (as shown in FIG. 1) The adjusted picture ratio is displayed on the display device 1 by using a plurality of human faces in front of the display device 1 as a main display screen.

According to the above embodiment, the present invention uses the image capturing unit 10 to obtain an image in front of the display device 1, and uses a face recognition module 302 to analyze and determine whether there is a human face in the image. The distance between the face and the display device 1, the size of the human face, the size or the average width and average height of the face contour, the display screen ratio of the display device 1 is adjusted according to the needs of the user.

Claims (5)

A method for automatically adjusting the display screen ratio of a display device includes: capturing an image in front of the display device; analyzing the image to determine whether there are multiple faces in the image; and calculating an average width and An average height, where the average width is the sum of the widths of the faces and divided by the number of the faces, and the average height is the sum of the heights of the faces and divided by the faces And calculate whether a distance between the faces and the display device conforms to a standard distance according to the average width and the average height, and if not, adjust a display screen ratio of the display device. The method according to item 1 of the scope of patent application, wherein the standard distance is three times the vertical length of a screen of the display device. A display device capable of automatically adjusting a display screen ratio includes: an image capturing unit for obtaining an image in front of the display device; and a face recognition module for determining whether there are multiple faces in the image based on the image An arithmetic module that calculates an average width and an average height of the faces; an adjustment module that adjusts the display based on the average width and the average height of the faces calculated by the arithmetic module A display screen ratio of the device; and a display module, which displays the adjusted image on the display device according to the display screen ratio adjusted by the adjustment module. The display device capable of automatically adjusting the display screen ratio as described in item 3 of the scope of patent application, wherein the image capturing unit is a camera lens. According to the display device capable of automatically adjusting the display frame ratio according to item 3 of the scope of the patent application, the image capturing unit is a camera lens without a sensor.