WO2012142869A1 - Method and apparatus for automatically adjusting terminal interface display - Google Patents

Abstract

Disclosed in an embodiment of the present invention are a method and apparatus for automatically adjusting terminal interface display; the method comprising: obtaining the physical distance data from a target object to a terminal and/or a target area model of the target object; determining a target area tracking data model according to the target area model and/or the physical distance data, and obtaining terminal interface display parameters corresponding to the target area tracking data model according to the mapping relationship between the target area tracking data model and the terminal interface display parameters; and adjusting the display content and/or display method of the current terminal interface according to the obtained terminal interface display parameters. The technical solution of the embodiment of the present invention can reduce user learning cost, improve user experience and make terminal operations more convenient and flexible.

Description

 Method and device for automatically adjusting terminal interface display

 The present invention relates to the field of mobile communications, and in particular, to a method and apparatus for automatically adjusting terminal interface display. Background technique

 In the prior art, when the user interacts with the mobile phone, the user can operate the mobile phone through the touch screen of the mobile phone. For example, when the image is enlarged, the user only needs two fingers to slide from the inside to the outside on the screen of the mobile phone, and the mobile phone automatically according to the mobile phone The speed and distance of the finger sliding are calculated as a multiple to be enlarged, and the enlarged image is displayed on the mobile phone interface according to the calculated magnification.

 At present, this kind of intelligent interaction based on touch sensing has made breakthroughs in comparison with the way of interacting with buttons in the past, which is more in line with the trend of humanized interaction design and the natural behavior habits of users, which is the basic design of the next generation mobile phone interface. Principles and requirements. However, the intelligent interaction method based on touch sensing still has the following shortcomings: When zooming in on the picture, the user must operate with at least one hand, so for the disabled without the arm, the above operation cannot be completed; The user also needs to do the sliding operation by hand, even if the operation is very simple, but for beginners, it is also necessary to learn the cost to get used to this interactive mode. Summary of the invention

 In order to solve the above technical problem, an embodiment of the present invention provides a method and apparatus for automatically adjusting a terminal interface display.

An embodiment of the present invention provides a method for automatically adjusting a terminal interface display, including: acquiring physical distance data of a target object to a terminal and/or a target area model of a target object; and determining target area tracking according to the target area model and/or physical distance data. Data model, and Obtaining a terminal interface display parameter corresponding to the target area tracking data model according to a mapping relationship between the target area tracking data model and the terminal interface display parameter;

 Adjust the display content and/or display mode of the current terminal interface according to the obtained terminal interface display parameters.

 An embodiment of the present invention further provides an apparatus for automatically adjusting a terminal interface display, including: an acquiring unit, configured to acquire physical distance data of a target object to a terminal and/or a target area model of the target object;

 The monitoring unit is configured to determine a target area tracking data model according to the target area model and/or the physical distance data, and obtain a terminal interface corresponding to the target area tracking data model according to the mapping relationship between the target area tracking data model and the terminal interface display parameter Display parameter

 The control unit is configured to adjust the display content and/or display mode of the current terminal interface according to the acquired terminal interface display parameters.

 The beneficial effects of the embodiments of the present invention are as follows:

 By establishing a target area tracking data model, and controlling the display of the terminal screen according to the mapping relationship between the target area tracking data model and the terminal interface display parameters, the existing terminal operation mode is expanded, and a new man-machine is provided. In the smart interaction mode, the embodiment of the invention can simulate the reading habit of the user, and adjust the content displayed on the screen according to the reading habit of the user, and adjust the font size, and can reduce the user learning cost and improve the user experience. It makes the terminal operation more convenient and flexible, and is conducive to improving the market competitiveness of the terminal, especially for users with broken arms, so that the content displayed on the terminal screen and the manner of display can be adjusted without hands-on. DRAWINGS

 1 is a schematic structural diagram of an apparatus for automatically adjusting a terminal interface display according to an embodiment of the present invention; FIG. 2 is a schematic diagram of a preferred structure of an embodiment of the present invention;

FIG. 3 is a schematic flow chart of a method for automatically adjusting a terminal interface display according to an embodiment of the present invention. detailed description

 Embodiments of the present invention provide a method and apparatus for automatically adjusting a terminal interface display. In actual life, if an item needs to be carefully viewed, in a person's natural behavior, the most natural behavior is to approach the item, close to There are two ways: 1. Put the eyes of the people together; 2. Take the items closer. It can be seen that if you don't use your hand, you need to zoom in to see an item. The most natural habit of people is to look around. Just close the eye to the item and you can zoom in. If you use your hand, this hand does not actually have any extra operations. Just move the item closer and move closer. If you want to see the upper or lower part, move the item up and down. According to the above analysis, the embodiment of the invention provides a method and a device for automatically adjusting the display of the terminal interface according to the distance between the human eye and the screen. The method and the device simulate the natural behavior of the human being, and are a more humanized interaction scheme. Will not let users pay any learning costs.

 The embodiments of the present invention are further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

 Device embodiment

 According to an embodiment of the present invention, a device for automatically adjusting a terminal interface display is provided. FIG. 1 is a schematic structural diagram of an apparatus for automatically adjusting a terminal interface display according to an embodiment of the present invention. As shown in FIG. 1, according to an embodiment of the present invention, The apparatus for automatically adjusting the display of the terminal interface includes: an acquisition unit 10, a monitoring unit 12, and a control unit 14. The respective modules of the embodiments of the present invention will be described in detail below.

 Specifically, the obtaining unit 10 is configured to acquire physical distance data of the target object to the terminal and/or a target area model of the target object. Specifically, the acquiring unit 10 includes: a video stream collecting unit, a ranging unit, an identifying unit, and a smart unit. .

The image stream collecting unit is configured to collect the image stream and collect the image data of the target object in the image stream. Preferably, in the embodiment of the present invention, the target object is a face or a person. In practical applications, in order to determine the specific position of an object in space, at least three points are needed, therefore, the image stream The collecting unit needs to collect at least three sets of image streams, and separately collect image data of the target objects in at least three sets of image streams;

 As can be seen from the above description, the image stream collecting unit has the function of collecting corresponding images in a dynamic or static image stream. In addition, in practical applications, the image stream collecting unit can transmit image data to the ranging unit through a proprietary protocol. .

 The ranging unit is configured to calculate physical distance data of the target object to the terminal according to the image data of the target object (ie, the distance between the person or the face to the terminal); in actual applications, the ranging unit will collect at least three sets of image data. They are marked as specific codes, analyze and calculate the relationship between specific codes, and obtain the physical distance data of the target object to the terminal.

 That is to say, the ranging unit supports preprocessing of the image stream, and in addition, the ranging unit also has the capability of transmitting the physical distance data to the identification unit through the private coordination;

 Preferably, in an actual application, the image stream collecting unit and the ranging unit may constitute a terminal tracking sensing module, and the terminal tracking sensing module refers to a device or device having certain intelligent acquisition and computing capabilities and capable of acquiring corresponding object images. In addition, the terminal tracking sensing module is also capable of calculating a specific physical distance from the corresponding object to the terminal, and transmitting the data by a proprietary protocol.

 The identification unit is configured to distinguish the target area from the target object to generate the target area data; preferably, in the embodiment of the invention, the target area is a human eye. Specifically, the identification unit includes: a segmentation processing module and a parameter matching module.

 The segmentation processing module is configured to initially distinguish the target region from the target object according to the intelligent segmentation strategy, and generate preliminary target region data; that is, the segmentation processing module has the capability of collecting the image data stream and the physical distance data through the transmission protocol. At the same time, it has an intelligent segmentation strategy that distinguishes the human eye area from the background and/or face.

The parameter matching module is configured to match the preliminary target area data with the target area model attribute characteristic parameter, determine a real image of the target area, and finally obtain the target area data according to the real image of the target area. In practical applications, the parameter matching module determines the human eye attribute Calculating the feature vector of the human eye and matching the human eye has the ability to recognize the real image of the human eye. The smart unit is configured to receive the target area data (human eye real image data) matched by the parameter matching module, and determine the target area model according to the target area data and the physical distance data, specifically, the smart unit according to the target area data and the physical distance data Calculating a focus area of the target area, and an angle of the target area and the terminal, and generating a target area model according to the focus area of the target area and the angle of the target area and the terminal;

 That is to say, the smart unit has the ability to calculate the human eye focus area and the human eye and screen angle data based on the distance data, and establish an intelligent human eye model having a mapping relationship of human eye image, distance angle data, and focus data.

 Preferably, in practical applications, the parameter matching module and the intelligent unit may constitute a system intelligent module, which has data calculation, intelligent identification, memory storage, and provides a function of establishing a smart human eye model;

 The monitoring unit 12 is configured to determine a target area tracking data model according to the target area model and/or the physical distance data, and obtain a terminal interface display parameter corresponding to the tracking data model according to the mapping relationship between the target area tracking data model and the terminal interface display parameter. ;

 That is, the monitoring unit 12 has the ability to establish a smart human eye tracking data model having a human eye tracking function according to the relationship between the smart human visual and physical distance data, and to have the control unit 14 triggered by monitoring the change of the physical distance data. Ability.

 Preferably, in the actual application, the preset module may be further configured to adjust the display parameters of the terminal interface according to the setting of the user, where the display parameters of the terminal interface specifically include: content layout, interface style, font size, and movement mode. . That is, the preset module has a function of storing a terminal interface display parameter set by the user;

The control unit 14 is configured to adjust the current terminal interface display content and/or display mode according to the acquired terminal interface display parameters. The terminal display module performs display of a user interface (UI) under the control of the control unit 14. That is, the control unit 14 supports the associated supervisor The data of the measuring unit 12 and the preset module are established, and a mapping relationship is established, and the function of managing and using the terminal display module is achieved by sending an instruction to call the configuration parameter in the preset module. Specifically, in a practical application, if the target area model in the target area tracking data model changes, the display content may be adjusted up and down and left and right only according to the change of the target area model; if the target area tracks the physical distance in the data model When the data changes, the size of the font in the display mode can be adjusted only according to the change of the physical distance data; when the target area model and the physical distance data are changed, the display content and the display mode can be simultaneously adjusted.

 It can be seen from the above process that it is necessary to establish a collected image stream, physical distance data of the target object to the terminal, a target area model (for example, a smart human eye model), and a target area tracking data model (for example, an intelligent human eye tracking model). And the mapping relationship between the display parameters of the terminal interface, specifically: establishing a mapping relationship between each set of collected image streams and physical distance data, and establishing a mapping between the collected image stream, the physical distance data, and the target area model (smart human eye model) Relationship, establish a correspondence between the target area model (smart human eye model), the physical distance data and the target area tracking data model (smart human eye tracking model), and establish a correspondence between the target area tracking data model and the terminal interface display parameters relationship. In practical applications, the monitoring unit 12 monitors the change of the target area, and the startup control unit 14 controls these mapping relationships to achieve the purpose of controlling the terminal display module.

The processing flow of each module in the embodiment of the present invention will be described below with reference to the accompanying drawings. 2 is a schematic structural diagram of a preferred embodiment of the present invention. As shown in FIG. 2, the method specifically includes: a terminal tracking sensing module, a segmentation processing module, a system intelligence module, a monitoring module (ie, a monitoring unit in FIG. 1), and a preset module. The system control module (ie, the control unit in FIG. 1) and the terminal display module, wherein the terminal tracking sensing module includes an image stream collecting unit and a ranging unit, and the system intelligent module includes a parameter matching module and an intelligent unit, as shown in FIG. 2 The device shown in the automatic adjustment terminal interface shown needs to perform the following processing when the terminal interface is automatically adjusted according to the human eye: Step 1. The user picks up the terminal, and the terminal tracking sensor module of the terminal starts up immediately. The terminal tracking sensor module synchronously collects the image stream and calculates the physical distance between the item and the terminal screen, and performs data transmission to the segmentation processing module by using a proprietary protocol. . Specifically, three or more cameras in the image stream collecting unit in the terminal tracking sensing module start collecting dynamic and static image streams of corresponding objects in front of the screen of the terminal through multiple directions, and the ranging unit receives images of the objects. After the flow, the image mark is quickly made, and the physical distance data between the corresponding object and the sensing module is calculated. The collected sets of image streams and physical distance data are transmitted to the segmentation processing module through a proprietary protocol.

 Step 2: The segmentation processing module firstly distinguishes the human eye from the image stream by acquiring image stream and physical distance data through techniques such as intelligent image segmentation and image processing, and generates a plurality of sets of human eye image data, and establishes each group of human eyes. The mapping relationship between the image stream and the corresponding physical distance data. The human eye shadow stream is re-identified by a parameter matching module that is transmitted to the system intelligence module through a proprietary protocol.

 Step 3: After receiving the plurality of sets of human eye image streams, the parameter matching module of the system intelligence module matches the human eye by analyzing the feature vector of the human eye multiple times to further determine the real image of the human eye. The multi-group data of the human eye's real image is transmitted to the intelligent unit for further analysis.

 Step 4: The system intelligent module stores the identified sets of human eye real image data through the intelligent unit, synchronously receives the mapping relationship of the physical distance data corresponding to the real image data of each group of human eyes, and obtains the human eye focus area according to the mapping relationship. And the angle data of the human eye and the screen; establishing a mapping relationship between the human eye focus area and the human eye real image, the distance between the human eye and the screen, and the angle between the human eye and the screen, generating a human eye intelligent model, and transmitting to the monitoring Module.

Step 5: The monitoring module generates a smart human eye tracking data model by mapping the physical distance data with the human eye intelligent model. The system control module sends an instruction by monitoring the physical distance data collected by the terminal tracking sensor module. Once the user moves the terminal, the distance between the user and the terminal screen changes, and the human eye focus area, the human eye and the screen angle in the mapping relationship of the human eye intelligent model It will change and the system control module will be started. At the same time, data such as the human eye focus area, the human eye and the screen angle, the human eye and the distance in the corresponding intelligent human eye tracking model at the distance are transmitted to the system control module.

 Step 6. The system control module calls the preset parameters of the preset module through the interface. The preset data includes all configuration parameters that the terminal UI interface can display under the change of distance, for example, content typesetting, interface style, content size, and moving mode. Preferably, when the user is using for the first time, the terminal interface display parameters may be set in the preset module according to the user's habits.

 Step 7. The system control module establishes a mapping relationship between the monitoring module and the preset module. When the monitoring module detects the distance change, the system control module is triggered. The system control module controls the display content and the manner of the terminal display module according to the parameters of the preset module. After receiving the operation instruction, the terminal display module receives data according to the human eye focus area, the human eye and the screen angle, the human eye and the screen distance, and the like. The terminal interface is called to display parameters, and the command is sent to adjust the display layout and style of the content on the terminal screen. For example, the monitoring module detects a near-distance change of the horizontal distance between the human eye and the screen, and the terminal display module zooms in and out on the human eye focus area on the terminal UI interface; meanwhile, according to the angle change of the human eye and the screen, the terminal display module The content of the terminal UI interface is moved up and down. Specifically, when the user's human eye level is close to the screen 5 cm, the monitoring module calculates that the distance data is shortened by 5 cm, triggering the system control module to perform the control operation of the preset module, and the system control module according to the human eye focus area, the human eye and the screen angle The data is used to enlarge the content of the human eye focus area of the UI interface by a factor of two. At this time, the terminal is vertically moved up to 3 cm, and the monitoring module monitors the distance between the human eye and the human focus area of the screen, and the angle of the corresponding human eye and the screen in the intelligent human eye tracking model becomes larger, so that the UI interface content is increased. Moving down, the user can easily see the upper part of the UI interface content.

As can be seen from the above processing, in the embodiment of the present invention, the content of the terminal interface exhibits sufficient flexibility and freedom. The terminal system can adjust the layout and style of the content display on the screen of the terminal according to the distance data of the screen and the human eye. For example, after the distance between the screen and the human eye becomes smaller, the screen content automatically becomes larger. A picture is stored on the terminal, and the image of the terminal screen can be based on the person. The distance between the eye and the screen is automatically adjusted to the appropriate image for the user to see. When the human eye is 30cm away from the screen, the entire character avatar can be seen. The human eye is 20cm away from the screen, and the screen is automatically adjusted to see the lips of the person's avatar. In addition, in the embodiment of the present invention, the terminal system can display the best interface according to the habits and characteristics of the terminal holder. For example, an elderly person is farsighted. After initializing the setting of farsighted data, within the effective value range, regardless of whether the terminal of the old person is far away from the human eye, the interface can be clearly viewed without being affected by the farsightedness disorder.

 With the above technical solution of the embodiment of the present invention, the target area tracking data model is established, and the display of the terminal screen is controlled according to the mapping relationship between the target area tracking data model and the terminal interface display parameter, thereby solving the touch-based touch in the prior art. Inductive intelligent interaction is not conducive to the operation of disabled people and requires users to pay for learning costs. It can expand the existing terminal operation mode, simulate user's living habits, reduce user learning costs, narrow individual user differences, and improve The user's experience makes the terminal operation more convenient and flexible, which is conducive to improving the market competitiveness of the terminal.

 Method embodiment

 According to an embodiment of the present invention, a method for automatically adjusting a terminal interface display is provided. FIG. 3 is a schematic flowchart of a method for automatically adjusting a terminal interface display according to an embodiment of the present invention. As shown in FIG. 3, according to an embodiment of the present invention, The method for automatically adjusting the display of the terminal interface includes the following processing: Step 301: Obtain physical distance data of the target object to the terminal and/or a target area model of the target object;

 Specifically, the obtaining the physical distance data of the target object to the terminal in the step 301 includes: processing the image stream, collecting the image data of the target object in the image stream, and calculating the physical distance data of the target object to the terminal according to the image data of the target object; Preferably, in the embodiment of the present invention, the target object is a face or a person.

In practical applications, in order to determine the specific location of an object in space, at least three points are needed. Therefore, in step 301, the following processing needs to be performed: 1. Collect at least three sets of image streams, Collecting image data of the target object in at least three sets of image streams respectively; 2. Marking at least three sets of image data collected as specific codes, analyzing and calculating the mutual relationship between the specific codes, and acquiring physical distance data of the target object to the terminal.

 Specifically, the acquiring the target area model of the target object in step 301 specifically includes: 1. collecting the image stream, collecting the image data of the target object in the image stream, and calculating the physical distance data of the target object to the terminal according to the image data of the target object; The target area is differentiated from the target object to generate the target area data, and the target area model is determined according to the target area data and the physical distance data. In the embodiment of the present invention, the target area is a human eye.

 Specifically, distinguishing the target area from the target object to generate the target area data specifically includes:

 1. According to the intelligent segmentation strategy, the target region is initially distinguished from the target object to generate preliminary target region data. 2. The preliminary target region data is matched with the target region model attribute parameter to determine the real image of the target region, according to the target region. The real image ultimately captures the target area data.

 Determining the target area model based on the target area data and the physical distance data specifically includes:

1. Calculate the focus area of the target area and the angle of the target area and the terminal according to the target area data and the physical distance data; 2. Generate a target area model according to the focus area of the target area and the angle of the target area and the terminal.

 Step 302: Determine a target area tracking data model according to the target area model and/or physical distance data, and obtain a terminal interface display parameter corresponding to the tracking data model according to the mapping relationship between the target area tracking data model and the terminal interface display parameter;

 Step 303: Adjust the display content and/or display mode of the current terminal interface according to the obtained terminal interface display parameter.

Specifically, in the actual application, if the target area model in the target area tracking data model changes, the display content may be up and down only according to the change of the target area model. If the physical distance data in the target area tracking data model changes, the size of the font in the display mode can be adjusted only according to the change of the physical distance data; when both the target area model and the physical distance data change , you can adjust the display content and display mode at the same time.

 Preferably, in the actual application, the terminal interface display parameters may also be adjusted according to the user's settings, wherein the terminal interface display parameters specifically include: content typesetting, interface style, font size, and moving mode.

 It can be seen from the above process that it is necessary to establish a collected image stream, physical distance data of the target object to the terminal, a target area model (for example, a smart human eye model), and a target area tracking data model (for example, an intelligent human eye tracking model). And the mapping relationship between the display parameters of the terminal interface, specifically: establishing a mapping relationship between each set of collected image streams and physical distance data, and establishing a mapping between the collected image stream, the physical distance data, and the target area model (smart human eye model) Relationship, establish a correspondence between the target area model (smart human eye model), the physical distance data and the target area tracking data model (smart human eye tracking model), and establish a correspondence between the target area tracking data model and the terminal interface display parameters relationship. In practical applications, the monitoring unit monitors the change of the target area, and the startup control unit controls these mapping relationships to achieve the purpose of controlling the terminal display module.

 The processing flow of each of the above modules in the embodiment of the present invention will be described below with reference to the accompanying drawings.

Step 1. The user picks up the terminal, and the terminal tracking sensor module of the terminal starts up immediately. The terminal tracking sensor module synchronously collects the image stream and calculates the physical distance between the item and the terminal screen, and performs data transmission to the segmentation processing module by using a proprietary protocol. . Specifically, three or more cameras in the image stream collecting unit in the terminal tracking sensing module start collecting dynamic and static image streams of corresponding objects in front of the screen of the terminal through multiple directions, and the ranging unit receives images of the objects. After the flow, the image mark is quickly made, and the internal calculation method is used to obtain the corresponding object and the sensing module. Physical distance data. The collected sets of image streams and physical distance data are transmitted to the segmentation processing module through a proprietary protocol.

 Step 2: The segmentation processing module firstly distinguishes the human eye from the image stream by acquiring image stream and physical distance data through techniques such as intelligent image segmentation and image processing, and generates a plurality of sets of human eye image data, and establishes each group of human eyes. The mapping relationship between the image stream and the corresponding physical distance data. The human eye shadow image stream is transmitted to the identification unit in the system intelligence module through a proprietary protocol for re-identification.

 Step 3: After receiving the plurality of sets of human eye image streams, the identification unit of the system intelligence module matches the human eye by analyzing the feature vector of the human eye multiple times to further determine the real image of the human eye, and The plurality of sets of data of the human eye's real image are transmitted to the smart unit for further analysis.

 Step 4: The system intelligent module stores the identified sets of human eye real image data through the intelligent unit, synchronously receives the mapping relationship of the physical distance data corresponding to the real image data of each group of human eyes, and obtains the human eye focus area according to the mapping relationship. And the angle data of the human eye and the screen; establishing a mapping relationship between the human eye focus area and the human eye real image, the distance between the human eye and the screen, and the angle between the human eye and the screen, generating a human eye intelligent model, and transmitting to the monitoring Module.

 Step 5: The monitoring module generates a smart human eye tracking data model by mapping the physical distance data with the human eye intelligent model. The system control module sends an instruction by monitoring the physical distance data collected by the terminal tracking sensor module. Once the user moves the terminal, the distance between the user and the terminal screen changes, and the human eye focus area, the human eye and the screen angle in the mapping relationship of the human eye intelligent model will change accordingly, and the system control module is activated. At the same time, data such as the human eye focus area, the human eye and the screen angle, the human eye and the distance in the corresponding intelligent human eye tracking model at the distance are transmitted to the system control module.

Step 6. The system control module calls the preset parameters of the preset module through the interface. The preset data includes all configuration parameters that the terminal UI interface can display under the change of distance, for example, content typesetting, interface style, content size, moving mode, and the like. Preferably, when the user is using for the first time, The terminal interface display parameters are set in the preset module according to the user's habits.

 Step 7. The system control module establishes a mapping relationship between the monitoring module and the preset module. When the monitoring module detects the distance change, the system control module is triggered. The system control module controls the display content and the manner of the terminal display module according to the parameters of the preset module. After receiving the operation instruction, the terminal display module receives data according to the human eye focus area, the human eye and the screen angle, the human eye and the screen distance, and the like. The terminal interface is called to display parameters, and the command is sent to adjust the display layout and style of the content on the terminal screen. For example, the monitoring module detects a near-distance change of the horizontal distance between the human eye and the screen, and the terminal display module zooms in and out on the human eye focus area on the terminal UI interface; meanwhile, according to the angle change of the human eye and the screen, the terminal display module The content of the terminal UI interface is moved up and down. Specifically, when the user's human eye level is close to the screen 5 cm, the monitoring module calculates that the distance data is shortened by 5 cm, triggering the system control module to perform the control operation of the preset module, and the system control module according to the human eye focus area, the human eye and the screen angle The data is used to enlarge the content of the human eye focus area of the UI interface by a factor of two. At this time, the terminal is vertically moved up to 3 cm, and the monitoring module monitors the distance between the human eye and the human focus area of the screen, and the angle of the corresponding human eye and the screen in the intelligent human eye tracking model becomes larger, so that the UI interface content is increased. Moving down, the user can easily see the upper part of the UI interface content.

As can be seen from the above processing, in the embodiment of the present invention, the content of the terminal interface exhibits sufficient flexibility and freedom. The terminal system can adjust the layout and style of the content display on the screen of the terminal according to the distance data of the screen and the human eye. For example, after the distance between the screen and the human eye becomes smaller, the screen content automatically becomes larger. A picture is stored on the terminal, and the image of the terminal screen can be automatically adjusted to a suitable image according to the distance between the human eye and the screen. When the human eye is 30 cm away from the screen, the entire character avatar can be seen; The screen is 20cm, and the screen is automatically adjusted to see the lips of the person's head. In addition, in the embodiment of the present invention, the terminal system can display the best interface according to the habits and characteristics of the terminal holder. For example, an elderly person is farsighted. After initializing the setting of farsighted data, within the effective value range, regardless of whether the terminal of the old person is far away from the human eye, the interface can be clearly viewed without being affected by the farsightedness disorder. With the above technical solution of the embodiment of the present invention, the target area tracking data model is established, and the display of the terminal screen is controlled according to the mapping relationship between the target area tracking data model and the terminal interface display parameter, and the existing terminal operation mode is performed. The expansion provides a new human-computer intelligent interaction mode, and the embodiment of the invention can simulate the reading habit of the user, and adjust the content displayed on the screen according to the reading habit of the user, and adjust the font size and/or the font size. Reduce the user's learning cost, improve the user's experience, make the terminal operation more convenient and flexible, and help to improve the market competitiveness of the terminal, especially for users with broken arms, so that they can be displayed on the terminal screen without hands-on. The content and display mode are adjusted.

 While the preferred embodiments of the present invention have been disclosed for purposes of illustration, those skilled in the art will recognize that various modifications, additions and substitutions are possible, and the scope of the invention should not be limited to the embodiments described above.

Claims

Claim  A method for automatically adjusting a terminal interface display, comprising:  Obtaining physical distance data of the target object to the terminal and/or a target area model of the target object;  Determining a target area tracking data model according to the target area model and/or the physical distance data, and acquiring a mapping relationship between the target area tracking data model and the terminal interface display parameter, and acquiring the target area tracking data model. Terminal interface display parameters;  Adjusting the current terminal interface display content and/or display mode according to the obtained terminal interface display parameter.  2. The method of claim 1 wherein:  The obtaining the physical distance data of the target object to the terminal specifically includes:  Collecting a video stream, collecting image data of the target object in the image stream, calculating the physical distance data of the target object to the terminal according to the image data of the target object; acquiring a target area model of the target object Specifically include:  Collecting a video stream, collecting image data of the target object in the image stream, calculating the physical distance data of the target object to the terminal according to the image data of the target object; and using the target area from the target object Distinguishing the target area data, and determining the target area model based on the target area data and the physical distance data.  The method according to claim 2, wherein the distinguishing the target area from the target object to generate the target area data specifically includes:  Initially distinguishing the target area from the target object according to an intelligent segmentation strategy, and generating preliminary target area data; Matching the preliminary target area data with the target area model attribute feature parameter, determining a real image of the target area, and finally acquiring the target area data according to the real image of the target area. The method according to claim 1, 2 or 3, wherein the method further comprises: adjusting the display parameters of the terminal interface according to the setting of the user, where the display parameters of the terminal interface specifically include: Content layout, interface style, font size, and how to move.  The method according to claim 2 or 3, wherein the target object is a human face, and the target area is a human eye;  Determining the target area model based on the target area data and the physical distance data includes:  Calculating a focus area of the target area and an angle of the target area and the terminal according to the target area data and the physical distance data;  The target area model is generated based on a focus area of the target area and an angle of the target area and the terminal.  6. A device for automatically adjusting a terminal interface display, comprising:  An obtaining unit, configured to acquire physical distance data of the target object to the terminal and/or a target area model of the target object;  a monitoring unit, configured to determine a target area tracking data model according to the target area model and/or the physical distance data, and obtain a mapping relationship between the target area tracking data model and the terminal interface display parameter, and acquire the target area Tracking the data interface corresponding to the terminal interface display parameters;  The control unit is configured to adjust the display content and/or the display manner of the current terminal interface according to the obtained terminal interface display parameter.  The device according to claim 6, wherein the acquiring unit comprises: an image stream collecting unit configured to collect a video stream, and collect image data of the target object in the image stream; a ranging unit, configured to calculate physical distance data of the target object to the terminal according to image data of the target object; a recognition unit, configured to distinguish the target area from the target object to generate target area data;  The smart unit is configured to determine a target area model based on the target area data and the physical distance data.  The device according to claim 7, wherein the identifying unit comprises: a segmentation processing module, configured to initially distinguish the target region from the target object according to an intelligent segmentation strategy, and generate a preliminary target Regional data;  The parameter matching module is configured to match the preliminary target area data with the target area model attribute characteristic parameter, determine a real image of the target area, and finally obtain the target area data according to the real image of the target area.  The device according to claim 6, 7 or 8, wherein the device further comprises: a preset module, configured to adjust the display parameters of the terminal interface according to a setting of a user, wherein the terminal The interface display parameters include: content layout, interface style, font size, and movement mode.  The device according to claim 7 or 8, wherein the target object is a human face, and the target area is a human eye;  The smart unit is configured to: calculate a focus area of the target area, an angle of the target area and the terminal, and a root target area model according to the target area data and the physical distance data.