WO2019076118A1 - Information display method and apparatus - Google Patents

Abstract

Disclosed in the present application are an information display method and apparatus: acquiring a screenshot of a program interface and displaying a pair of pointers or a cursor; when monitoring an operation executed by the user on the pair of pointers or the cursor, determining the position of each pointer in the pair of pointers or the position of the cursor; for the pair of pointers, further determining the element boundaries corresponding respectively to each pointer, respectively moving each executed pointer to the boundary, and displaying the distance between the pair of pointers; for the cursor, further determining the colour corresponding to the cursor; on the basis of the cursor boundary and the determined colour, determining a character boundary; and thereby determining the character size and displaying same.

Description

Method and device for displaying information Technical field

The present application relates to the field of information technology, and in particular, to a method and an apparatus for displaying information.

Background technique

Currently, when a mobile terminal measures the size of an element or a character in a program interface, it is usually measured by using a tool for measuring the size. Among them, the element size usually refers to the size of the button, window and other areas designed in the interface, and the character size is usually the size of the text in the interface, as shown in Figure 1.

In the prior art, the tool for measuring the size in the mobile terminal needs to drag the cursor by the user's finger and only displays the distance between the cursors.

However, generally, the size measurement of elements and characters needs to be accurate to the pixel level. It can be seen that there is a need for a method for accurately displaying element size and character size on a mobile terminal. Based on the prior art, the present specification provides a new information display method. .

Summary of the invention

The embodiment of the present specification provides a method and an apparatus for information display, which are used to solve the problem that the prior art is difficult to conveniently and accurately determine the element size and character size of the program interface on the mobile terminal.

The embodiments of the present specification adopt the following technical solutions:

A method for displaying information includes:

Obtaining a screenshot of the program interface of the mobile terminal, displaying at least one pair of cursors, and monitoring the operation of the user;

For each pair of cursors, when it is detected that the user performs an operation on the pair of cursors, determining a position corresponding to each of the cursors on which the operation is performed;

Determining, according to each cursor, a selection range corresponding to each cursor in the screenshot;

Determining, according to a preset boundary algorithm, a boundary of an element in the program interface, respectively, in the selection range corresponding to each cursor;

Moving each cursor of the operation to the boundary of the respectively determined element;

Shows the distance between the pair of cursors.

An information display method includes:

Obtaining a screenshot of the program interface of the mobile terminal, displaying at least one cursor, and monitoring the operation of the user;

Determining the position of the cursor on which the operation is performed when it is detected that the user performs an operation on any of the cursors;

Determining the color at the location in the screenshot;

Determining a character boundary according to the boundary of the cursor and the color;

The size of the character covered by the cursor is determined according to the determined character boundary and displayed.

An information display device comprising:

Obtaining a display and monitoring module, obtaining a screenshot of the program interface of the mobile terminal, displaying at least one pair of cursors, and monitoring the operation of the user;

a first determining module, for each pair of cursors, when detecting that the user performs an operation on the pair of cursors, determining a position corresponding to each of the cursors on which the operation is performed;

a second determining module, according to each cursor corresponding to the position, determining, in the screenshot, a selection range corresponding to each cursor;

a third determining module, respectively, determining, according to a preset boundary algorithm, a boundary of an element in the program interface in the selection range corresponding to each cursor;

a fourth determining module, respectively moving each cursor that is to perform the operation to a boundary of the respectively determined element;

A display module that displays the distance between the pair of cursors.

An information display device comprising:

Obtaining a display and monitoring module, obtaining a screenshot of the program interface of the mobile terminal, displaying at least one cursor, and monitoring the operation of the user;

a first determining module, when detecting that the user performs an operation on any of the cursors, determining a position of the cursor on which the operation is performed;

a second determining module determining a color at the location in the screenshot;

a third determining module, determining a character boundary according to the boundary of the cursor and the color;

The display module determines the size of the character covered by the cursor according to the determined character boundary and displays it.

A mobile terminal comprising: one or more processors and a memory, the program being configured to perform the following steps by one or more processors:

Obtaining a screenshot of the program interface of the mobile terminal, displaying at least one pair of cursors, and monitoring user operations;

For each pair of cursors, when it is detected that the user performs an operation on the pair of cursors, determining a position corresponding to each of the cursors on which the operation is performed;

Determining, according to each cursor, a selection range corresponding to each cursor in the screenshot;

Determining, according to a preset boundary algorithm, a boundary of an element in the program interface, respectively, in the selection range corresponding to each cursor;

Moving each cursor of the operation to the boundary of the respectively determined element;

Shows the distance between the pair of cursors.

A mobile terminal comprising: one or more processors and a memory, the program being configured to perform the following steps by one or more processors:

Obtaining a screenshot of the program interface of the mobile terminal, displaying at least one cursor, and monitoring the operation of the user;

Determining the position of the cursor on which the operation is performed when it is detected that the user performs an operation on any of the cursors;

Determining the color at the location in the screenshot;

Determining a character boundary according to the boundary of the cursor and the color;

The size of the character covered by the cursor is determined according to the determined character boundary and displayed.

The above at least one technical solution adopted by the embodiments of the present specification can achieve the following beneficial effects:

Through the method provided in this specification, by taking a screenshot of the program interface and monitoring the user's operation on the cursor, the cursor is adsorbed onto the determined element boundary, so that it is possible to determine without moving the cursor line to the element boundary accurately. Accurately measured element size. Similarly, by determining the boundary of the cursor and the color of the cursor position, the character boundary is determined, and the size of the character is accurately determined, so that the size of the character can be obtained by simply overlaying the cursor on the character. Therefore, on the mobile terminal, even if the user's finger cannot accurately move the cursor or the cursor, the accurate element size and the character size are obtained, which makes up for the defect that the prior art is difficult to accurately measure the element size and the character size on the mobile terminal, so that The size of the elements and characters in the program interface can be conveniently and accurately determined on the mobile terminal.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the present application, and are intended to be a part of this application. In the drawing:

1 is a schematic diagram of element sizes and character sizes of an existing program interface;

2 is a process of information display provided by an embodiment of the present disclosure;

Figure 3a is a schematic diagram of a program interface provided by an embodiment of the present specification;

FIG. 3b is a schematic diagram showing different cursor pairs in a program interface provided by an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of displaying a cursor pair in another program interface according to an embodiment of the present disclosure;

4a to 4d are schematic diagrams showing a process of displaying a cursor line and a cursor in a floating window according to an embodiment of the present disclosure;

Figure 5 is a schematic view of a line segment provided by an embodiment of the present specification;

6a to 6d are schematic diagrams of processes for accurately determining element sizes provided by embodiments of the present specification;

7a and 7b are schematic diagrams showing processes of displaying element boundaries according to an embodiment of the present disclosure;

FIG. 8 is another process of displaying information according to an embodiment of the present disclosure;

FIG. 9 is a schematic diagram of determining a boundary of a character according to an embodiment of the present disclosure

Figure 10 is a schematic diagram of a fitting curve provided by an embodiment of the present specification;

FIG. 11 is a schematic diagram showing display element size and character size according to an embodiment of the present disclosure; FIG.

FIG. 12 is a schematic structural diagram of an information display apparatus according to an embodiment of the present disclosure;

FIG. 13 is a schematic structural diagram of another information display apparatus according to an embodiment of the present disclosure;

FIG. 14 is a schematic structural diagram of a mobile terminal according to an embodiment of the present disclosure;

FIG. 15 is a schematic structural diagram of another mobile terminal according to an embodiment of the present disclosure.

Detailed ways

In the prior art, when an application is developed on a mobile terminal, in order to enable the application to provide a better user experience, application development is usually performed by an interaction designer, a visual designer, and a programmer.

The process of application development usually consists of designing the interface of the application, interaction logic, etc. by the interaction designer and visual designer (for the convenience of describing the following collectively referred to as the designer), and determining the design draft of the application (eg, interface style, interaction). The method, etc.), and then the application developer writes the application according to the design draft.

Among them, when the program developer writes the program according to the design draft, it is necessary to visually restore the content of the design draft. However, due to the deviation of the understanding of the design draft by the program developers and designers, it is often difficult to accurately restore the visual effects in the design draft. Therefore, the designer is required to check and write the written application to determine whether there is content that does not meet the design requirements. If so, propose changes to the program developer, and then modify it by the program developer, and repeat until the application meets the design requirements. The process of acceptance and modification described above is commonly referred to as visual restoration.

Among them, when designing the visual effect, the designer mainly accepts the color, element size and character size of the program interface. Also, the element is usually a rectangle composed of parallel lines and vertical lines in the program interface. The size of the size is usually determined based on the number of pixels (pixels, px). For example, in the Android system, the density of the pixels (Density-independent Pixels, dp) is used to represent the element size, and the scale-independent Pixels (sp) Represents the character size.

However, in the prior art, the tool for measuring the size on the mobile terminal generally displays the distance between a pair of cursors, and when the user needs to measure the element or the character size, the cursor is separated from the cursor to the boundary of the element by the finger, and The distance between the cursors displayed by the tool for measuring dimensions, as an element or character size. Due to the low precision of the operation of the human finger on the screen, the accuracy of the measurement is difficult to ensure.

Or in the prior art, the designer takes a screenshot of the application interface and sends it to the personal computer to enlarge the screenshot on a larger screen (eg, the screen of the display), and then to the element or character. The dimensions are measured accurately. However, it will lead to cumbersome operations and low measurement efficiency.

Therefore, the embodiments of the present specification provide a method and an apparatus for displaying information, which solves the problem that the prior art is difficult to conveniently and accurately determine the element size and character size of the program interface on the mobile terminal.

The technical solutions of the present application will be clearly and completely described in the following with reference to the specific embodiments of the specification and the accompanying drawings. It is apparent that the described embodiments are only a part of the embodiments of the present application, and not all of them. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the specification without departing from the inventive scope are the scope of the application.

The technical solutions provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings.

2 is a process of information display provided by an embodiment of the present invention, which may specifically include the following steps:

S100: Obtain a screenshot of the program interface of the mobile terminal, display at least one pair of cursors, and monitor the operation of the user.

Since the method provided by the present specification is for solving the problem that it is difficult to conveniently and accurately measure the size of elements and characters in the program interface of the application on the mobile terminal, the embodiment of the present specification may be implemented by the mobile terminal itself or a program installed on the mobile terminal. The information shows the process.

The mobile terminal may be a device such as a mobile phone or a tablet computer, which is not limited in this specification. On the other hand, if the information display process is executed by a program installed on the mobile terminal, the program can be a program installed in the system of the mobile terminal, and the above information display process can be executed by running the program. At this time, the program interface of the mobile terminal is a program interface of the size of the element to be measured. The program corresponding to the program interface to be measured is a third-party program. For example, the system program (that is, the program interface is the system interface at this time) or other programs installed in the system program, as shown in Figure 3a.

Specifically, whether the information display process is performed by the mobile terminal itself or by a program installed on the mobile terminal, it is necessary to obtain a screenshot of the program interface to be measured and display at least one pair of cursors to monitor the user's subsequent execution of the cursor pair operation. operating. The description does not limit the shape of the cursor. For convenience of description, the following description is made by taking the cursor as a line segment as an example. Specifically, each pair of cursors may be line segments parallel to each other, and the length of the line segments may be set as needed. For example, the line segment of the cursor may be a line segment running through the floating window, or may be a line segment of a preset length, as shown in FIG. 3b.

FIG. 3 is a schematic diagram of a program interface to be measured according to an embodiment of the present disclosure, and FIG. 3b is a schematic diagram of displaying a cursor line and a cursor on a program interface according to an embodiment of the present disclosure.

Further, the cursor can be displayed in a floating window (Float Window). Then the floating window is an interface of a program that executes the information display process, and the floating window can be a transparent window. Moreover, the window Z order of the floating window is higher than the window Z order of the program interface. Thus, when the floating window is displayed, although the window Z sequence of the floating window is above the program interface, the content in the program interface is not obscured. Moreover, since the cursor is displayed in the floating window, when the user operates the cursor, the elements (eg, buttons) in the program interface to be measured are not accidentally touched.

In addition, through the schematic diagram of the program interface as shown in FIG. 1, it can be seen that the elements in the program interface are generally rectangular. Therefore, in order to facilitate the determination of the longitudinal side length of the element and the horizontal side length, two pairs of cursors can be displayed in this specification. Among them, one pair of cursors is a horizontal line segment, and the other pair of cursors is a vertical line segment, as shown in Fig. 3c.

Further, in the present specification, there is no execution order between obtaining a screenshot, displaying a cursor pair, and monitoring a user's operation. You can get the screenshot first, then display the cursor to monitor the user's operation at the end, or you can monitor the user's operation first, and then get the screenshot and finally display the cursor. This specification does not limit this.

Specifically, the floating window can be displayed when a user input instruction is detected. For example, the program corresponding to the floating window can display a floating button after the startup, and the window Z sequence of the floating button is higher than the window Z sequence of the program interface to be measured. Then, after the program to be measured is started, the program interface does not block the floating button. Therefore, the floating window can be displayed on the program interface when the user is monitored to perform a click operation on the floating button (ie, when the user inputs an instruction is monitored). The above process can be as shown in Figures 4a to 4d.

4a is a schematic diagram of a system interface of a mobile terminal provided by the present specification. Among them, APP1 in the system interface is a program corresponding to the floating window, and the floating button can be displayed when the user starts the program. FIG. 4b is a schematic diagram showing floating keys displayed on the system interface after the program corresponding to the floating window is started. The APP4 in the system interface is a program corresponding to the program interface to be measured, and the program interface can be displayed when the user starts the APP4. FIG. 4c is a schematic diagram of displaying a floating button on the program interface after starting the program corresponding to the program interface to be measured. Among them, the window Z order of the floating button is higher than the window Z order of the program interface, so it is not blocked by the program interface. The floating window can be displayed when the user is monitored to perform a click operation on the floating button. FIG. 4d is a schematic diagram of displaying a floating window on the program interface after the user performs a click operation on the floating button. Among them, two pairs of cursors are displayed in the floating window. Moreover, since the floating window is a transparent window, the content in the program interface is not blocked.

Further, in the embodiment of the present specification, a screenshot of the program interface may also be acquired when the user inputs an instruction. The instruction to obtain the screenshot and the instruction to display the floating window may be the same instruction, and when the user inputs the instruction, the floating window and the screenshot may be displayed. Alternatively, the screenshot button may also be displayed in the floating window. When the user clicks the screenshot button, it is determined that the user inputs an instruction and obtains a screenshot of the program interface.

S102: For each pair of cursors, when it is detected that the user performs an operation on the pair of cursors, determine a position corresponding to each of the cursors on which the operation is performed.

In the embodiment of the present specification, for each pair of cursors, when the user is monitored to perform an operation on the pair of cursors, the positions corresponding to the respective cursors of the performed operations may be further determined. For convenience of description, one of a pair of cursors will be described as an example in this specification.

Specifically, since the cursor is usually used for dragging, the operation can be a drag operation. Then, when the user performs a drag operation on the cursor, the position corresponding to the cursor is determined. Of course, this specification does not limit the specific operation of the operation, and can be set as needed. For example, when the user performs a click operation, a double-click operation, or the like on the cursor, the position corresponding to the cursor may be determined.

In addition, in the present specification, a description will be given by taking an example in which the monitoring user performs a drag operation on the cursor. Since the position of the cursor may be constantly changing when the user performs a drag operation on the cursor, the position of the cursor can be determined when the end of the drag operation is detected. To reduce the number of times the cursor position is determined, reducing resource consumption.

It should be noted that the position of the cursor determined at this time is the position of the cursor in the screen of the mobile terminal. Moreover, since the screenshot of the acquired program interface is also displayed on the screen of the mobile terminal, it can also be regarded as the position of the determined cursor as the position of the cursor in the program interface.

S104: Determine, according to each cursor, a selection range corresponding to each cursor in the screenshot.

In the embodiment of the present specification, one of the pair of cursors continues to be described as an example. After the location corresponding to the cursor is determined in step S102, the selected range corresponding to the location may be further determined in the acquired screenshot. That is to say, the selection range corresponding to the position of each cursor is determined. In order to subsequently determine the boundary of the elements in the program interface within the determined selection range according to the preset boundary algorithm, the subsequent steps are performed.

Specifically, since there are usually multiple elements in the program interface and elements farther from the cursor, it is obviously less likely that the user needs to measure the size of the element. That is, the user usually moves the cursor near the border of the element to measure the element size. Therefore, in order to avoid the boundary of the determined erroneous element, after determining the position of the vernier, the selection range corresponding to the position may be determined first. And, the boundary of the element within the selection range is regarded as the boundary to be selected, and the boundary is determined by step S106. Wherein, the length unit of the selection range can be represented by dp. For example, the selection range is within a range of 10 dp from the cursor.

The value of the selection range can be set as needed, which is not limited in this specification. Moreover, since the cursor is a line segment, the length of the line segment can also be set as needed, as shown in Figure 3b. Thus, the selection range can include a vertical range and/or a horizontal range. For example, when the cursor is a horizontal line segment that runs through the screen of the mobile terminal, the selection range may be only a vertical range. When the cursor is a vertical line segment that runs through the screen of the mobile terminal, the selection range may be only a horizontal range. When the cursor is a line segment having a length of 10 dp, the selection range may include both a vertical range and a horizontal range.

S106: Determine, according to a preset boundary algorithm, a boundary of an element in the program interface, respectively, in the selection range corresponding to each cursor.

In the embodiment of the present specification, after determining the selection range corresponding to the cursor, the boundary of the element may be determined according to the preset boundary algorithm.

Specifically, the present specification provides a first method of determining the boundary of an element. First, the boundary of each element in the program interface can be determined according to a preset boundary algorithm. After that, the boundary within the selection range corresponding to the cursor is determined. Finally, from the boundaries within the selection range, select the boundary closest to the cursor. The preset boundary algorithm may be a Sobel edge detection algorithm, a Roberts operator, etc., which is not limited in this specification.

In addition, in the second method of determining the boundary of an element provided by the present specification, the cursor may be a line segment. First, the color displayed by the program interface at the position of the cursor can be determined as the base color. Then, within the selection range, at least one line segment parallel to the line segment of the cursor, exceeding a preset length, and having a different color from the base color is determined. Finally, from among the determined line segments, the line segment closest to the cursor is selected as the determined boundary. The preset length can be set as needed, which is not limited in this specification.

For example, suppose the cursor is a horizontal line segment that runs through the screen. First, you can first determine the base color corresponding to the cursor. Then, starting from the line segment where the cursor is located, up or down, line segments whose length exceeds the preset length and are not the base color are determined line by line. Finally, the line segment with the smallest vertical distance from the line segment is used as the boundary.

It should be noted that, for the elements in the program interface, the element boundary can be regarded as the above line segment in the present specification. For example, assume that the 10x10 color block shown in Figure 5 is an element in the program interface. Then, the boundary of the 1×10 color block enclosed by the dotted line frame is the line segment of the present specification. That is to say, if the color blocks are all within the selection range corresponding to a certain cursor, the color block can be determined as 10 line segments.

S108: Move each cursor that is to perform the operation to a boundary of the respectively determined element.

S110: Display the distance between the pair of cursors.

In the embodiment of the present specification, taking one cursor of a pair of cursors as an example, when the boundary corresponding to the cursor is determined, the cursor line can be moved to the determined boundary. Then, for each pair of cursors to be operated, each cursor in the pair of cursors can determine the boundary of the corresponding element by the above steps S102 to S106. Then, in step S108, each of the cursors in the pair of cursors can be respectively moved to their corresponding element boundaries. Then, when the distance between the pair of cursors is displayed at this time, since the cursor has moved to the boundary of the element, the display distance is accurate.

Specifically, for each pair of cursors in step S102, the user can usually only perform operations on the respective cursors in the pair of cursors. Therefore, when the distance between the pair of cursors is displayed in step S110, there is a case where one of the pair of cursors moves to the boundary of the element, and the other of the cursor lines does not move to the boundary of the element. At this point, the distance between the pair of cursors can also be displayed, but the displayed distance is not the size of the element (as shown in Figures 6a and 6b). After the user repeats the above steps after performing another operation on the cursor, another cursor can also be moved to the boundary of the determined element. Thereby the distance between the displayed cursor pairs is the exact element size (as shown in Figures 6c and 6d). Wherein, the above distance can be displayed in units of dp.

Through the above information display process, it can be seen that it is not necessary to accurately move the cursor to the element boundary. The boundary of the element is determined by determining the selection range corresponding to the cursor. The cursor is then moved to the determined boundary to determine the element size for the exact measurement. Solved the problem of not being able to accurately measure the element size on a mobile terminal.

Further, in the present specification, the screenshot may not be acquired in step S100, but the screenshot may be acquired in step S102 of the present specification. Specifically, the user can be monitored to perform an operation on the cursor as a user input instruction is monitored. Therefore, a screenshot of the program interface can be obtained when the user is monitored to perform a drag operation on the cursor.

Further, since the user's finger operation precision is low, the cursor may be moved to the vicinity of the boundary of the element to be measured after performing the drag operation on the cursor multiple times. If every time the user is monitored to perform an operation on the cursor, obtaining a screenshot may result in too many screenshots being acquired. As a result, the cache of the terminal causes a large storage pressure. And further increase the number of times the terminal performs the Garbage Collection (GC).

Therefore, in the present specification, in order to reduce the buffer pressure and reduce the number of GCs, when monitoring the user performing a drag operation on the cursor, it may first determine whether the screenshot is stored in the preset time period, and if so, calling the stored Screenshot, if not, perform a screenshot operation on the program interface, take a screenshot and store. The screenshot obtained after performing the screenshot operation on the program interface may be stored in the cache of the mobile terminal.

Specifically, the preset time period corresponds to a preset duration, and the duration can be set as needed. When the user is monitored to perform the drag operation, the preset duration is backtracked, and the preset time period is determined. Then, the steps of subsequent judgment are performed. That is to say, when the mobile terminal performs a screenshot operation on the program interface and stores the screenshot. The screenshots already stored in the cache can be used regardless of how many times the user performs a drag operation within the preset duration. There is no need to perform a screenshot operation on the program interface each time the drag operation is monitored.

Further, in the program interface, element boundaries may not be displayed when displayed. For example, an element is a pattern drawn on a transparent background. Then, by the existing method of determining the boundary, only the boundary of the pattern can be determined. Therefore, in order to conveniently determine the boundary of the element, before acquiring the screenshot of the program interface, the existing interface layout boundary display tool can also be activated to display the boundary of each element in the program interface.

For example, assume that FIG. 7a is a case where each element does not display the boundary of an element. Then, after starting the interface layout boundary display tool, the element boundary shown in Figure 7b can be displayed. It should be noted that the program corresponding to the program interface, the program for executing the information display process, and the interface layout boundary display tool can be three different independent programs.

It should be noted that the execution bodies of the steps of the method provided by the embodiment of the present application may all be the same device, or the method may also be performed by different devices. For example, the execution body of step S102 and step S104 may be device 1, and the execution body of step S106 and step S108 may be device 2; for example, the execution bodies of steps S102 and S106 may be device 2, step S104 and step S108. The execution subject can be device 1; and so on. The foregoing description of the specific embodiments of the specification has been described. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than the embodiments and still achieve the desired results. In addition, the processes depicted in the figures are not necessarily required to be in a particular order or in a sequential order to achieve a desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

Based on the information display method shown in FIG. 2, the embodiment of the present specification further provides an information display method, as shown in FIG. 8.

FIG. 8 is an information display process according to an embodiment of the present disclosure, which may specifically include the following steps:

S200: Obtain a screenshot of the program interface of the mobile terminal, display at least one cursor, and monitor the operation of the user.

S202: When it is detected that the user performs an operation on any of the cursors, determine the position of the cursor on which the operation is performed.

In the embodiment of the present specification, the information display process is for displaying the size of a character in the mobile terminal. Similar to the information display process shown in FIG. 2, the information display process can be performed by the mobile terminal itself or an installed program.

Specifically, since the size of the character is usually smaller than the size of the element in the program interface, it is difficult to measure the character by the cursor pair. Therefore, in the present specification, at least one cursor can be displayed when measuring the character size. The character size of the character covered by the cursor is displayed in the subsequent steps. Wherein, in the embodiment of the present specification, the shape of the cursor may be a rectangle. The size of the cursor can be set as needed.

In addition, for the other operations in the step, the descriptions in step S100 and step S102 can be referred to, and the description is not repeated herein.

S204: Determine a color at the position in the screenshot.

S206: Determine a character boundary according to the boundary of the cursor and the color.

In the embodiment of the present specification, after determining the position of the cursor, the color at the position may also be determined in the acquired screenshot. The boundary of the character is then determined based on the boundary of the cursor and the determined color.

Specifically, in the embodiment of the present specification, the cursor may partially cover the character to be measured, and when the color at the position of the cursor is determined in step S204, the color of the character and the background color may be determined. And in the subsequent step S206, the boundary of the character covered by the cursor is determined according to the determined color of the character, the determined background color, and the cursor boundary.

Moreover, since the size of the character can generally only be determined by the height of the character or the width of the character, when determining the boundary of the character, the upper and lower boundaries of the cursor and/or the left and right boundaries of the cursor can be determined first. Of course, since the height of a character is usually taken as the size of a character in the prior art, the description will be made by taking the height of the cursor as an example in the present specification.

First, determine the upper and lower boundaries of the cursor. Thereafter, according to the color determined in step S204, the color corresponding to the upper boundary of the cursor and the color corresponding to the lower boundary of the cursor are further determined. The color corresponding to the upper boundary of the cursor includes the color of the character and the background color corresponding to the upper boundary, and the color corresponding to the lower boundary of the cursor includes the color of the character and the background color corresponding to the lower boundary. Then, determining each row of pixels between the extension lines of the left and right boundaries of the cursor, starting from the upper boundary of the cursor, and selecting a row of pixels that are not exactly the same color as the pixels of the next row from the determined pixels of each row. As the upper boundary of the character. Similarly, for the lower boundary of the cursor, the same method is used to determine the lower boundary of the character boundary. When the upper and lower boundaries of the character boundary are determined, the distance between the upper and lower boundaries is taken as the height of the character boundary.

For example, the process of determining the upper and lower boundaries of a character boundary as shown in FIG. In Figure 9, the cursor is overlaid on the "person" character, which determines that the color of the cursor position is black and white. In step S206, it may be determined line by line from the upper and lower boundaries of the cursor whether or not a color that is not exactly the same as the position of the cursor appears. When a line other than the "person" character is judged, only white is present in the line, and then it can be determined. The boundary of the last character that has been judged to determine the upper and lower boundaries of the character boundary. Further, the distance between the upper and lower boundaries is taken as the height of the character boundary.

Similarly, in the embodiment of the present specification, each column of pixels between the extension lines of the upper and lower boundaries of the cursor can also be determined. And starting from the left boundary of the cursor to the left, from the determined columns of pixels, a column of pixels that are not exactly the same color as the pixels of the next column is selected as the left boundary of the character. The right column of the cursor is used as a starting column to the right. From among the determined columns of pixels, a column of pixels that are not exactly the same color as the pixels of the next column is selected as the right boundary of the character. The distance between the left and right boundaries of the character boundary is taken as the width of the character boundary.

S208: Determine, according to the determined character boundary, the size of the character covered by the cursor, and display the size.

In the embodiment of the present specification, since the screen size, pixel density, and the like of different mobile terminals are not completely consistent, the character size that is usually set is the size of the character actually displayed in the program interface (eg, the height of the character boundary or The width of the character boundary) cannot be consistent. For example, the program developer sets a character size of 12px, but the character size displayed in the program interface is 10px. Therefore, the height or width of the character boundary does not accurately determine the character size.

Therefore, in the present specification, the character size corresponding to the character boundary can also be determined and displayed according to the fitting formula acquired in advance.

Specifically, the mobile terminal can send the device information (such as the device model, the screen size, the pixel density, and the like) of the mobile terminal to the server in advance by the mobile terminal itself or a program for executing the information display process, and then receive the information returned by the server and the device. Corresponding fitting formulas are stored. Then, after determining the height or width of the character boundary, the height or width may be input into the fitting formula to obtain a corresponding character size.

The server may predetermine a fitting formula corresponding to different device information, and when receiving the device information, determine a corresponding fitting formula and return. For example, the server may collect the character size set in the mobile terminal for each type of mobile terminal, and the corresponding actual display character size, and the left and right samples. A fitting curve of the set character size and the actually displayed character size is determined by a least square method, and a fitting formula corresponding to the fitting curve is obtained, as shown in FIG.

By the fitting formula corresponding to the fitting curve shown in FIG. 10, the mobile terminal can determine the character size corresponding to the distance between the upper and lower boundaries of the character (ie, the actually displayed character size) (ie, the set character size).

Through the information display process shown in FIG. 8, it can be seen that the accurate character size can be obtained by simply covering the cursor on the character to be measured. It solves the problem that it is difficult to measure the character size on the mobile terminal.

In addition, in the embodiment of the present specification, it is necessary to cover the characters by the cursor to determine the character size. However, there may be larger characters in the program interface, and there may be smaller characters, so a single-size cursor may be inconvenient for measuring the character size. Therefore, a plurality of cursors can be displayed in step S200, and the sizes of the respective cursors may not be identical to meet the measurement requirements for characters of different sizes.

Further, in the embodiment of the present specification, the information display methods illustrated in FIGS. 2 and 8 may exist simultaneously. Thus, in this specification, the element size can be displayed in the middle of each pair of cursors, and the character size can be displayed next to the cursor, as shown in FIG. Of course, the specific distance and size are not limited in this description.

Based on the information display method shown in FIG. 2, the embodiment of the present specification further provides an information display device, as shown in FIG.

FIG. 12 is a schematic structural diagram of an information display apparatus according to an embodiment of the present disclosure, including:

Obtaining the display and monitoring module 300, acquiring a screenshot of the program interface of the mobile terminal, displaying at least one pair of cursors, and monitoring the operation of the user;

The first determining module 302 is configured, for each pair of cursors, when detecting that the user performs an operation on the pair of cursors, determining a position corresponding to each of the cursors on which the operation is performed;

The second determining module 304 determines, according to the corresponding positions of the cursors, the selection ranges corresponding to the respective cursors in the screenshots;

The third determining module 306 determines, according to a preset boundary algorithm, a boundary of an element in the program interface, respectively, in the selection range corresponding to each cursor;

a fourth determining module 308, respectively, moving each cursor that is to perform the operation to a boundary of the respectively determined element;

The display module 310 displays the distance between the pair of cursors.

Obtaining the display and monitoring module 300, displaying a floating window, displaying at least one pair of cursors in the floating window, wherein the floating window is a transparent window, and the floating window is displayed on an upper layer of the program interface.

The display and monitoring module 300 is configured to display two pairs of cursors in the screen of the mobile terminal, wherein one pair of cursors is in a horizontal line segment and the other pair of cursors is a vertical line segment.

The display and monitoring module 300 is configured to display the floating window and/or obtain a screenshot of the program interface when a user input command is detected.

a third determining module 306, for each cursor in the pair of cursors, determining a color displayed by the program interface at a position of the cursor as a base color, and determining, in the selection range corresponding to the cursor, the cursor The line segments are parallel, beyond a preset length, and a line segment having a different color from the base color as the determined boundary.

a third determining module 306, in the selected range corresponding to the cursor, determining at least one line segment parallel to the line segment of the cursor, exceeding a preset length, and having a color different from the base color, from the determined at least one line segment In the middle, the line segment closest to the cursor is selected as the determined boundary.

Obtaining the display and monitoring module 300, before acquiring the screenshot of the program interface on the mobile terminal, launching the interface layout boundary display tool to display the boundary of each element in the program interface.

Based on the information display method shown in FIG. 8, the embodiment of the present specification further provides an information display device, as shown in FIG.

FIG. 13 is a schematic structural diagram of an information display apparatus according to an embodiment of the present disclosure, including:

Obtaining the display and monitoring module 400, acquiring a screenshot of the program interface of the mobile terminal, displaying at least one cursor, and monitoring the operation of the user;

The first determining module 402 determines, when the user performs an operation on any of the cursors, the position of the cursor on which the operation is performed;

a second determining module 404, determining a color at the location in the screenshot;

a third determining module 406, determining a character boundary according to the boundary of the cursor and the color;

The display module 408 determines the size of the character covered by the cursor according to the determined character boundary and displays it.

The shape of the cursor is a rectangle;

a third determining module 406, determining an upper and lower boundary of the cursor and/or a left and right boundary of the cursor, and determining, according to the color, a color corresponding to an upper and lower boundary of the cursor and/or the cursor according to the color The color corresponding to the left and right borders respectively determines the height of the character boundary according to the color corresponding to the upper and lower boundaries of the cursor, and/or determines the width of the character boundary according to the color corresponding to the left and right boundaries of the cursor respectively. .

a third determining module 406, determining each row of pixels between the extension lines of the left and right boundaries of the cursor, starting from the upper boundary of the cursor, and selecting the row of pixels from the determined row of pixels. A row of pixels whose colors are not exactly the same, as the upper boundary of the character, starting from the lower boundary of the cursor, and selecting from the determined rows of pixels, the color of the pixels in the next row is not completely the same. A row of pixels, as the lower boundary of the character, takes the distance between the upper and lower boundaries of the character boundary as the height of the character boundary.

a third determining module 406, determining each column of pixels between the extension lines of the upper and lower boundaries of the cursor, starting from the left boundary of the cursor to the left, and selecting from the determined columns of pixels A column of pixels of a column of pixels having different colors is used as the left boundary of the character, and the right column of the cursor is used as a starting column to be rightward. From among the determined columns of pixels, the color of the pixel corresponding to the next column is selected. A column of pixels that are not identical, as the right boundary of the character, the distance between the left and right boundaries of the character boundary is taken as the width of the character boundary.

The display module 408 determines a size corresponding to the height of the character boundary and/or a size corresponding to the width of the character boundary according to a fitting formula acquired in advance.

The display module 408 sends the device information of the mobile terminal to the server in advance, and receives a fitting formula corresponding to the device information returned by the server and stores the same.

Based on the information display method shown in FIG. 2, the embodiment of the present specification further provides another mobile terminal, as shown in FIG.

FIG. 14 is a schematic structural diagram of a terminal according to an embodiment of the present disclosure. The terminal includes: one or more processors and a memory, where the program is configured to perform the following steps by one or more processors:

Obtaining a screenshot of the program interface of the mobile terminal, displaying at least one pair of cursors, and monitoring user operations;

For each pair of cursors, when it is detected that the user performs an operation on the pair of cursors, determining a position corresponding to each of the cursors on which the operation is performed;

Determining, according to each cursor, a selection range corresponding to each cursor in the screenshot;

Determining, according to a preset boundary algorithm, a boundary of an element in the program interface, respectively, in the selection range corresponding to each cursor;

Moving each cursor of the operation to the boundary of the respectively determined element;

Shows the distance between the pair of cursors.

Based on the information display method shown in FIG. 8, the embodiment of the present specification further provides another mobile terminal, as shown in FIG.

FIG. 15 is a schematic structural diagram of a terminal according to an embodiment of the present disclosure. The terminal includes: one or more processors and a memory, where the program is configured to perform the following steps by one or more processors:

Obtaining a screenshot of the program interface of the mobile terminal, displaying at least one cursor, and monitoring the operation of the user;

Determining the position of the cursor on which the operation is performed when it is detected that the user performs an operation on any of the cursors;

Determining the color at the location in the screenshot;

Determining a character boundary according to the boundary of the cursor and the color;

The size of the character covered by the cursor is determined according to the determined character boundary and displayed.

It is to be noted that the various embodiments in the present specification are described in a progressive manner, and the same similar parts between the various embodiments may be referred to each other, and each embodiment focuses on different embodiments from other embodiments. At the office. In particular, for the mobile terminal and the server provided by the embodiment of the present application, since it is basically similar to the method embodiment, the description is relatively simple, and the related parts can be referred to the description of the method embodiment.

In the 1990s, improvements to a technology could clearly distinguish between hardware improvements (eg, improvements to circuit structures such as diodes, transistors, switches, etc.) or software improvements (for process flow improvements). However, as technology advances, many of today's method flow improvements can be seen as direct improvements in hardware circuit architecture. Designers almost always get the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that the improvement of a method flow cannot be implemented by hardware entity modules. For example, a Programmable Logic Device (PLD) (such as a Field Programmable Gate Array (FPGA)) is an integrated circuit whose logic function is determined by the user programming the device. Designers can program themselves to "integrate" a digital system on a single PLD without having to ask the chip manufacturer to design and fabricate a dedicated integrated circuit chip. Moreover, today, instead of manually making integrated circuit chips, this programming is mostly implemented using "logic compiler" software, which is similar to the software compiler used in programming development, but before compiling The original code has to be written in a specific programming language. This is called the Hardware Description Language (HDL). HDL is not the only one, but there are many kinds, such as ABEL (Advanced Boolean Expression Language). AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc., are currently the most commonly used VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. It should also be apparent to those skilled in the art that the hardware flow for implementing the logic method flow can be easily obtained by simply programming the method flow into the integrated circuit with a few hardware description languages.

The controller can be implemented in any suitable manner, for example, the controller can take the form of, for example, a microprocessor or processor and a computer readable medium storing computer readable program code (eg, software or firmware) executable by the (micro)processor. In the form of logic gates, switches, application specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers, examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, The Microchip PIC18F26K20 and the Silicone Labs C8051F320, the memory controller can also be implemented as part of the memory's control logic. Those skilled in the art will also appreciate that in addition to implementing the controller in purely computer readable program code, the controller can be logically programmed by means of logic gates, switches, ASICs, programmable logic controllers, and embedding. The form of a microcontroller or the like to achieve the same function. Such a controller can therefore be considered a hardware component, and the means for implementing various functions included therein can also be considered as a structure within the hardware component. Or even a device for implementing various functions can be considered as a software module that can be both a method of implementation and a structure within a hardware component.

The system, device, module or unit illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product having a certain function. A typical implementation device is a computer. Specifically, the computer can be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or A combination of any of these devices.

For the convenience of description, the above devices are described separately by function into various units. Of course, the functions of each unit may be implemented in the same software or software and/or hardware when implementing the present application.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory. Memory is an example of a computer readable medium.

Computer readable media includes both permanent and non-persistent, removable and non-removable media. Information storage can be implemented by any method or technology. The information can be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary storage of computer readable media, such as modulated data signals and carrier waves.

It is also to be understood that the terms "comprises" or "comprising" or "comprising" or any other variations are intended to encompass a non-exclusive inclusion, such that a process, method, article, Other elements not explicitly listed, or elements that are inherent to such a process, method, commodity, or equipment. An element defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device including the element.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The application can be described in the general context of computer-executable instructions executed by a computer, such as a program module. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types. The present application can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules can be located in both local and remote computer storage media including storage devices.

The various embodiments in the specification are described in a progressive manner, and the same or similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

The above description is only an embodiment of the present application and is not intended to limit the application. Various changes and modifications can be made to the present application by those skilled in the art. Any modifications, equivalents, improvements, etc. made within the spirit and scope of the present application are intended to be included within the scope of the appended claims.

Claims (18)

A method of displaying information, including: Obtaining a screenshot of the program interface of the mobile terminal, displaying at least one pair of cursors, and monitoring the operation of the user; For each pair of cursors, when it is detected that the user performs an operation on the pair of cursors, determining a position corresponding to each of the cursors on which the operation is performed; Determining, according to each cursor, a selection range corresponding to each cursor in the screenshot; Determining, according to a preset boundary algorithm, a boundary of an element in the program interface, respectively, in the selection range corresponding to each cursor; Moving each cursor of the operation to the boundary of the respectively determined element; Shows the distance between the pair of cursors. The method of claim 1, displaying at least one pair of cursors, specifically comprising: Display a floating window; At least one pair of cursors are displayed in the floating window, wherein the floating window is a transparent window, and the floating window is displayed on an upper layer of the program interface. The method of claim 1, displaying at least one pair of cursors, specifically comprising: Two pairs of cursors are displayed in the screen of the mobile terminal, wherein one pair of cursors is in a horizontal line segment and the other pair of cursors is a vertical line segment. The method of claim 2, wherein displaying the floating window on the program interface comprises: When the user input instruction is monitored, the floating window is displayed and/or a screenshot of the program interface is obtained. The method of claim 3, determining a boundary of an element in the program interface in the selection range corresponding to the pair of cursors according to a preset boundary algorithm, specifically comprising: Determining, according to each cursor in the pair of cursors, a color displayed by the program interface at the position of the cursor as a base color; Within the selected range corresponding to the cursor, a line segment parallel to the line segment of the cursor, exceeding a preset length, and a color different from the base color is determined as the determined boundary. The method according to claim 5, wherein within the selection range corresponding to the cursor, a line segment parallel to the line segment of the cursor, exceeding a preset length, and a color different from the base color is determined as the determined The boundary includes: Determining, in the selection range corresponding to the cursor, at least one line segment that is parallel to the line segment of the cursor, exceeds a preset length, and has a color different from the base color; From among the determined at least one line segment, the line segment closest to the cursor is selected as the determined boundary. The method of claim 1, before the obtaining a screenshot of the program interface on the mobile terminal, the method further comprising: The interface layout boundary display tool is activated to display the boundaries of the elements in the program interface. An information display method includes: Obtaining a screenshot of the program interface of the mobile terminal, displaying at least one cursor, and monitoring the operation of the user; Determining the position of the cursor on which the operation is performed when it is detected that the user performs an operation on any of the cursors; Determining the color at the location in the screenshot; Determining a character boundary according to the boundary of the cursor and the color; The size of the character covered by the cursor is determined according to the determined character boundary and displayed. The method of claim 8 wherein the shape of the cursor is a rectangle; Determining the character boundary according to the boundary of the cursor and the color, specifically including: Determining upper and lower boundaries of the cursor and/or left and right boundaries of the cursor; Determining, in the screenshot, the color corresponding to the upper and lower boundaries of the cursor and/or the left and right boundaries of the cursor respectively according to the color; Determining a height of the character boundary according to a color corresponding to the upper and lower boundaries of the cursor, and/or determining a width of the character boundary according to a color corresponding to each of the left and right boundaries of the cursor. The method of claim 9, determining the height of the character boundary according to the color corresponding to the upper and lower boundaries of the cursor, specifically including: Determining each row of pixels between the extension lines of the left and right boundaries of the cursor; Starting from the upper boundary of the cursor as a starting line, from the determined rows of pixels, selecting a row of pixels that are not exactly the same color as the pixels of the next row, as the upper boundary of the character; Starting from the lower boundary of the cursor as a starting line, from the determined rows of pixels, selecting a row of pixels that are not exactly the same color as the pixels of the next row, as the lower boundary of the character; The distance between the upper and lower boundaries of the character boundary is taken as the height of the character boundary. The method of claim 9, determining the width of the character boundary according to the color corresponding to the left and right boundaries of the cursor, specifically including: Determining columns of pixels between extension lines of the upper and lower boundaries of the cursor; Starting from the left boundary of the cursor to the left, from the determined columns of pixels, selecting a column of pixels that are not exactly the same color as the pixels of the next column, as the left boundary of the character; Starting from the right border of the cursor to the right, from the determined columns of pixels, selecting a column of pixels that are not exactly the same color as the pixels of the next column, as the right boundary of the character; The distance between the left and right boundaries of the character boundary is taken as the width of the character boundary. The method of claim 9, determining the size of the character according to the determined boundary of the character, specifically comprising: The size corresponding to the height of the character boundary and/or the size corresponding to the width of the character boundary is determined according to a fitting formula acquired in advance. The method according to claim 12, wherein the fitting formula is obtained in advance, specifically comprising: Sending device information of the mobile terminal to the server in advance; A fitting formula corresponding to the device information returned by the server is received and stored. The method of claim 9, wherein the cursor is present in plurality and the sizes of the respective cursors are not identical. An information display device comprising: Obtaining a display and monitoring module, obtaining a screenshot of the program interface of the mobile terminal, displaying at least one pair of cursors, and monitoring the operation of the user; a first determining module, for each pair of cursors, when detecting that the user performs an operation on the pair of cursors, determining a position corresponding to each of the cursors on which the operation is performed; a second determining module, according to each cursor corresponding to the position, determining, in the screenshot, a selection range corresponding to each cursor; a third determining module, respectively, determining, according to a preset boundary algorithm, a boundary of an element in the program interface in the selection range corresponding to each cursor; a fourth determining module, respectively moving each cursor that is to perform the operation to a boundary of the respectively determined element; A display module that displays the distance between the pair of cursors. An information display device comprising: Obtaining a display and monitoring module, obtaining a screenshot of the program interface of the mobile terminal, displaying at least one cursor, and monitoring the operation of the user; a first determining module, when detecting that the user performs an operation on any of the cursors, determining a position of the cursor on which the operation is performed; a second determining module determining a color at the location in the screenshot; a third determining module, determining a character boundary according to the boundary of the cursor and the color; The display module determines the size of the character covered by the cursor according to the determined character boundary and displays it. A mobile terminal comprising: one or more processors and a memory, the program being configured to perform the following steps by one or more processors: Obtaining a screenshot of the program interface of the mobile terminal, displaying at least one pair of cursors, and monitoring user operations; For each pair of cursors, when it is detected that the user performs an operation on the pair of cursors, determining a position corresponding to each of the cursors on which the operation is performed; Determining, according to each cursor, a selection range corresponding to each cursor in the screenshot; Determining, according to a preset boundary algorithm, a boundary of an element in the program interface, respectively, in the selection range corresponding to each cursor; Moving each cursor of the operation to the boundary of the respectively determined element; Shows the distance between the pair of cursors. A mobile terminal comprising: one or more processors and a memory, the program being configured to perform the following steps by one or more processors: Obtaining a screenshot of the program interface of the mobile terminal, displaying at least one cursor, and monitoring the operation of the user; Determining the position of the cursor on which the operation is performed when it is detected that the user performs an operation on any of the cursors; Determining the color at the location in the screenshot; Determining a character boundary according to the boundary of the cursor and the color; The size of the character covered by the cursor is determined according to the determined character boundary and displayed.

Images