CN116700850A - Display method and electronic device - Google Patents

Abstract

The present application provides a display method and an electronic device, which can reduce performance loss caused by unnecessary operations performed by the electronic device. The method is applied to an electronic device with at least two display screens, and the method includes: the electronic device generates a first layer according to image data, and then corresponds to the layout information of the first layer and at least two display screens in a preset coordinate system The target display area is determined from at least two display screens, wherein the layout information of the first layer indicates the display area where the first layer is located in the preset coordinate system. The electronic device synthesizes the first graphical user interface GUI according to at least one second layer; wherein, at least one second layer includes the first layer; or, at least one second layer includes the first layer and the target display screen has displayed at least one layer corresponding to the second GUI. The electronic device controls the target display screen to display the first GUI.

Description

Display method and electronic device

technical field

The present application relates to the technical field of electronic equipment, in particular to a display method and electronic equipment.

Background technique

At present, with the development of human-computer interaction, single-screen display can no longer meet the needs of users, and there are more and more electronic devices that support dual-screen display. Taking a mobile phone as an example, FIG. 1 shows a schematic diagram of a graphical user interface (graphical user interface, GUI) of a mobile phone supporting dual-screen display. Usually, a GUI displayed on the mobile phone is a graphic obtained by the mobile phone through a series of graphics drawing processes. For a GUI, it may include one or more layers, and the electronic device can draw each layer separately, and then synthesize them into a GUI.

In order to improve the frame rate of rendering, electronic devices often adopt a mechanism of multiple buffer rotations. Taking the double buffer as an example, the buffer used to output the GUI currently displayed on the screen is called the front buffer (front buffer), and the buffer used to synthesize the next GUI in the background is called the back buffer (back buffer). The device completes the refresh of the screen by switching the front buffer and the back buffer, that is, completes the display of the next GUI.

In the existing solution, for an electronic device that supports dual-screen display, when the electronic device determines that the GUI needs to be updated, for both display screens, the electronic device will execute drawing layers according to the image data to be displayed on the display screens, and then The drawn layers are synthesized into a GUI, and the GUI is output to the display screen for display. However, this process brings about a loss in the performance of the electronic device.

Contents of the invention

The present application provides a display method and an electronic device, which can reduce performance loss caused by unnecessary operations performed by the electronic device.

In order to achieve the above object, the application adopts the following technical solutions:

In a first aspect, the present application provides a display method applied to an electronic device, the electronic device includes at least two display screens, and the method includes: the electronic device generates a first layer according to image data; the electronic device generates a first layer according to the layout information of the first layer and the corresponding display areas of the at least two display screens in the preset coordinate system, determining the target display screen from the at least two display screens, wherein the layout information of the first layer indicates that the first layer is in the preset coordinate system The display area where it is located; the electronic device synthesizes a first graphical user interface GUI according to at least one second layer; wherein, at least one second layer includes the first layer; or, at least one second layer includes the first layer and at least one layer corresponding to the second GUI displayed on the target display screen; the electronic device controls the target display screen to display the first GUI.

Based on the above technical solution, after the electronic device generates the first layer according to the image data, it first determines the target display screen according to the layout information of the first layer and the corresponding display area of the display screen in the preset coordinate system. It can be understood that the target display screen is the display screen that needs to update the GUI. The first GUI is then composited from at least one second layer. It can be understood that at least one second layer is a layer corresponding to the GUI to be displayed on the target display screen. That is, the electronic device only executes the operation of synthesizing the corresponding layers into the GUI for the display screen that needs to update the GUI. Finally, the target display screen is controlled to display the first GUI. It can be understood that this step needs to be implemented by the electronic device performing a screen refresh operation. In other words, only when the electronic device determines that the GUI on the display screen needs to be updated, it will perform an operation on the layer to be displayed on the display screen, and output the synthesized GUI to the display screen for display through a screen refresh operation. When the GUI on the display screen does not need to be updated, the composition operation and screen refresh operation will not be performed on the layer corresponding to the display screen, thereby reducing the unnecessary synthesis operation and refresh operation of the electronic device. performance loss.

In a possible design, the electronic device determines the target display screen from at least two display screens according to the layout information of the first layer and the corresponding display areas of the at least two display screens in the preset coordinate system, including: the electronic device Among the at least two display screens, at least one display screen whose corresponding display area in the preset coordinate system overlaps with the display area of the first layer in the preset coordinate system is determined as the target display screen.

Based on this design, the electronic device determines that the display area corresponding to the display screen in the preset coordinate system overlaps with the display area of the first layer in the preset coordinate system, so it can be determined that the first layer needs to be displayed in this On the display screen, the electronic device determines that the GUI of the display screen needs to be updated, and then starts to perform the corresponding composition operation and refresh operation on the display screen.

In a possible design, the image data is data of a layer not displayed on at least two display screens; the electronic device generating the first layer according to the image data includes: the electronic device drawing the first layer according to the image data.

In a possible design, the image data is the data of the third layer displayed on at least two display screens; the electronic device generates the first layer according to the image data, including: the electronic device acquires the third layer in at least two The change data of the display position on the display screen; the electronic device adjusts the display position of the image data according to the change data to obtain the first layer.

In a possible design, before the electronic device synthesizes the first GUI according to at least one second layer, the method further includes: the electronic device displays the second GUI through the target display screen; all layers corresponding to the second GUI are combined with the first GUI All corresponding layers are different, at least one second layer includes the first layer.

In a possible design, before the electronic device synthesizes the first GUI according to at least one second layer, the method further includes: the electronic device displays the second GUI through the target display screen; the at least one layer corresponding to the second GUI is the same as the first GUI Part of the layers corresponding to the GUI are the same, and at least one second layer includes the first layer and at least one layer corresponding to the second GUI.

In a possible design, after the electronic device synthesizes the first GUI according to the at least one second layer, the method further includes: the electronic device caches the first GUI in a back buffer corresponding to the target display screen.

In a possible design, the electronic device controls the target display screen to display the first GUI, including: the electronic device switches the back buffer corresponding to the target display screen to the front buffer corresponding to the target display screen; The first GUI in the front buffer is output to the target display screen for display.

In a second aspect, the present application provides an electronic device, including a first processor, a second processor, and at least two display screens, the second processor, at least two display screens are coupled to the first processor; the first processor Or the second processor is configured to generate the first layer according to the image data; the first processor is configured to generate the first layer according to the layout information of the first layer and the corresponding display areas of at least two display screens in the preset coordinate system, from Determining a target display screen from at least two display screens, wherein the layout information of the first layer indicates the display area where the first layer is located in a preset coordinate system; the second processor is configured to, according to at least one second Layer synthesis of the first graphical user interface GUI; wherein, at least one second layer includes the first layer; or, at least one second layer includes the first layer and at least one corresponding to the second GUI displayed on the target display screen A layer; a target display screen for displaying the first GUI.

In a possible design, the first processor is specifically configured to overlap the corresponding display area in the preset coordinate system of the at least two display screens with the display area of the first layer in the preset coordinate system At least one display screen of is determined as the target display screen.

In a possible design, the image data is data of a layer not displayed on at least two display screens; the first processor or the second processor is specifically configured to draw the first layer according to the image data.

In a possible design, the image data is the data of the third layer displayed on at least two display screens; the first processor is specifically used to obtain the display position of the third layer on at least two display screens Change data; according to the change data, adjust the display position of the image data to obtain the first layer.

In a possible design, the target display screen is also used to display the second GUI; all layers corresponding to the second GUI are different from all layers corresponding to the first GUI, and at least one second layer includes the first layer.

In a possible design, the target display screen is also used to display the second GUI; at least one layer corresponding to the second GUI is the same as part of the layers corresponding to the first GUI, and at least one second layer includes the first layer and at least one layer corresponding to the second GUI.

In a possible design, the second processor is further configured to cache the first GUI to a back buffer corresponding to the target display screen.

In a possible design, the first processor is also used to switch the background buffer corresponding to the target display screen to the front buffer corresponding to the target display screen; the first processor is also used to switch the front buffer corresponding to the target display screen The first GUI in the buffer is output to the target display screen for display.

In a possible design, the first processor is a central processing unit (central processing unit, CPU), and the second processor is a graphics processing unit (graphics processing unit, GPU).

In a third aspect, the present application provides an electronic device, including at least two display screens and one or more processors; the display screen is coupled to the processor, and the processor is used to execute computer program instructions, so that the electronic device performs the above-mentioned first Aspects and methods of any design thereof.

In a fourth aspect, the present application provides an electronic device, including at least two display screens, a memory, and one or more processors, the display screen, the memory and the processor are coupled, and the memory is used to store computer program codes, and the computer program codes include computer Instructions, the processor reads computer instructions from the memory, so that the electronic device executes the method described in the above first aspect and any one of the designs.

In a fifth aspect, the present application provides an electronic device, which has the function of implementing the method described in the above first aspect and any one of the designs. This function may be implemented by hardware, or may be implemented by executing corresponding software on the hardware. The hardware or software includes one or more modules corresponding to the above functions.

In a sixth aspect, the present application provides a computer-readable storage medium, on which a computer program or instruction is stored, and when the computer program or instruction is run on the computer, the computer executes the above-mentioned first aspect and any of them. - Design the method described.

In a seventh aspect, the present application provides a computer program product, the computer program product including: a computer program or instruction, when the computer program or instruction is run on the computer, the computer executes the above-mentioned first aspect and any one of the designs. method.

In an eighth aspect, the present application provides a chip system, including at least one processor and at least one interface circuit, at least one interface circuit is used to perform the function of sending and receiving, and send instructions to at least one processor, when at least one processor executes the instruction , at least one processor executes the method described in the above first aspect and any one of the designs.

It should be noted that, for the technical effect brought by any design in the second aspect to the eighth aspect above, please refer to the technical effect brought by the corresponding design in the first aspect, which will not be repeated here.

Description of drawings

FIG. 1 is a schematic diagram of a GUI provided by an embodiment of the present application;

FIG. 2 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

FIG. 3 is a schematic structural diagram of another electronic device provided in the embodiment of the present application;

FIG. 4 is a schematic structural diagram of a computer system provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of a hardware structure of an electronic device provided in an embodiment of the present application;

FIG. 6 is a schematic flow diagram of an existing method for updating a GUI;

FIG. 7 is a schematic diagram of an existing process for completing image frame display;

FIG. 8 is a schematic interface diagram of an update GUI provided in an embodiment of the present application;

FIG. 9 is a schematic diagram of another update GUI interface provided by the embodiment of the present application;

FIG. 10 is a schematic flowchart of a display method provided by an embodiment of the present application;

FIG. 11 is a schematic diagram of display areas corresponding to display screens of an electronic device in a preset coordinate system according to an embodiment of the present application;

Fig. 12a is a schematic diagram of vertices of a display screen included in a mobile phone provided by an embodiment of the present application;

Fig. 12b is a schematic diagram of vertices of a display screen included in another mobile phone provided by the embodiment of the present application;

FIG. 13 is a schematic diagram of display areas corresponding to display screens of yet another electronic device in a preset coordinate system according to an embodiment of the present application;

FIG. 14 is a schematic diagram of another update GUI interface provided by the embodiment of the present application;

FIG. 15 is a schematic diagram of a process for completing image frame display provided by an embodiment of the present application;

FIG. 16 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

FIG. 17 is a schematic structural diagram of a chip system provided by an embodiment of the present application.

Detailed ways

The display method and the electronic device provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

The terms "including" and "having" and any variations thereof mentioned in the description of the present application are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes other unlisted steps or units, or optionally also includes Other steps or elements inherent to the process, method, product or apparatus are included.

It should be noted that, in the embodiments of the present application, words such as "exemplary" or "for example" are used as examples, illustrations or descriptions. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of the present application shall not be interpreted as being more preferred or more advantageous than other embodiments or design schemes. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete manner.

In the description of the present application, unless otherwise specified, the meaning of "plurality" refers to two or more. The "and/or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist at the same time, and B exists alone These three situations.

The display method provided in the embodiment of the present application may be applied to the electronic device 200 , or to a system including the electronic device 200 .

Optionally, the electronic device 200 may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, and a personal digital assistant ( Various electronic devices with at least two display screens such as personal digital assistant (PDA), artificial intelligence (AI) equipment, vehicle-mounted equipment, smart home equipment and/or smart city equipment, etc., the embodiment of the present application is for the electronic equipment 200 The specific type is not particularly limited.

Taking the electronic device 200 as an example of a mobile phone supporting dual-screen display, FIG. 2 shows a schematic structural diagram of a dual-screen mobile phone provided by an embodiment of the present application. As shown in Figure 2, the dual screens of the mobile phone can be implemented in the form of A screen and B screen shown in (a) in Figure 2, or in the form of A screen and B screen shown in Figure 2 (b). In the form of screens, the mobile phone can display the same or different content through the A screen and the B screen. It is understandable that in practical applications, the dual screens of the mobile phone can also have other settings, for example: one display screen is located on the front of the mobile phone, and the other display screen is located on the back of the mobile phone, etc. The size of each display screen can be the same or can be Differently, the present application does not specifically limit the setting manner, size, etc. of each display screen.

Taking the electronic device 200 as an example of a notebook computer supporting dual-screen display, FIG. 3 shows a schematic structural diagram of a dual-screen notebook computer provided by an embodiment of the present application. The notebook computer can display the same or different content through the A screen and the B screen. Likewise, the present application does not limit the arrangement, size, etc. of each display screen of the notebook computer.

Optionally, the display method provided in the embodiment of the present application may also be applied to a computer system including at least two display screens. Optionally, the computer system may include various types of terminals such as multiple physical hosts, portable computers, handheld devices, vehicle-mounted devices, AI devices, and servers. Exemplarily, as shown in FIG. 4 , it is a schematic diagram of a computer system supporting dual-screen display provided by the embodiment of the present application. In the computer system 400, a display 401, a display 402, and one or more hosts 403 are included. wait. Wherein, the communication connection between the display 401 and the display 402 and the host 403 can be established through a wired link or a wireless link. Wherein, the display 401 and the display 402 can be used to display the same or different content. The host 403 can be used to place the motherboard and other main components (for example: central processing unit (central processing unit, CPU), memory, hard disk, optical drive, power supply, and other input and output controllers and interfaces, etc.). Optionally, the communication system 400 may also include other input and output devices (not shown in the figure), such as a mouse, a keyboard, etc., so as to facilitate information interaction between the user and the computer system.

Exemplarily, FIG. 5 shows a schematic diagram of a hardware structure of an electronic device provided in an embodiment of the present application.

The electronic device 200 may include a processor 210, an internal memory 220, a universal serial bus (universalserial bus, USB) interface 230, a charging management module 240, a power management module 241, an antenna 1, an antenna 2, a mobile communication module 250, and a wireless communication module 260, display 270, etc.

It can be understood that, the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 200 . In other embodiments of the present application, the electronic device 200 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

The processor 210 may include one or more processing units, for example: the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor ( image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. . Wherein, different processing units may be independent devices, or may be integrated in one or more processors. In some embodiments of the present application, the processor 210 can perform measurement, set layout, generate polygons and textures, perform raster formatting operations on polygons and textures, and write the processed content to the corresponding window (window) Surface (surface) in a buffer (buffer), and then put the buffer into the buffer queue (buffer queue). The processor 210 can also be used to synthesize the contents of multiple surfaces into one frame of GUI.

Wherein, the controller may be the nerve center and command center of the electronic device 200 . The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.

A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in processor 210 is a cache memory. The memory may hold instructions or data that the processor 210 has just used or recycled. If the processor 210 needs to use the instruction or data again, it can be directly recalled from the memory. Repeated access is avoided, and the waiting time of the processor 210 is reduced, thereby improving the efficiency of the system.

The charging management module 240 is configured to receive charging input from the charger. Wherein, the charger may be a wireless charger or a wired charger.

The power management module 241 is used for connecting the charging management module 240 and the processor 210 . The power management module 241 receives the input of the charging management module 240 and supplies power to the processor 210 , the internal memory 220 , the display screen 270 , and the wireless communication module 260 .

The wireless communication function of the electronic device 200 may be realized by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, a modem processor, a baseband processor, and the like.

The mobile communication module 250 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 200 . The mobile communication module 250 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.

The wireless communication module 260 can provide applications on the electronic device 200 including wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.

The electronic device 200 realizes the display function through the GPU, the display screen 270 , and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 270 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 270 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light emitting diode). AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments of the present application, the electronic device 200 may include 2 or N display screens 270 , where N is a positive integer greater than 2. The display screens can be the same or different in size and shape. Each display screen can be used to display the same content and/or different content.

Internal memory 220 may be used to store computer-executable program code, which includes instructions. The internal memory 220 may include an area for storing programs and an area for storing data. The internal memory 220 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like. The processor 210 executes various functional applications and data processing of the electronic device 200 by executing instructions stored in the internal memory 220 and/or instructions stored in a memory provided in the processor.

Optionally, for the relevant introduction of the hardware structure of the computer system 400, reference may be made to the relevant introduction of the electronic device 200, which will not be repeated herein. Computer system 400 may have more or fewer components than shown in FIG. 5, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

Wherein, the above-mentioned electronic device or computer system may complete GUI display through a graphic display system.

For ease of understanding, an introduction to the graphic display system is given below.

The graphics display system is responsible for processing and displaying graphics, so as to provide users with a visual interface, and these user-visible interfaces are GUIs. The graphics display system is mainly divided into three parts from the software level to the hardware level: application layer, system layer, and hardware layer. That is, the graphic display system may be a combination of several software modules and several hardware modules (such as the processor 210 shown in FIG. 5 ) of an electronic device or a computer system.

The application layer includes various applications (i.e. applications). For an application, there may be multiple windows (windows) on a GUI (for example: dialog box, status bar, etc.), as shown in Figure 1, the status bar 101 is a window, the main interface 102 is also a window, the virtual button bar 103 is also a window, and so on. Each window may correspond to a surface. As shown in FIG. 1 , the status bar 101 corresponds to a surface, the main interface 102 corresponds to a surface, and the virtual button bar 103 also corresponds to a surface. Wherein, from the inside of the electronic device, the surface is a package of multiple buffers, and the multiple buffers form a buffer queue (buffer queue). Each surface corresponds to a layer. For example, the status bar 101 is a layer, the main interface 102 is a layer, and the virtual button bar 103 is also a layer. It should be noted that, in the embodiment of the present application, the GUI can also be described as an image, a graph, an image frame, etc., and the meanings they intend to express are the same unless additional description is made, and they will be collectively described here.

The system layer mainly uses system services such as window manager and graphics synthesizer (SurfaceFlinger).

Among them, the window manager is used to manage window programs. In the embodiment of the present application, the window manager may be an Android window manager, a kwin window manager, etc., and the present application is not limited thereto.

The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc. A window manager can manage windows as a system service. A window manager can be used to oversee a window's life cycle, input and focus events, screen orientation, transitions, animations, position, z-order, and many other aspects of a window. Among them, z-order can be understood as the position of the window on the z-axis, and the z-axis refers to the coordinate axis perpendicular to the screen. According to the z-order, the upper and lower coverage relationship between the windows can be determined, that is, it can be determined according to the z-order The upper and lower coverage relationship between surfaces, in other words, the upper and lower coverage relationship between layers can be determined according to z-order. The window manager can provide buffers (for example: front buffer and back buffer) and window metadata (for example: window position, size, transparency, z-order, etc.) to the graphics compositor. The window manager is also used to request the surface from the graphics compositor when receiving the message that the application program requests to create a surface, and send the requested surface to the application program.

Graphics Composer is used to control the compositing of each window, and to combine multiple windows into a single GUI. The graphics compositor is also used to create a surface and send it to the window manager when it receives a message from the window manager requesting a surface.

It can be understood that the graphics synthesizer can be used to execute the instructions of the window manager, and the window manager can be used to determine the position, size, transparency and other aspects of the window related information.

The hardware layer mainly includes the display backend, that is, the display screen. For example: the display backend may be the display screen 270 shown in FIG. 5 . Optionally, input devices may also be included, such as a mouse, a keyboard, and the like. Wherein, there may be multiple frame buffers corresponding to the display screen, taking a double buffer as an example, the double buffers are a front buffer and a back buffer respectively. Among them, the frontbuffer is used to output the GUI currently displayed on the screen, and the back buffer is used to synthesize the next GUI in the background. It can be understood that if a GUI already synthesized by the graphics synthesizer is located in the same buffer as the GUI being synthesized, the front and rear GUIs will overlap. Therefore, to avoid this situation, multiple framebuffers can be used, one for compositing a GUI.

A GUI displayed on the electronic device can be obtained by the electronic device through a series of graphics drawing processes. The graphics drawing process can be executed by the above-mentioned graphics display system. The graphics drawing process specifically includes: a layer drawing operation, a compositing operation, and a refreshing operation.

Layer drawing operation: the application in the application layer draws the content to be displayed in the buffer in the surface, which is called layer drawing operation. For example: when an application needs to display some content, the application will request the surface from the window manager, and then receive the surface from the window manager, and the application can draw the content to be displayed in the buffer in the surface. The specific process of the drawing operation includes: measuring the width and height of the view (view), which can be called measurement (messure); setting the width and height position of the view, which can be called setting layout (layout); generating polygons and Texture; perform raster formatting operations on polygons and textures; write the content after raster formatting operations into a buffer in the surface corresponding to each window, and then put the buffer into the corresponding buffer queue.

It can be understood that the rasterization operation refers to the operation of converting an image expressed in a vector graphics format into a bitmap. view is the base class used to build components in the GUI (eg buttons, text fields, etc.).

Compositing operation: The process in which a graphics compositor synthesizes the contents of multiple surfaces drawn by an application into a GUI is called a compositing operation. In other words, the process of compositing multiple layers into a GUI is called a compositing operation. Wherein, the graphics compositor can perform the compositing operation according to information such as buffer and window metadata provided by the window manager. This compositing operation may also be referred to as an overlay operation. After the graphics synthesizer synthesizes a GUI, it will write the data of the GUI to the frame buffer corresponding to the display screen.

Refresh operation: When the next vertical synchronization (VSYNC) signal comes, switch the front buffer and back buffer, that is, switch the front buffer to the back buffer, and switch the back buffer to the front buffer, that is, refresh the screen, and the switched front buffer The GUI data is output on the screen, and the switched back buffer is used to synthesize the next GUI in the background. This process is called a refresh operation. It should be noted that the content in the buffer supports reuse, that is to say, after the front buffer is switched to the back buffer, the content in it will not be cleared. When the front buffer is switched to the back buffer and the content on the current screen does not need to be updated, after it is switched to the front buffer again, the uncleared content can be directly displayed on the current screen.

At present, many electronic devices support dual-screen display. If the image displayed on one screen needs to be updated, but the image displayed on the other screen does not need to be updated, how to realize the display of images on the two screens? Taking the dual screens configured by electronic equipment as screen A and screen B as an example, assuming that the image displayed on screen A changes continuously, for example: the image from frame n to frame n+k changes continuously; while the image displayed on screen B changes continuously. The image changes in some frames, but does not change in other frames. For example, the image of frame n+k changes relative to the image of frame n, while the image of frame n to frame n+k-1 does not change. Wherein, n is a positive integer, and k is a positive integer greater than or equal to 2.

In this case, in order to complete the display of the image on the A screen and the image on the B screen, a solution is provided in the prior art. Exemplarily, as shown in FIG. 6 , the solution includes the following steps: S601. In the case that the GUI needs to be updated, the electronic device draws a layer according to the image data. S602. The electronic device performs a compositing operation on the layers to be displayed on the screen A. S603. The electronic device controls A screen to display the GUI after the synthesis operation is performed in step S602. S604. The electronic device performs a compositing operation on the layers to be displayed on the screen B. S605. The electronic device controls screen B to display the GUI after the synthesis operation in step S604. In this solution, after the electronic device draws the layers, no matter whether the GUI on the display screen needs to be updated, the electronic device will perform synthesis and refresh operations on the layers to be displayed on the two display screens, and display the result of the synthesis to the corresponding screen.

In combination with the above situation, taking the value of n as 1 and the value of k as 2 as an example, the scheme shown in FIG. 6 is introduced in detail. FIG. 7 shows a schematic diagram of a process of displaying image frames using the scheme shown in FIG. 6 . Wherein, the first row "screen content" shown in FIG. 7 is the content currently displayed on the screen. The buffers shown in line 2 and line 3 are the buffers corresponding to screen A and screen B respectively. It can be understood that, in order to facilitate the electronic device to determine to output the data in the buffer to the corresponding screen display, the screen and the buffer can be bound in advance. Take the double buffer mechanism as an example, for example: screen A is bound to buffer 0 and buffer 1, and screen B is bound to buffer 2 and buffer 3, which will be explained uniformly here.

For the first frame, the content displayed on screen A and screen B is "0", and the electronic device draws layers according to the image data. For screen A, the electronic device executes the synthesis operation according to the layers to be displayed on screen A, and the synthesized The result is "0", and the composite result is stored in buffer 0, and then the data in buffer 0 is output to screen A for display, and the display of the first frame on screen A is completed (buffer 0 is the front buffer at this time area, buffer 1 is the back buffer). For the B screen, the electronic device performs a synthesis operation according to the layer to be displayed on the B screen, and the result of the synthesis is "0", and stores the result of the synthesis into buffer 2, and then outputs the data in buffer 2 to B screen display, complete the display of the first frame on the B screen (at this time, buffer 2 is the front buffer, and buffer 3 is the back buffer).

For the second frame, the display content on screen A changes to "1", and the display content on screen B remains unchanged, and the display content is still "0". The electronic device draws the layer according to the image data to be displayed. For A screen, the electronic device executes a compositing operation according to the layers to be displayed on screen A, and the compositing result is "1", and stores the compositing result in buffer 1. Then switch buffer 0 and buffer 1, that is, perform a refresh operation, output the data in buffer 1 to A screen display, and complete the display of the second frame on A screen (at this time, buffer 1 is the front buffer, buffer 0 for the back buffer). For the B screen, since the display content of the second frame has not changed compared with the first frame, after the electronic device performs the synthesis operation, the result of the synthesis is the same as that of the first frame, both of which are "0", and the result of the synthesis is stored in the buffer Zone 3. Then switch buffer 2 and buffer 3, that is, perform a refresh operation, output the data in buffer 3 to the B screen display, and complete the display of the second frame on the B screen (at this time, buffer 3 is the front buffer, buffer 2 for the back buffer).

Subsequently, for screen A and screen B, the process of the electronic device to complete the display of the third frame is similar to the process of completing the display of the second frame on screen A, and will not be described in detail here.

It is understandable that, for screen B, if the display content of the third frame remains unchanged and is still "0", the electronic device will still switch between buffer 2 and buffer 3, that is, execute the refresh operation, but no longer Compositing operations. That is, the electronic device completes the display of the image from the n+2th frame to the n+k-1th frame by repeatedly switching buffer2 and buffer3, that is, repeatedly performing the refresh operation to complete.

It can be seen from Figure 7 that for screen A, the display content on the screen changes once, and the electronic device performs a synthesis operation and a buffer switching operation (that is, a refresh operation). Therefore, for screen A, the frequency of the electronic device performing the synthesis operation And the frequency of the refresh operation is the same as the actual change frequency of the displayed content. For screen B, the display content of the second frame is unchanged from that of the first frame, and the display content is "0". For the electronic device, the composite operation and refresh operation will still be performed. Therefore, in the example shown in Figure 7, the electronic device The frequency of performing the compositing operation and the frequency of the refresh operation is twice the frequency of the actual change of the displayed content. Executing the compositing operation consumes the performance of electronic devices, including but not limited to the performance of CPU, GPU, etc., while performing the refresh operation consumes the bandwidth of the electronic device (for example: the bandwidth of the display channel) and power consumption. Obviously, for the B screen, when the display content remains unchanged, the performance of the electronic device will be wasted if the electronic device performs the composition operation and refresh operation. In the example shown in Figure 7, for the B screen, there is 50% performance waste.

The above example is introduced with the value of n being 1 and the value of k being 2. Similarly, when n and k are other values, the above solution will also cause loss of performance of the electronic device.

Therefore, in order to solve the above technical problems, an embodiment of the present application provides a display method, which is applied to an electronic device including at least two display screens. The electronic device generates the first layer according to the image data, and according to the layout information of the first layer and the corresponding display areas of the at least two display screens in the preset coordinate system, determining the target display screen from the at least two display screens, wherein the layout information of the first layer indicates the location of the first layer in the preset coordinate system display area at . Then the electronic device synthesizes the first GUI according to the at least one second layer, and controls the target display screen to display the first GUI. Wherein, the target display screen may be a display screen that needs to update the GUI, and at least one second layer is a layer corresponding to the GUI to be displayed on the target display screen. That is to say, only when the electronic device determines that the GUI displayed on the display screen needs to be updated, it will perform a composition operation on the layers to be displayed on the display screen, and after the composition, the synthesized GUI will be output to the display screen for display through a refresh operation. For a display screen where the displayed GUI does not need to be updated, the electronic device will not perform composition operations and refresh operations on the layers to be displayed on the display screen. Thus, the performance loss caused by unnecessary operations performed by the electronic device can be reduced.

The scheme provided by the implementation of the present application will be described below in conjunction with the accompanying drawings.

Take an electronic device including a screen A and a screen B as an example. In a possible example, the image data used by the electronic device to generate the first layer is the data of layers not displayed on the A screen and the B screen. As shown in FIG. 8 , screen A displays a main interface 800 , and screen B displays a calculator interface 801 . The electronic device detects the user's operation for triggering the electronic device to display several new interfaces, such as the user's click operation on the icon 802 of the video application. In response to the click operation, the electronic device determines that the GUI needs to be updated, that is, the electronic device determines that the application program exists The electronic device executes the layer drawing operation according to the drawing requirement, and the electronic device draws the first layer according to the content to be updated (ie image data). In this example, the content to be updated is the content requested to be displayed by the video application, that is, the relevant interface of the video application, and the image data is the data of the undisplayed relevant interface of the video application. If the electronic device determines that only the GUI of the target display screen needs to be updated according to the layout information of the first layer and the corresponding display areas of screen A and screen B in the preset coordinate system, taking the target display screen as screen A as an example, the electronic device Only execute the composition operation on the second layer to be displayed on the A screen to generate the first GUI, and then control the A screen to display the first GUI. Exemplarily, screen A may display related interfaces of video applications such as interface 803 , while screen B still displays calculator interface 801 .

In another possible example, the image data used by the electronic device to generate the first layer is the data of the third layer already displayed on the A screen and/or the B screen. As shown in FIG. 9 , screen A displays an interface 900 , which includes a main interface 901 and a chat interface 902 (ie, the third layer) floating on the main interface, and screen B displays a calculator interface 903 . The electronic device detects the user's movement operation on the chat interface 902, and in response to the movement operation, the electronic device determines that the GUI needs to be updated, and then the electronic device generates the first layer according to the content to be updated (ie image data). In this example, the image data is the data of the chat interface 902 already displayed on screen A. Specifically, the electronic device may obtain change data of the display position of the chat interface 902 on the display screen according to the user's mobile operation, adjust the display position of the image data corresponding to the chat interface 902 according to the change data, and obtain the first layer. Exemplarily, as shown in the interface 905, the chat interface changes from the position shown in the interface 900 to the position shown in the interface 905, and the chat interface 904 shown in the interface 905 is the first layer. According to the layout information of the first layer (that is, the layout information of the third layer after display position adjustment) and the corresponding display areas of the A screen and the B screen in the preset coordinate system, the electronic device determines to only update the target display screen. GUI. Taking the target display screen as the A screen as an example, the electronic device only performs a compositing operation on the second layer to be displayed on the A screen to generate a first GUI, and then displays the first GUI through the A screen. Exemplarily, screen A may display an interface such as interface 905 , while screen B still displays calculator interface 903 .

It can be understood that, in this example, the difference between the first layer and the third layer is only that the two display positions on the display screen are different. It should be noted that the different positions of the first layer and the third layer on the display screen include, but not limited to, the two are located at different positions on the same display screen, and the two are located on different display screens.

It should be noted that in this embodiment of the application, each interface diagram is only a schematic diagram and does not constitute a limitation to the application. In practical applications, each interface may include more or less content, or may include more or more content. less interface.

An embodiment of the present application provides a display method, which can be applied to an electronic device including at least two display screens, and can also be applied to a computer system including at least two display screens such as that shown in FIG. 4 . Among them, at least two display screens can be used to display the GUI. Exemplarily, in the embodiment of the present application, the main interface 800, the calculator interface 801, and the video interface 803 shown in FIG. 8, the interface 900, and the interface shown in FIG. 905 and the like can all be referred to as a GUI, which is the interface currently displayed on the display screen. Optionally, the electronic device may display the same or different GUIs through at least two display screens, and the different GUIs include but not limited to GUIs of different applications, different GUIs of the same application, and the like. Exemplarily, taking the electronic device as an example of a mobile phone supporting dual-screen display, FIG. 8 shows a schematic diagram of an interface in which the GUI displayed on screen A of the mobile phone is different from the GUI displayed on screen B of the mobile phone.

Exemplarily, as shown in FIG. 10 , it is a schematic flowchart of a display method provided in the embodiment of the present application, and the method includes the following steps:

S1001. The electronic device generates a first layer according to image data.

Wherein, the image data may be data of layers displayed on at least two display screens, or data of layers not displayed on at least two display screens.

In a possible example, the image data is data of a layer not displayed on at least two display screens, and the electronic device may draw the first layer according to the image data. Wherein, the process of drawing the first layer is a layer drawing operation, and the electronic device can draw the image data in the buffer in the surface. Exemplarily, as shown in FIG. 8 , the image data may be data of a new interface requested by the application program to be displayed.

In another possible example, the image data is the data of the third layer already displayed on at least two display screens. It can be understood that the third layer may be any one of the layers displayed on at least two display screens, and the number of the third layer may be one or more. Then the electronic device can obtain the change data of the display position of the third layer on at least two display screens, and then the electronic device adjusts the display position of the image data according to the change data to obtain the first layer, that is, the first layer is Obtained by adjusting the display position of the third layer on the display. Exemplarily, as shown in FIG. 9 , the image data may be the data of the chat interface 902 (that is, the third layer) that has been displayed on screen A before. In this example, the electronic device does not need to draw the first layer again according to the image data, that is, does not need to perform a layer drawing operation, but only adjusts the display position of the image data on the display screen to obtain the first layer.

Optionally, the above image data may be obtained according to user operations (for example, the user's operation of opening several interfaces, the user's operation of moving a window on a certain interface, the user's operation of playing a video, etc.).

Optionally, there may be one or more first layers, and the one or more first layers may belong to the same application, or may belong to different applications.

Optionally, before the electronic device generates the first layer according to the image data, GUIs may or may not be displayed on at least two display screens, which is not limited in this application.

S1002. The electronic device determines a target display screen from at least two display screens according to the layout information of the first layer and the corresponding display areas of the at least two display screens in the preset coordinate system.

Wherein, the layout information of the first layer indicates the display area where the first layer is located in the preset coordinate system.

Optionally, if the shapes of the display areas where the first layer is located in the preset coordinate system are different, the layout information of the first layer may be expressed in different forms. Exemplarily, taking the shape of the display area where the first layer is located in the preset coordinate system as a rectangle as an example, the layout information of the first layer may specifically include information such as vertex coordinates, length and width of the rectangular display area . Taking the shape of the display area where the first layer is located in the preset coordinate system as a circle as an example, the layout information of the first layer may specifically include information such as the coordinates of the center of the circular display area, the radius length, etc. . When the display area corresponding to the first layer is an area of other shapes, the layout information of the first layer may also include other forms of information. The present application does not limit the specific representation form of the layout information of the first layer.

Optionally, the electronic device may determine at least one of the at least two display screens whose corresponding display area in the preset coordinate system overlaps with the display area where the first layer is located in the preset coordinate system is the target display screen, that is, there may be one or more target display screens. It can be understood that if the display area of the first layer in the preset coordinate system overlaps with the display area of the target display screen in the preset coordinate system, it means that the first layer needs to be displayed on the target display screen, in other words , the target display is the display used to display the first layer. Conversely, if there is no overlapping area between the display area where the first layer is located in the preset coordinate system and the corresponding display area of a display screen in the preset coordinate system, it means that the first layer does not need to be displayed on the display screen superior.

Optionally, in some embodiments, the electronic device may determine the display position of the first layer on the corresponding display area of the display screen in the preset coordinate system according to the display area of the first layer in the preset coordinate system. The actual display position of the layer on the display.

It should be pointed out that the preset coordinate system can be a rectangular coordinate system, a polar coordinate system, etc., which can be set by developers according to actual needs, and this application does not make any limitation on the type of the preset coordinate system.

Exemplarily, with the preset coordinate system as the Cartesian coordinate system, the display screens included in the electronic device are A screen and B screen, the size of the A screen and the B screen are the same, the length is 1920 pixels (pixel, P), and the width is 1920 pixels. All are 1080P, and the shapes are all rectangles as an example.

FIG. 11 shows a schematic diagram of display areas corresponding to each display screen of an electronic device in a preset coordinate system. As shown in Figure 11, the corresponding display area of A screen in the preset coordinate system (hereinafter referred to as the corresponding display area of A screen) and the corresponding display area of B screen in the preset coordinate system (hereinafter referred to as the corresponding display area of B screen) display area) are rectangular areas, and are arranged left and right in the preset coordinate system. Optionally, the shape of the display area corresponding to the display screen in the preset coordinate system may be the same as the shape of the display screen, and the size of the display area corresponding to the display screen in the preset coordinate system may also be the same as the size of the display screen.

As shown in Figure 11, the coordinates of the four vertices of the display area A corresponding to screen A are (0,0), (1920,0), (0,1080), (1920,1080), and these four vertices correspond to The upper left corner, lower left corner, upper right corner, and lower right corner of screen A; the coordinates of the four vertices of display area B corresponding to screen B are (1920,0), (3840,0), (1920,1080), (3840 , 1080), these four vertices correspond to the upper left corner, lower left corner, upper right corner, and lower right corner of the B screen in turn.

Assuming that the display area corresponding to the first layer in the preset coordinate system is a rectangular area, the layout information of the first layer indicates that the coordinates of the lower left vertex of the rectangular area corresponding to the first layer in the preset coordinate system are ( 850,740), the length is 650P, and the width is 360P. It can be seen from FIG. 11 that the corresponding display area of the first layer in the preset coordinate system is a rectangular area C. It can be seen that there is an overlapping area between the rectangular area C and the display area A corresponding to the screen A, but there is no overlapping area with the display area B corresponding to the screen B, and the electronic device can determine that the screen A is the target display screen.

In order to facilitate the understanding of the mapping relationship between the vertices of the display area corresponding to the display screen in the preset coordinate system and the vertices of the actual physical display screen, the electronic device in this example is a mobile phone including A screen and B screen. For example, Fig. 12a shows a schematic diagram of the vertices of A-screen and B-screen included in a mobile phone, where A-screen and B-screen are arranged left and right. Fig. 12b shows a schematic diagram of the vertices of A-screen and B-screen included in another mobile phone, where A-screen and B-screen are arranged vertically.

Exemplarily, FIG. 13 shows a schematic diagram of display areas corresponding to display screens of yet another electronic device in a preset coordinate system. As shown in FIG. 13 , the display area corresponding to screen A and the display area corresponding to screen B are both rectangular areas, and are arranged up and down in a preset coordinate system. As shown in Figure 13, the coordinates of the four vertices of the display area A corresponding to screen A are (0,0), (1920,0), (0,1080), (1920,1080), and these four vertices correspond to The upper left corner, lower left corner, upper right corner, and lower right corner of screen A; the coordinates of the four vertices of the display area corresponding to screen B are (0, 1080), (0, 2160), (1920, 1080), (1920, 2160), these four vertices correspond to the upper left corner, upper right corner, lower left corner, and lower right corner of the B screen in turn.

It should be noted that this application does not limit the specific display area corresponding to each display screen of the electronic device in the preset coordinate system, which can be moved arbitrarily in the preset coordinate system based on the examples shown in Figure 11 and Figure 13 , or rotate arbitrarily, the corresponding display areas of each display screen can be arranged adjacently or not.

S1003. The electronic device synthesizes the first GUI according to at least one second layer.

Wherein, at least one second layer includes the first layer. Alternatively, the at least one second layer includes the first layer and at least one layer corresponding to the second GUI already displayed on the target display screen. It can be understood that the second layer is the layer to be displayed on the target display screen.

In a possible implementation manner, before the electronic device synthesizes the first GUI according to at least one second layer, the electronic device displays the second GUI through the target display screen, and all layers corresponding to the second GUI are equal to all layers corresponding to the first GUI. The layers are different, ie the first GUI is a completely new GUI, then at least one second layer comprises the first layer.

Exemplarily, taking FIG. 8 as an example, the electronic device includes screen A and screen B, wherein screen A is a target display screen, and image data is layer data not displayed on screen A and screen B. The video interface 803 displayed on the screen A is the first GUI, and the main interface 800 displayed on the screen A is the second GUI. The first GUI includes a layer 803 , the second GUI includes a layer 800 , and the layer 803 is different from the layer 800 . It can be seen that the layers included in the first GUI are different from the layers included in the second GUI. At this time, at least one second layer is the first layer, and both the second layer and the first layer are layers 803 .

In another possible implementation manner, before the electronic device synthesizes the first GUI according to at least one second layer, the electronic device displays the second GUI through the target display screen, and at least one layer corresponding to the second GUI corresponds to the first GUI part of the layers are the same, then at least one second layer includes the first layer and at least one layer corresponding to the second GUI. That is, the first GUI may include some layers in the second GUI.

Exemplarily, taking FIG. 9 as an example, the electronic device includes a screen A and a screen B, wherein the screen A is a target display screen, and the image data is data of a layer already displayed on the screen A. It can be understood that this example is described with the image data being the data of the layer already displayed on the target display screen. In the embodiment of the present application, the image data may be the data of the layer displayed on the target display screen, or the layer data displayed on other display screens except the target display screen, or the data of the layer displayed on the target display screen. Data for layers on the target display and layers already displayed on displays other than the target display.

Wherein, the interface 905 displayed on the screen A is the first GUI, and the interface 900 displayed on the screen A is the second GUI. The first GUI includes a layer 901 and a layer 904 , and the second GUI includes a layer 901 and a layer 902 . It can be understood that in the embodiment of the present application, the content displayed in layer 902 and layer 904 is the same, but the display positions on the display screen are different, so the two are different layers. Both the first GUI and the second GUI include a layer 901 . It can be seen that the partial layers included in the first GUI are the same as the partial layers included in the second GUI. At this time, at least one second layer includes the first layer and some layers in the second GUI, the first layer is layer 904 , and the part layer in the second GUI is layer 901 .

Exemplarily, taking FIG. 14 as an example, the image data is the layer data not displayed on the A screen and the B screen. The electronic device includes a screen A and a screen B, wherein the screen A displays a video interface 1400 , and the screen B displays a calculator interface 1402 . The electronic device detects the user's click operation on the message notification icon 1401 on screen A, and in response to the click operation, the electronic device determines that the GUI needs to be updated, and then the electronic device draws the first layer according to the image data. The electronic device determines that screen A is the target display screen according to the layout information of the first layer and the corresponding display areas of screen A and screen B in the preset coordinate system, and then the electronic device performs synthesis on the second layer to be displayed on screen A Operation, generate the first GUI, and control screen A to display the first GUI. Exemplarily, the screen A of the electronic device displays an interface such as interface 1405, which includes a video interface 1400 and a chat interface 1403 (that is, the first layer) floating on the video interface, and the screen B still displays a calculator interface 1402 .

Wherein, the interface 1405 displayed on the screen A is the first GUI, and the interface 1400 displayed on the screen A is the second GUI. Layer 1400 and layer 1403 are included in the first GHI, and layer 1400 is included in the second GUI. It can be seen that both the first GUI and the second GUI include the layer 1400 . It can be seen that the partial layers included in the first GUI are the same as the partial layers included in the second GUI. At this moment, at least one second layer includes the first layer and some layers in the second GUI, the first layer is layer 1403 , and the part layer in the second GUI is layer 1400 .

In yet another possible implementation manner, before the electronic device synthesizes the first GUI according to the at least one second layer, the electronic device does not display the GUI through the target display screen, and the at least one second layer includes the first layer.

It should be noted that, in the embodiment of the present application, the above-mentioned implementation manner is applicable to the two kinds of image data mentioned in step S1001 , and no further examples are given here.

Optionally, there may be one or more target display screens, and there may also be one or more first layers. In the case of one target display screen, at least one second layer includes all layers in one or more first layers; in the case of multiple target display screens, at least one second layer may include Partial layers within one or more first layers.

It can be understood that the process of synthesizing the first GUI by the electronic device according to at least one second layer is a synthesizing operation, that is, performing the synthesizing operation on the content in the surface to be displayed on the display screen. In the embodiment of the present application, the electronic device will perform a composition operation on the layers to be displayed on the display screen only when it is determined that the GUI displayed on the display screen needs to be updated. For a display screen whose displayed GUI does not need to be updated, no compositing operation will be performed on the layers to be displayed on the display screen.

Optionally, after the electronic device synthesizes the first GUI according to the at least one second layer, the electronic device may also cache the first GUI in a background buffer area corresponding to the target display screen. It can be understood that the back buffer refers to a buffer for synthesizing the GUI in the background, and the front buffer refers to a buffer for outputting the GUI currently displayed on the display screen.

It should be noted that, in the embodiment of the present application, in order to facilitate the electronic device to output the content of the buffer to a corresponding display screen for display, the buffer area and the display screen may be pre-bound. Taking the double buffering mechanism as an example, if the display screen of the electronic device includes screen A and screen B, then screen A can be bound to buffer 0 and buffer 1 to perform compositing operations for the layers to be displayed on screen A . Screen B can be bound to buffer 2 and buffer 3, so as to perform compositing operations for the layers to be displayed on screen B.

It should be noted that the embodiment of the present application does not limit the number of buffers, and the technical solution provided by the embodiment of the present application is also applicable to the case of multiple buffers.

S1004. The electronic device controls the target display screen to display the first GUI.

Wherein, for a display screen that needs to update the GUI, the electronic device will output the corresponding synthesized GUI to the display screen for display, that is, perform a refresh operation. For a display screen that does not need to update the GUI, the electronic device does not perform a refresh operation, and the display screen still displays the original content.

Specifically, the electronic device may switch the back buffer corresponding to the target display screen to the front buffer corresponding to the target display screen, and then output the first GUI in the front buffer corresponding to the target display screen to the target display screen for display.

Optionally, before the electronic device switches the background buffer corresponding to the target display to the foreground buffer corresponding to the target display, the electronic device may also receive a vertical synchronization signal, respond to the vertical synchronization signal, and then switch the corresponding The background buffer of the target display screen is switched to the front buffer corresponding to the target display screen, the screen is refreshed, and the first GUI in the front buffer area corresponding to the target display screen is output to the target display screen for display.

Based on the above technical solution, after the electronic device generates a layer according to the image data, only after determining that the GUI displayed on the display screen needs to be updated according to the layout information of the layer, will the GUI be synthesized according to the layer to be displayed on the display screen, that is, execute Combining operations, and then displaying the synthesized GUI through the display screen, that is, performing a refresh operation. For a display screen whose displayed GUI does not need to be updated, the electronic device will neither perform a composition operation nor a refresh operation on the layers to be displayed on the display screen. Thus, the performance loss caused by unnecessary operations performed by the electronic device can be reduced.

Still, the display screens included in the electronic equipment are A screen and B screen, and the image from the nth frame to the n+k frame image on the A screen changes continuously; while the n+k frame image on the B screen changes with respect to the nth frame image. change, but the image from frame n to frame n+k-1 does not change, screen A is bound to buffer0 and buffer1, screen B is bound to buffer2 and buffer3, the value of n is 1, and the value of k is 2 as an example. FIG. 15 shows a schematic diagram of the process of completing image frame display by adopting the technical solution provided by the embodiment of the present application. Wherein, the meaning of each line in Fig. 15 is the same as that described in Fig. 7, the process of the electronic device completing the display of the first frame on the A screen and the B screen is the same as that of the electronic device described in Fig. 7 completing the display of the first frame on the A screen and the B screen The process is also the same and will not be repeated here.

For the second frame, the display content on the A screen changes to "1", and the display content on the B screen does not change, and the display content is still "0". The electronic device generates layers from the image data. For screen A, the electronic device executes a composite operation according to the layer to be displayed on screen A, and the composite result is “1”, which is stored in buffer 1 . Then the electronic device switches between buffer 0 and buffer 1, that is, executes a refresh operation, outputs the data in buffer 1 to A screen display, and completes the display of the second frame on A screen (at this time, buffer 1 is the front buffer, Buffer 0 is the back buffer). Since the displayed content on the B screen has not changed, the electronic device will not execute the compositing operation on the layer to be displayed on the B screen, nor will it perform the refresh operation, and the B screen still displays "0".

Subsequently, for screen A and screen B, the process of the electronic device to complete the display of the third frame is similar to the process of completing the display of the second frame on screen A, and will not be described in detail here. In addition, for screen B, if the display content of the third frame remains unchanged and is still "0", the electronic device will also not execute the composite operation and refresh operation.

It can be seen from FIG. 13 that, for screen A, the display content of the first frame to the third frame changes continuously, and the display content on the screen changes once, and the electronic device performs a composite operation and a screen refresh operation. For the B screen, the display content of the first frame to the third frame changes once every frame, and when the display content does not change (for example: the second frame), the electronic device does not perform the synthesis operation, nor does it perform the screen refresh operation. It can be known that, for screen A and screen B, the frequency of the electronic device performing the composition operation and the frequency of the refresh operation is the same as the frequency of the actual change of the displayed content. It can be seen that the technical solutions provided by the embodiments of the present application reduce the performance loss caused by unnecessary operations performed by the electronic device.

The above example is introduced with the value of n being 1 and the value of k being 2. Similarly, when n and k are other values, the technical solution provided by the embodiment of the present application can also reduce unnecessary execution of electronic devices. The performance loss caused by the operation.

The foregoing mainly introduces the solutions provided by the embodiments of the present application from the perspective of methods. It can be understood that, in order to realize the above functions, the electronic device includes hardware structures and/or software modules corresponding to each function. Combining the units and algorithm steps of each example described in the embodiments disclosed in this application, the embodiments of this application can be implemented in hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer-driven hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the technical solutions of the embodiments of the present application.

The embodiment of the present application may divide the electronic device into functional modules according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software function modules. It should be noted that the division of units in the embodiment of the present application is schematic, and is only a logical function division, and there may be another division manner in actual implementation.

As shown in FIG. 16 , it is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The electronic device 1600 can be used to implement the methods described in the above method embodiments. Exemplarily, the electronic device 1600 may specifically include: a processing unit 1601 and a display unit 1602 .

Wherein, the processing unit 1601 is configured to support the electronic device 1600 to execute steps S1001 to S1003 in FIG. 10 . And/or, the processing unit 1601 is further configured to support the electronic device 1600 to perform other steps performed by the electronic device in the embodiment of the present application.

The display unit 1602 is configured to support the electronic device 1600 to execute step S1004 in FIG. 10 . And/or, the display unit 1602 is further configured to support the electronic device 1600 to perform other steps performed by the electronic device in the embodiment of the present application.

Optionally, the electronic device 1600 shown in FIG. 16 may further include a communication unit 1603, configured to support the electronic device 1600 to perform the steps of communication between the electronic device and other electronic devices in the embodiment of the present application.

Optionally, the electronic device 1600 shown in FIG. 16 may further include a storage unit (not shown in FIG. 16 ), where programs or instructions are stored in the storage unit. When the processing unit 1601 executes the program or instruction, the electronic device 1600 shown in FIG. 16 can execute the method shown in FIG. 10 .

For the technical effect of the electronic device 1600 shown in FIG. 16 , reference may be made to the technical effect of the method shown in FIG. 10 , which will not be repeated here. The processing unit 1601 involved in the electronic device 1600 shown in FIG. 16 may be implemented by a processor or processor-related circuit components, and may be a processor or a processing module. The communication unit 1603 may be implemented by a transceiver or transceiver-related circuit components, and may be a transceiver or a transceiver module. The display unit 1602 may be implemented by display screen related components.

The embodiment of the present application also provides a chip system, as shown in FIG. 17 , the chip system includes at least one processor 1701 and at least one interface circuit 1702 . The processor 1701 and the interface circuit 1702 can be interconnected through wires. For example, interface circuit 1702 may be used to receive signals from other devices. As another example, the interface circuit 1702 may be used to send signals to other devices (such as the processor 1701). Exemplarily, the interface circuit 1702 can read instructions stored in the memory, and send the instructions to the processor 1701 . When the instructions are executed by the processor 1701, the electronic device may be made to perform various steps performed by the electronic device in the foregoing embodiments. Of course, the chip system may also include other discrete devices, which is not specifically limited in this embodiment of the present application.

Optionally, there may be one or more processors in the chip system. The processor can be realized by hardware or by software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, or the like. When implemented by software, the processor may be a general-purpose processor implemented by reading software codes stored in a memory.

Optionally, there may be one or more memories in the chip system. The memory can be integrated with the processor, or can be set separately from the processor, which is not limited in this application. Exemplarily, the memory can be a non-transitory processor, such as a read-only memory ROM, which can be integrated with the processor on the same chip, or can be respectively arranged on different chips. The setting method of the processor is not specifically limited.

Exemplarily, the chip system may be a field programmable gate array (field programmable gate array, FPGA), an application specific integrated circuit (ASIC), or a system chip (system on chip, SoC), or It can be a central processor unit (CPU), a network processor (network processor, NP), a digital signal processing circuit (digital signal processor, DSP), or a microcontroller (micro controller unit) , MCU), and may also be a programmable controller (programmable logic device, PLD) or other integrated chips.

It should be understood that each step in the foregoing method embodiments may be implemented by an integrated logic circuit of hardware in a processor or instructions in the form of software. The method steps disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor.

The embodiment of the present application also provides a computer storage medium, the computer storage medium stores computer instructions, and when the computer instructions are run on the electronic device, the electronic device is made to execute the method described in the foregoing method embodiments.

An embodiment of the present application provides a computer program product, and the computer program product includes: a computer program or an instruction. When the computer program or instruction is run on a computer, the computer is made to execute the method described in the above method embodiments.

In addition, the embodiment of the present application also provides a device, which may specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein, the memory is used to store instructions executed by a computer, and when the device is running, the processing The device can execute the computer-executed instructions stored in the memory, so that the device executes the methods in the foregoing method embodiments.

Wherein, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is all used to execute the corresponding method provided above, therefore, the beneficial effects it can achieve can refer to the corresponding method provided above The beneficial effects in the method will not be repeated here.

Through the description of the above embodiments, those skilled in the art can understand that for the convenience and brevity of the description, only the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned functions can be assigned by different Completion of functional modules means that the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. The various embodiments may be combined or referred to each other without conflict. The device embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated. to another device, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

A unit described as a separate component may or may not be physically separated, and a component shown as a unit may be one physical unit or multiple physical units, which may be located in one place or distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If an integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium Among them, several instructions are included to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods in various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk, and other media capable of storing program codes.

The above content is only the specific implementation of the application, but the scope of protection of the application is not limited thereto. Anyone familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the application, and should covered within the scope of protection of this application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims (18)

1. A display method applied to an electronic device, wherein the electronic device comprises at least two display screens, the method comprising:

the electronic equipment generates a first image layer according to the image data;

the electronic equipment determines a target display screen from at least two display screens according to the layout information of the first layer and the display areas corresponding to the at least two display screens in a preset coordinate system, wherein the layout information of the first layer indicates the display area of the first layer in the preset coordinate system;

the electronic equipment synthesizes a first graphical user interface GUI according to at least one second layer; wherein the at least one second layer comprises the first layer; or the at least one second layer comprises the first layer and at least one layer corresponding to a second GUI displayed by the target display screen;

And the electronic equipment controls the target display screen to display the first GUI.

2. The method of claim 1, wherein the determining, by the electronic device, the target display screen from the at least two display screens according to the layout information of the first layer and the display areas corresponding to the at least two display screens in the preset coordinate system, includes:

and the electronic equipment determines at least one display screen, in the at least two display screens, of which the corresponding display area in the preset coordinate system and the display area of the first layer in the preset coordinate system have an overlapping area, as the target display screen.

3. The method according to claim 1 or 2, wherein the image data is data of a layer not displayed on the at least two display screens; the electronic device generates a first image layer according to image data, including:

the electronic device draws the first layer according to the image data.

4. The method according to claim 1 or 2, wherein the image data is data of a third layer that has been displayed on the at least two display screens; the electronic device generates a first image layer according to image data, including:

The electronic equipment acquires the change data of the display positions of the third layer on the at least two display screens;

and the electronic equipment adjusts the display position of the image data according to the change data to obtain the first image layer.

5. The method of claim 3 or 4, wherein prior to the electronic device synthesizing the first GUI from the at least one second layer, the method further comprises:

the electronic equipment displays the second GUI through the target display screen; and all layers corresponding to the second GUI are different from all layers corresponding to the first GUI, and the at least one second layer comprises the first layer.

6. The method of claim 3 or 4, wherein prior to the electronic device synthesizing the first GUI from the at least one second layer, the method further comprises:

the electronic equipment displays the second GUI through the target display screen; at least one layer corresponding to the second GUI is the same as a part of layers corresponding to the first GUI, and the at least one second layer comprises the first layer and at least one layer corresponding to the second GUI.

7. The method of any of claims 1-6, wherein after the electronic device synthesizes the first GUI from the at least one second layer, the method further comprises:

And the electronic equipment caches the first GUI to a background buffer zone corresponding to the target display screen.

8. The method of any of claims 1-7, wherein the electronic device controlling the target display to display the first GUI comprises:

the electronic equipment switches a background buffer zone corresponding to the target display screen into a foreground buffer zone corresponding to the target display screen;

and the electronic equipment outputs the first GUI in the foreground buffer area corresponding to the target display screen for display.

9. An electronic device comprising a first processor, a second processor, and at least two display screens, the second processor, the at least two display screens being coupled to the first processor;

the first processor or the second processor is used for generating a first image layer according to the image data;

the first processor is configured to determine a target display screen from the at least two display screens according to layout information of the first layer and display areas corresponding to the at least two display screens in a preset coordinate system, where the layout information of the first layer indicates the display area of the first layer in the preset coordinate system;

The second processor is used for synthesizing a first graphical user interface GUI according to at least one second image layer; wherein the at least one second layer comprises the first layer; or the at least one second layer comprises the first layer and at least one layer corresponding to a second GUI displayed by the target display screen;

and the target display screen is used for displaying the first GUI.

10. The electronic device of claim 9, wherein the electronic device comprises a memory device,

the first processor is specifically configured to determine, as the target display screen, at least one display screen in which an overlapping area exists between a display area corresponding to the preset coordinate system and a display area of the first layer in the preset coordinate system in the at least two display screens.

11. The electronic device of claim 9 or 10, wherein the image data is data of a layer not displayed on the at least two display screens;

the first processor or the second processor is specifically configured to draw the first layer according to the image data.

12. The electronic device of claim 9 or 10, wherein the image data is data of a third layer that has been displayed on the at least two display screens;

The first processor is specifically configured to obtain change data of display positions of the third layer on the at least two display screens; and adjusting the display position of the image data according to the change data to obtain the first image layer.

13. An electronic device as claimed in claim 11 or 12, characterized in that,

the target display screen is further used for displaying the second GUI; and all layers corresponding to the second GUI are different from all layers corresponding to the first GUI, and the at least one second layer comprises the first layer.

14. An electronic device as claimed in claim 11 or 12, characterized in that,

the target display screen is also used for displaying a second GUI; at least one layer corresponding to the second GUI is the same as a part of layers corresponding to the first GUI, and the at least one second layer comprises the first layer and at least one layer corresponding to the second GUI.

15. The electronic device of any of claims 9-14, wherein the electronic device comprises a memory device,

the second processor is further configured to cache the first GUI to a background buffer corresponding to the target display screen.

16. The electronic device of any of claims 9-15, wherein,

The first processor is further configured to switch a background buffer area corresponding to the target display screen to a foreground buffer area corresponding to the target display screen;

the first processor is further configured to output the first GUI in the foreground buffer corresponding to the target display screen for display.

17. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program or instructions, which when run on a computer, cause the computer to perform the method according to any of claims 1-8.

18. A computer program product, the computer program product comprising: computer program or instructions which, when run on a computer, cause the computer to perform the method of any of claims 1-8.