WO2018161534A1 - Image display method, dual screen terminal and computer readable non-volatile storage medium - Google Patents

Abstract

Disclosed in the embodiments of the present invention are an image display method, a dual screen terminal and a computer readable non-volatile storage medium. The method comprises: respectively acquiring a plurality of image layers to be merged corresponding to a first screen and a plurality of image layers to be merged corresponding to a second screen; merging the plurality of image layers to be merged corresponding to the first screen to form a first image, and merging the plurality of image layers to be merged corresponding to the second screen to form a second image; by means of a hardware synthesiser in the dual screen terminal, transmitting the first image to the first screen for display and transmitting the second image to the second screen for display, thereby implementing simultaneous display of images comprising multiple image layers on both screens of the dual screen terminal.

Description

Method for displaying image, dual screen terminal and computer readable non-volatile storage medium

The present application claims priority to the CN Patent Application, the disclosure of which is hereby incorporated by reference in its entirety in its entirety in its entirety in in.

Technical field

The present invention relates to the field of electronic technologies, and in particular, to a method for displaying an image, a dual screen terminal, and a computer readable nonvolatile storage medium.

Background technique

With the development of electronic technology, various terminals have been widely used, for example, terminals such as mobile phones with display functions. At present, only one screen is set in the terminal used by the user, and the user can interact with the terminal through the image displayed on the terminal screen. At present, most of the terminals only support the display of a single screen, and there are two factors on the terminal for simultaneously displaying images. More.

Summary of the invention

Embodiments of the present invention provide a method of displaying an image, a dual screen terminal, and a computer readable nonvolatile storage medium.

In a first aspect, an embodiment of the present invention provides a method for displaying an image, where the method includes:

Obtaining, respectively, a plurality of layers to be synthesized corresponding to the first screen and a plurality of layers to be synthesized corresponding to the second screen;

Synthesizing a plurality of layers to be synthesized corresponding to the first screen to form a first image, and synthesizing a plurality of layers to be synthesized corresponding to the second screen to form a second image;

The first image is transmitted to the first screen for display by a hardware synthesizer in the dual screen terminal, and the second image is transmitted to the second screen for display.

In some implementations, the synthesizing the plurality of layers to be synthesized corresponding to the first screen to form a first image includes:

And forming, according to the display position of the first screen, each of the plurality of layers to be combined corresponding to the first screen, synthesizing a plurality of layers to be synthesized corresponding to the first screen to form The first image;

And synthesizing the plurality of layers to be synthesized corresponding to the second screen to form a second image, including:

And synthesizing a plurality of layers to be synthesized corresponding to the second screen according to a display position of the second screen corresponding to each layer of the plurality of layers to be synthesized corresponding to the second screen The second image.

In some embodiments, the first screen is an ink screen, and the acquiring a plurality of layers to be synthesized corresponding to the first screen includes:

Acquiring, by the graphics processor GPU in the dual-screen terminal, a plurality of layers to be synthesized corresponding to the first screen;

And synthesizing the plurality of layers to be synthesized corresponding to the first screen, and forming the first image includes:

And synthesizing, by the GPU, a plurality of layers to be synthesized corresponding to the first screen to form the first image, and storing the first image in a first buffer area;

Transmitting, by the hardware synthesizer in the dual screen terminal, the first image to the first screen for display, including:

Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer, and transmitting the first image to the first screen for display.

In some embodiments, when each of the plurality of layers to be synthesized corresponding to the second screen does not change, acquiring the plurality of layers to be synthesized corresponding to the second screen includes:

Acquiring, by the GPU, a plurality of layers to be synthesized corresponding to the second screen;

And synthesizing the plurality of layers to be synthesized corresponding to the second screen, and forming the second image includes:

And synthesizing, by the GPU, a plurality of layers to be synthesized corresponding to the second screen to form the second image, and storing the second image in a second buffer area;

Transmitting, by the hardware synthesizer, the second image to the second screen for display, including:

Acquiring the second image stored in the second buffer area through the second channel of the hardware synthesizer, and transmitting the second image to the second screen for display.

In some embodiments, when each of the plurality of layers to be synthesized corresponding to the second screen is changed, acquiring the plurality of layers to be synthesized corresponding to the second screen includes:

Obtaining, by the channel other than the first channel, the plurality of layers to be synthesized corresponding to the second screen, wherein one channel of the hardware synthesizer acquires a layer, where the The number of layers of the plurality of layers to be synthesized corresponding to the two screens is less than or equal to the number of channels of the hardware synthesizer minus one;

And synthesizing the plurality of layers to be synthesized corresponding to the second screen to form a second image, including:

Synthesizing a plurality of layers to be synthesized corresponding to the second screen by the hardware synthesizer to form a The second image is described.

In some embodiments, when the plurality of layers to be synthesized corresponding to the second screen includes the first layer set and the second layer set, the layers in the first layer set do not change. The layers in the second layer set are all changed, and the multiple layers to be synthesized corresponding to the second screen are obtained, including:

Acquiring each layer in the first layer set by using the GPU, and acquiring each layer in the second layer set by using the remaining channels except the first channel and the second channel in the hardware synthesizer Wherein a channel in the hardware synthesizer acquires a layer, the number of layers in the second set is less than or equal to the number of channels of the hardware synthesizer minus 2;

And synthesizing the plurality of layers to be synthesized corresponding to the second screen to form a second image, including:

And synthesizing each layer in the first layer set by the GPU to form a third image, and storing the third image in a second buffer area;

Obtaining, by the second channel of the hardware synthesizer, the third image stored in the second buffer area;

And forming, by the hardware synthesizer, each layer in the second layer set and the third image to form the second image.

In some embodiments, the first channel stored in the first buffer area is acquired by the first channel of the hardware synthesizer, and the first image is transmitted to the first screen for display, including :

Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer in the dual screen terminal when detecting the synthesis completion instruction of the first image by the GPU, and Transmitting the first image to the first screen for display;

Obtaining, by the second channel of the hardware synthesizer, the second image stored in the second buffer area, and transmitting the second image to the second screen for display, including:

Acquiring the second image stored in the second buffer area through the second channel of the hardware synthesizer when the GPU completes the synthesis completion instruction of the second image, and transmitting the second image Display to the second screen.

In some embodiments, the method further includes:

Deleting the first image in the first buffer area when detecting the display completion instruction of the first image;

When the display completion instruction of the second image is detected, the second image in the second buffer area is deleted.

In some embodiments, the first buffer is stored in the first channel of the hardware synthesizer And transmitting the first image to the first screen for display, including:

Obtaining, by the first channel of the hardware synthesizer, the first image stored in the first buffer area;

Decoding the first image, obtaining logical TCON data corresponding to the first image, and driving the first screen to display according to the TCON data.

In a second aspect, an embodiment of the present invention provides a dual screen terminal, including: the dual screen terminal includes: a memory, a processor, a GPU, a hardware synthesizer, a first screen, a second screen, and are stored on the memory and a program executable on the processor, the processor being respectively coupled to the memory, the hardware synthesizer, and the GPU, the GPU being coupled to the memory, the hardware synthesizer separately and the The memory, the first screen and the second screen are connected, and the processor implements the program when:

Obtaining, respectively, a plurality of layers to be synthesized corresponding to the first screen and a plurality of layers to be synthesized corresponding to the second screen;

Synthesizing a plurality of layers to be synthesized corresponding to the first screen to form a first image, and synthesizing a plurality of layers to be synthesized corresponding to the second screen to form a second image;

The first image is transmitted to the first screen for display by a hardware synthesizer in the dual screen terminal, and the second image is transmitted to the second screen for display.

In some embodiments, the processor implements the program when:

And forming, according to the display position of the first screen, each of the plurality of layers to be combined corresponding to the first screen, synthesizing a plurality of layers to be synthesized corresponding to the first screen to form The first image;

And synthesizing a plurality of layers to be synthesized corresponding to the second screen according to a display position of the second screen corresponding to each layer of the plurality of layers to be synthesized corresponding to the second screen The second image.

In some embodiments, the first screen is an ink screen, and when the processor executes the program, the implementation is:

Acquiring, by the graphics processor GPU in the dual-screen terminal, a plurality of layers to be synthesized corresponding to the first screen;

And synthesizing, by the GPU, a plurality of layers to be synthesized corresponding to the first screen to form the first image, and storing the first image in a first buffer area;

Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer, and transmitting the first image to the first screen for display.

In some embodiments, when each of the plurality of layers to be synthesized corresponding to the second screen does not change, the processor executes the program:

Acquiring, by the GPU, a plurality of layers to be synthesized corresponding to the second screen;

And synthesizing, by the GPU, a plurality of layers to be synthesized corresponding to the second screen to form the second image, and storing the second image in a second buffer area;

Acquiring the second image stored in the second buffer area through the second channel of the hardware synthesizer, and transmitting the second image to the second screen for display.

In some embodiments, when each of the plurality of layers to be synthesized corresponding to the second screen changes, the processor executes the program:

Obtaining, by the channel other than the first channel, the plurality of layers to be synthesized corresponding to the second screen, wherein one channel of the hardware synthesizer acquires a layer, where the The number of layers of the plurality of layers to be synthesized corresponding to the two screens is less than or equal to the number of channels of the hardware synthesizer minus one;

Forming, by the hardware synthesizer, a plurality of layers to be synthesized corresponding to the second screen to form the second image.

In some implementations, when the plurality of layers to be synthesized corresponding to the second screen includes a first layer set and a second layer set, the processor implements the program when:

Acquiring each layer in the first layer set by using the GPU, and acquiring each layer in the second layer set by using the remaining channels except the first channel and the second channel in the hardware synthesizer Wherein a channel in the hardware synthesizer acquires a layer, the number of layers in the second set is less than or equal to the number of channels of the hardware synthesizer minus 2;

And synthesizing each layer in the first layer set by the GPU to form a third image, and storing the third image in a second buffer area;

Obtaining, by the second channel of the hardware synthesizer, the third image stored in the second buffer area;

And forming, by the hardware synthesizer, each layer in the second layer set and the third image to form the second image.

In some embodiments, the processor implements the program when:

Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer in the dual screen terminal when detecting the synthesis completion instruction of the first image by the GPU, and Transmitting the first image to the first screen for display;

Acquiring the second image stored in the second buffer area through the second channel of the hardware synthesizer when the GPU completes the synthesis completion instruction of the second image, and transmitting the second image Display to the second screen.

In some embodiments, the processor when executing the program further implements:

Deleting the first image in the first buffer area when detecting the display completion instruction of the first image;

When the display completion instruction of the second image is detected, the second image in the second buffer area is deleted.

In some embodiments, the processor implements the program when:

Obtaining, by the first channel of the hardware synthesizer, the first image stored in the first buffer area;

Decoding the first image, obtaining logical TCON data corresponding to the first image, and driving the first screen to display according to the TCON data.

In a third aspect, an embodiment of the present invention provides a computer readable non-volatile storage medium, where the non-volatile storage medium stores a program, and when the program is executed, the method step of the first aspect is carried out.

In a fourth aspect, an embodiment of the present invention provides an apparatus for displaying an image, including:

An acquiring module, configured to respectively acquire a plurality of layers to be synthesized corresponding to the first screen and multiple layers to be synthesized corresponding to the second screen;

a synthesizing module, configured to synthesize a plurality of layers to be synthesized corresponding to the first screen to form a first image, and synthesize the plurality of layers to be synthesized corresponding to the second screen to form a second image ;

And a display module, configured to transmit the first image to the first screen for display through a hardware synthesizer in the dual screen terminal, and transmit the second image to the second screen for display.

In some embodiments, the synthesizing module is configured to display, according to the display position of the first screen, each of the plurality of layers to be synthesized corresponding to the first screen, to the first screen Corresponding multiple layers to be combined are combined to form the first image; according to the display position of each of the plurality of layers to be synthesized corresponding to the second screen at the second screen, And synthesizing a plurality of layers to be synthesized corresponding to the second screen to form the second image.

In some embodiments, the acquiring module is configured to acquire, by the graphics processor GPU in the dual screen terminal, a plurality of graphics to be synthesized corresponding to the first screen, when the first screen is an ink screen. Floor;

The synthesizing module is configured to synthesize a plurality of layers to be synthesized corresponding to the first screen by using the GPU to form the first image, and store the first image in a first buffer area;

The display module is configured to acquire a first image stored in the first buffer area by using a first channel of the hardware synthesizer, and transmit the first image to the first screen for display.

In some implementations, the acquiring module is configured to acquire, by the GPU, the first screen correspondingly when each of the plurality of layers to be synthesized corresponding to the second screen does not change. Multiple to be synthesized Layer

The synthesizing module is configured to synthesize a plurality of layers to be synthesized corresponding to the second screen by using the GPU to form the second image, and store the second image in a second buffer area;

The display module is configured to acquire a second image stored in the second buffer area by using a second channel of the hardware synthesizer, and transmit the second image to the second screen for display.

In some implementations, the acquiring module is configured to remove, by the hardware synthesizer, the first one when each of the plurality of layers to be synthesized corresponding to the second screen changes The channel outside the channel acquires multiple layers to be synthesized corresponding to the second screen, where one channel in the hardware synthesizer acquires a layer, and the number of multiple layers to be synthesized corresponding to the second screen is smaller than Or equal to the number of channels of the hardware synthesizer minus one;

The synthesizing module is configured to synthesize a plurality of layers to be synthesized corresponding to the second screen by using the hardware synthesizer to form the second image.

In some implementations, the acquiring module is configured to acquire, by the GPU, when the multiple layers to be synthesized corresponding to the second screen include a first layer set and a second layer set Each layer in a set of layers acquires each layer in the second set of layers through the remaining channels of the hardware synthesizer except the first channel and the second channel; wherein one of the hardware synthesizers The channel acquires a layer, the number of layers in the second set is less than or equal to the number of channels of the hardware synthesizer minus 2;

The synthesizing module is configured to synthesize each layer in the first layer set by the GPU to form a third image, and store the third image in a second buffer area;

The acquiring module is further configured to acquire, by using a second channel of the hardware synthesizer, a third image stored in the second buffer area;

The synthesizing module is further configured to synthesize each layer in the second layer set and the third image by using the hardware synthesizer to form the second image.

In some embodiments, the display module is configured to acquire, by the first channel of the hardware synthesizer in the dual screen terminal, when the GPU completes the synthesis completion instruction of the first image. a first image stored in the first buffer area, and transmitting the first image to the first screen for display; when detecting a synthesis completion instruction of the second image by the GPU, passing the hardware The second channel of the synthesizer acquires the second image stored in the second buffer area and transmits the second image to the second screen for display.

In some embodiments, the apparatus further includes a deletion module,

The deleting module is configured to: when the display completion instruction of the first image is detected, delete the first image in the first buffer area; when detecting the display completion instruction of the second image, The second image in the second buffer area is deleted.

In some embodiments, the apparatus further includes a decoding module,

The acquiring module is further configured to acquire, by using the first channel of the hardware synthesizer, the first image stored in the first buffer area;

The decoding module is configured to decode the first image, obtain logical TCON data corresponding to the first image, and drive the first screen to display according to the TCON data.

DRAWINGS

In order to more clearly illustrate the technical solution of the method embodiment of the present invention, a brief description of the drawings to be used in the description of the embodiments will be briefly introduced. It is obvious that the drawings in the following description are some embodiments of the method of the present invention. Other drawings may also be obtained from those skilled in the art based on these drawings without paying any creative effort.

1 is a schematic flow chart of Embodiment 1 of a method for displaying an image provided by the present invention;

2 is a schematic diagram of layer composition according to an embodiment of the present invention;

FIG. 3 is a schematic flowchart diagram of Embodiment 2 of a method for displaying an image according to the present invention;

FIG. 3a is a schematic diagram of layer synthesis according to Embodiment 2 of the present invention; FIG.

4 is a schematic flow chart of a third embodiment of a method for displaying an image according to the present invention;

4a is a schematic diagram of layer synthesis according to Embodiment 3 of the present invention;

4b is a schematic diagram showing a display flow of the first image and the second image;

FIG. 5 is a schematic flowchart diagram of Embodiment 4 of a method for displaying an image according to the present invention;

FIG. 5a is a schematic diagram of layer composition according to Embodiment 4 of the present invention; FIG.

FIG. 6 is a schematic flowchart diagram of Embodiment 5 of a method for displaying an image according to the present invention;

FIG. 6a is a schematic diagram of layer composition according to Embodiment 5 of the present invention; FIG.

FIG. 7 is a schematic structural diagram of a terminal according to an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of a terminal according to an embodiment of the present disclosure;

FIG. 9 is a schematic flowchart diagram of Embodiment 1 of an apparatus for displaying an image according to the present invention;

FIG. 10 is a schematic flowchart diagram of Embodiment 2 of an apparatus for displaying an image according to the present invention;

FIG. 11 is a schematic flowchart diagram of Embodiment 3 of an apparatus for displaying an image according to the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The embodiment of the invention provides a method for displaying an image, and the execution body of the method is a dual screen terminal. The dual-screen terminal may be any terminal having a display function, such as a dual-screen mobile phone. The dual-screen terminal may be provided with a graphics processor, a memory, a hardware synthesizer, a screen, and the graphics processor may be used for processing related processes of synthesizing a plurality of layers, and the memory may be used to store the following processes required and generated. The data synthesizer can be used for correlation processing of multiple layers for synthesis, and can be used to acquire images stored in the buffer area and transfer them to the screen, which can be used to display images.

The technical solutions of the present invention will be described in detail below with specific embodiments. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be described in some embodiments.

FIG. 1 is a schematic flowchart diagram of Embodiment 1 of a method for displaying an image provided by the present invention. The execution body of this embodiment is a dual screen terminal, and specifically may be a device having a display image function in a dual screen terminal. As shown in FIG. 1, the method in this embodiment may include:

S101. Acquire, respectively, a plurality of layers to be synthesized corresponding to the first screen and a plurality of layers to be synthesized corresponding to the second screen.

It should be noted that, in some embodiments, the method for synthesizing the image to be displayed on the first screen is similar to the method for synthesizing the image to be displayed on the second screen, and the first screen will be taken as an example in conjunction with the specific embodiment.

In the implementation, in some cases (such as the main interface of the dual-screen terminal and some game interfaces, etc.), the image displayed by the dual-screen terminal is synthesized by multiple layers, that is, the dual-screen terminal is often used before the image is displayed. Synthesize multiple layers contained in the image to be displayed on the screen. When the smart terminal is operated, the display content and the scene will change constantly, and the number of layers will change constantly. To display the desired content on the screen, these images must be displayed. The layers are combined into a final picture. Generally, smart terminals with display will have GPU and hardware synthesizer, and the synthesis of layers is done by these two modules. Among them, the hardware synthesizer consumes less power when synthesized. GPU synthesis refers to merging layers according to the size and starting position of the layer in order from top to bottom.

Specifically, after obtaining the data of the layer to be drawn, the dual screen terminal can pass the GPU (Graphics Processing) Unit, graphics processor or CPU (Central Processing Unit) draws the layer, or draws the layer by the upper application to get the multiple layers corresponding to the first screen, GPU or hardware synthesizer (For example, the Overlay module) may acquire a plurality of layers to be synthesized corresponding to the first screen and a plurality of layers to be synthesized corresponding to the second screen.

S102. Synthesize a plurality of layers to be synthesized corresponding to the first screen to form a first image, and synthesize the plurality of layers to be synthesized corresponding to the second screen to form a second image.

In an implementation, after the GPU or the hardware synthesizer acquires multiple layers to be synthesized corresponding to the first screen, multiple layers may be combined to form a first image. Optionally, the GPU and the hardware synthesizer may combine the multiple layers to be synthesized corresponding to the first screen to form a first image. For example, the first image corresponds to four layers to be synthesized, wherein when the contents in the first layer and the second layer are unchanged, the contents in the third layer and the fourth layer are changed at any time, such that The GPU can be used to synthesize the first layer and the second layer, the third layer and the fourth layer are synthesized using a hardware synthesizer, and then the GPU synthesized image and hardware synthesizer are synthesized using a hardware synthesizer. The image is finally synthesized to obtain the first image. In this embodiment, the method for synthesizing the first image is not limited, and is specifically determined according to actual needs.

The obtaining process of the second image is the same as the acquiring process of the first image, and the description of the first image is not described herein.

S103. The first image is transmitted to the first screen for display through a hardware synthesizer in the dual screen terminal, and the second image is transmitted to the second screen for display.

In an implementation, after acquiring the first image and the second image, the dual screen terminal may send the first image to the first screen for display by using a hardware synthesizer (HW overlay), and send the second image to the second screen for display. . The synthesis function of the hardware synthesizer in this step is turned off and is in the channel mode.

According to the technical solution of the present invention, if the first image or the second image of the embodiment is synthesized by the hardware synthesizer, the hardware synthesizer directly transmits the synthesized first image or the second image to the first screen or the second screen. display. If the first image and the second image are synthesized by the GPU, the hardware synthesizer acquires the first image and the second image synthesized by the GPU, and transmits the first image to the first display screen for display using different channels, and the second image The image is transmitted to the second display for display.

The solution of the embodiment of the present invention may be applicable to a scenario in which the first screen and the second screen are simultaneously displayed. When the first screen and the second screen of the dual screen terminal are not simultaneously displayed, that is, only one screen is displayed at the same time, The dual screen terminal can also adopt the method of displaying an image on the first screen or the second screen described in the present scheme.

The method for displaying an image provided by the embodiment of the present invention obtains a plurality of to-be-synthesized corresponding to the first screen respectively. a plurality of layers to be combined corresponding to the second layer and the second screen; combining the plurality of layers to be synthesized corresponding to the first screen to form a first image, and corresponding to the second screen The layer is synthesized to form a second image; the first image is transmitted to the first screen for display through the hardware synthesizer in the dual screen terminal, and the second image is transmitted to the second screen for display, thereby realizing two of the dual screen terminals The screen also displays an image with multiple layers.

In an implementation manner of the embodiment of the present invention, the multiple layers to be synthesized corresponding to the first screen are combined to form a first image, and the method includes:

And forming, according to the display position of the first screen, each of the plurality of layers to be combined corresponding to the first screen, synthesizing a plurality of layers to be synthesized corresponding to the first screen to form The first image.

In an implementation, an upper layer application (such as a desktop application or a game application) that triggers a dual screen terminal to display an image may send a composite location corresponding to each layer to a GPU or a hardware synthesizer before synthesizing a plurality of layers. Wherein, the composite location may be a display location for identifying the layer ultimately in the screen. After receiving the composite position corresponding to each layer in the multiple layers, the GPU or the hardware synthesizer may use multiple GPUs and/or hardware synthesizers according to the composite position corresponding to each layer in the multiple layers. The layers are combined to form a first image. For example, the desktop image displayed by the dual-screen terminal is synthesized by the status bar layer, the wallpaper layer, and the icon layer. After the GPU and/or the hardware synthesizer obtain the respective layers, the composite position of each layer may be used. It is synthesized to obtain the final desktop image, as shown in Figure 2.

Optionally, the composite location may be a display location in the first screen. In an implementation, the composite location corresponding to each of the multiple layers to be synthesized corresponding to the first screen may include each layer in the layer The display position in the first screen, that is, the display position in the screen (for example, in the upper area of the screen, or the middle area), wherein the display position may be the pixel position of the display area where the layer is located (the pixel position may be The pixel position of two diagonal vertices in the area). In addition, the composite location of the layer may also include the number of layers in which the layer is located (eg, may be the second layer in all layers).

In another implementation manner of the embodiment of the present invention, the multiple layers to be synthesized corresponding to the second screen are combined to form a second image, which includes:

And synthesizing a plurality of layers to be synthesized corresponding to the second screen according to a display position of the second screen corresponding to each layer of the plurality of layers to be synthesized corresponding to the second screen The second image.

For the second image, the GPU and/or the hardware synthesizer according to the display position of the second screen corresponding to each of the plurality of layers to be synthesized corresponding to the second screen, and the plurality of to-be-composited corresponding to the second screen Layers are synthesized, The second image is formed, and the specific process is the same as the process of synthesizing the first image. Referring to the above description, details are not described herein again.

FIG. 3 is a schematic flowchart diagram of Embodiment 2 of a method for displaying an image provided by the present invention. On the basis of the above-mentioned embodiments, the present embodiment relates to a specific process of acquiring a first image and displaying a first image when the first screen of the embodiment is an ink screen, as shown in FIG. 3, which is the embodiment of the present embodiment. Methods can include:

S201. Acquire, by the graphics processor GPU in the dual-screen terminal, multiple layers to be synthesized corresponding to the first screen.

The electronic ink screen is different from the screen of the ordinary color screen, and the driving method is also different, that is, the composite display data of the ordinary color screen is directly output to the color screen for display, and the composite display data of the ink screen needs to be converted into TCON data through software decoding. To drive the ink screen. Therefore, the ink screen is synthesized by the GPU, and the data synthesized by the GPU can be saved, so that the saved synthesized data can be decoded and processed, and the synthesized data is directly output to the screen by the hardware synthesizer, which cannot be obtained. The final synthesized data is therefore unable to be decoded. Therefore, in this embodiment, when the first screen is an ink screen, the plurality of layers to be combined corresponding to the first screen are acquired by the GPU, as shown in FIG. 3a.

S202. Synthesize a plurality of layers to be synthesized corresponding to the first screen by using the GPU to form the first image, and store the first image in a first buffer area.

Specifically, the GPU acquires multiple layers to be synthesized corresponding to the first screen, and synthesizes the layers. For example, the GPU is first according to each of the plurality of layers to be synthesized corresponding to the first screen. The display position of the screen is combined with the plurality of layers to be synthesized corresponding to the first screen to form a first image.

Then, the synthesized first image may be stored in a storage area corresponding to the first screen, that is, may be stored in the first buffer area, where the first buffer area may be used to store the first screen to be displayed. The memory storage area of the image, for example, can be stored in the frame buffer frame buffer of fb_target0.

S203. Acquire a first image stored in the first buffer area by using a first channel of the hardware synthesizer, and transmit the first image to the first screen for display.

In an implementation, after storing the first image in the first buffer area, the dual screen terminal may acquire the first image stored in the first buffer area through the first channel in the hardware synthesizer (HW overlay), and then, Send to the first screen for display. The synthesis function of the hardware synthesizer in this step is turned off, in the channel mode, and the first channel may be any channel of the hardware synthesizer that is not currently used.

In this embodiment, since the first screen is an ink screen, the foregoing S203 may specifically include:

Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer.

Decoding the first image, obtaining logical TCON data corresponding to the first image, and driving the first screen to display according to the TCON data.

For the specific reason, referring to the above, since the ink screen needs TCON data to be driven, it is necessary to decode the first image synthesized by the CPU into TCON data, specifically, the decoding program in the dual screen terminal reads the first from the first buffer area. And decoding the first image, decoding the first image into TCON data, and driving the ink screen with the TCON data, thereby implementing display of the first image on the first screen.

In an implementation manner of this embodiment, the foregoing S203 may be specifically:

Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer in the dual screen terminal when detecting the synthesis completion instruction of the first image by the GPU, and The first image is transmitted to the first screen for display.

In the implementation, the GPU completes the synthesis of the multiple layers, and after storing the synthesized first image in the first buffer area, may send a synthesis completion notification to the hardware synthesizer, and the hardware synthesizer receives the synthesis of the first image. When the notification is that, when the dual screen terminal detects the GPU completes the synthesis completion instruction of the first image, the first image stored in the first buffer area may be acquired through the first channel, and the first image is transmitted to the first screen for display. .

Optionally, when the first screen is to display the next frame image, the first image in the first buffer area may be deleted. Correspondingly, the processing may be as follows: when the display completion instruction of the first image is detected, The first image in the first buffer is deleted.

In an implementation, the dual-screen terminal may further include a buffer management service, and the dual-screen terminal may manage the first buffer area and the second buffer area by using the buffer management server. Specifically, for the first buffer area, when the hardware synthesizer displays the first image and the next frame image is to be displayed, the display completion instruction of the first image may be sent to the buffer management service, and the buffer management service receives the first image. When the display completion instruction of an image, the first image in the first buffer area can be deleted.

The method for displaying an image provided by the embodiment of the present invention, when the first screen is an ink screen, the plurality of layers to be combined corresponding to the first screen are acquired by the GPU, and the corresponding screen to be synthesized by the GPU is corresponding to the first screen. The plurality of layers are combined to form a first image, the first image is stored in the first buffer area, and finally the first image stored in the first buffer area is acquired by the first channel of the hardware synthesizer, and the first image is transmitted to The first screen is displayed to implement display of the first image on the first screen.

FIG. 4 is a schematic flowchart diagram of Embodiment 3 of a method for displaying an image according to the present invention. In the base of the above embodiment The present embodiment relates to a specific process of acquiring a second image and displaying a second image when each of the plurality of layers to be synthesized corresponding to the second screen is unchanged. As shown in FIG. 4, the method in this embodiment may specifically include:

S301. Acquire, by the GPU, multiple layers to be synthesized corresponding to the second screen.

S302. Synthesize a plurality of layers to be synthesized corresponding to the second screen by using the GPU to form the second image, and store the second image in a second buffer area.

In this embodiment, when the content of the layer is unchanged, the layer is determined to be a constant layer, and when each layer of the plurality of layers to be synthesized corresponding to the second screen does not change, These layers can be composited using the GPU to form a first image. This is mainly because the image synthesized by the GPU is saved, so that only the invariant layer needs to be synthesized once, and the synthesized second image is placed in the frame buffer frame buffer of fb_target1, and the next frame is displayed. In the case of the second image, the layer corresponding to the second image does not need to be resynthesized, and the second image can be directly read from the fb_target1 frame buffer frame buffer area, thereby reducing the workload of the GPU and reducing the power consumption of the mobile phone.

In an implementation, for the second screen, the dual-screen terminal may acquire a plurality of layers to be synthesized corresponding to the second screen by using the GPU, where the drawing of the layer may be consistent with the method described in S101, and further, the GPU is used to The plurality of layers corresponding to the two screens are combined to obtain a second image that is synthesized and stored in the second buffer area, wherein the second buffer area may be different from the first buffer area for storing the second screen. The memory area of the image to be displayed, for example, can be stored in the frame buffer frame buffer of fb_target1, as shown in Figure 4a.

S303. Acquire a second image stored in the second buffer area by using a second channel of the hardware synthesizer, and transmit the second image to the second screen for display.

In an implementation, after storing the second image in the second buffer area, the dual screen terminal may acquire the second image through the second channel of the hardware synthesizer, and transmit the second image to the second screen for display, where the second The channel may be any channel of the hardware synthesizer different from the first channel and not used, and the display flow of the first image and the second image is as shown in FIG. 4b. The specific implementation in the process of displaying the second image is similar to the process of displaying the first image, and details are not described herein.

In an implementation manner of this embodiment, the foregoing S303 may be specifically:

Acquiring the second image stored in the second buffer area through the second channel of the hardware synthesizer when the GPU completes the synthesis completion instruction of the second image, and transmitting the second image Display to the second screen.

In an implementation, the GPU completes the synthesis of multiple layers, and stores the synthesized second image in the second buffer area. The synthesis completion notification may be sent to the hardware synthesizer. When the hardware synthesizer receives the notification of the completion of the synthesis of the second image, that is, when the dual screen terminal detects the synthesis completion instruction of the second image by the GPU, the second channel may obtain the second channel. The second image stored in the second buffer area and the second image is transmitted to the second screen for display.

Optionally, when the second screen is about to display the next frame image, the second image in the second buffer area may be deleted. Correspondingly, the processing may be as follows: when the display completion instruction of the second image is detected, The second image in the second buffer area is deleted.

In an implementation, the dual-screen terminal may further include a buffer management service, and the dual-screen terminal may manage the first buffer area and the second buffer area by using the buffer management server. Specifically, for the second buffer area, when the hardware synthesizer displays the second image and the next frame image is to be displayed, the display completion instruction of the second image may be sent to the buffer management service, and the buffer management service receives the first image. When the display of the two images is completed, the second image in the second buffer area can be deleted.

The method for displaying an image according to the embodiment of the present invention, when each of the plurality of layers to be synthesized corresponding to the second screen does not change, the GPU acquires multiple layers to be synthesized corresponding to the second screen. And synthesizing the plurality of layers to be synthesized corresponding to the second screen by the GPU to form a second image, storing the second image in the second buffer area, and finally acquiring the second buffer area through the second channel of the hardware synthesizer The stored second image is transmitted to the second screen for display, thereby implementing display of the second image on the second screen.

FIG. 5 is a schematic flowchart diagram of Embodiment 4 of a method for displaying an image provided by the present invention. On the basis of the foregoing embodiment, the present embodiment relates to a specific process of acquiring a second image and displaying a second image when each of the plurality of layers to be synthesized corresponding to the second screen changes. As shown in FIG. 5, the method in this embodiment may specifically include:

S401. Acquire a plurality of layers to be synthesized corresponding to the second screen by using a channel other than the first channel in the hardware synthesizer.

The one channel of the hardware synthesizer acquires a layer, and the number of layers of the plurality of layers to be synthesized corresponding to the second screen is less than or equal to the number of channels of the hardware synthesizer minus one.

Since the hardware synthesizer performs layer synthesis, its power consumption is low, and therefore, for a layer that is changing, this embodiment uses a hardware synthesizer for synthesis.

In actual use, since the first screen is an ink screen, one channel of the hardware synthesizer is occupied, so the remaining channels of the hardware synthesizer can be used for the synthesis of the layers corresponding to the second image. For example, the hardware synthesizer of the dual-screen terminal has 4 channels, and the channel 1 is used for the first screen, then the second screen can only use the channel 2 to Channel 4 is the three channels.

When the layer is acquired by the hardware synthesizer, one layer corresponds to one channel, that is, one channel can only acquire one layer. Therefore, in this embodiment, if the number of channels of the hardware synthesizer is n, the corresponding screen of the second screen is to be synthesized. The number of multiple layers is m, then m is less than or equal to n-1, so as to ensure that the hardware synthesizer obtains each of the plurality of layers to be synthesized corresponding to the second screen. In this embodiment, the remaining channels of the hardware synthesizer except the first channel acquire a plurality of layers to be synthesized corresponding to the second screen, as shown in FIG. 5a.

S402. Synthesize a plurality of layers to be synthesized corresponding to the second screen by using the hardware synthesizer to form the second image.

In an implementation, after the remaining channels of the first channel acquire each of the plurality of layers to be synthesized corresponding to the second screen in the hardware synthesizer, the layers are combined to form a second image, and the synthesis process is performed. The same as the description of the above embodiment, reference is made to the above embodiment. In this embodiment, after the hardware synthesizer synthesizes the second image, the second image is not saved, but is directly sent to the second screen for display. In this way, when the display pattern of the next frame changes, the hardware synthesizer merges the layers corresponding to the next frame graphic to form a new second image, and directly sends the new second image to the second screen for display. The power consumption of the second image of the change of the dual screen terminal processing is saved.

The method for displaying an image according to an embodiment of the present invention, when each of the plurality of layers to be synthesized corresponding to the second screen changes, acquiring a second screen through a channel other than the first channel in the hardware synthesizer Corresponding multiple layers to be combined, and synthesizing a plurality of layers corresponding to the second screen corresponding to the second screen by a hardware synthesizer to form a second image, and transmitting the second image to the second screen for display, thereby implementing The display of the second image on the second screen reduces the power consumption of the dual screen terminal.

FIG. 6 is a schematic flowchart diagram of Embodiment 5 of a method for displaying an image according to the present invention. On the basis of the foregoing embodiment, the embodiment relates to acquiring the second image and displaying the second image when the plurality of layers to be combined corresponding to the second screen include both the change layer and the unchanged layer. The specific process. As shown in FIG. 6, the method in this embodiment may specifically include:

S501. Acquire each layer in the first layer set by using the GPU, and obtain, by using the remaining channels of the hardware synthesizer except the first channel and the second channel, each of the second layer set. Layer.

Wherein, one channel in the hardware synthesizer acquires a layer, and the number of layers in the second set is less than or equal to the number of channels of the hardware synthesizer minus 2.

For example, the mobile phone usually has several layers on the standby interface, and the status bar (the signal quality is displayed at the top of the screen). Pool power), navigation bar (virtual button at the bottom of the screen), wallpaper, launcher (APP icon), when the screen is bright, these layers have not changed, in this case, all layers can be GPU synthesized, because No change in the layer only needs to be synthesized once. When sliding, usually the status bar, navigation bar and wallpaper are unchanged layers, only the launcher icon changes, then you can use mixed composition, the status bar, navigation bar and wallpaper are synthesized by GPU, the result of the synthesis Together with the launcher layer, it is sent to the hardware synthesizer for resynthesis.

In this embodiment, the plurality of layers to be synthesized corresponding to the second screen include both the changed layer and the unchanged layer, and the layer that does not change is attributed to the first layer set for easy distinction. The changed layer is reduced to a second layer set. Use the GPU to merge layers that do not change, and use a hardware synthesizer to merge the changed layers.

Wherein one channel in the hardware synthesizer acquires one layer, and one channel of the hardware synthesizer (for example, the first channel) is used to transmit the first image, and one channel of the hardware synthesizer (for example, the second channel) is used to transmit the GPU. The synthesized image is such that, assuming that the hardware synthesizer has n channels, the channels for acquiring the layers in the second layer set are n-2. Therefore, in order to ensure complete acquisition of each layer in the second layer set by the hardware synthesizer, the number of layers in the second layer set should not exceed n-2, as shown in FIG. 6a.

In implementation, the GPU obtains each layer in the first layer set, and the layers are unchanged layers, and the second picture is obtained through the remaining channels of the hardware synthesizer except the first channel and the second channel. Layers of each change in the layer set.

S502. Synthesize each layer in the first layer set by using the GPU to form a third image, and store the third image in a second buffer area.

The GPU acquires the layers that do not change in the first layer set, and combines the layers to form a third image. The specific composition process is described in the foregoing embodiment, for example, according to each layer in the first layer set. The specific positions on the second screen are combined to form a third image. Next, the third image is saved to the second buffer area, wherein the second buffer area is used to store the second image or an image related to the second image.

S503. Acquire a third image stored in the second buffer area by using a second channel of the hardware synthesizer.

Optionally, in an implementation, after the GPU stores the synthesized third image in the second buffer area, the GPU may send a synthesis completion notification to the hardware synthesizer, and the hardware synthesizer receives the notification of the completion of the synthesis of the third image, that is, When the dual screen terminal detects the GPU completes the synthesis completion instruction of the third image, the third image stored in the second buffer area may be acquired through the second channel.

S504. Synthesize each layer in the second layer set and the third image by using the hardware synthesizer to form the second image.

The hardware synthesizer acquires a third image in the second buffer area through the second channel, and each layer in the second layer set obtained by the remaining channels except the first channel and the second channel, the hardware synthesizer pair The three images and the layers in the second layer set are merged to form a second image, and the second image is directly transmitted to the second screen for display.

In this embodiment, the hardware synthesizer may synthesize each layer in the third image and the second layer set at the same time, or may synthesize each layer in the second layer set to form a fourth The image is then combined with the third image and the fourth image to generate a second image.

The method for displaying an image according to the embodiment of the present invention, when a plurality of layers to be synthesized corresponding to the second screen includes a change layer and a non-change layer, the GPU obtains each image in the first layer set. The layer obtains each layer in the second layer set through the remaining channels except the first channel and the second channel in the hardware synthesizer, and synthesizes each layer in the first layer set through the GPU to form a third layer. And storing the third image in the second buffer area, acquiring the third image stored in the second buffer area through the second channel of the hardware synthesizer, and using each layer in the second layer set by the hardware synthesizer And synthesizing with the third image to form a second image. That is, in this embodiment, the GPU is used to synthesize the unchanged layers, and the synthesis of the changed layers is performed by the hardware synthesizer, thereby achieving accurate acquisition of the second image and preparing for display of the second image.

A person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium. The storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.

FIG. 7 is a schematic structural diagram of a dual screen terminal according to an embodiment of the present invention. As shown in FIG. 7, the dual screen terminal 600 includes: a memory 120, a processor 110, a GPU 130, a hardware synthesizer 151, a first screen 161, a second screen 162, and is stored on the memory 120 and can be in the a program running on the processor 110, the processor 110 is respectively connected to the memory 120, the hardware synthesizer 151 and the GPU 130, and the GPU 130 is connected to the memory 120, and the hardware synthesizer 151 respectively The memory 120, the first screen 161 and the second screen 162 are connected, and the processor 110 can be used to implement the method for displaying an image provided in the above embodiments.

The memory 120 can be used to store software programs and modules, and the processor 110 executes various functional applications and data processing by running software programs and modules stored in the memory 120. The memory 120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store the root Data (such as audio data, phone book, etc.) created according to the use of the dual screen terminal 600. Moreover, memory 120 can include high speed random access memory 120, and can also include non-volatile memory 120, such as at least one disk storage 120 piece, flash memory device, or other volatile solid state memory 120 piece. Accordingly, memory 120 may also include a memory 120 controller to provide processor 110 access to memory 120.

The processor 110 is the control center of the dual screen terminal 600, which connects various portions of the entire handset using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 120, and recalling stored in the memory 120. The data performs various functions and processing data of the dual screen terminal 600, thereby performing overall monitoring of the mobile phone. Optionally, the processor 110 may include one or more processing cores; preferably, the processor 110 may integrate the application processor 110 and the modem processor 110, wherein the application processor 110 mainly processes an operating system, a user interface, and The application processor or the like, the modem processor 110 mainly processes wireless communication. It can be understood that the above-mentioned modem processor 110 may not be integrated into the processor 110.

The GPU 130 and the hardware synthesizer 151 are used to synthesize a layer, and the hardware synthesizer 151 is further configured to transmit the synthesized picture to the display unit 160 to cause the first screen 161 or the second screen 162 in the display unit 160 to display. As shown in FIG. 7, the hardware synthesizer 151 of the present embodiment belongs to the display controller 150 of the dual screen terminal 600, and the first screen 161 and the second screen 162 belong to the display unit 160, wherein the display controller 150 is connected to the display unit 160.

Continuing to refer to FIG. 7, the processor 110, the memory 120, and the display controller 150 of the present embodiment are both connected to the system bus 140, and data can be transmitted through the system bus 140. The GPU 130 is connected to the memory 120, and can read data from the memory 120 or write the data into the memory 120. The hardware synthesizer 151 in the display controller 150 reads the data in the memory 120 through the system bus 140.

Optionally, as shown in FIG. 8 , the dual-screen terminal 600 may further include an RF (Radio Frequency) circuit 210 , an input unit 220 , a sensor 170 , an audio circuit 180 , and a WiFi (Wireless Fidelity) module 190 . , power supply 200 and other components. It will be understood by those skilled in the art that the dual screen terminal 600 structure shown in FIG. 11 does not constitute a limitation of the dual screen terminal, and may include more or less components than those illustrated, or may combine some components, or different. Assembly of parts. among them:

The RF circuit 210 can be used for receiving and transmitting signals during and after receiving or transmitting information, in particular, after receiving downlink information of the base station, and processing it by one or more processors 110; in addition, transmitting data related to the uplink to the base station. . Generally, the RF circuit 210 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier). , duplexer, etc. In addition, the RF circuit 210 can also communicate with the wireless The network communicates with other devices. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access). , Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), and the like.

The input unit 220 can be configured to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls. In particular, input unit 220 can include touch-sensitive surface 221 as well as other input devices 222. Touch-sensitive surface 221, also referred to as a touch display or trackpad, can collect touch operations on or near the user (eg, the user uses a finger, stylus, etc., on any touch-sensitive surface 221 or on the touch-sensitive surface 221 The operation near the touch-sensitive surface 221) and driving the corresponding connecting device according to a preset program. Alternatively, the touch sensitive surface 221 can include two portions of a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 110 is provided and can receive commands from the processor 110 and execute them. In addition, the touch-sensitive surface 221 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch-sensitive surface 221, the input unit 220 can also include other input devices 222. Specifically, other input devices 222 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.

The display unit 160 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the dual screen terminal 600, which can be composed of graphics, text, icons, video, and any combination thereof. The display unit 160 may include a first screen 161 and a second screen 162. Alternatively, the second screen may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. 162. The first screen 161 can be an ink screen. Further, the touch-sensitive surface 221 can cover the display unit 160, and when the touch-sensitive surface 221 detects a touch operation thereon or nearby, it is transmitted to the processor 110 to determine the type of the touch event, and then the processor 110 according to the touch event The type provides a corresponding visual output on display unit 160. Although in FIG. 8, touch-sensitive surface 221 and display unit 160 are implemented as two separate components to implement input and input functions, in some embodiments, touch-sensitive surface 221 can be integrated with display unit 160 for input. And output function.

The dual screen terminal 600 can also include at least one type of sensor 170, such as a light sensor, a motion sensor, and His sensor. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display unit 160 according to the brightness of the ambient light, and the proximity sensor may close the display unit when the dual screen terminal 600 moves to the ear. 160 and / or backlight. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the dual-screen terminal 600, it can also be configured with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. This will not be repeated here.

The audio circuit 180, the speaker 181, and the microphone 182 can provide an audio interface between the user and the dual screen terminal 600. The audio circuit 180 can transmit the converted electrical data of the received audio data to the speaker 181 for conversion to the sound signal output by the speaker 181; on the other hand, the microphone 182 converts the collected sound signal into an electrical signal by the audio circuit 180. After receiving, it is converted into audio data, and then processed by the audio data output processor 110, transmitted to the terminal, for example, via the RF circuit 210, or outputted to the memory 120 for further processing. The audio circuit 180 may also include an earbud jack to provide communication of the peripheral earphones with the dual screen terminal 600.

WiFi is a short-range wireless transmission technology, and the dual-screen terminal 600 can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 190, which provides wireless broadband Internet access for users. Although FIG. 8 shows the WiFi module 190, it can be understood that it does not belong to the essential configuration of the dual screen terminal 600, and may be omitted as needed within the scope of not changing the essence of the invention.

The dual screen terminal 600 also includes a power source 200 (such as a battery) for powering various components. Preferably, the power source 200 can be logically coupled to the processor 110 through the power source management system to manage charging, discharging, and power through the power management system. Consumption management and other functions. The power supply 200 can also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.

Although not shown, the dual screen terminal 600 may further include a camera, a Bluetooth module, and the like, and details are not described herein. Specifically, in the embodiment, the display unit 160 of the dual screen terminal 600 is a touch screen display, the dual screen terminal 600 further includes a memory 120, and one or more programs, wherein one or more programs are stored in the memory 120, and The one or more programs described above are configured to be executed by one or more processors 110, which are implemented when the processor 110 executes the program:

Obtaining, respectively, a plurality of layers to be synthesized corresponding to the first screen and a plurality of layers to be synthesized corresponding to the second screen;

Combining a plurality of layers to be synthesized corresponding to the first screen to form a first image, for the second The plurality of layers to be synthesized corresponding to the screen are combined to form a second image;

The first image is transmitted to the first screen for display by a hardware synthesizer in the dual screen terminal, and the second image is transmitted to the second screen for display.

In some implementations, when the processor 110 executes the program, the step of synthesizing the plurality of layers to be synthesized corresponding to the first screen to form a first image is performed, and the step includes:

And forming, according to the display position of the first screen, each of the plurality of layers to be combined corresponding to the first screen, synthesizing a plurality of layers to be synthesized corresponding to the first screen to form The first image;

When the processor 110 executes the program, the step of synthesizing the plurality of layers to be combined corresponding to the second screen to form a second image is further implemented, the step comprising:

And synthesizing a plurality of layers to be synthesized corresponding to the second screen according to a display position of the second screen corresponding to each layer of the plurality of layers to be synthesized corresponding to the second screen The second image.

In some implementations, the first screen is an ink screen, and when the processor 110 executes the program, the step of acquiring multiple layers to be synthesized corresponding to the first screen is implemented, and the step includes:

Acquiring, by the graphics processor GPU in the dual-screen terminal, a plurality of layers to be synthesized corresponding to the first screen;

When the processor 110 executes the program, the step of synthesizing the plurality of layers to be combined corresponding to the first screen to form a first image is performed. The step includes:

And synthesizing, by the GPU, a plurality of layers to be synthesized corresponding to the first screen to form the first image, and storing the first image in a first buffer area;

When the processor 110 executes the program, the step of transmitting the first image to the first screen for display by using a hardware synthesizer in the dual screen terminal is further implemented, the step comprising:

Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer, and transmitting the first image to the first screen for display.

In some implementations, when each of the plurality of layers to be synthesized corresponding to the second screen does not change, the processor 110, when executing the program, obtains the to-be-synthesized corresponding to the second screen. The steps of multiple layers, this step includes:

Acquiring, by the GPU, a plurality of layers to be synthesized corresponding to the second screen;

When the processor 110 executes the program, the step of synthesizing the plurality of layers to be combined corresponding to the second screen to form a second image is further implemented, the step comprising:

Forming, by the GPU, a plurality of layers to be synthesized corresponding to the second screen to form the first a second image, storing the second image in a second buffer area;

When the processor 110 executes the program, the step of transmitting the second image to the second screen for display by the hardware synthesizer is further implemented, and the step includes:

Acquiring the second image stored in the second buffer area through the second channel of the hardware synthesizer, and transmitting the second image to the second screen for display.

In some implementations, when each of the plurality of layers to be synthesized corresponding to the second screen changes, the processor 110, when executing the program, obtains the plurality of to-be-synthesized corresponding to the second screen. Steps of a layer, this step includes:

Obtaining, by the channel other than the first channel, the plurality of layers to be synthesized corresponding to the second screen, where one channel in the hardware synthesizer acquires a layer, the second screen The number of corresponding multiple layers to be synthesized is less than or equal to the number of channels of the hardware synthesizer minus one;

When the processor 110 executes the program, the step of synthesizing the plurality of layers to be combined corresponding to the second screen to form a second image is further implemented, the step comprising:

Forming, by the hardware synthesizer, a plurality of layers to be synthesized corresponding to the second screen to form the second image.

In some implementations, when the plurality of layers to be synthesized corresponding to the second screen includes a first layer set and a second layer set, the processor 110 implements a layer in the first layer set when executing the program. The steps of the multiple layers in the second layer set are changed, and the multiple layers corresponding to the second screen are acquired. The steps include:

Acquiring each layer in the first layer set by using the GPU, and acquiring each layer in the second layer set by using the remaining channels except the first channel and the second channel in the hardware synthesizer Wherein a channel in the hardware synthesizer acquires a layer, the number of layers in the second set is less than or equal to the number of channels of the hardware synthesizer minus 2;

When the processor 110 executes the program, the step of synthesizing the plurality of layers to be combined corresponding to the second screen to form a second image is further implemented, the step comprising:

And synthesizing each layer in the first layer set by the GPU to form a third image, and storing the third image in a second buffer area;

Obtaining, by the second channel of the hardware synthesizer, the third image stored in the second buffer area;

And forming, by the hardware synthesizer, each layer in the second layer set and the third image to form the second image.

In some implementations, when the processor 110 executes the program, the first channel stored in the first buffer area is acquired by the first channel of the hardware synthesizer, and the first image is transmitted to the first image. The screen displays the steps, which include:

Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer in the dual screen terminal when detecting the synthesis completion instruction of the first image by the GPU, and Transmitting the first image to the first screen for display;

When the processor 110 executes the program, the step of acquiring the second image stored in the second buffer area by using the second channel of the hardware synthesizer, and transmitting the second image to the second screen for display, is implemented. This step includes:

Acquiring the second image stored in the second buffer area through the second channel of the hardware synthesizer when the GPU completes the synthesis completion instruction of the second image, and transmitting the second image Display to the second screen.

In some implementations, processor 110 also implements when executing the program:

Deleting the first image in the first buffer area when detecting the display completion instruction of the first image;

When the display completion instruction of the second image is detected, the second image in the second buffer area is deleted.

In some implementations, when the processor 110 executes the program, the first image stored in the first buffer area is acquired by the first channel of the hardware synthesizer, and the first image is transmitted to the first A screen for displaying steps, the steps including:

Obtaining, by the first channel of the hardware synthesizer, the first image stored in the first buffer area;

Decoding the first image, obtaining logical TCON data corresponding to the first image, and driving the first screen to display according to the TCON data.

The dual-screen terminal of this embodiment may be used to implement the technical solution of the foregoing method embodiment, and the implementation principle and the technical effect are similar, and details are not described herein again.

In some implementations of the present invention, the embodiment provides a computer readable non-volatile storage medium, where the program is stored in the non-volatile storage medium, and when the program is executed, the method step of displaying the image is Execution, its implementation principle and technical effect are similar, and will not be described here.

FIG. 9 is a schematic flowchart diagram of Embodiment 1 of an apparatus for displaying an image provided by the present invention. The device of this embodiment can It is implemented by software, hardware or a combination of software and hardware. As shown in FIG. 9, the apparatus of this embodiment may include:

The obtaining module 410 is configured to respectively acquire a plurality of layers to be synthesized corresponding to the first screen and a plurality of layers to be combined corresponding to the second screen.

The compositing module 420 is configured to synthesize a plurality of layers to be synthesized corresponding to the first screen to form a first image, and synthesize the plurality of layers to be synthesized corresponding to the second screen to form a second image.

The display module 430 is configured to transmit the first image to the first screen for display through a hardware synthesizer in the dual screen terminal, and transmit the second image to the second screen for display.

The device in this embodiment may be used to implement the technical solution of the foregoing method embodiment, and the implementation principle and the technical effect are similar, and details are not described herein again.

In an implementation manner of the embodiment of the present invention, the synthesizing module 420 is configured to display, according to the first screen, a display position of each of the plurality of layers to be synthesized corresponding to the first screen. And synthesizing a plurality of layers to be synthesized corresponding to the first screen to form the first image; each of the plurality of layers to be synthesized corresponding to the second screen is in the a display position of the second screen, and synthesizing a plurality of layers to be synthesized corresponding to the second screen to form the second image.

In another implementation manner of the embodiment of the present invention,

The obtaining module 410 is configured to acquire, by the graphics processor GPU in the dual-screen terminal, a plurality of layers to be synthesized corresponding to the first screen when the first screen is an ink screen.

The synthesizing module 420 is configured to synthesize a plurality of layers to be synthesized corresponding to the first screen by using the GPU to form the first image, and store the first image in a first buffer area.

The display module 430 is configured to acquire a first image stored in the first buffer area by using a first channel of the hardware synthesizer, and transmit the first image to the first screen for display.

In another implementation manner of the embodiment of the present invention,

The obtaining module 410 is configured to acquire, by the GPU, the to-be-synthesized corresponding to the first screen by using the GPU when each of the plurality of layers to be synthesized corresponding to the second screen does not change. Layers.

The synthesizing module 420 is configured to synthesize a plurality of layers to be synthesized corresponding to the second screen by using the GPU to form the second image, and store the second image in a second buffer area.

The display module 430 is configured to acquire a second image stored in the second buffer area by using a second channel of the hardware synthesizer, and transmit the second image to the second screen for display.

In another implementation manner of the embodiment of the present invention,

The obtaining module 410 is configured to obtain, by using, a channel other than the first channel in the hardware synthesizer when each of the plurality of layers to be synthesized corresponding to the second screen changes The plurality of layers to be synthesized corresponding to the second screen, wherein one channel in the hardware synthesizer acquires a layer, and the number of the plurality of layers to be synthesized corresponding to the second screen is less than or equal to the hardware The number of channels in the synthesizer is reduced by 1.

The synthesizing module 420 is configured to synthesize a plurality of layers to be synthesized corresponding to the second screen by using the hardware synthesizer to form the second image.

In another implementation manner of the embodiment of the present invention,

The obtaining module 410 is configured to: when the multiple layers to be synthesized corresponding to the second screen include the first layer set and the second layer set, obtain the first layer set by using the GPU Each layer of the second layer set is acquired by the remaining channels of the hardware synthesizer except the first channel and the second channel; wherein one channel in the hardware synthesizer acquires a layer The number of layers in the second set is less than or equal to the number of channels of the hardware synthesizer minus 2.

The synthesizing module 420 is configured to synthesize each layer in the first layer set by the GPU to form a third image, and store the third image in a second buffer area.

The obtaining module 410 is further configured to acquire, by using the second channel of the hardware synthesizer, the third image stored in the second buffer area.

The synthesizing module 420 is further configured to synthesize each layer in the second layer set and the third image by using the hardware synthesizer to form the second image.

In another implementation manner of the embodiment of the present invention,

The display module 430 is configured to acquire, by using the first channel of the hardware synthesizer in the dual-screen terminal, the first buffer area when detecting the synthesis completion instruction of the GPU by the GPU And storing the first image, and transmitting the first image to the first screen for display; when detecting the synthesis completion instruction of the second image by the GPU, passing the second of the hardware synthesizer The channel acquires the second image stored in the second buffer area, and transmits the second image to the second screen for display.

The device in this embodiment may be used to implement the technical solution of the foregoing method embodiment, and the implementation principle and the technical effect are similar, and details are not described herein again.

FIG. 10 is a schematic flowchart diagram of Embodiment 2 of an apparatus for displaying an image provided by the present invention. Based on the above embodiment, as shown in FIG. 10, the apparatus further includes a deletion module 440:

The deleting module 440 is configured to: when the display completion instruction of the first image is detected, the first The first image in the buffer area is deleted; when the display completion instruction of the second image is detected, the second image in the second buffer area is deleted.

The device in this embodiment may be used to implement the technical solution of the foregoing method embodiment, and the implementation principle and the technical effect are similar, and details are not described herein again.

FIG. 11 is a schematic flowchart diagram of Embodiment 3 of an apparatus for displaying an image according to the present invention. Based on the above embodiment, as shown in FIG. 11, the apparatus further includes a decoding module 450:

The obtaining module 410 is further configured to acquire, by using the first channel of the hardware synthesizer, the first image stored in the first buffer area.

The decoding module 450 is configured to decode the first image, obtain logical TCON data corresponding to the first image, and drive the first screen to display according to the TCON data.

The device in this embodiment may be used to implement the technical solution of the foregoing method embodiment, and the implementation principle and the technical effect are similar, and details are not described herein again.

Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that The technical solutions described in the foregoing embodiments may be modified, or some or all of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present invention. range.

Claims (19)

A method of displaying an image, the method comprising: Obtaining, respectively, a plurality of layers to be synthesized corresponding to the first screen and a plurality of layers to be synthesized corresponding to the second screen; Synthesizing a plurality of layers to be synthesized corresponding to the first screen to form a first image, and synthesizing a plurality of layers to be synthesized corresponding to the second screen to form a second image; The first image is transmitted to the first screen for display by a hardware synthesizer in the dual screen terminal, and the second image is transmitted to the second screen for display. The method according to claim 1, wherein the synthesizing the plurality of layers to be synthesized corresponding to the first screen to form a first image comprises: And forming, according to the display position of the first screen, each of the plurality of layers to be combined corresponding to the first screen, synthesizing a plurality of layers to be synthesized corresponding to the first screen to form The first image; And synthesizing the plurality of layers to be synthesized corresponding to the second screen to form a second image, including: And synthesizing a plurality of layers to be synthesized corresponding to the second screen according to a display position of the second screen corresponding to each layer of the plurality of layers to be synthesized corresponding to the second screen The second image. The method according to claim 1, wherein the first screen is an ink screen, and the acquiring a plurality of layers to be synthesized corresponding to the first screen comprises: Acquiring, by the graphics processor GPU in the dual-screen terminal, a plurality of layers to be synthesized corresponding to the first screen; And synthesizing the plurality of layers to be synthesized corresponding to the first screen, and forming the first image includes: And synthesizing, by the GPU, a plurality of layers to be synthesized corresponding to the first screen to form the first image, and storing the first image in a first buffer area; Transmitting, by the hardware synthesizer in the dual screen terminal, the first image to the first screen for display, including: Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer, and transmitting the first image to the first screen for display. The method according to claim 3, wherein when each of the plurality of layers to be synthesized corresponding to the second screen does not change, the corresponding corresponding to the second screen is acquired. Multiple layers include: Acquiring, by the GPU, a plurality of layers to be synthesized corresponding to the second screen; And synthesizing the plurality of layers to be synthesized corresponding to the second screen, and forming the second image includes: And synthesizing, by the GPU, a plurality of layers to be synthesized corresponding to the second screen to form the second image, and storing the second image in a second buffer area; Transmitting, by the hardware synthesizer, the second image to the second screen for display, including: Acquiring the second image stored in the second buffer area through the second channel of the hardware synthesizer, and transmitting the second image to the second screen for display. The method according to claim 3, wherein when each of the plurality of layers to be synthesized corresponding to the second screen changes, acquiring the plurality of to-be-synthesized corresponding to the second screen The layers include: Obtaining, by the channel other than the first channel, the plurality of layers to be synthesized corresponding to the second screen, wherein one channel of the hardware synthesizer acquires a layer, where the The number of layers of the plurality of layers to be synthesized corresponding to the two screens is less than or equal to the number of channels of the hardware synthesizer minus one; And synthesizing the plurality of layers to be synthesized corresponding to the second screen to form a second image, including: Forming, by the hardware synthesizer, a plurality of layers to be synthesized corresponding to the second screen to form the second image. The method according to claim 3, wherein when the plurality of layers to be synthesized corresponding to the second screen comprise a first layer set and a second layer set, the first layer set is The layers in the second layer set are all changed, and the plurality of layers to be synthesized corresponding to the second screen are obtained, including: Acquiring each layer in the first layer set by using the GPU, and acquiring each layer in the second layer set by using the remaining channels except the first channel and the second channel in the hardware synthesizer Wherein a channel in the hardware synthesizer acquires a layer, the number of layers in the second set is less than or equal to the number of channels of the hardware synthesizer minus 2; And synthesizing the plurality of layers to be synthesized corresponding to the second screen to form a second image, including: And synthesizing each layer in the first layer set by the GPU to form a third image, and storing the third image in a second buffer area; Obtaining, by the second channel of the hardware synthesizer, the third image stored in the second buffer area; And forming, by the hardware synthesizer, each layer in the second layer set and the third image to form the second image. The method according to claim 4, wherein the first image stored in the first buffer area is acquired by the first channel of the hardware synthesizer, and the first image is transmitted to the First screen Display, including: Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer in the dual screen terminal when detecting the synthesis completion instruction of the first image by the GPU, and Transmitting the first image to the first screen for display; Obtaining, by the second channel of the hardware synthesizer, the second image stored in the second buffer area, and transmitting the second image to the second screen for display, including: Acquiring the second image stored in the second buffer area through the second channel of the hardware synthesizer when the GPU completes the synthesis completion instruction of the second image, and transmitting the second image Display to the second screen. The method of claim 4, wherein the method further comprises: Deleting the first image in the first buffer area when detecting the display completion instruction of the first image; When the display completion instruction of the second image is detected, the second image in the second buffer area is deleted. The method according to claim 3, wherein the first image stored in the first buffer area is acquired by the first channel of the hardware synthesizer, and the first image is transmitted to the first The screen is displayed, including: Obtaining, by the first channel of the hardware synthesizer, the first image stored in the first buffer area; Decoding the first image, obtaining logical TCON data corresponding to the first image, and driving the first screen to display according to the TCON data. A dual screen terminal, comprising: a memory, a processor, a GPU, a hardware synthesizer, a first screen, a second screen, and stored on the memory and on the processor a running program, the processor is respectively connected to the memory, the hardware synthesizer and the GPU, the GPU is connected to the memory, and the hardware synthesizer is respectively connected to the memory and the first screen Connected to the second screen, when the processor executes the program: Obtaining, respectively, a plurality of layers to be synthesized corresponding to the first screen and a plurality of layers to be synthesized corresponding to the second screen; Synthesizing a plurality of layers to be synthesized corresponding to the first screen to form a first image, and synthesizing a plurality of layers to be synthesized corresponding to the second screen to form a second image; Transmitting the first image to the first screen for display by a hardware synthesizer in a dual screen terminal The second image is transmitted to the second screen for display. The dual screen terminal according to claim 10, wherein said processor executes said program to: And forming, according to the display position of the first screen, each of the plurality of layers to be combined corresponding to the first screen, synthesizing a plurality of layers to be synthesized corresponding to the first screen to form The first image; And synthesizing a plurality of layers to be synthesized corresponding to the second screen according to a display position of the second screen corresponding to each layer of the plurality of layers to be synthesized corresponding to the second screen The second image. The dual screen terminal according to claim 10, wherein the first screen is an ink screen, and the processor executes the program to: Acquiring, by the graphics processor GPU in the dual-screen terminal, a plurality of layers to be synthesized corresponding to the first screen; And synthesizing, by the GPU, a plurality of layers to be synthesized corresponding to the first screen to form the first image, and storing the first image in a first buffer area; Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer, and transmitting the first image to the first screen for display. The dual-screen terminal according to claim 12, wherein when the processor performs the program when each of the plurality of layers to be synthesized corresponding to the second screen does not change achieve: Acquiring, by the GPU, a plurality of layers to be synthesized corresponding to the second screen; And synthesizing, by the GPU, a plurality of layers to be synthesized corresponding to the second screen to form the second image, and storing the second image in a second buffer area; Acquiring the second image stored in the second buffer area through the second channel of the hardware synthesizer, and transmitting the second image to the second screen for display. The dual-screen terminal according to claim 12, wherein when each of the plurality of layers to be synthesized corresponding to the second screen changes, the processor implements the program : Obtaining, by the channel other than the first channel, the plurality of layers to be synthesized corresponding to the second screen, wherein one channel of the hardware synthesizer acquires a layer, where the The number of layers of the plurality of layers to be synthesized corresponding to the two screens is less than or equal to the number of channels of the hardware synthesizer minus one; Forming, by the hardware synthesizer, a plurality of layers to be synthesized corresponding to the second screen to form the second image. The dual screen terminal according to claim 12, wherein when said second screen corresponds to When the synthesized multiple layers include the first layer set and the second layer set, the processor implements the program when: Acquiring each layer in the first layer set by using the GPU, and acquiring each layer in the second layer set by using the remaining channels except the first channel and the second channel in the hardware synthesizer Wherein a channel in the hardware synthesizer acquires a layer, the number of layers in the second set is less than or equal to the number of channels of the hardware synthesizer minus 2; And synthesizing each layer in the first layer set by the GPU to form a third image, and storing the third image in a second buffer area; Obtaining, by the second channel of the hardware synthesizer, the third image stored in the second buffer area; And forming, by the hardware synthesizer, each layer in the second layer set and the third image to form the second image. The dual screen terminal according to claim 13, wherein said processor executes said program to: Acquiring the first image stored in the first buffer area through the first channel of the hardware synthesizer in the dual screen terminal when detecting the synthesis completion instruction of the first image by the GPU, and Transmitting the first image to the first screen for display; Acquiring the second image stored in the second buffer area through the second channel of the hardware synthesizer when the GPU completes the synthesis completion instruction of the second image, and transmitting the second image Display to the second screen. The dual screen terminal according to claim 13, wherein the processor further implements when the program is executed: Deleting the first image in the first buffer area when detecting the display completion instruction of the first image; When the display completion instruction of the second image is detected, the second image in the second buffer area is deleted. The dual screen terminal according to claim 12, wherein said processor executes said program to: Obtaining, by the first channel of the hardware synthesizer, the first image stored in the first buffer area; Decoding the first image, obtaining logical TCON data corresponding to the first image, and driving the first screen to display according to the TCON data. A computer-readable non-volatile storage medium, wherein the non-volatile storage medium stores a program, when the program is executed, the method of any one of claims 1 to 9 The method steps are executed.

Images