WO2025112925A1 - Screen mirroring method, electronic device, storage medium, and program product - Google Patents

Abstract

Embodiments of the present application relate to the technical field of screen mirroring, and provide a screen mirroring method, an electronic device, a storage medium, and a program product, which can dynamically adjust the bit rate of a video to be screen mirrored without affecting the subjective experience of a user as much as possible, and improves the user experience while reducing the power consumption. The screen mirroring method comprises: obtaining a first application type weight, wherein the first application type weight is an application type weight corresponding to a current foreground application; on the basis of a bit rate adjustment parameter, determining whether to perform bit rate adjustment, wherein the bit rate adjustment parameter comprises the first application type weight; if yes, performing, on the basis of a target bit rate, coding and wireless screen mirroring on content to be screen mirrored, wherein the target bit rate is lower than the original bit rate of the content to be screen mirrored; and if not, performing, on the basis of the original bit rate, coding and wireless screen mirroring on the content to be screen mirrored.

Description

Screen projection method, electronic device, storage medium and program product

This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on November 30, 2023, with application number 202311654618.5 and application name “Screen projection method, electronic device, storage medium and program product”, the entire contents of which are incorporated by reference in this application.

Technical Field

The present application relates to the field of screen projection technology, and specifically to a screen projection method, electronic device, storage medium and program product.

Background Art

With the increase of interactive functions between electronic devices, more and more users are using the screen projection function. For example, when a user uses a mobile phone to play a video, the mirroring screen projection function can be used to transmit the content on the mobile phone screen to the large-screen TV for playback through a wireless connection. However, for mobile phones, screen projection requires encoding and transmitting a large amount of video stream data, which consumes a lot of power and can easily cause the phone to heat up during the projection process. In order to solve the heating problem caused by screen projection, the existing technology monitors the temperature of the mobile phone. If the temperature of the mobile phone is too high during the projection process, the bit rate of the mobile phone projection is reduced to reduce power consumption. However, this will reduce the clarity or smoothness of the projection, thereby reducing the user experience.

Summary of the invention

In view of this, the present application provides a screen projection method, electronic device, storage medium and program product, which can dynamically adjust the bit rate of the projection video without affecting the user's subjective experience as much as possible, so as to improve the user experience.

In a first aspect, a screen projection method is provided, including: obtaining a first application type weight, the first application type weight being the application type weight corresponding to the current foreground application; determining whether to perform bit rate adjustment according to a bit rate adjustment parameter, the bit rate adjustment parameter including the first application type weight, and if so, encoding and wirelessly projecting the content to be projected based on a target bit rate, the target bit rate being lower than the original bit rate of the content to be projected; if not, encoding and wirelessly projecting the content to be projected based on the original bit rate.

The current foreground application corresponds to the scene of the content to be projected. If it is in a relatively stable scene, that is, the continuity of the image is relatively good and the probability of application switching is relatively low, then the weight of the application type corresponding to this application is relatively high; if it is in a scene with a high degree of complexity, then the weight of the application type corresponding to this application is relatively high, because the higher the bit rate, the more complex the scene, and the higher the bit rate, the smaller the impact of reducing the bit rate on the user, that is, the greater the power consumption benefit of bit rate adjustment, so the weight of the application type corresponding to this application is relatively high. According to the higher application type weight, it is easier to determine to adjust the bit rate. In this scenario, encoding and wireless projection based on the reduced bit rate can reduce power consumption on the one hand, and have less impact on user perception on the other hand. For some application types, there may be unstable or less complex scenes. In these scenarios, reducing the bit rate has a greater impact on user perception, so it is easier to determine not to adjust the bit rate, that is, to encode and wirelessly project the content to be projected based on the original bit rate. In addition, the screen projection method in the embodiment of the present application does not need to wait until the temperature rises to a threshold value before adjusting the bit rate, but dynamically adjusts the bit rate based on the foreground application type, which can improve the temperature rise of the screen projection source device caused by screen projection, prolong the temperature rise time, and reduce the probability of equipment abnormalities due to heat.

In a possible implementation, the application type weight corresponding to the video or game application is greater than the application type weight corresponding to other applications.

In a possible implementation, determining whether to perform rate adjustment according to the rate adjustment parameter includes: if the weight of the first application type is greater than the preset weight, determining to perform rate adjustment; if the weight of the first application type is not greater than the preset weight, determining not to perform rate adjustment.

In a possible implementation, the bitrate adjustment parameter also includes the frequency at which the current foreground application switches from the background to the foreground within a preset period of time. The frequency at which the current foreground application switches from the background to the foreground within the preset period of time is continuous, and the switching frequency can reflect the next scene. Therefore, dynamically adjusting the projection bitrate in combination with the switching frequency can further improve the user experience.

In a possible implementation, determining whether to perform rate adjustment according to the rate adjustment parameter includes: determining a rate adjustment index according to the rate adjustment parameter, if the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, determining to perform rate adjustment, if the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, determining not to perform rate adjustment, the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the weight of the first application type, and the necessity of rate adjustment represented by the rate adjustment index is negatively correlated with the frequency.

In a possible implementation, the bitrate adjustment parameter further includes a second application type weight, which is an application type weight corresponding to a target application that is switched to a foreground application during a preset period of time, and the target application is an application other than the current foreground application. The use can also reflect the scene of the projection screen to a certain extent. Therefore, the projection bit rate can be dynamically adjusted in combination with the weight of the second application type to further improve the user experience.

In a possible implementation, determining whether to perform rate adjustment according to the rate adjustment parameter includes: determining a rate adjustment index according to the rate adjustment parameter, if the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, determining to perform rate adjustment, if the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, determining not to perform rate adjustment, the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the weight of the first application type, the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the weight of the second application type, and the necessity of rate adjustment represented by the rate adjustment index is negatively correlated with the above-mentioned frequency.

In a possible implementation, determining whether to perform rate adjustment according to the rate adjustment parameter includes: determining a rate adjustment index k according to the following formula: k = W _app1 ² /(a×f/W _app2 ), if k is greater than a threshold, it is determined to perform rate adjustment, if k is not greater than the threshold, it is determined not to perform rate adjustment, W _app1 is the weight of the first application type, f is the frequency of the current foreground application switching from the background to the foreground within a preset period, W _app2 is the weight of the second application type, and a is a constant. Determining the rate adjustment index based on this formula can more accurately achieve dynamic adjustment of encoding.

In a possible implementation, encoding and wirelessly projecting the content to be projected based on the target bit rate includes: determining a target resolution of the content to be projected based on the target bit rate, the target resolution of the content to be projected being lower than the original resolution of the content to be projected; encoding and wirelessly projecting the content to be projected based on the target resolution. This can reduce the bit rate while minimizing the adverse impact on user experience.

In a second aspect, a screen projection method is provided, including: determining whether to perform bit rate adjustment based on the frequency of the current foreground application switching from the background to the foreground within a preset time period; if so, encoding and wirelessly projecting the content to be projected based on a target bit rate, wherein the target bit rate is lower than the original bit rate of the content to be projected; if not, encoding and wirelessly projecting the content to be projected based on the original bit rate.

According to the user's historical operation behavior, the probability of the user switching the foreground application in the next period of time can be predicted. If the probability of the user switching the foreground application next is high, it is more inclined not to adjust the bit rate, because after switching the foreground application, if the bit rate of the foreground application switched to is reduced, it will have a great impact on the user's subjective feelings, which will easily reduce the user experience; if the probability of the user switching the foreground application next is small, it is more inclined to adjust the bit rate, because the bit rate reduction in a stable scenario has a small impact on the user's perception, and the bit rate reduction is not easy to reduce the user experience. Dynamic bit rate adjustment is implemented according to the switching frequency of the foreground application, which can improve the user experience while reducing power consumption. In addition, the screen projection method in the embodiment of the present application does not need to wait until the temperature rises to a threshold before adjusting the bit rate, but implements dynamic adjustment of the bit rate based on the switching frequency of the foreground application, which can improve the temperature rise of the screen projection source device caused by screen projection, prolong the temperature rise time, and reduce the probability of abnormalities of the device due to heat.

In a possible implementation, determining whether to perform rate adjustment according to the frequency of the current foreground application switching from the background to the foreground within a preset period includes: determining whether to perform rate adjustment according to the frequency of the current foreground application switching from the background to the foreground within the preset period and the second application type weight, the second application type weight being the application type weight corresponding to the target application switched to the foreground application within the preset period, the target application being an application other than the current foreground application. Determining whether to perform rate adjustment in combination with the switching frequency of the foreground application and the application type of the target application switched to can further improve the user experience.

In a possible implementation, the application type weight corresponding to the video or game application is greater than the application type weight corresponding to other applications.

In a possible implementation, determining whether to perform rate adjustment based on the frequency of the current foreground application switching from the background to the foreground within a preset period of time and the weight of the second application type includes: determining a rate adjustment index based on the frequency of the current foreground application switching from the background to the foreground within a preset period of time and the weight of the second application type, if the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, then determining to perform rate adjustment, if the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, then determining not to perform rate adjustment, the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the weight of the second application type, and the necessity of rate adjustment represented by the rate adjustment index is negatively correlated with the above-mentioned frequency. The necessity of rate adjustment represented by the rate adjustment index meeting the adjustment condition may mean that the rate adjustment index belongs to the first range, and the necessity of rate adjustment represented by the rate adjustment index not meeting the adjustment condition may mean that the rate adjustment index belongs to the second range.

In a possible implementation, encoding and wirelessly projecting the content to be projected based on the target bit rate includes: determining a target resolution of the content to be projected based on the target bit rate, the target resolution of the content to be projected being lower than the original resolution of the content to be projected; encoding and wirelessly projecting the content to be projected based on the target resolution. This can reduce the bit rate while minimizing the adverse impact on user experience.

In a third aspect, an embodiment of the present application provides a screen projection method, including: obtaining projected content; determining a predicted bit rate of the content to be projected; determining a target bit rate of the content to be projected based on the predicted bit rate of the content to be projected and a perceived coding distortion curve, wherein the target bit rate of the content to be projected is less than the predicted bit rate; encoding and wirelessly projecting the content to be projected based on the target bit rate.

Determine the predicted bit rate of the content to be projected, and determine the target bit rate after reducing the bit rate according to the predicted bit rate and the perceptual coding distortion curve, encode the content to be projected and wirelessly project the screen based on the target bit rate, because the target bit rate after reducing the bit rate is determined based on the predicted bit rate and the perceptual coding distortion curve. The target bit rate is set as the target bit rate. Therefore, the impact of the reduced target bit rate on user perception is relatively low, and power consumption is reduced at the same time. That is to say, the embodiment of the present application can dynamically adjust the bit rate of the screen projection video without affecting the user's subjective experience as much as possible, thereby improving the user experience while reducing power consumption. In addition, the screen projection method in the embodiment of the present application does not need to wait until the temperature rises to a threshold before adjusting the bit rate, but dynamically adjusts the bit rate based on the projected content, which can improve the temperature rise of the screen projection source device caused by screen projection, prolong the temperature rise time, and reduce the probability of abnormalities caused by heat in the device.

In a possible implementation, determining the predicted bit rate of the content to be projected includes determining the predicted bit rate of the content to be projected according to the picture complexity of the projected content.

In a possible implementation, the ordinate of the perceptual coding distortion curve is the image distortion rate perceived by the human eye, the abscissa of the perceptual coding distortion curve is the bit rate, the perceptual coding distortion curve has multiple steps, the width of the steps in the multiple steps is positively correlated with the bit rate, and the height of the steps in the multiple steps is negatively correlated with the bit rate; determining the target bit rate of the content to be projected according to the predicted bit rate of the content to be projected and the perceptual coding distortion curve includes: determining the step corresponding to the predicted bit rate of the content to be projected in the perceptual coding distortion curve; determining the bit rate on the left side of the predicted bit rate in the corresponding step as the target bit rate of the content to be projected. The width of the steps in the multiple steps is positively correlated with the bit rate, that is, under the condition of the same image quality, the higher the complexity of the image in the temporal and spatial domains, the stronger the visual masking effect. Therefore, if the predicted bit rate is large, the bit rate that is reduced by a large amount based on the predicted bit rate can be used as the target bit rate, and it can still be ensured that the human eye cannot perceive the distortion caused by the bit rate reduction. The height of the steps is negatively correlated with the bit rate, that is, under the same image quality, the higher the complexity of the image in the temporal and spatial domains, the smaller the impact on human eye perception caused by reducing the bit rate. Dynamically adjusting the bit rate based on the above perceptual coding distortion curve can further improve the user experience.

In one possible implementation, determining the predicted bit rate of the content to be projected based on the picture complexity of the projected content includes: determining the target picture complexity of the content to be projected based on the picture complexity of the projected content; determining the predicted bit rate of the content to be projected based on the target picture complexity of the content to be projected. Under the premise of the same image quality, there is a positive correlation between the complexity of the image and the bit rate required for the image. After obtaining the picture complexity of the content to be projected, the bit rate of the content to be projected can be determined based on the correlation between the picture complexity and the bit rate.

In a possible implementation, determining the target screen complexity of the content to be projected according to the screen complexity of the projected content includes: calculating the target screen complexity of the content to be projected according to the following formula: C _N+1 is the target screen complexity of the content to be projected, N is the number of frames of the multi-frame projected content, i is the sequence number of the frame in the multi-frame projected content, the value of i is positively correlated with the time series of the multi-frame projected content, W _i is the complexity weight coefficient of the i-th frame in the multi-frame projected content, and C _i is the screen complexity of the i-th frame in the multi-frame projected content; _Wi is positively correlated with i.

In one possible implementation, L _i is the encoding length corresponding to the projected content of the i-th frame, and QP _i is the encoding parameter corresponding to the projected content of the i-th frame.

In a possible implementation, determining the predicted bit rate of the content to be projected according to the target screen complexity of the content to be projected includes: calculating the encoding length corresponding to the content to be projected according to the following formula; L _N+1 is the encoding length corresponding to the content to be projected, QP _N+1 is the encoding parameter corresponding to the content to be projected, _qpi is the weight coefficient of the encoding parameter of the i-th frame in the multi-frame projected content, qpi is positively correlated with _i , and CN ₊₁ is the target picture complexity of the content to be projected. The predicted bit rate of the content to be projected is calculated according to the following formula: predicted bit rate = LN ₊₁ × frame rate.

In a possible implementation, the method further includes: obtaining a first application type weight, the first application type weight being the application type weight corresponding to the current foreground application; determining whether to perform rate adjustment according to a rate adjustment parameter, the rate adjustment parameter including the first application type weight, and if so, executing a process of encoding and wirelessly projecting the content to be projected based on the target rate, and if not, encoding and wirelessly projecting the content to be projected based on the original rate. According to a higher application type weight, it is easier to determine to perform rate adjustment. In this scenario, encoding and wirelessly projecting based on a dynamically reduced rate can reduce power consumption on the one hand, and have less impact on user perception on the other. For some application types, there may be unstable or less complex scenarios. In these scenarios, reducing the rate has a greater impact on user perception, so it is easier to determine not to perform rate adjustment, that is, encoding and wirelessly projecting the content to be projected based on the original rate.

In a possible implementation, the application type weight corresponding to the video or game application is greater than the application type weight corresponding to other applications.

In one possible implementation, determining whether to perform rate adjustment according to the rate adjustment parameter includes: determining a rate adjustment index according to the rate adjustment parameter, and if the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, determining to perform rate adjustment, and if the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, determining not to perform rate adjustment, and the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the weight of the first application type. The weight of the first application type is positively correlated with the power consumption benefit of reducing the rate in the scenario, and the user experience can be improved by dynamically adjusting the projection bit rate based on the application type. The necessity of rate adjustment represented by the rate adjustment index meeting the adjustment condition may mean that the rate adjustment index belongs to the first range, and the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition. The condition may be that the bit rate adjustment indicator belongs to the second range.

In a possible implementation, the bit rate adjustment parameter also includes the frequency of the current foreground application switching from the background to the foreground within a preset period of time. Determining whether to perform bit rate adjustment in combination with the switching frequency of the foreground application can further improve the user experience.

In a possible implementation, the bitrate adjustment parameter further includes a second application type weight, which is an application type weight corresponding to a target application that is switched to a foreground application during a preset period of time, and the target application is an application other than the current foreground application. Determining whether to perform bitrate adjustment in combination with the switching frequency of the foreground application and the application type of the target application switched to can further improve the user experience.

In a possible implementation, determining whether to perform rate adjustment according to the rate adjustment parameter includes: determining a rate adjustment index according to the rate adjustment parameter, if the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, determining to perform rate adjustment, if the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, determining not to perform rate adjustment, the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the weight of the first application type, the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the weight of the second application type, and the necessity of rate adjustment represented by the rate adjustment index is negatively correlated with the switching frequency.

In a possible implementation, determining whether to perform rate adjustment according to the rate adjustment parameter includes: determining a rate adjustment index k according to the following formula: k = W _app1 ² /(a×f/W _app2 ), if k is greater than a threshold, it is determined to perform rate adjustment, if k is not greater than the threshold, it is determined not to perform rate adjustment, W _app1 is the weight of the first application type, f is the frequency of the current foreground application switching from the background to the foreground within a preset period, W _app2 is the weight of the second application type, and a is a constant. Determining the rate adjustment index based on this formula can more accurately achieve dynamic adjustment of the rate.

In a possible implementation, encoding and wirelessly projecting the content to be projected based on the target bit rate includes: determining the target resolution of the content to be projected based on the target bit rate of the content to be projected, the target resolution of the content to be projected being lower than the original resolution of the content to be projected; encoding and wirelessly projecting the content to be projected based on the target resolution. The quality of a single pixel is kept unchanged, and the target resolution is determined by reducing the resolution to achieve bit rate adjustment. This method of reducing the bit rate has a small reduction in the quality of the picture displayed by the target device for projection.

In a fourth aspect, an electronic device is provided, comprising: a processor and a memory, wherein the memory is used to store at least one instruction, and when the instruction is loaded and executed by the processor, the electronic device executes the above method.

In a fifth aspect, a computer-readable storage medium is provided, comprising a program or an instruction. When the program or the instruction runs on a computer, the above method is executed.

According to a sixth aspect, a computer program product is provided. The computer program product includes executable instructions. When the executable instructions are executed on a computer, the computer executes the above method.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

FIG1 is a schematic diagram of three screen projection scenarios involved in an embodiment of the present application;

FIG2 is a schematic diagram of a structure of an electronic device involved in an embodiment of the present application;

FIG3 is a software structure block diagram of an electronic device in an embodiment of the present application;

FIG4 is a schematic diagram of a flow chart of a screen projection method in an embodiment of the present application;

FIG5 is a schematic diagram of a perceptual coding distortion curve in an embodiment of the present application;

FIG6 is a schematic diagram of a flow chart of another screen projection method in an embodiment of the present application;

FIG7 is a schematic diagram showing the change of resolution at different stages under three different comparative examples;

FIG8 is a schematic diagram of a resolution coding relationship in an embodiment of the present application;

FIG9 is a schematic diagram of a temperature rise curve comparing the embodiment of the present application with other methods;

FIG10 is a schematic diagram of a flow chart of another screen projection method in an embodiment of the present application;

FIG. 11 is a flow chart of another screen projection method in an embodiment of the present application.

DETAILED DESCRIPTION

In order to better understand the technical solution of the present application, the embodiments of the present application are described in detail below with reference to the accompanying drawings.

It should be clear that the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

It should be understood that the term "and/or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character "/" in this article generally indicates that the associated objects before and after are in an "or" relationship.

First, the application scenarios involved in the embodiments of the present application are described. The embodiments of the present application involve wireless screen projection scenarios, as shown in Figure 1, such as mobile phone screen projection to computer, mobile phone screen projection to TV or mobile phone screen projection to tablet, etc. The screen projection here can be mirror screen projection. The wireless screen projection scenario involves two electronic devices: the screen projection source device and the screen projection target device.

FIG. 2 shows a schematic structural diagram of the electronic device 100 .

The electronic device 100 may include a processor 110 , an external memory interface 120 , an internal memory 121 , a wireless communication module 160 , a display screen 194 , an antenna 1 , and the like.

It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. The processor 110 may be used for functions such as encoding and decoding of audio and video streams.

The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the wireless communication module 160, the modem processor and the baseband processor.

The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 1, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 1. The wireless communication module 160 includes, for example, a Bluetooth chip.

The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

In some embodiments, the electronic device 100 may set a touch sensor on the display screen 194, and the touch sensor and the display screen 194 form a touch screen, also known as a "touch screen". The touch sensor is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. The display screen 194 can provide visual information related to the touch operation. In some other embodiments, the touch sensor may also be disposed on the surface of the electronic device 100 , which is different from the location of the display screen 194 .

The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system of the layered architecture is taken as an example to exemplify the software structure of the electronic device 100.

FIG. 3 is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

The application layer can include a series of application packages.

As shown in FIG. 3 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

As shown in FIG. 3 , the application framework layer may include a window manager, a content provider, a view system, a resource manager, and the like.

The window manager is used to manage window programs. The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. The display interface can be composed of one or more views.

The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

A 2D graphics engine is a drawing engine for 2D drawings.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, Bluetooth driver, audio driver, and sensor driver.

The electronic devices involved in the embodiments of the present application may be smart TVs, mobile phones, tablet computers, personal computers (PCs), personal digital assistants (PDAs), smart watches, wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, vehicle-mounted devices, drone devices, smart cars, smart speakers, robots, smart glasses, and the like.

The above-mentioned electronic device can be a screen projection source device or a screen projection target device in a wireless screen projection scenario.

The present application embodiment provides a screen projection method, which is applied to a screen projection source device. As shown in FIG4 , the screen projection method includes:

Step 101, performing wireless screen projection;

Before wireless screen projection, a wireless connection is established between the screen projection source device and the screen projection target device. The projection source device will capture its own display screen, which is the projection content, and encode the projection content, and then send the encoded projection content to the projection target device via a wireless connection. After receiving the projection content, the projection target device will decode and play the projection content, thus realizing wireless projection. At the beginning of projection, the projection source device can encode and wirelessly project the projection content based on the original bit rate.

Step 102: Obtain the projected content;

During the screen projection process, the screen projection source device can obtain the screen projection content in the recent period of time, for example, obtain the screen projection content in the last minute.

Step 103: Determine the predicted bit rate of the content to be projected according to the picture complexity of the projected content;

The projected content is a frame-by-frame image. The corresponding complexity can be determined based on any frame image. In the video, the frame images are continuous, and there is a strong correlation between adjacent or close-in-time frame images. The image content is usually similar, so the complexity between images is also relatively close, and usually no mutations occur. Therefore, the bit rate of the content to be projected can be predicted based on the image complexity of the most recently projected content, that is, the predicted bit rate of the content to be projected can be determined.

It can be understood that determining the predicted bit rate of the content to be projected based on the picture complexity of the projected content is only one implementation method. In other possible implementation methods, the predicted bit rate of the content to be projected can also be determined by other methods. For example, the predicted bit rate of the content to be projected can be determined by the actual bit rate of the projected content. For example, the average actual bit rate of the projected content over a period of time is calculated and used as the predicted bit rate of the content to be projected.

Step 104: determining a target bit rate of the content to be projected according to the predicted bit rate of the content to be projected and the perceptual coding distortion curve, wherein the target bit rate of the content to be projected is less than the predicted bit rate;

Among them, the perceptual coding distortion curve is a curve or mapping relationship pre-set according to the relationship between the image distortion rate and the image bit rate perceived by the human eye. For example, as shown in Figure 5, the relationship between the statistical coding distortion curve and the perceptual coding distortion curve is illustrated. The statistical coding distortion curve refers to the corresponding relationship curve between the image distortion rate and the bit rate in theory. It can be seen that from the perspective of the computer, the correlation between the image distortion rate and the bit rate is expressed as a continuous curve; the perceptual coding distortion curve refers to the corresponding relationship curve between the image distortion rate and the bit rate perceived by the human eye. For the perception of the human eye, affected by the visual masking effect, the correlation between the image distortion rate and the bit rate perceived by the human eye is expressed as a discount, that is, the distortion rate perceived by the human eye will be perceived by the human eye only after the distortion of the bit rate accumulates to a certain threshold. In other words, the perceptual coding distortion curve has multiple steps, and the image bit rate change corresponding to each step will not correspond to the change of the image distortion rate. Only the bit rate change between different steps will cause a sudden change in the image distortion rate. In step 103, the position of the predicted bit rate of the content to be projected in the perceptual coding distortion curve is determined. Assuming that the predicted bit rate of the content to be projected is A in FIG5, A is located at the bottom step of the perceptual coding distortion curve. Since all bit rates on this step correspond to the same image distortion rate perceived by the human eye, the bit rate on the left side of A on the step can be set as the target bit rate of the content to be projected. For example, A' is set as the target bit rate of the content to be projected. The smaller the target bit rate A' is, the better the effect of reducing power consumption is. However, the target bit rate A' cannot be equal to or less than the bit rate s1 corresponding to the rising edge on the left side of the step, because on the same platform, the image distortion rate perceived by the human eye remains unchanged, that is, the user will not perceive the distortion caused by the bit rate reduction. Therefore, s1＜A'＜A, the closer A' is to the bit rate s1 corresponding to the rising edge on the left side of the step, the better the effect of reducing the bit rate is. Assuming that the predicted bit rate of the content to be projected is B in FIG5, and the bit rate corresponding to the rising edge on the left side of the step is s2, the bit rate B' between s2 and B can be set as the target bit rate of the content to be projected.

Step 105: Encode and wirelessly project the content to be projected based on the target bit rate.

Among them, the target bit rate is less than the predicted bit rate, that is, the bit rate of the content to be projected is reduced. In this way, during the wireless screen projection process, the wireless transmission image bit rate is lower, that is, the amount of data transmitted is lower, thereby reducing power consumption. At the same time, since the reduction in the target bit rate is determined based on the perceptual coding distortion curve, the bit rate reduction has little impact on human eye perception.

After step 105, step 102 may be performed again, that is, in the process of wireless screen projection, steps 102 to 105 are periodically performed. Take a specific scenario as an example for illustration, for example, in a wireless screen projection process, the 1st to Nth frames are encoded and wirelessly projected at a default bit rate, and then, in step 103, the predicted bit rate of the N+1th frame to be projected is determined based on the complexity of the screen of the projected content of the 1st to Nth frames, in step 104, the target bit rate of the N+1th frame is determined according to the predicted bit rate of the N+1th frame, and in step 105, the N+1th frame is encoded and wirelessly projected according to the target bit rate. ; Then, the predicted bit rate of the N+2th frame to be projected is determined based on the picture complexity of the projected content from the 2nd to the N+1st frames, and the target bit rate of the N+2th frame is determined, and the N+2th frame is encoded and wirelessly projected according to the target bit rate; and so on, the predicted bit rate of the N+3th frame to be projected is determined based on the picture complexity of the projected content from the 3rd to the N+3rd frames, and the target bit rate of the N+3th frame is determined, and the N+3th frame is encoded and wirelessly projected according to the target bit rate. In this way, the bit rate can be dynamically adjusted based on the projected content during the wireless projection process.

The screen projection method in the embodiment of the present application obtains the predicted bit rate of the content to be projected based on the projected content, and determines the target bit rate after reducing the bit rate according to the predicted bit rate and the perceived coding distortion curve, and encodes and wirelessly projects the content to be projected based on the target bit rate. The predicted bit rate and the perceptual coding distortion curve determine the reduced target bit rate. Therefore, the reduced target bit rate has a lower impact on user perception and reduces power consumption. In other words, the embodiment of the present application can dynamically adjust the bit rate of the screen projection video without affecting the user's subjective experience as much as possible, thereby improving the user experience while reducing power consumption. In addition, the screen projection method in the embodiment of the present application does not need to wait until the temperature rises to a threshold before adjusting the bit rate, but dynamically adjusts the bit rate based on the projected content, which can improve the temperature rise of the screen projection source device caused by screen projection, prolong the temperature rise time, and reduce the probability of abnormalities caused by heat in the device.

In a possible implementation, as shown in FIG5 , the ordinate of the perceptual coding distortion curve is the image distortion rate perceived by the human eye, the abscissa of the perceptual coding distortion curve is the bit rate, and the perceptual coding distortion curve has multiple steps. The above step 104, determining the target bit rate of the content to be projected according to the predicted bit rate of the content to be projected and the perceptual coding distortion curve, includes: determining the step corresponding to the predicted bit rate of the content to be projected in the perceptual coding distortion curve; determining the bit rate on the left side of the predicted bit rate in the corresponding step as the target bit rate of the content to be projected, and the bit rate on the left side of the predicted bit rate in the corresponding step does not include the rising edge on the left side of the step. Among them, the width of the steps in the multiple steps is positively correlated with the bit rate, that is, under the same image quality, the higher the complexity of the image in the temporal and spatial domains, the stronger the visual masking effect. Therefore, if the predicted bit rate is large, the bit rate that is reduced by a large amount based on the predicted bit rate can be used as the target bit rate, and it can still be ensured that the human eye cannot perceive the distortion caused by the bit rate reduction. The height of the steps in the multiple steps is negatively correlated with the bit rate, that is, under the condition of the same image quality, the higher the complexity of the image in the time and space domains, the smaller the impact on human eye perception caused by reducing the bit rate. For example, if the screen projection content is a video, the video and film content are more complex. In this scenario, even if the bit rate is reduced more, the user is not likely to perceive the picture distortion; and if the screen projection content is the chat interface of an instant messaging application, the chat interface is less complex. In this scenario, the picture distortion caused by the reduction in the bit rate is easily perceived by the user. Therefore, dynamically adjusting the bit rate based on the above-mentioned perceptual coding distortion curve can further improve the user experience.

The following is an explanation of a method for determining the bit rate on the left side of the predicted bit rate in the corresponding step as the target bit rate of the content to be projected. For example, a positive number less than 1 is set as the target bit rate adjustment coefficient, such as 0.8. When determining the target bit rate of the content to be projected, the predicted bit rate of the content to be projected is directly multiplied by the coefficient 0.8 as the target bit rate.

In a possible implementation, the above step 103, determining the predicted bit rate of the content to be projected according to the picture complexity of the projected content, includes: step 1031 and step 1032. Step 1031, determining the target picture complexity of the content to be projected according to the picture complexity of the projected content. For example, in the projected content of the last minute, one frame of image is acquired per second, and 60 frames of image are acquired. The picture complexity of the content to be projected is predicted based on the picture complexity of these 60 frames of image; for another example, in the projected content of the last second, each frame of image is acquired according to the picture display frame rate. Assuming that the frame rate is 60Hz, 60 consecutive frames of images of the most recent projection are acquired, and the picture complexity of the content to be projected is predicted based on the picture complexity of these 60 frames of image. Step 1032, determining the predicted bit rate of the content to be projected according to the target picture complexity of the content to be projected. Under the premise of the same image quality, there is a positive correlation between the complexity of the image and the bit rate required for the image. After obtaining the picture complexity of the content to be projected, the bit rate of the content to be projected can be determined based on the correlation between the picture complexity and the bit rate. This bit rate is called the predicted bit rate in the embodiment of the present application.

In a possible implementation, the above step 1031, determining the target screen complexity of the content to be projected according to the screen complexity of the projected content, includes: calculating the target screen complexity of the content to be projected according to the following formula: C _N+1 is the target screen complexity of the content to be projected, N is the number of frames of the multi-frame projected content, i is the sequence number of the frame in the multi-frame projected content, the value of i is positively correlated with the time series of the multi-frame projected content, W _i is the complexity weight coefficient of the i-th frame in the multi-frame projected content, and C _i is the screen complexity of the i-th frame in the multi-frame projected content; _Wi is positively correlated with i.

Specifically, multiple frames of projected content can be selected from the most recent projected content, and the target screen complexity of the content to be projected is determined based on the screen complexity of the selected multiple frames of projected content. In one embodiment, for example, all 60 frames of projected content in the last second can be used as the multiple frames of projected content in step 1031, N = 60, i is 1, 2, 3, ..., 60, and the value of i is positively correlated with the time series of the multiple frames of projected content, that is, the larger the value of i, the later the time in the corresponding 60 frames, and CN ₊₁ and _CN can correspond to two adjacent frames. The closer the frame is to the content to be projected, the higher the correlation with the content to be projected. Therefore, the screen complexity of the content to be projected can be determined based on the multiple frames of projected content adjacent to the content to be projected. In addition, for this reason, in the calculation formula, the larger the complexity weight coefficient is set, so as to improve the prediction accuracy of the screen complexity of the content to be projected. In another embodiment, for example, one frame may be selected every one second from the 360 frames of screen projection in the last minute, and 60 frames of the selected frames may be used as the multi-frame screen projection content in step 1031 .

In one possible implementation, _Li is the encoding length corresponding to the projected content of the i-th frame, _QPi is the encoding parameter corresponding to the projected content of the i-th frame, _QPi is usually a natural number between 0 and 51. The larger the value, the lower the image quality. The values corresponding to different frames may be different, but _QPi is a known parameter.

In addition, in addition to using the above formula to determine the complexity of the screen content, other methods can also be used to determine the complexity of the screen content. Determine the image complexity of the projected content. For example, the image complexity can be determined by the color distribution of the projected content, and the color distribution may be related to image parameters such as the variance or standard deviation of RGB pixels. In the embodiments of the present application, the image complexity of the projected content is determined by the formula based on _Ci as an example.

In a possible implementation, the above step 1032, determining the predicted bit rate of the content to be projected according to the target screen complexity of the content to be projected, includes: calculating the encoding length corresponding to the content to be projected according to the following formula; L _N+1 is the encoding length corresponding to the content to be projected, QP _N+1 is the encoding parameter corresponding to the content to be projected, _qpi is the weight coefficient of the encoding parameter of the i-th frame in the multi-frame projected content, qpi is positively correlated with _i , C _N+1 is the target screen complexity of the content to be projected; the predicted bit rate of the content to be projected is calculated according to the following formula: predicted bit rate = L _N+1 × frame rate, where the frame rate can be the screen data acquisition frequency of the projected content on the projection source device.

In a possible implementation, as shown in FIG6 , the method further includes: step 106, obtaining a first application type weight, the first application type weight being the application type weight corresponding to the current foreground application; step 107, determining whether to perform rate adjustment based on a rate adjustment parameter, the rate adjustment parameter including the first application type weight, if yes, executing step 105, encoding and wirelessly projecting the content to be projected based on the target rate, if no, executing step 108, encoding and wirelessly projecting the content to be projected based on the original rate. After step 105, step 106 may be executed again to determine whether to perform rate adjustment in the next cycle, that is, to implement periodic dynamic rate adjustment. After step 108, step 106 may be executed again to determine whether to perform rate adjustment in the next cycle, that is, to implement periodic dynamic rate adjustment.

Specifically, it can be determined whether to reduce the screen projection bit rate according to the current foreground application type. The first application type weight is used to indicate that the current foreground application has the value of bit rate adjustment. The greater the weight, the greater the possibility of determining bit rate adjustment in step 107. The current foreground application corresponds to the scene of the content to be projected. If it is in a relatively stable scene, that is, the continuity of the image is relatively good, and the probability of application switching is relatively low, then the application type weight corresponding to this application is relatively high; if it is in a scene with a higher degree of complexity, the first application type weight corresponding to this application is relatively high, because the higher the bit rate, the more complex the scene. As shown in Figure 5, the higher the bit rate, the smaller the impact of reducing the bit rate on the user, that is, the greater the power consumption benefit of bit rate adjustment, so the first application type weight corresponding to this application is relatively high. According to the higher weight of the first application type, it is easier to determine to adjust the bit rate in step 107. In this scenario, encoding and wireless projection based on the dynamically reduced bit rate can reduce power consumption on the one hand, and have less impact on user perception on the other hand. For some types of applications, there may be unstable or less complex scenarios. In these scenarios, reducing the bit rate has a greater impact on user perception. Therefore, it is easier to determine not to adjust the bit rate in step 107, that is, to encode and wirelessly project the content to be projected based on the original bit rate in step 108.

It should be noted that in the process shown in Figure 6, when it is determined to be yes in step 107, steps 102 to 105 are executed, that is, the target bit rate is determined after it is determined to adjust the bit rate. However, the embodiment of the present application does not limit the order between steps 102 to 104 and step 107. That is to say, in other possible implementations, the target bit rate can also be determined before determining whether to adjust the bit rate or during the process of determining the bit rate adjustment. As for whether to perform encoding and wireless screen projection based on the target bit rate, it needs to be triggered according to the result determined in step 107.

In one possible implementation, the bit rate is related to the resolution, and the bit rate is related to the quality of each pixel, and the bit rate is approximately equal to the resolution × the quality of each pixel. Therefore, for the adjustment of the bit rate, the resolution can be kept unchanged and the amount of data for each pixel can be reduced, that is, the quality of each pixel can be reduced. In other words, step 105 includes determining the target quality of each pixel corresponding to the content to be projected based on the target bit rate of the content to be projected, the target quality of each pixel is less than the original quality of each corresponding pixel, the resolution is kept unchanged, and the content to be projected is encoded and wirelessly projected based on the target quality of each pixel and the unchanged resolution. It can be understood that in other possible methods, the quality of each pixel and the resolution can be reduced at the same time, and the content to be projected is encoded and wirelessly projected based on the reduced quality of each pixel and the reduced resolution.

In a possible implementation, the above-mentioned step 105, encoding and wirelessly projecting the content to be projected based on the target bit rate, includes: determining the target resolution of the content to be projected based on the target bit rate of the content to be projected, the target resolution of the content to be projected is lower than the original resolution of the content to be projected; encoding and wirelessly projecting the content to be projected based on the target resolution.

Specifically, in most screen projection scenarios, the resolution of the picture captured by the screen projection source device is relatively high, while when the screen projection target device displays it, the received data will be downsampled and then displayed, so the resolution displayed by the screen projection target device is relatively low. For example, as shown in Figure 7, the size of the rectangle in Figure 7 represents the resolution, and the larger the rectangle, the higher the resolution. In Comparative Example 1, the resolution of the picture captured by the screen projection source device is relatively high, and it is encoded, transmitted, and decoded without changing the resolution, but the resolution of the picture displayed by the screen projection target device is relatively low; in Comparative Example 2, the resolution of encoding, transmission, and decoding is lower than the resolution of the captured picture, but the resolution of the picture displayed by the screen projection target device is even lower; in Comparative Example 3, the resolution of encoding, transmission, and decoding is the same as the resolution displayed by the screen projection target device. In this way, for encoding, The power consumption during transmission and decoding is the lowest, but the display effect is the same as the other two comparison ratios. Therefore, in the embodiment of the present application, the quality of a single pixel is kept unchanged, and the target resolution is determined by reducing the resolution to achieve bit rate adjustment. This method of reducing the bit rate has a small reduction in the quality of the picture displayed by the target device. Due to the limitation of encoding, under different encoding parameters QP, the encoding ratio and the resolution ratio have a corresponding relationship, as shown in Table 1 and Figure 8.

Table 1 is a table of the correspondence between resolution and bit rate, and FIG. 8 is a schematic diagram of the relationship between resolution and bit rate corresponding to Table 1, wherein both bit rate and resolution are expressed as a ratio in percentage form. In addition to illustrating the correspondence between resolution ratio and bit rate ratio, Table 1 and FIG. 8 also illustrate the correspondence between two reference ratios and bit rate ratios, wherein the unilateral ratio refers to the unilateral ratio of pixels, and the correspondence between the pixel area ratio and the bit rate ratio can be equivalently understood as the relationship between the ideal resolution and bit rate, but due to the limitation of encoding, the correspondence between the actual resolution ratio and the bit rate is related to the encoding parameter QP. The resolution ratio and bit rate ratio relationship under different encoding parameters QP can be pre-stored in the projection source device. In the process of determining the target resolution of the content to be projected based on the target bit rate of the content to be projected, the ratio of the reduced target bit rate to the original bit rate, that is, the reduced bit rate ratio, can be determined. According to the resolution ratio and bit rate ratio relationship corresponding to the current encoding parameter QP, the resolution ratio corresponding to the reduced bit rate ratio can be determined. According to the resolution ratio, the corresponding target resolution can be determined, and then the content to be projected can be encoded and wirelessly projected based on the target resolution.

As shown in Table 2 and Figure 9.

Table 2

Table 2 shows the temperature test data of electronic devices under three scenarios. Figure 9 shows the temperature rise curves of electronic devices under three scenarios corresponding to Table 2. It can be seen that the temperature rises faster in the wireless screen projection scenario than in the local video playback scenario, and the wireless screen projection method of the embodiment of the present application has a slower temperature rise than the wireless screen projection method that does not change the bit rate. In other words, the embodiment of the present application can improve the temperature rise of the screen projection source device caused by screen projection and prolong the temperature rise time.

As shown in FIG10 , the embodiment of the present application further provides a screen projection method, including:

Step 201: Obtain a first application type weight, where the first application type weight is an application type weight corresponding to the current foreground application;

Step 202: determine whether to perform bit rate adjustment based on the bit rate adjustment parameters, the bit rate adjustment parameters include the first application type weight. If yes, execute step 203: encode and wirelessly project the content to be projected based on the target bit rate, and the target bit rate is lower than the original bit rate of the content to be projected. If no, execute step 204: encode and wirelessly project the content to be projected based on the original bit rate.

Specifically, the executor of the screen projection method can be a screen projection source device, step 201 can be the same as step 106 in the above embodiment, step 202 can be the same as step 107, step 204 can be the same as step 108, and step 203 can be similar to step 105, with the difference that step 203 does not limit the method for determining the target bit rate, and can apply the target bit rate determination method in the above embodiment, or other possible target bit rate determination methods, as long as the target bit rate is lower than the original bit rate.

In the screen projection method of the embodiment of the present application, the current foreground application corresponds to the scene of the content to be projected. If it is in a relatively stable scene, that is, the continuity of the image is relatively good, and the probability of application switching is relatively low, then the weight of the application type corresponding to this application is relatively high; if it is in a scene with a higher degree of complexity, then the weight of the application type corresponding to this application is relatively high, because the higher the bit rate, the more complex the scene, and the higher the bit rate, the smaller the impact of reducing the bit rate on the user, that is to say, the greater the power consumption benefit of bit rate adjustment, so the weight of the application type corresponding to this application is relatively high. According to the higher application type weight, it is easier to determine to adjust the bit rate. In this scenario, encoding and wireless projection based on the reduced bit rate can reduce power consumption on the one hand, and have less impact on user perception on the other hand. For some application types, there may be unstable or less complex scenes. In these scenarios, reducing the bit rate has a greater impact on user perception, so it is easier to determine not to adjust the bit rate, that is, to encode and wirelessly project the content to be projected based on the original bit rate. In addition, the screen projection method in the embodiment of the present application does not need to wait until the temperature rises to a threshold value before adjusting the bit rate, but dynamically adjusts the bit rate based on the foreground application type, which can improve the temperature rise of the screen projection source device caused by screen projection, prolong the temperature rise time, and reduce the probability of equipment abnormalities due to heat.

In a possible implementation, as shown in FIG6 and FIG10, step 107 or step 202, determining whether to perform rate adjustment according to the rate adjustment parameter includes: if the weight of the first application type is greater than the preset weight, determining to perform rate adjustment, and if the weight of the first application type is not greater than the preset weight, determining not to perform rate adjustment. That is, in step 107 or 202, it can be directly determined whether to perform rate adjustment according to the weight of the first application type.

In one possible implementation, as shown in FIG6 and FIG10, the application type weight corresponding to the video or game application is greater than the application type weight corresponding to other applications; the above step 107 or step 202, determining whether to perform bit rate adjustment according to the bit rate adjustment parameter includes: determining a bit rate adjustment index according to the first application type weight, if the necessity of bit rate adjustment represented by the bit rate adjustment index meets the adjustment condition, then determining to perform bit rate adjustment, if the necessity of bit rate adjustment represented by the bit rate adjustment index does not meet the adjustment condition, then determining not to perform bit rate adjustment, the necessity of bit rate adjustment represented by the bit rate adjustment index is positively correlated with the first application type weight. The first application type weight is positively correlated with the power consumption benefit of bit rate reduction in the scenario, and the user experience can be improved by dynamically adjusting the projection bit rate based on the application type.

Specifically, the rate adjustment index is correlated with the weight of the first application type, for example, the two may be positively correlated. In this case, the rate adjustment index is greater than the adjustment threshold, that is, the necessity of rate adjustment represented by the rate adjustment index satisfies the adjustment condition, then it is determined to perform rate adjustment; if the rate adjustment index is not greater than the adjustment threshold, that is, the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, then it is determined not to perform rate adjustment; the rate adjustment index may be negatively correlated with the weight of the first application type. In this case, the necessity of rate adjustment represented by the rate adjustment index is not greater than the adjustment threshold, that is, the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, then it is determined to perform rate adjustment; if the rate adjustment index is greater than the adjustment threshold, that is, the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, then it is determined not to perform rate adjustment. For video applications and game applications, the frame rate is usually high and highly complex images are prone to appear. The frame rate is usually stable at 30, 60 or 120fps, and the front and back correlation of images is relatively large. The original power consumption of this type of application when used as the foreground for screen projection is relatively large, and the power consumption benefit of reducing the bit rate is obvious. Therefore, the application type weight corresponding to the video or game application can be set to 1, that is, it has the highest priority in determining whether to adjust the bit rate; for other applications besides videos and games, since the probability of highly complex images appearing is low, a lower application type weight can be set. For other applications, further divisions can be made. For example, a music application will dynamically display lyrics when playing a song, and the frame rate is usually stable at 30 or 60fps. The image complexity is relatively small compared to games or videos, and the bit rate can be reduced. The power consumption benefit is medium and relatively stable, so the application type weight corresponding to the music application can be set to 0.5, that is, it has medium priority in determining whether to adjust the bit rate; and for other applications other than music applications, it refers to applications other than video applications, game applications and music applications, such as instant messaging applications or memo applications, etc. Take instant messaging applications as an example. When the window is static, its frame rate is usually less than 5fps, and the screen projection bit rate is low. When sliding the window or refreshing other functions with picture or video interfaces, the instantaneous frame rate may quickly rise to 60 or 120fps. The response speed of bit rate reduction is not easy to match the frame rate and bit rate change speed of the application, which is easy to affect the user's subjective feeling due to bit rate reduction. In addition, the overall bit rate of such applications is relatively low, and the power consumption benefit of bit rate reduction is not obvious. Therefore, the lowest application type weight is set, for example, the application type weight corresponding to other applications other than music applications can be set to 0. The first application type weight is positively correlated with the power consumption benefit of bit rate reduction in the scene. By dynamically adjusting the screen projection bit rate based on the application type, the user experience can be improved.

In a possible implementation, as shown in Figures 6 and 10, the bit rate adjustment parameter also includes the frequency of the current foreground application switching from the background to the foreground within a preset time period, that is, in step 107 or 202, it can be determined whether to perform bit rate adjustment based on the first application type weight and the frequency of the current foreground application switching from the background to the foreground within the preset time period.

Specifically, the preset time period is a recent period of time, such as the last 1 minute. The frequency of the current foreground application switching from the background to the foreground within the preset period of time can represent the user's historical operation behavior, and user operations are usually continuous and relevant. For example, some users are accustomed to switching to instant messaging applications to reply to messages while watching videos, while some users rarely switch applications while watching videos. Therefore, based on the user's historical operation behavior, the probability of the user switching the foreground application in the next period of time can be predicted. If the probability of the user switching the foreground application next is high, it is more inclined not to adjust the bit rate, because after switching the foreground application, if the bit rate of the foreground application switched to is reduced, it will have a great impact on the user's subjective feelings, which is easy to reduce the user experience; if the probability of the user switching the foreground application next is small, it is more inclined to adjust the bit rate, because the bit rate reduction in a stable scenario has less impact on the user's perception, and the bit rate reduction is not easy to reduce the user experience. For example, if there is a foreground application switch in the last minute, then step 204 is executed for the next 10 minutes without reducing the bit rate, and then step 202 is executed again to determine whether to adjust the bit rate in the next cycle, that is, to achieve periodic dynamic bit rate adjustment; if there is no foreground application switch in the last minute, then step 203 is executed for the next 10 minutes to reduce the bit rate and perform screen projection, and then step 202 is executed again to determine whether to adjust the bit rate in the next cycle, that is, to achieve periodic dynamic bit rate adjustment. Determining whether to adjust the bit rate in combination with the switching frequency of the foreground application can further improve the user experience.

In a possible implementation, as shown in FIG6 and FIG10, the bit rate adjustment parameter also includes a second application type weight, where the second application type weight is an application type weight corresponding to a target application that is switched to a foreground application during a preset period of time, and the target application is an application other than the current foreground application.

Specifically, if the user frequently switches to the instant messaging application to reply to messages while watching videos in the recent period, it means that in the next period of time, the user has a greater probability of switching to the instant messaging application to reply to messages while watching videos. Since the instant messaging application and the video application are different in application type, the impact of reducing the bit rate on the user experience is also different. Therefore, the necessity of bit rate adjustment is not only related to the switching frequency, but also to the application type weight corresponding to the target application. For example, if the target application that the user has switched to in the recent period is a video application, the corresponding application type weight is large, so it is more inclined to adjust the bit rate; if the target application that the user has switched to in the recent period is, for example, an instant messaging application, the corresponding application type weight is small, so it is more inclined not to adjust the bit rate. Determining whether to adjust the bit rate in combination with the switching frequency of the foreground application and the application type of the target application switched to can further improve the user experience.

In a possible implementation, as shown in FIG6 and FIG10, step 107 or 202, determining whether to perform rate adjustment according to the rate adjustment parameter includes: determining a rate adjustment index according to the first application type weight and the frequency of the current foreground application switching from the background to the foreground within a preset time period; if the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, determining to perform rate adjustment; if the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, determining not to perform rate adjustment; the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the first application type weight, and the necessity of rate adjustment represented by the rate adjustment index is negatively correlated with the above-mentioned frequency.

In a possible implementation, as shown in FIG6 and FIG10, step 107 or 202, determining whether to perform rate adjustment according to the rate adjustment parameter includes: determining a rate adjustment index according to the first application type weight and the second application type weight, if the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, determining to perform rate adjustment, if the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, determining not to perform rate adjustment, the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the first application type weight, and the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the second application type weight.

In a possible implementation, as shown in FIG. 6 and FIG. 10, step 107 or 202, determining whether to perform bit rate adjustment according to the bit rate adjustment parameter includes: determining the bit rate according to the second application type weight and the frequency of the current foreground application switching from the background to the foreground within a preset period of time Adjustment indicator: if the necessity of rate adjustment represented by the rate adjustment indicator meets the adjustment condition, it is determined to perform rate adjustment; if the necessity of rate adjustment represented by the rate adjustment indicator does not meet the adjustment condition, it is determined not to perform rate adjustment; the necessity of rate adjustment represented by the rate adjustment indicator is positively correlated with the weight of the second application type, and the necessity of rate adjustment represented by the rate adjustment indicator is negatively correlated with the frequency.

In a possible implementation, as shown in FIG6 and FIG10, step 107 or 202, determining whether to perform rate adjustment according to the rate adjustment parameter includes: determining a rate adjustment index according to the first application type weight, the second application type weight, and the frequency of the current foreground application switching from the background to the foreground in a preset period of time; if the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, it is determined to perform rate adjustment; if the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, it is determined not to perform rate adjustment; the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the first application type weight, the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the second application type weight, and the necessity of rate adjustment represented by the rate adjustment index is negatively correlated with the frequency.

Specifically, whether it is the current foreground application or the target application that has been switched recently, it may be the application corresponding to the next screen projection content. Both can reflect the next screen projection scene. Therefore, the necessity of bitrate adjustment represented by the bitrate adjustment index can be set to be positively correlated with the first application type weight and the second application type weight. In other words, the greater the weight of the application type that has been switched to the foreground application, the greater the probability that the bitrate of the next screen projection scene will be higher, and therefore the more inclined to perform bitrate adjustment. The higher the switching frequency, the lower the stability of the next screen projection scene, and therefore the more inclined not to perform bitrate adjustment. Determining whether to perform bitrate adjustment based on the switching frequency of the foreground application, the application type of the target application switched to, and the application type of the current foreground application can further improve the user experience.

In a possible implementation, determining whether to perform rate adjustment according to the rate adjustment parameter includes: determining a rate adjustment index k according to the following formula: k = W _app1 ² /(a×f/W _app2 ), if k is greater than a threshold, it is determined to perform rate adjustment, if k is not greater than the threshold, it is determined not to perform rate adjustment, W _app1 is the weight of the first application type, f is the frequency of the current foreground application switching from the background to the foreground within a preset period, W _app2 is the weight of the second application type, and a is a constant. Determining the rate adjustment index based on this formula can more accurately achieve dynamic adjustment of encoding.

Specifically, a×f/W _app2 may be used to indicate an estimated probability of switching to an application type for which bit rate adjustment should not be performed in the next period of time. Assume that in the first scenario, the current foreground application is a game application, and its corresponding application type weight W _app1 =1, the user switches to the music application once in the last minute, and the switching frequency of once in 1 minute is set to f=1, for example, the music application is the target application, and its corresponding application type weight W _app2 =0.5; Assume that the second scenario is similar to the first scenario, the only difference is that the user switches to the music application 5 times in the last minute, and the switching frequency of 5 times in 1 minute is set to f=5, for example, then relative to the first scenario, the switching frequency in the second scenario is larger, so the bit rate adjustment index k is smaller, and it is less likely to be greater than the threshold, that is, it is less likely to perform bit rate adjustment; Assume that the second scenario is similar to the first scenario, the only difference is that the current foreground application is an instant messaging application, and its corresponding application type weight W _app1 =0, the bit rate adjustment index k=0, the threshold is a positive number, k must be less than the threshold, so no bit rate adjustment is performed; Assume that the second scenario is similar to the first scenario, the only difference is that the target application is an instant messaging application, and its corresponding application type weight W _app2 =0, the bit rate adjustment index k=0, the threshold is a positive number, k must be less than the threshold, so the bit rate adjustment is not performed. In order to ensure that the calculation is performed normally, if there is no switching within the preset period, f and W _app2 can be set to non-zero preset values. Determining the bit rate adjustment index based on this formula can more accurately achieve dynamic adjustment of the bit rate.

In a possible implementation, the above step 203, encoding and wirelessly projecting the content to be projected based on the target bit rate, includes: determining the target resolution of the content to be projected based on the target bit rate, the target resolution of the content to be projected is lower than the original resolution of the content to be projected; encoding and wirelessly projecting the content to be projected based on the target resolution. The bit rate can be reduced while minimizing the adverse impact on the user experience. The specific process and principle are the same as the relevant content of step 105 in the above embodiment, and will not be repeated here.

As shown in FIG11 , the embodiment of the present application further provides a screen projection method, including:

Step 301, determine whether to adjust the bit rate based on the frequency of the current foreground application switching from the background to the foreground within a preset time period. If so, execute step 302, encode and wirelessly project the content to be projected based on the target bit rate, and the target bit rate is lower than the original bit rate of the content to be projected. If it is determined to be no in step 301, execute step 303, encode and wirelessly project the content to be projected based on the original bit rate.

Specifically, the executor of the screen projection method can be a screen projection source device, step 301 can be the same as the above step 107, step 303 can be the same as the above step 108, and step 302 is similar to the above step 105. The difference is that step 303 does not limit the method for determining the target bit rate. The target bit rate determination method in the above embodiment can be applied, and other possible target bit rate determination methods can also be applied, as long as the target bit rate is lower than the original bit rate.

The screen projection method of the embodiment of the present application can predict the probability of the user switching the foreground application in the next period of time based on the user's historical operation behavior. If the probability of the user switching the foreground application next time is high, it is more inclined not to adjust the bit rate, because after switching the foreground application, if the bit rate of the foreground application switched to is reduced, it will have a great impact on the user's subjective feelings, which is easy to reduce the user experience; if the probability of the user switching the foreground application next time is low, it is more inclined to adjust the bit rate, because the bit rate reduction in a stable scenario has a relatively small impact on the user's perception. Small, the bit rate reduction is not easy to reduce the user experience. Dynamic bit rate adjustment can be implemented according to the switching frequency of the foreground application to improve the user experience while reducing power consumption. In addition, the screen projection method in the embodiment of the present application does not need to wait until the temperature rises to the threshold before adjusting the bit rate, but dynamically adjusts the bit rate based on the switching frequency of the foreground application, which can improve the temperature rise of the screen projection source device caused by screen projection, prolong the temperature rise time, and reduce the probability of abnormalities caused by heat in the device.

In a possible implementation, the above step 301, determining whether to adjust the bit rate based on the frequency of the current foreground application switching from the background to the foreground within a preset time period, includes: determining whether to adjust the bit rate based on the frequency of the current foreground application switching from the background to the foreground within a preset time period and the second application type weight, the second application type weight being the application type weight corresponding to the target application that is switched to the foreground application within the preset time period, the target application being an application other than the current foreground application. For example, if the target application that the user has switched to in the recent period is a video application, its corresponding application type weight is relatively large, and therefore it is more inclined to adjust the bit rate; if the target application that the user has switched to in the recent period is, for example, an instant messaging application, its corresponding application type weight is relatively small, and therefore it is more inclined not to adjust the bit rate. Determining whether to adjust the bit rate based on the switching frequency of the foreground application and the application type of the target application switched to can further improve the user experience.

In a possible implementation, the application type weight corresponding to the video or game application is greater than the application type weight corresponding to other applications.

In a possible implementation, determining whether to perform rate adjustment based on the frequency of the current foreground application switching from the background to the foreground within a preset time period and the weight of the second application type includes: determining a rate adjustment index based on the frequency of the current foreground application switching from the background to the foreground within a preset time period and the weight of the second application type; if the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, determining to perform rate adjustment; if the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, determining not to perform rate adjustment; the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the weight of the second application type, and the necessity of rate adjustment represented by the rate adjustment index is negatively correlated with the frequency. That is to say, the higher the frequency of switching from the background to the foreground within the preset time period, the worse the stability of the screen to be projected, and therefore the lower the necessity for bitrate adjustment; the lower the switching frequency, the higher the stability of the screen to be projected, and therefore the higher the necessity for bitrate adjustment; the higher the application type weight of the target application, the greater the probability that the screen to be projected is a high bitrate, that is, the higher the necessity for bitrate adjustment; the lower the application type weight of the target application, the smaller the probability that the screen to be projected is a high bitrate, that is, the lower the necessity for bitrate adjustment.

In a possible implementation, the above step 303, encoding and wirelessly projecting the content to be projected based on the target bit rate, includes: determining the target resolution of the content to be projected based on the target bit rate, the target resolution of the content to be projected is lower than the original resolution of the content to be projected; encoding and wirelessly projecting the content to be projected based on the target resolution. The bit rate can be reduced while minimizing the adverse impact on the user experience. The specific process and principle are the same as those in the above embodiment and will not be repeated here.

The embodiment of the present application also provides an electronic device, including: a processor and a memory, the memory is used to store at least one instruction, and when the instruction is loaded and executed by the processor, the electronic device executes the method of any of the above embodiments. The specific process and principle of the method are the same as those of the above embodiment, and will not be repeated here. The electronic device can be specifically the electronic device shown in Figure 2.

The electronic devices involved in this application may be smart TVs, mobile phones, tablet computers, personal computers (PCs), personal digital assistants (PDAs), smart watches, wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, vehicle-mounted devices, drone equipment, smart cars, smart speakers, robots, smart glasses, and any other products.

An embodiment of the present application further provides a computer-readable storage medium, including a program or an instruction. When the program or the instruction runs on a computer, the method in any of the above embodiments is executed.

The embodiments of the present application also provide a computer program product, which includes executable instructions. When the executable instructions are executed on a computer, the computer executes the method in any of the above embodiments.

In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in this application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk), etc.

In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And/or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and/or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character "/" generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, c can be single or multiple.

The above are only preferred embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (15)

A screen projection method, characterized by comprising: Obtaining a first application type weight, where the first application type weight is an application type weight corresponding to a current foreground application; Determine whether to perform bit rate adjustment according to the bit rate adjustment parameter, the bit rate adjustment parameter includes the first application type weight, if yes, encode and wirelessly project the content to be projected based on the target bit rate, and the target bit rate is lower than the original bit rate of the content to be projected, if no, encode and wirelessly project the content to be projected based on the original bit rate. The method according to claim 1, characterized in that The application type weight corresponding to video or game applications is greater than the application type weight corresponding to other applications. The method according to claim 1 or 2, characterized in that Determining whether to perform bit rate adjustment according to the bit rate adjustment parameter includes: If the weight of the first application type is greater than the preset weight, it is determined to perform bit rate adjustment; if the weight of the first application type is not greater than the preset weight, it is determined not to perform bit rate adjustment. The method according to claim 1, characterized in that The bit rate adjustment parameters also include the frequency of the current foreground application switching from the background to the foreground within a preset time period. The method according to claim 5, characterized in that The determining whether to perform rate adjustment according to the rate adjustment parameter includes: determining a rate adjustment index according to the rate adjustment parameter, and if the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, determining to perform rate adjustment, and if the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, determining not to perform rate adjustment, the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the weight of the first application type, and the necessity of rate adjustment represented by the rate adjustment index is negatively correlated with the frequency. The method according to claim 1 or 4, characterized in that The bit rate adjustment parameter also includes a second application type weight, where the second application type weight is an application type weight corresponding to a target application that is switched to a foreground application during the preset time period, and the target application is an application other than the current foreground application. The method according to any one of claims 1 to 6, characterized in that The encoding of the content to be projected and the wireless projection based on the target bit rate include: Determining a target resolution of the content to be projected based on a target bit rate, wherein the target resolution of the content to be projected is lower than an original resolution of the content to be projected; The content to be projected is encoded and wirelessly projected based on the target resolution. A screen projection method, characterized by comprising: Whether to perform bitrate adjustment is determined based on the frequency of the current foreground application switching from the background to the foreground within a preset time period. If so, the content to be projected is encoded and wirelessly projected based on the target bitrate, and the target bitrate is lower than the original bitrate of the content to be projected. If not, the content to be projected is encoded and wirelessly projected based on the original bitrate. The method according to claim 8, characterized in that The determining whether to perform bitrate adjustment based on the frequency of the current foreground application switching from the background to the foreground within a preset time period includes: determining whether to perform bitrate adjustment based on the frequency of the current foreground application switching from the background to the foreground within a preset time period and a second application type weight, wherein the second application type weight is an application type weight corresponding to a target application that is switched to the foreground application within the preset time period, and the target application is an application other than the current foreground application. The method according to claim 9, characterized in that The application type weight corresponding to video or game applications is greater than the application type weight corresponding to other applications. The method according to claim 9, characterized in that The determining whether to perform rate adjustment according to the frequency of the current foreground application switching from the background to the foreground within a preset period of time and the second application type weight includes: determining a rate adjustment index according to the frequency of the current foreground application switching from the background to the foreground within a preset period of time and the second application type weight, if the necessity of rate adjustment represented by the rate adjustment index meets the adjustment condition, determining to perform rate adjustment, if the necessity of rate adjustment represented by the rate adjustment index does not meet the adjustment condition, determining not to perform rate adjustment, the necessity of rate adjustment represented by the rate adjustment index is positively correlated with the second application type weight, and the necessity of rate adjustment represented by the rate adjustment index is negatively correlated with the frequency. The method according to any one of claims 8 to 11, characterized in that The encoding of the content to be projected and the wireless projection based on the target bit rate include: Determining a target resolution of the content to be projected based on a target bit rate, wherein the target resolution of the content to be projected is lower than an original resolution of the content to be projected; The content to be projected is encoded and wirelessly projected based on the target resolution. An electronic device, comprising: A processor and a memory, wherein the memory is used to store at least one instruction, and when the instruction is loaded and executed by the processor, the electronic device executes the method according to any one of claims 1 to 12. A computer-readable storage medium, characterized in that it includes a program or an instruction, and when the program or the instruction is run on a computer, the method according to any one of claims 1 to 12 is executed. A computer program product, characterized in that the computer program product contains executable instructions, and when the executable instructions are executed on a computer, the computer executes the method described in any one of claims 1 to 12.