TWI502965B - Wireless video transmission system and method - Google Patents

Description

Wireless video transmission system and method

The invention mainly relates to a wireless video transmission technology, and in particular to a technology for performing an image compensation mechanism by using image processing capability of a receiving end.

With the advancement and popularity of wireless technology, more and more user behaviors are moving toward wireless operation, from early wireless keyboards and mice to wireless Internet access, as well as wireless video that has received increasing attention in the near future. Transmission is achieved by using wireless technology. However, today's wireless audio and video transmission often encounters several problems when it is applied to the application, such as 1. transmission bandwidth size 2. popularity of wireless transmission hardware 3. insufficient hardware capability of the transmission end. The solution with better bandwidth often requires more special technology and hardware, while the popular wireless technology wi-fi 802.11n claims to have a bandwidth greater than 100Mbps, but the actual use is too popular and it is easy to encounter bandwidth crowding. The problem. The more innovative technologies and hardware requirements for the system capabilities of the transmitter are also stronger.

The existing wireless audio and video transmission technology relies entirely on the CPU computing and compression capabilities of the transmission end. First, by crawling the host-side desktop, various methods of compression (ex: h.264 or motion jpeg...etc) are performed. Finally, the compressed image is transmitted to the receiving end through the wireless technology packet, and the receiving end performs the solution. Compress and output the picture to the receiving screen. Therefore, today's wireless audio and video transmission technology concentrates most of the master control and load on the transmitting end, from picture capture, picture compression to network packet implementation. . Therefore, when the hardware capability of the transmitting end system is limited and the wireless network is crowded, the transmission of video and audio is likely to be unsmooth.

In view of the above problems of the prior art, the present invention provides a wireless video transmission system and method, which can utilize the image processing capability of the receiving end to share the work of the partial transmission transmitting end.

According to an embodiment of the present invention, a wireless video transmission system includes: a transmitting device configured to generate an image packet according to an image data and a transmission setting information; and a receiving device configured to receive the image packet; The detecting device is configured to detect a first image processing capability of the receiving device, and output the transmission setting information according to the detected first image processing capability.

According to an embodiment of the present invention, a method for transmitting a wireless video and audio is provided. The method includes: detecting a first image processing capability of a receiving device, and outputting a transmission setting information according to the detected first image processing capability. Generating an image packet on a transmitting device according to an image data and the transmission setting information; decompressing the image packet by using a decompressing device to generate a decompressed image packet; and compensating the decompression by using a compensation device according to the transmission setting information The image is encoded to produce an output image.

1 is a block diagram showing a wireless video transmission system 100 according to an embodiment of the invention. As shown in the figure, a wireless video transmission system 100 according to an embodiment of the invention includes a transmitting device 110, a detecting device 120, and a receiving device 130. The transmitting device 110 is configured to generate the image packet S2 according to an image data S1 and a transmission setting information. The receiving device 130 is configured to receive the image packet S2.

According to an embodiment of the invention, the transmission device 110 determines the compression ratio required by the image packet S2 according to the bandwidth required for transmitting the image data S1 and the preset bandwidth of one of the wireless network environments used. The bandwidth required for the image data S1 refers to the bandwidth required for the image data S1 when transmitting the image data S1 in the wireless environment, and the preset bandwidth of the wireless network refers to when the image is transmitted. The bandwidth that the wireless network environment can provide when the data is S1. For example, when the preset bandwidth of the wireless network environment is smaller than the bandwidth required for transmitting the image data S1, it means that the bandwidth of the wireless network is not enough to transmit the complete image data S1, therefore, the image packet S2 is required. Higher compression ratio.

The detecting device 120 is configured to detect the first image processing capability of the receiving device 130, and the detecting device 120 outputs the transmission setting information to the transmitting device 110 according to the first image processing capability. According to an embodiment of the present invention, the first image processing capability of the receiving device 130 can be obtained by transmitting a test image packet to the receiving device 130 through the detecting device 120, and generating a test image packet according to the receiving device 130. The time it takes to test the output image is to evaluate the first image processing capability of the receiving device 130. The test image described herein may be a small portion of image data S1 or other data. The first image processing capability of the receiving device 130 is known to those skilled in the art. After reading the embodiment of the present specification, it can be understood that the first image processing capability of the receiving device 130 refers to the cost of testing the output image. The practice of time. According to other embodiments of the present invention, the first image processing capability may also include the quality of the test output image, the error rate of the receiving device 130 generating the test output image, and the like.

Next, the transmitting device 110 determines the data included in the image packet S2 according to the transmission setting information. According to an embodiment of the invention, the transmission setting information refers to the number of image frames that the transmission device 110 needs to transmit the image packet per second. Therefore, according to the transmission setting information, the transmitting device 110 can determine the transmitted image packet S2. Need to include several image frames. According to an embodiment of the invention, the detecting device 120 can be integrated in the transmitting device 110 or the receiving device 130.

According to an embodiment of the invention, the detecting device 120 further detects the second image processing capability of the transmitting device 110. The detecting device 120 detects the second image processing capability of the transmitting device 110, and transmits a test image packet to the transmitting device by transmitting the detecting device 120 by using the first image processing capability of the receiving device 130. 110. The second image processing capability of the transmitting device 110 is evaluated based on the time it takes for the transmitting device 110 to process the test image packet to generate a test output image.

After the first image processing capability and the second image processing capability are known, the detecting device 120 outputs the transmission setting information according to the first image processing capability and the second image processing capability, that is, by evaluating the transmitting device 110 and The receiving device 130 processes the test image packet, and the time required for generating a test output image determines the number of image frames included in the image packet to be transmitted by the transmitting device 110 per second, and the number of untransferred image frames is reused. The receiving device 130 compensates for the number of image frames included in the image packet to be transmitted per second, and the ratio of the number of sheets to be compensated by the receiving device 130, and then according to the first image processing capability and the second image processing capability. Assignment in different proportions. For example, it is assumed that the receiving device 130 has good performance according to the first image processing capability and the second image processing capability, and the original transmitting device 110 needs to transmit the image packet every second when the performance of the transmitting end is insufficient. If the number of video images is 50, it can be reduced to 30, so as to reduce the burden on the transmission device 110, and the remaining number of untransferred video frames is compensated by the receiving device 130. Therefore, by reducing the number of image frames included in the image packet to be transmitted by the transmitting device 110 per second, the receiving device 130 can share the work of the partial transmitting device 110, so that the load of the transmitting device 110 is not excessively heavy, and the audio and video screen is generated. Not smooth. However, if the load of the receiving device 130 is too heavy, it can be adjusted according to the first image processing capability and the second image processing capability at that time, such as increasing the number of image frames included in the image packet to be transmitted by the transmitting device 110 per second.

According to an embodiment of the invention, the receiving device 130 includes a decompressing device 140 and a compensating device 150. The decompression device 140 is configured to decompress the image packet S2 to generate a decompressed image packet S3. The compensating device 150 then compensates the decompressed image packet S3 according to the transmission setting information to generate an output image S4. According to an embodiment of the present invention, the receiving device 130 also transmits a receiving end information S5 to the transmitting device 110, and informs the transmitting device 110 that the receiving device 130 is currently receiving the status of the device 130, that is, the transmitting device 110 can thereby receive the receiving end information S5. It is known whether the workload currently performed by the receiving device 130 has exceeded the load, and if the load has been exceeded, the detection is performed again, and the transmission setting is adjusted. According to an embodiment of the invention, the receiving end information S5 is returned by the compensation device 150. According to an embodiment of the present invention, when decompressing, the detecting device 120 simultaneously transmits the number of the number of images transmitted by the transmitting device 110, the information of the image frame feature, and the image generating ratio transmitted by the transmitting end to the compensation device 150. The information about the number of the number of images transmitted by the transmitting device 110, the information of the image frame feature, and the image generation ratio transmitted by the transmitting end may be included in the transmission setting information. According to an embodiment of the present invention, the compensation device 150 determines parameters such as an algorithm, a resolution, and the like of the predicted image by using the transmission setting information, and generates a missing picture. According to an embodiment of the invention, if the transmitted image frame is a moving image frame, in the prediction of the moving image frame, a Motion Estimation & Motion Compensation (MEMC) method may be used, firstly on the screen. The motion vector (MV) is searched for a motion compensation base (MC-base) prediction, thereby using MC-base to calculate the error from the previous picture, and using this error value for picture generation. According to an embodiment of the present invention, if the transmitted image frame is a still image frame, for the static image, a small portion of the moving region can be distinguished through the image feature analysis, and the small region image compensation is performed by using the MEMC method. For large areas of static areas, you can directly copy the previous screen.

2 is a flow chart 200 showing a method of wireless video transmission according to an embodiment of the invention. First, in step S210, first detecting a first image processing capability of a receiving device, and outputting a transmission setting information according to the detected first image processing capability; in step S220, according to an image data and the transmitting Setting the information to generate an image packet in a transmitting device; in step S230, decompressing the image packet generated by the transmitting device by using a decompressing device to generate a decompressed image packet; and in step S240, utilizing the transmission setting information according to the A compensation device compensates the decompressed image packet to generate an output image.

In the wireless video transmission method proposed by the present invention, in a relatively complicated wireless environment such as an office or a public place, due to the complexity of the environment, for wireless audio and video transmission applications, the bandwidth is often insufficient due to excessive use. In this case, the reliance on bandwidth requirements can be reduced by this compensation mechanism. In addition, through this compensation mechanism, part of the image generation task can be forwarded to the receiving end to reduce the dependence on the transmitting end system.

The specific features, structures, or properties mentioned in the "invention" or "embodiment" referred to in the specification may be included in at least one embodiment of the present specification. Therefore, statements that appear in different places, "in one embodiment," may not all refer to the same embodiment. In addition, this particular feature, structure, or property may be combined with one or more embodiments in any suitable manner. In addition, it should be noted that the following illustrations are only for the purpose of explanation and are not drawn to the actual scale.

The embodiments disclosed herein will readily appreciate the above advantages for anyone skilled in the art. After reading the contents of the specification, any person skilled in the art can make appropriate changes and substitutions in a broad manner without departing from the spirit and scope of the invention. Therefore, the embodiments disclosed in the present specification are intended to protect the scope of the claims of the present invention and are not intended to limit the scope of the invention.

100. . . Wireless video transmission system

110. . . Conveyor

120. . . Detection device

130. . . Receiving device

140. . . Decompression device

150. . . Prediction device

S1. . . video material

S2. . . Image packet

S3. . . Decompressed packet

S4. . . Output image

S5. . . Receiver information

1 is a block diagram showing a wireless video transmission system 100 according to an embodiment of the invention.

2 is a flow chart 200 showing a method of wireless video transmission according to an embodiment of the invention.

100. . . Wireless video transmission system

110. . . Conveyor

120. . . Detection device

130. . . Receiving device

140. . . Decompression device

150. . . Prediction device

S1. . . video material

S2. . . Image packet

S3. . . Decompressed packet

S4. . . Output image

S5. . . Receiver information

Claims (15)

A wireless video transmission system includes: a transmitting device for generating a plurality of image packets according to an image data and a transmission setting information; a receiving device for receiving the image packet; and a detecting device for detecting the above Receiving a first image processing capability of the device, and outputting the transmission setting information according to the first image processing capability. The wireless video transmission system of claim 1, wherein the detecting device is further configured to detect a second image processing capability of the transmitting device, and according to the first image processing capability of the receiving device The second image processing capability of the transmitting device outputs the transmission setting information. The wireless video transmission system of claim 1, wherein the transmitting device is configured to determine information included in the image package according to the transmission setting information. The wireless video transmission system of claim 1, wherein the receiving device further comprises: a decompression device for decompressing the image packet to generate a plurality of decompressed image packets; and a compensation device for The transmission setting information compensates the decompressed image packet to generate an output image. The wireless video transmission system of claim 4, wherein the compensation device determines, according to the number of pictures that are missing from the image package, an image picture feature information, and an image generation ratio of the transmission device. Performing an algorithm, and using the above algorithm to generate a missing picture of the image packet to compensate the decompressed image packet; wherein the number of pictures lacking the image packet, the image picture feature information, and the transmitting The image generation ratio transmitted by the device is included in the transmission setting information. The wireless video transmission system of claim 4, wherein the receiving device is further configured to transmit a receiving end information to the transmitting device to notify whether the workload of the receiving device currently performed by the receiving device has exceeded load. The wireless video transmission system of claim 2, wherein the detecting means transmits a test image packet to the receiving device and the transmitting device respectively, and processes the test image packet according to the receiving device and the transmitting device. A time required to test the output image is respectively generated to detect the first image processing capability and the second image processing capability. The wireless video transmission system of claim 1, wherein the transmission device is configured to determine the image packet according to a bandwidth required for transmitting the image data and a preset bandwidth of a wireless network used. A compression ratio. A method for transmitting wireless video and audio, the method comprising: detecting a first image processing capability of a receiving device, and outputting a transmission setting information according to the detected first image processing capability; according to an image data and the transmission setting Generating a plurality of image packets on a transmitting device; decompressing the image packets by using a decompressing device to generate a plurality of decompressed image packets; and compensating the decompressed image packets to generate an output image by using a compensation device according to the transmission setting information. The wireless video transmission method of claim 9, further comprising detecting a second image processing capability of the transmitting device, and based on the first image processing capability of the receiving device and the second of the transmitting device The image processing capability outputs the above transmission setting information. The wireless video transmission method according to claim 9, wherein the data contained in the image packet generated by the transmitting device is determined according to the transmission setting information. The wireless video transmission method of claim 9, further comprising: determining, according to the number of pictures, the number of pictures, the image picture feature information, and the image generation rate of the transmission device And performing, by using the above algorithm, the lack of a picture of the image packet to compensate for the decompressed image packet, wherein the number of pictures lacking the image packet, the image picture feature information, and the transmitting device are transmitted The above image generation ratio is included in the above transmission setting information. The wireless video transmission method of claim 9, further comprising: transmitting, by the receiving device, a receiving end information to the transmitting device to notify whether the workload performed by the receiving device has exceeded a load. The wireless video transmission method of claim 10, further comprising transmitting a test image packet to the receiving device and the transmitting device respectively, and generating a test according to the receiving device and the transmitting device processing the test image packet. The time required to output the images respectively is to detect the first image processing capability and the second image processing capability. The method for adjusting position information according to claim 9 of the patent application, further comprising determining a compression ratio of the image packet according to a bandwidth required for transmitting the image data and a preset bandwidth of the wireless network used.