CN108667936A - Data processing method, terminal, mobile edge computing server and storage medium - Google Patents

Abstract

The invention discloses a data processing method, a terminal, a Mobile Edge Computing (MEC) server and a computer storage medium, wherein the method comprises the following steps: carrying out image processing on the acquired three-dimensional video data by an image processor (GPU) of the terminal to obtain an image processing result; the GPU sends the image processing result to a baseband chip (BB); and the BB transmits the image processing result to the MEC server after transmission processing.

Description

Data processing method, terminal, mobile edge computing server and storage medium

technical field

The present invention relates to data processing technology, in particular to a data processing method, a terminal, a Mobile Edge Computing (MEC, Mobile Edge Computing) server, and a computer storage medium.

Background technique

With the continuous development of mobile communication networks, the transmission rate of mobile communication networks has increased rapidly, thus providing strong technical support for the generation and development of 3D video services. In the scenario of end-to-end communication of 3D video data, processing such as data collection, data synthesis, data transmission, and data presentation needs to be performed. If front-end processing and network-side processing are coordinated and divided, efficient processing capability and processing speed can be achieved. However, there is currently no effective solution for this.

Contents of the invention

Embodiments of the present invention provide a data processing method, a terminal, an MEC server, and a computer storage medium, which realize the coordinated division of labor between front-end processing and network-side processing, and can achieve efficient processing capabilities and processing speeds.

A data processing method provided by an embodiment of the present invention, the method includes:

The collected three-dimensional video data is processed by the image processor (GPU) of the terminal to obtain the image processing result;

The GPU sends the image processing result to the baseband chip (BB);

The BB sends the image processing result to the MEC server after transmission processing.

In the above solution, the BB sends the image processing result to the MEC server after transmission processing, including:

The BB modulates the image processing result and then transmits it.

In the above scheme, the method also includes:

The BB demodulates the data returned by the MEC server to obtain the image processing result.

In the above solution, the collected 3D video data is processed by the GPU of the terminal, including:

The GPU performs graphics coding conversion on the 3D video data and performs modeling or compression to obtain an image processing result.

A data processing method provided by an embodiment of the present invention, the method includes:

The MEC server obtains the image processing results transmitted by the BB;

The image processing result is obtained by performing image processing on the GPU.

In the above scheme, the method also includes:

The MEC server operates on the image processing result to decide whether to continue to transmit the image processing result.

In the above solution, the MEC server performs calculations on the image processing results to decide whether to continue to transmit the image processing results, including:

Verifying the image processing result according to the verification parameters;

If the verification is passed, continue to transmit the image processing result; otherwise, output the image processing result as invalid and send it back to the terminal.

In the above solution, the verification parameter includes: at least one of timestamp and tag information.

In the above solution, the invalidation of the output image processing result is fed back to the terminal, including:

Detecting the time period for obtaining the image processing result;

When the time period is the 0-T1 interval, the image processing result corresponding to the 0-T1 interval is invalidated and fed back to the terminal;

The image processing results corresponding to the 0-T1 interval are discarded locally.

A terminal provided by an embodiment of the present invention, the terminal includes an image processing unit and a baseband processing unit; wherein,

The image processing unit is configured to perform image processing on the collected three-dimensional video data to obtain an image processing result, and send the image processing result to the baseband processing unit;

The baseband processing unit is used for:

The image processing result is sent to the MEC server after transmission processing.

In the above scheme, the baseband processing unit is further used for:

The image processing result is modulated and then transmitted.

In the above scheme, the baseband processing unit is further used for:

The data returned by the MEC server is demodulated to obtain the image processing result.

In the above solution, the image processing unit is further used for:

The three-dimensional video data is converted into graphics and then modeled or compressed to obtain an image processing result.

An MEC server provided by an embodiment of the present invention, the MEC server includes:

an acquisition unit, configured to acquire the image processing result transmitted by the BB;

The image processing result is obtained by performing image processing on the GPU.

In the above solution, the MEC server also includes:

The computing unit is configured to perform computation on the image processing result to decide whether to continue to transmit the image processing result.

In the above scheme, the operation unit is further used for:

Verifying the image processing result according to the verification parameters;

If the verification is passed, continue to transmit the image processing result; otherwise, output the image processing result as invalid and send it back to the terminal.

In the above solution, the verification parameter includes: at least one of timestamp and tag information.

In the above scheme, the operation unit is further used for:

Detecting the time period for obtaining the image processing result;

When the time period is the 0-T1 interval, the image processing result corresponding to the 0-T1 interval is invalidated and fed back to the terminal;

The image processing results corresponding to the 0-T1 interval are discarded locally.

A data processing system provided by an embodiment of the present invention, the system includes a GPU, a BB and an MEC server; wherein,

The GPU for:

Perform image processing on the collected 3D video data to obtain image processing results;

Send the image processing result to BB;

The BB is configured to send the image processing result to the MEC server after transmission processing;

The MEC server is configured to perform calculations on the image processing results.

A terminal provided by an embodiment of the present invention, the terminal includes: a processor and a memory for storing a computer program that can run on the processor;

Wherein, when the processor is configured to run the computer program, it executes the steps of the method described in any one of the above solutions.

An MEC server provided by an embodiment of the present invention, the MEC server includes: a processor and a memory for storing a computer program that can run on the processor;

Wherein, when the processor is configured to run the computer program, it executes the steps of the method described in any one of the above solutions.

A computer storage medium according to an embodiment of the present invention is characterized in that a computer program is stored thereon, and when the computer program is executed by a processor, the steps of the method described in any one of the above solutions are implemented.

In the technical solution of the embodiment of the present invention, the collected three-dimensional video data is image-processed by the GPU of the terminal to obtain the image processing result; the GPU sends the image processing result to the BB; the BB performs the image processing result on the After the transmission is processed, it is sent to the MEC server. Since the coordination and division of labor between the front-end processing and the network-side processing is realized, efficient processing capability and processing speed can be achieved.

Description of drawings

Fig. 1 is a system architecture diagram based on the implementation of the method embodiment of the embodiment of the present invention;

Fig. 2 is a schematic flow chart of a method of an embodiment of the present invention;

FIG. 3 is a schematic flow diagram of another method according to an embodiment of the present invention;

FIG. 4 is a schematic flow chart of another method according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a terminal structure-composition according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of the structure and composition of the MEC server according to the embodiment of the present invention;

FIG. 7 is a schematic diagram of another structure of a terminal according to an embodiment of the present invention.

Detailed ways

In order to understand the characteristics and technical contents of the embodiments of the present invention in more detail, the implementation of the embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. The attached drawings are only for reference and description, and are not intended to limit the embodiments of the present invention.

The technical solutions of the embodiments of the present invention can be applied to the scene of end-to-end communication of 3D video data. In the data transmission of end-to-end communication, front-end processing and network-side processing are coordinated and divided. Specifically, the BB and GPU on the terminal side can perform front-end data processing, and the MEC server on the network side can perform calculations. In the end-to-end communication scenario, for data collection, data synthesis, data transmission, and data presentation, etc., through the coordination and division of labor between the front-end processing and the network-side processing, efficient processing capacity and processing speed can be achieved.

FIG. 1 shows the system architecture based on the front-end data processing method of the embodiment of the present invention. As shown in Figure 1, the system may include terminals, base stations, MEC servers, business processing servers, core networks, and the Internet (Internet), etc.; a high-speed channel is established between the MEC server and the business processing servers through the core network to achieve data synchronization.

Taking the application scenario where two terminals interact as shown in Figure 1 as an example, MEC server A is an MEC server deployed close to terminal A (transmitter), and core network A is the core network in the area where terminal A is located; correspondingly, MEC server B is the MEC server deployed near terminal B (the receiving end), and core network B is the core network in the area where terminal B is located; MEC server A and MEC server B can communicate with the service processing server through core network A and core network B respectively Establish high-speed channels for data synchronization.

Among them, after the 3D video data sent by terminal A is transmitted to MEC server A, MEC server A synchronizes the data to the business processing server through core network A; then MEC server B obtains the 3D video data sent by terminal A from the business processing server, and sent to terminal B for presentation.

Here, if terminal B and terminal A realize the transmission through the same MEC server, then terminal B and terminal A directly realize the transmission of 3D video data through one MEC server without the participation of the business processing server. This method is called local return method. Specifically, assume that terminal B and terminal A realize the transmission of 3D video data through MEC server A. After the 3D video data sent by terminal A is transmitted to MEC server A, MEC server A sends the 3D video data to terminal B for presentation.

Here, the terminal can select an evolved base station (eNB) to access a 4G network or a next-generation evolved base station (gNB) to access a 5G network based on network conditions, its own configuration, or its own configured algorithm, so that The eNB is connected to the MEC server through a Long Term Evolution (LTE, Long Term Evolution) access network, so that the gNB is connected to the MEC server through a Next Generation Access Network (NG-RAN).

Here, the MEC server is deployed on the network edge side close to the terminal or data source. The so-called close to the terminal or close to the data source is not only logically located, but also geographically close to the terminal or close to the data source. Different from the main service processing servers deployed in several large cities in the existing mobile communication network, multiple MEC servers can be deployed in one city. For example, if there are many users in an office building, a MEC server can be deployed near the office building.

Among them, the MEC server, as an edge computing gateway with integrated network, computing, storage, and application core capabilities, provides platform support for edge computing including device domain, network domain, data domain, and application domain. It connects various smart devices and sensors, provides intelligent connection and data processing services nearby, and allows different types of applications and data to be processed in the MEC server, realizing real-time business, business intelligence, data aggregation and interoperability, security and privacy protection, etc. Key intelligent services can effectively improve the efficiency of intelligent business decision-making.

In other words: on the edge of the network close to the device or data source, deploy an edge computing gateway that integrates network, computing, storage, and application core capabilities, such as MEC. Provide platform support for edge computing through MEC, including device domain, network domain, data domain and application domain. The edge computing gateway connects various smart devices and sensors, provides intelligent connection and data processing services nearby, and allows different types of applications and data to be processed at the edge of the network to achieve real-time business, business intelligence, data aggregation and interoperability, security and privacy protection, etc. Key intelligent services can effectively improve the efficiency of intelligent business decision-making.

FIG. 2 is a schematic flow diagram of a method in an embodiment of the present invention. The data processing method in the embodiment of the present invention can be applied to a terminal, and the method includes:

Step 101, the collected 3D video data is image-processed by the GPU of the terminal to obtain an image-processing result.

Step 102, the GPU sends the image processing result to BB;

Step 103, the BB sends the image processing result to the MEC server after transmission processing.

In the technical solution of the embodiment of the present invention, through the system architecture of the GPU+BB+MEC server, the collected three-dimensional video data is image-processed by the GPU of the terminal to obtain the image processing result; the GPU sends the image processing result to BB; the BB sends the image processing result to the MEC server after transmission processing. Since the coordination and division of labor between the front-end processing and the network-side processing is realized, efficient processing capability and processing speed can be achieved.

The data processing method in the embodiment of the present invention may be applied to a terminal, and the method may further include: sending at least one piece of data. Specifically, it may be implemented by a BB on the terminal side, and the BB sends at least one piece of data to the GPU on the terminal side. Image processing is performed on the at least one piece of data to obtain an image processing result. Specifically, it may be implemented by a GPU on the terminal side, and the GPU performs image processing on at least one piece of data. The image processing result is output to the MEC server for calculation, so as to decide whether to continue to transmit the image processing result. Specifically, it may be implemented by an MEC server, and the MEC server performs calculations to decide whether to continue to transmit the image processing result.

In the embodiment of the present invention, the terminal may be both a sending end and a receiving end, that is, both sending and receiving functions are available. In terms of the sending function, at least one data is sent; in terms of the receiving function, at least one data is received, and image processing is performed on the at least one data to obtain an image processing result. Specifically, the GPU performs image processing on the at least one data. When the terminal is only the sender, in the end-to-end scenario, the data sender sends at least one piece of data. When the terminal is only the receiving end, in the end-to-end scenario, the data receiving end receives at least one piece of data, performs image processing on the at least one piece of data, and obtains an image processing result. Specifically, the GPU performs image processing on the at least one piece of data. Afterwards, the GPU outputs the image processing result to the MEC server for calculation, so as to decide whether to continue to transmit the image processing result.

In the data transmission of end-to-end communication, front-end processing and network-side processing coordination and division of labor can be composed of three modules: BB+GPU+EC, which is different from the AP solution (in the AP solution, all processing is performed by the AP) . However, in the embodiment of the present invention, the system architecture composed of these three modules is used to coordinate and divide the work. Among them, BB is only responsible for sending and receiving; GPU is only responsible for image processing; other calculations are handed over to EC (such as EC cluster) to perform high-intensity calculations. Through the system architecture composed of these three modules, efficient processing capacity and processing speed are realized, and the advantages of each module are maximized. The AP of the application layer is only responsible for making a coordination announcement to each module when the working mode is turned on in this mode of the embodiment of the present invention. After entering the working mode, the data does not pass through the AP, but is directly carried out between the modules.

In the first embodiment of the present invention, it further includes: the BB transmits the image processing result to the MEC server after transmission processing, including: the BB modulates the image processing result and then transmits it.

In the first embodiment of the present invention, the method further includes: the BB demodulates the data returned by the MEC server to obtain the image processing result.

In the first embodiment of the present invention, it also includes: the collected 3D video data is image-processed by the GPU of the terminal, including: the GPU performs graphics coding conversion on the 3D video data and performs modeling or compression to obtain image processing result.

In an implementation manner of an embodiment of the present invention, the method further includes: before sending the at least one piece of data, obtaining the at least one piece of data after modulating the first original data. In an example of sending processing, the input is a bunch of digital information of 0101000011, which is modulated and sent out.

In an embodiment of the present invention, the method further includes: receiving the at least one piece of data; and obtaining the first original data after demodulating the at least one piece of data. In an example of receiving processing, a bunch of RF signals are received, and after demodulation is completed, a bunch of digital signals of 01001010011 are output and directly transmitted to the GPU.

Both the sending and receiving processing can be handled by the BB. Since the BB itself does not know the type and characteristics of the data, for the BB: the received and sent data is the signal after modulation and demodulation. The baseband chip is the core part of the entire terminal. Taking the terminal as a mobile phone as an example, it is like the host of a computer, and the others are peripherals. The traditional baseband chip is divided into two parts, ABB and DBB. BB in this article is the abbreviation of Baseband.

In an embodiment of the present invention, performing image processing on the at least one piece of data to obtain an image processing result includes: performing graphics coding conversion on the at least one piece of data and then performing modeling or compression to obtain an image processing result. Wherein, outputting the image processing result to the MEC server for calculation includes: outputting the image processing result in a target image mode to the MEC server for calculation.

The image processing can be performed by the GPU, and in this mode of the embodiment of the present invention, a first-in-first-out (FIFO) implementation is adopted. After receiving the digital signal sent by BB, after graphics coding conversion, modeling or compression, the image mode of the target is output. Since the GPU itself is optimized for image graphics calculation, compression, and modeling, it can achieve high-efficiency and low-cost related image calculations. A GPU is a microprocessor that specializes in image computing work on personal computers, workstations, game consoles, and some mobile devices (such as tablets, smartphones, etc.). Its purpose is to convert and drive the display information required by the computer system, provide line scan signals to the display, and control the correct display of the display. It is an important component for connecting the display and the motherboard of the personal computer.

In the computer, FIFO can adopt a first-in-first-out data buffer. The difference between it and ordinary memory is that there is no external read and write address line. The FIFO queue in it follows the traditional sequential execution mechanism, that is, the first-entry instruction Complete and retire first, and then execute the second instruction (the instruction is the program code that the computer responds to the user's operation, which is transparent to the user). For example, when the CPU is too late to respond to all the instructions in a certain period of time, the instructions will be arranged in the FIFO queue. For example, instruction No. 0 enters the queue first, followed by instruction No. 1 and instruction No. 2... When the CPU After the current instruction is completed, the No. 0 instruction will be taken out from the queue and executed first. At this time, the No. 1 instruction will take over the position of the No. 0 instruction. Similarly, the No. 2 instruction, No. 3 instruction... will move forward one Location.

FIG. 3 is a schematic flow diagram of a method in an embodiment of the present invention. The data processing method in the embodiment of the present invention can be applied to an MEC server. The method includes:

Step 201, the MEC server obtains the image processing result transmitted by the BB;

Step 202, the image processing result is obtained by GPU performing image processing.

The data processing method in the embodiment of the present invention can be applied to an MEC server, and the method further includes: acquiring an image processing result, and the image processing result is obtained by executing image processing via a terminal. Specifically, the GPU on the terminal side performs image processing on at least one piece of data sent by the BB on the terminal side to obtain an image processing result. An operation is performed on the image processing result to decide whether to continue to transmit the image processing result. Specifically, the MEC server performs operations on the image processing results to decide whether to continue to transmit the image processing results. Specifically, the image processing result may be verified according to the verification parameter. If the verification is passed, continue to transmit the image processing result; otherwise, output the image processing result as invalid and send it back to the terminal.

In an implementation manner of an embodiment of the present invention, the verification parameter includes: at least one of a time stamp and label information. For example, the MEC server may perform operations on the image processing result according to the time stamp and tag information to decide whether to continue to transmit the image processing result.

In the first implementation manner of the embodiment of the present invention, the feeding back of the invalid output image processing result to the terminal includes: detecting a time period for obtaining the image processing result. When the time period is the 0-T1 interval, the image processing result corresponding to the 0-T1 interval is invalidated and fed back to the terminal. The image processing results corresponding to the 0-T1 interval are discarded locally.

In the embodiment of the present invention, the MEC server has powerful computing capabilities and comprehensive information. After receiving the image file output by the GPU during the time period "0-T1", it corrects the image according to the timestamp and tag information. If the verification is passed, continue to transmit and process the image processing result; if the verification is not passed, then feed back to the front unit (such as the terminal) The data transmitted during the period "0-T1" is invalid, and discard this period at the same time The time the image message was received.

In addition, for MEC, the MEC server, as a mobile edge processor, can be deployed close to end users. Its physical location is usually between the base station and the nearest gateway. Used to act as a content server for users. It can be deployed in the form of clusters, for example, MEC1-main server-MEC2, in the form of MEC clusters and MEC servers, a local area network is formed between them through a virtual high-speed tunnel to achieve high-speed synchronization of each cluster. The physical connection method may be through a dedicated network, or through the leased operator's network and still go through EPC, or other ways. However, the synchronization between MEC clusters and MEC servers must ensure low latency and high reliability. These are technical indicators during design and deployment, and engineering implementation must be achieved, otherwise it is meaningless to put it into use. After the local terminal collects the data, it is transmitted to the nearest MEC through the high-speed access network, and the basic verification (such as verification of the image processing results obtained by GPU processing) and image compression are completed through the MEC. The purpose of compression is to reduce the volume while ensuring a certain graphic image quality. For example, in MEC1-main server-MEC2, MEC1 is responsible for image verification and image compression. After the compression is completed, the data is synthesized and the model is established according to the algorithm, and finally the target graphic image is output, and communicated with other MEC2, MEC3, .......MECn etc. synchronization. After the transmission is complete, MEC-n decompresses locally.

A data processing method according to an embodiment of the present invention is applied to a system architecture comprising a front-end terminal and a back-end server, as shown in FIG. 4 , including:

In step 301, the GPU performs image processing on the collected 3D video data to obtain an image processing result.

Step 302. Send the image processing result to the BB.

In step 303, the BB sends the image processing result to the MEC server after transmission processing.

Step 304, the MEC server performs calculations on the image processing results.

A data processing method according to an embodiment of the present invention is applied to a system architecture composed of a front-end terminal and a back-end server, and includes: a baseband chip sending at least one piece of data to an image processor. The image processor performs image processing on the at least one piece of data to obtain an image processing result. The image processor outputs the image processing result to the MEC server. The MEC server performs an operation on the image processing result to decide whether to continue to transmit the image processing result.

A data processing system according to an embodiment of the present invention, the system includes a GPU, a BB, and an MEC server; wherein, the GPU is used to: perform image processing on the collected three-dimensional video data to obtain an image processing result; The processing result is sent to the BB; the BB is configured to transmit the image processing result and send it to the MEC server; the MEC server is configured to perform calculations on the image processing result.

A terminal according to an embodiment of the present invention, as shown in FIG. 5 , the terminal includes a baseband processing unit 401 and an image processing unit 402; wherein the image processing unit 402 is configured to perform image processing on the collected three-dimensional video data to obtain an image Processing results, sending the image processing results to the baseband processing unit. The baseband processing unit 401 is configured to transmit the image processing result to the MEC server after transmission processing.

In an implementation manner of the embodiment of the present invention, the baseband processing unit is further configured to: transmit the image processing result after modulation.

In an embodiment of the present invention, the baseband processing unit is further configured to: demodulate the data returned by the MEC server to obtain the image processing result.

In an implementation manner of the embodiment of the present invention, the image processing unit is further configured to: model or compress the 3D video data after graphics coding conversion, to obtain an image processing result.

A terminal according to an embodiment of the present invention includes a baseband processing unit and an image processing unit, wherein the baseband processing unit is configured to send at least one piece of data, and the baseband processing unit is not limited to BB. An image processing unit, configured to perform image processing on the at least one data to obtain an image processing result; output the image processing result to the MEC server for calculation to decide whether to continue to transmit the image processing result, the image processing unit is not limited to GPU.

In an implementation manner of the embodiments of the present invention, the terminal further includes: a modulating unit, configured to modulate the first original data to obtain the at least one piece of data.

In an implementation manner of the embodiments of the present invention, the terminal further includes: a receiving unit configured to: receive the at least one piece of data; and obtain first original data after demodulating the at least one piece of data.

In an implementation manner of the embodiments of the present invention, the image processing unit is further configured to perform modeling or compression on the at least one piece of data after graphics coding conversion to obtain an image processing result.

In an implementation manner of the embodiments of the present invention, the image processing unit is further configured to: output the image processing result to the MEC server in a target image mode for calculation.

An MEC server according to an embodiment of the present invention, as shown in FIG. 6, the MEC server includes an acquisition unit 501 and a computing unit 502; the acquisition unit 501 is used to acquire the image processing result transmitted by the baseband chip BB; the image processing The result is obtained by image processing performed by the image processor GPU. The computing unit 502 is used for computing the image processing result to decide whether to continue to transmit the image processing result.

An MEC server according to an embodiment of the present invention includes an acquisition unit and an operation unit, wherein the acquisition unit is used to obtain an image processing result obtained by performing image processing via a terminal; the operation unit is used to perform the image processing on the An operation is performed on the image processing result to decide whether to continue to transmit the image processing result.

In an implementation manner of the embodiments of the present invention, the computing unit is further configured to: verify the image processing result according to the verification parameters; if the verification is passed, continue to transmit the image processing result; otherwise, output The image processing result is invalidated and fed back to the terminal.

In an implementation manner of an embodiment of the present invention, the verification parameter includes: at least one of a time stamp and tag information.

In an implementation manner of the embodiment of the present invention, the computing unit is further configured to: detect the time period for obtaining the image processing result; when the time period is the 0-T1 interval, it will correspond to the The image processing result is invalidated and fed back to the terminal; the image processing result corresponding to the 0-T1 interval is discarded locally.

A terminal according to an embodiment of the present invention, the terminal includes: a processor and a memory for storing a computer program that can run on the processor; wherein, when the processor is used to run the computer program, execute the above-mentioned embodiment The step of any described method.

An MEC server according to an embodiment of the present invention, the MEC server includes: a processor and a memory for storing a computer program that can run on the processor; wherein, when the processor is used to run the computer program, execute the above-mentioned The steps of the method described in any one of the embodiments.

A computer storage medium according to an embodiment of the present invention is characterized in that a computer program is stored thereon, and when the computer program is executed by a processor, it is applied to any one of the terminal method embodiment and the MEC server method embodiment. method steps.

The above-mentioned terminals or MEC servers in the embodiments of the present invention all include: a processor and a memory for storing a computer program that can run on the processor. Taking a terminal as an example, in actual application, as shown in FIG. 7 , a processor 61 and a memory 62 are coupled together through a bus system 63 . It can be understood that the bus system 63 is used to realize connection and communication between these components. In addition to the data bus, the bus system 63 also includes a power bus, a control bus and a status signal bus. However, the various buses are labeled as bus system 63 in FIG. 7 for clarity of illustration.

A computer storage medium according to an embodiment of the present invention stores a computer program thereon, and when the computer program is executed by a processor, the steps of the method described in any one of the above embodiments are implemented. For example, FIG. 7 includes a memory 62 of a computer program. Taking a terminal as an example, the above computer program can be executed by the processor 61 of the terminal to complete the steps described in the foregoing method. The computer-readable storage medium can be a magnetic random access memory (FRAM, ferromagnetic random access memory), a read-only memory (ROM, Read Only Memory), a programmable read-only memory (PROM, Programmable Read-Only Memory), an erasable Programmable Read-Only Memory (EPROM, Erasable Programmable Read-Only Memory), Electrically Erasable Programmable Read-Only Memory (EEPROM, ElectricallyErasable Programmable Read-Only Memory), Flash Memory (Flash Memory), Magnetic Surface Memory, CD-ROM, or Read CD-ROM (CD-ROM, Compact Disc Read-Only Memory) and other memory.

It should be noted that when the terminal provided in the above embodiment performs the data processing method, it only uses the division of the above program modules for illustration. The internal structure of the device is divided into different program modules to complete all or part of the processing described above. In addition, the processing logic of each program module in the terminal provided by the above embodiments belongs to the same idea as the data processing method embodiment, and its specific implementation process is detailed in the method embodiment, and will not be repeated here.

The technical solutions described in the embodiments of the present invention may be combined arbitrarily if there is no conflict.

In the several embodiments provided by the present invention, it should be understood that the disclosed methods and smart devices can be implemented in other ways. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or May be integrated into another system, or some features may be ignored, or not implemented. In addition, the coupling, or direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical or other forms of.

The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units; Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be fully integrated into a second processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; The above-mentioned integrated units can be implemented in the form of hardware, or in the form of hardware plus software functional units.

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention.

Claims (22)

1. A method of data processing, the method comprising:

carrying out image processing on the acquired three-dimensional video data by an image processor GPU of the terminal to obtain an image processing result;

the GPU sends the image processing result to a baseband chip BB;

and the BB transmits the image processing result to a mobile edge computing MEC server after transmission processing.

2. The method of claim 1, wherein the BB transmits the image processing result to an MEC server after performing transmission processing, and the method comprises:

and the BB modulates and transmits the image processing result.

3. The method according to claim 1 or 2, characterized in that the method further comprises:

and the BB demodulates the data returned by the MEC server to obtain the image processing result.

4. The method according to claim 1 or 2, wherein the acquired three-dimensional video data is subjected to image processing by a GPU of the terminal, comprising:

and the GPU carries out modeling or compression after carrying out graphic coding conversion on the three-dimensional video data to obtain an image processing result.

5. A method of data processing, the method comprising:

the mobile edge computing MEC server obtains an image processing result transmitted by a baseband chip BB;

and the image processing result is obtained by executing image processing by an image processor GPU.

6. The method of claim 5, further comprising:

and the MEC server operates the image processing result to decide whether to continuously transmit the image processing result.

7. The method of claim 6, wherein the MEC server operates on the image processing result to decide whether to continue to transmit the image processing result, comprising:

verifying the image processing result according to the verification parameters;

if the verification is passed, continuing to transmit the image processing result; otherwise, outputting the image processing result which is useless and feeding back to the terminal.

8. The method of claim 7, wherein the verification parameters comprise: at least one of a timestamp and tag information.

9. The method of claim 7, wherein outputting the image processing result as a void feedback to the terminal comprises:

detecting a time period for acquiring the image processing result;

when the time period is 0-T1, the image processing result corresponding to the 0-T1 interval is discarded and fed back to the terminal;

the image processing results corresponding to the interval 0-T1 are discarded locally.

10. A terminal, characterized in that the terminal comprises an image processing unit and a baseband processing unit; wherein,

the image processing unit is used for carrying out image processing on the acquired three-dimensional video data to obtain an image processing result and sending the image processing result to the baseband processing unit;

the baseband processing unit is configured to:

and transmitting the image processing result to a mobile edge computing MEC server after transmission processing.

11. The terminal of claim 10, wherein the baseband processing unit is further configured to:

and modulating and transmitting the image processing result.

12. The terminal according to claim 10 or 11, wherein the baseband processing unit is further configured to:

and demodulating the data returned by the MEC server to obtain the image processing result.

13. The terminal according to claim 10 or 11, wherein the image processing unit is further configured to:

and modeling or compressing the three-dimensional video data after performing graphic coding conversion to obtain an image processing result.

14. A mobile edge computing, MEC, server, the MEC server comprising:

an acquisition unit configured to acquire an image processing result transmitted by a baseband chip BB;

and the image processing result is obtained by executing image processing by an image processor GPU.

15. The MEC server of claim 14, wherein the MEC server further comprises:

and the operation unit is used for operating the image processing result so as to decide whether to continuously transmit the image processing result.

16. The MEC server according to claim 15, wherein the arithmetic unit is further configured to:

verifying the image processing result according to the verification parameters;

if the verification is passed, continuing to transmit the image processing result; otherwise, outputting the image processing result which is useless and feeding back to the terminal.

17. The MEC server of claim 16, wherein the verification parameters include: at least one of a timestamp and tag information.

18. The MEC server according to claim 16, wherein the arithmetic unit is further configured to:

detecting a time period for acquiring the image processing result;

when the time period is 0-T1, the image processing result corresponding to the 0-T1 interval is discarded and fed back to the terminal;

the image processing results corresponding to the interval 0-T1 are discarded locally.

19. A data processing system, characterized in that the system comprises an image processor GPU, a baseband chip BB and a mobile edge computing MEC server; wherein,

the GPU is used for:

carrying out image processing on the acquired three-dimensional video data to obtain an image processing result;

sending the image processing result to BB;

the BB is used for transmitting the image processing result to the MEC server after transmission processing;

and the MEC server is used for calculating the image processing result.

20. A terminal, characterized in that the terminal comprises: a processor and a memory for storing a computer program capable of running on the processor;

wherein the processor is adapted to perform the steps of the method of any one of claims 1 to 4 when running the computer program.

21. A mobile edge computing, MEC, server, the MEC server comprising: a processor and a memory for storing a computer program capable of running on the processor;

wherein the processor is adapted to perform the steps of the method of any one of claims 5 to 9 when running the computer program.

22. A computer storage medium, having a computer program stored thereon, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 4, 5 to 9.