WO2025031457A1 - Video transmission processing module, apparatus, acquisition system and injection system - Google Patents

Abstract

Disclosed in the present application are a video transmission processing module, an apparatus, an acquisition system, and an injection system. The video transmission processing module comprises a multiplexing circuit. When being used to implement first-type uses, the multiplexing circuit acquires a video signal of video data acquired in real time, and feeds back the video data acquired in real time to a target device which is not a controller, the video data acquired in real time being from a video acquisition device. When being used to implement second-type uses, the multiplexing circuit acquires video data not acquired in real time, and outputs a video signal of the video data not acquired in real time, so as to inject into a first controller the video data not acquired in real time, the video data not acquired in real time being from an information source device. The technical solution of the present application aims to use the multiplexing circuit to enable the video transmission processing module to have both an acquisition function and an injection function, thereby improving the functional compatibility of the video transmission processing module.

Description

Video transmission processing module, device, acquisition system and injection system

This application claims priority to the following Chinese patent applications, the entire contents of which are incorporated herein by reference.

1. A Chinese patent application was submitted to the China Patent Office on August 8, 2023, with application number 202322128558.5 and utility model name "Circuit board, video transmission device and video processing system".

2. A Chinese patent application submitted to the China Patent Office on August 8, 2023, with application number 202310994960.3 and invention name “Video Data Transmission Device and System”.

3. A Chinese patent application submitted to the China Patent Office on August 8, 2023, with application number 202310995916.4 and invention name “Multi-circuit board video processing device and system”.

4. A Chinese patent application submitted to the China Patent Office on August 8, 2023, with application number 202310999012.9 and invention name "Video acquisition injection device, system, vehicle and re-injection equipment".

Technical Field

The present application relates to the field of controller development, and in particular to a video transmission processing module, device, acquisition system and injection system.

Background Art

At present, in the process of developing a controller (such as a domain controller equipped with an autonomous driving algorithm), the controller needs to be trained and verified. Therefore, it is necessary to inject various video signals into the controller through a video transmission processing device. The applicant has found that the existing video transmission processing device can only inject the input data and has a relatively simple function.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a video transmission processing module, device, acquisition system and injection system to solve the problem that the existing video transmission processing device can only inject video data into a controller and has relatively single functions.

The technical solution of this application is as follows:

In a first aspect, an embodiment of the present application provides a video transmission processing module, wherein the video transmission processing module includes a multiplexing circuit, wherein the multiplexing circuit is used to:

When used for the first type of purpose, a video signal of real-time collected video data is obtained, and the real-time collected video data is fed back to a target device other than the controller, the real-time collected video data originating from the video collection device;

When used for the second purpose, non-real-time video data is acquired, and the non-real-time video data is injected into the first controller by outputting a video signal of the non-real-time video data, wherein the non-real-time video data comes from a power source device.

In a second aspect, an embodiment of the present application further provides a device, the device comprising the above-mentioned video transmission processing module, the multiplexing circuit of the video transmission processing module is arranged on a main board, the device further comprising a collection input unit and a plurality of output units detachably connected to the main board;

The acquisition input unit is used to, when connecting the mainboard and the video acquisition device, receive a first signal of real-time acquisition video data from the video acquisition device, deserialize the first signal into a first video signal, and then transmit the first video signal to the multiplexing circuit, so that the multiplexing circuit performs the first type of purpose;

At least one output unit among the plurality of output units can be used as an injection output unit;

The injection output unit is used to receive the second video signal of the non-real-time acquired video data output by the multiplexing circuit by executing the second type of purpose when connecting the main board and the first controller, and after serializing the second video signal into a second signal, transmit the second signal to the first controller.

In a third aspect, an embodiment of the present application further provides an acquisition system, which includes the above-mentioned video transmission processing module, the target device, and the video acquisition device.

In a fourth aspect, an embodiment of the present application further provides a collection system, which includes the above-mentioned apparatus, the target device, and the video collection device.

In a fifth aspect, an embodiment of the present application further provides an injection system, which includes the above-mentioned video transmission processing module and the source device.

In a sixth aspect, an embodiment of the present application further provides an injection system, which includes the above-mentioned apparatus and the source device.

Beneficial Effects

The beneficial effect of the present application is that the present application adopts a multiplexing circuit to enable the video transmission processing module to be compatible with both injection and acquisition functions. When the multiplexing circuit accesses the non-real-time video data provided by the source device, the non-real-time acquisition video data can be injected into the controller to achieve training or verification of the controller, and when the video acquisition device is accessed, the accessed real-time acquisition video data can be acquired, so that the real-time acquisition video data can be supplied to the target device other than the controller, so that the acquired real-time acquisition video data can be stored, further analyzed or displayed.

BRIEF DESCRIPTION OF THE DRAWINGS

The technical solution and other beneficial effects of the present application will be made apparent by describing in detail the specific implementation methods of the present application in conjunction with the accompanying drawings.

FIG1 is a schematic diagram of a connection structure of a video transmission processing module in an embodiment of the present application;

FIG2 is a schematic diagram of a connection structure when the multiplexing circuit in the embodiment of the present application is used for the first type of purpose;

FIG3 is a schematic diagram of a connection structure when the multiplexing circuit of the video transmission processing module in the embodiment of the present application is used for the second type of purpose;

FIG4 is a schematic diagram of a connection structure when the multiplexing circuit in the embodiment of the present application is used for a second purpose;

FIG5 is a schematic diagram of a structure of a multiplexing circuit in an embodiment of the present application;

FIG6 is a schematic diagram of a flow direction of real-time video data acquisition in an embodiment of the present application;

FIG7 is another schematic diagram of the flow of real-time video data acquisition in an embodiment of the present application;

FIG8 is another schematic diagram of the structure of the multiplexing circuit in the embodiment of the present application;

FIG9 is a flow diagram of non-real-time video data acquisition in an embodiment of the present application;

FIG10 is another schematic diagram of the structure of the multiplexing circuit in the embodiment of the present application;

FIG11 is a schematic diagram of another structure of the multiplexing circuit in the embodiment of the present application;

FIG12 is another schematic diagram of the flow of non-real-time video data acquisition in an embodiment of the present application;

FIG13 is a schematic diagram of a structure of a video transmission processing module in an embodiment of the present application;

FIG14 is another schematic diagram of the structure of the video transmission processing module in an embodiment of the present application;

FIG15 is a schematic diagram of a structure of a device in an embodiment of the present application;

FIG16 is another schematic diagram of the structure of the device in the embodiment of the present application;

FIG17 is another schematic diagram of the structure of the device in the embodiment of the present application;

FIG18 is a schematic diagram of a circuit structure of a power consumption simulation circuit in an embodiment of the present application;

FIG19 is another schematic diagram of the structure of the device in the embodiment of the present application;

FIG. 20 is a schematic diagram of a circuit structure of a signal synchronization module in an embodiment of the present application.

Description of Figure Numbers:

Label name Label name 100 Motherboard 1402 Injection Input Unit 110 Multiplexing circuit 1501 Injection output unit 111 Data Access Department 1502 The first acquisition output unit 112 Selection Department 1503 Second acquisition output unit 113 Data Processing Department 160 Power consumption simulation circuit 114 Data output unit 170 The first temperature sensor module 115 Configuration Department 180 Second temperature sensing module 116 Cache 190 Signal synchronization module 117 Control Department 200 Video capture equipment 1201 First computer bus interface 300 Source equipment 1202 Second computer bus interface 310 Second computer 1301 First video interface 320 Industrial Computer 1302 Second video interface 400 Target devices 1303 Third video interface 410 First Computer 1304 Fourth video interface 420 Processing equipment 1305 Fifth video interface 500 First Controller 1401 Acquisition input unit 600 Second controller

Embodiments of the present invention

The specific structural and functional details disclosed herein are merely representative and are for the purpose of describing exemplary embodiments of the present application. However, the present application can be implemented in many alternative forms and should not be interpreted as being limited to only the embodiments set forth herein.

In the description of the present application, it should be understood that the terms "center", "lateral", "up", "down", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, which are only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present application, unless otherwise specified, "multiple" means two or more. In addition, the term "including" and any variation thereof are intended to cover non-exclusive inclusions.

In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a supporting connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

The terms used herein are only for describing specific embodiments and are not intended to limit exemplary embodiments. Unless the context clearly indicates otherwise, the singular forms "one", "one" and "item" used herein are also intended to include plural numbers. It should also be understood that the terms "include" and/or "comprise" used herein specify the existence of stated features, integers, steps, operations, units and/or components, without excluding the existence or addition of one or more other features, integers, steps, operations, units, components and/or combinations thereof.

The present application is further described below in conjunction with the accompanying drawings and embodiments.

The present application proposes a video transmission processing module.

1 , in one embodiment, the video transmission processing module includes a multiplexing circuit 110, and the multiplexing circuit 110 can be used to:

When used for the first purpose, a video signal of real-time collected video data of the video acquisition device 200 is obtained, and the real-time collected video data is fed back to the target device 400 which is not the controller.

When used for the second purpose, non-real-time collected video data from the power source device 300 is obtained, and the non-real-time collected video data is injected into the first controller 500 by outputting a video signal of the non-real-time collected video data.

In the embodiment of the present application, the first purpose of the multiplexing circuit 110 can be understood as being used for acquisition, and the so-called acquisition can be understood as the need to provide real-time acquired video data to the target device 400. The multiplexing circuit 110 can acquire the real-time acquired video data from the video acquisition device 200 frame by frame, and then feed the acquired real-time acquired video data back to the target device 400.

The second use of the multiplexing circuit 110 can be understood as being used for injection. The so-called injection can be understood as the need to send the non-real-time collected video data to the first controller 500 in the form of a video signal.

In the embodiment of the present application, the first controller 500 may be a domain controller for a vehicle, or a controller for aerospace, electric power and other fields, which may be determined according to the actual application scenario and is not limited here; taking the domain controller of a vehicle as an example, the first controller 500 may be a domain controller in the training or verification stage, and non-real-time video data needs to be injected to realize the training or verification of the algorithm;

The target device 400 may include information processing devices such as PCs, analysis devices such as video analyzers, data recorders dedicated to data collection and disk storage, data collection workstations, etc.;

The video acquisition device 200 may include a camera, a still camera, etc.;

The source device 300 may include an industrial computer, a board, a computer, etc.

It is understandable that the video signal of the above-mentioned real-time video data acquisition can be a Gigabit Multimedia Serial Links (GMSL) signal directly output by the video acquisition device 200, or a Mobile Industry Processor Interface (MIPI) signal obtained after deserialization of the GMSL signal, or a Digital Video Port (DVP) signal or a Low Voltage Differential Signaling (LVDS) signal. The real-time video data acquisition is usually the real data acquired by the video acquisition device 200.

Similarly, the video signal of the above-mentioned non-real-time video data acquisition can be a MIPI signal directly output by the source device 300, or a DVP signal or a LVDS signal, or a GMSL signal obtained by adding a string to a MIPI signal, a DVP signal, a LVDS signal, etc. The non-real-time video data acquisition can be real data or simulated video data.

In addition, if used for the second type of purpose, the video signal of the non-real-time acquisition video data output by the multiplexing circuit 110 and the signal finally injected into the first controller 500 may be the same, and then the multiplexing circuit 110 can directly inject the video signal into the first controller 500 through the corresponding interface. Of course, the video signal of the non-real-time acquisition video data output by the multiplexing circuit 110 and the signal finally injected into the first controller 500 may also be different, for example, the signal finally injected into the first controller 500 is a signal obtained by adding a string to the video signal of the non-real-time acquisition video data output by the multiplexing circuit 110.

In this embodiment, the multiplexing circuit 110 may obtain the non-real-time collected video data by receiving a video signal of the non-real-time collected video data, or may receive the non-real-time collected video data in a non-video signal manner.

If used for the first type of purpose, the multiplexing circuit 110 can output the real-time collected video data by outputting a video signal of the real-time collected video data, or can output the real-time collected video data in a non-video signal manner. If it is implemented by a video signal, then the video signal of the real-time collected video data outputted and the video signal finally given to the target device 400 can be the same. It can be understood that the video signal of the real-time collected video data outputted by the multiplexing circuit 110 and the signal finally given to the target device 400 can also be different. For example, after the multiplexing circuit 110 outputs the video signal of the real-time collected video data, the video signal is sent to the target device 400 after being string-added. The multiplexing circuit 110 can also share the real-time collected video data to the target device 400 in a non-video signal manner.

In this embodiment, the video signal of the real-time video data acquired by the multiplexing circuit 110 may be the same as the signal output by the video acquisition device 200. In some embodiments, the video signal of the real-time video data acquired by the multiplexing circuit 110 may be different from the signal output by the video acquisition device 200. For example, the video signal of the real-time video data acquired by the multiplexing circuit 110 may be the signal obtained after deserializing the signal output by the video acquisition device 200.

It can be understood that the real-time video data and non-real-time video data involved in this application may refer to the video data itself, which can be transmitted, shared, input, output, etc. in different forms (such as forms specified by different communication protocols), thereby forming different signals to realize data transmission.

The present application uses a multiplexing circuit 110 to multiplex the video transmission processing module, so that the video transmission processing device that can only perform non-real-time acquisition video data injection can be compatible with both injection and acquisition functions. When the multiplexing circuit 110 is connected to the source device 300, it can inject the non-real-time acquisition video data output by the source device 300 into the first controller 500 to achieve training or verification of the first controller 500. When the multiplexing circuit 110 is connected to the video acquisition device 200, it can output the real-time acquisition video data from the video acquisition device 200 according to the type of the target device 400 connected, so that the collected real-time acquisition video data can be stored, displayed or further analyzed. Therefore, the video transmission processing module can also be understood as a video acquisition injection module. Specifically, referring to FIG. 1 , when the staff uses the video transmission processing module, if it is necessary to train or verify the first controller 500, the source device 300 such as an industrial computer and a board card can be connected to the input end of the multiplexing circuit 110, and the function of the multiplexing circuit 110 is set to achieve the second type of use. At this time, the multiplexing circuit 110 will inject the non-real-time collected video data that is connected, and the specific injection method can be configured according to user needs;

If the real-time video data collected by the video acquisition device 200 needs to be further processed, such as analysis, storage or display, the video acquisition device 200 such as a camera can be connected to the input end of the multiplexing circuit 110, and the target device 400 such as a PC and a video analyzer can be connected to the output end of the multiplexing circuit 110, and the function of the multiplexing circuit 110 can be set to achieve the first type of purpose. At this time, the multiplexing circuit 110 can output the connected real-time collected video data, and the specific output method can be configured according to user needs.

The present application multiplexes the video transmission processing module by using a multiplexing circuit 110, so that the video transmission processing module can be compatible with both injection and acquisition functions. When the multiplexing circuit 110 is connected to the source device 300, it can inject the non-real-time acquisition video data output by the source device 300 into the controller to achieve training or verification of the controller, and when it is connected to the video acquisition device 200, it can output the real-time acquisition video data, so that the collected real-time acquisition video data can be stored, further analyzed or displayed.

2 , in one embodiment, the first type of use may include at least one of a first use and a second use, and the multiplexing circuit 110 may be specifically used for:

When used for the first purpose, the real-time collected video data is fed back to the first computer 410 as the target device 400 through the first computer bus interface 1201;

When used for the second purpose, the real-time collected video data is output through the first video interface 1301 so that the real-time collected video data is fed back to the processing device 420 as the target device 400 .

In the embodiment of the present application, the first computer bus interface 1201 may include a card slot, a PCIe interface, etc.; the first video interface 1301 may include a High Definition Multimedia Interface (HDMI), a MIPI interface, a Video Graphics Array (VGA) interface, a DVP interface, a LVDS interface, etc. The number and type of the first video interfaces 1301 selected for use may be configured according to demand. For example, if one channel of video data is to be output, the number of the first video interfaces 1301 may be one; if multiple channels of video data are to be output, the number of the first video interfaces 1301 may be multiple.

When using the video transmission processing module, the staff can connect the video acquisition device 200 to the input end of the multiplexing circuit 110. Taking the video acquisition device 200 including a camera as an example, in one embodiment, when the video data acquired by the camera needs to be stored on a disk, the first computer 410 can be connected to the multiplexing circuit 110 through the first computer bus interface 1201 (for example, a PCIe interface), or it can be understood as plugging the PCIe interface of the video transmission processing module into the PCIe slot of the first computer 410, and setting the multiplexing circuit 110 for the first purpose (for example, setting the multiplexing circuit 110 to be in a first acquisition state). At this time, if real-time acquired video data is input into the multiplexing circuit 110, it will be output to the first computer 410 by the multiplexing circuit 110, so that the acquired real-time acquired video data is stored in the first computer 410.

In another embodiment, the video signal can be output through the first video interface 1301, for example, it can be used to further analyze the video data collected by the camera, and then, the video signal or the signal after the video signal is processed (for example, string processing) can be transmitted to the processing device 420 (for example, a video analyzer), and the multiplexing circuit 110 is set for a second purpose (for example, the multiplexing circuit 110 is set in a second acquisition state). At this time, if real-time collected video data is input into the multiplexing circuit 110, it will be output to the processing device 420 by the multiplexing circuit 110, so as to further analyze the collected real-time collected video data.

The multiplexing circuit 110 and the video capture device 200 may be directly connected or connected via other circuits (such as a capture input unit). The first video interface 1301 and the processing device 420 may be directly connected or connected via other circuits (such as a capture output unit).

Referring to FIG. 3 , in one embodiment, the second type of use may include at least one of the third use and the fourth use, and the multiplexing circuit 110 may be specifically used for:

When used for the third purpose, the non-real-time collected video data is obtained from the second computer 310 as the source device 300 through the second computer bus interface 1202;

When used for the fourth purpose, non-real-time collected video data is obtained from the industrial computer 320 as the source device 300 through the second video interface 1302 .

In the embodiment of the present application, the second computer bus interface 1202 may include a card slot, a PCIe interface, etc.; the second video interface 1302 may include an HDMI interface, a MIPI interface, a VAG interface, a DVP interface, an LVDS interface, etc. The number and type of the second video interface 1302 selected for use may be configured according to demand. For example, if one channel of video data is to be accessed, the number of the second video interface 1302 may be one; if multiple channels of video data are to be accessed, the number of the second video interface 1302 may be multiple.

When using the video transmission processing module, the staff can connect the source device 300 to the input end of the multiplexing circuit 110 and connect the first controller 500 to the output end of the multiplexing circuit 110. In one embodiment, when the source device 300 is the second computer 310, the connection between the second computer 310 and the multiplexing circuit 110 can be achieved through the second computer bus interface 1202, such as the PCIe interface, or it can be understood as plugging the PCIe interface of the video transmission processing module into the PCIe slot of the second computer 310, and setting the multiplexing circuit 110 for a third purpose (for example, setting the multiplexing circuit 110 to be in the first injection state). At this time, the non-real-time acquisition video data output by the second computer 310 will be injected into the first controller 500 frame by frame.

In another embodiment, when the source device 300 is an industrial computer 320, the industrial computer 320 can be connected to the input end of the multiplexing circuit 110 through the second video interface 1302, and the multiplexing circuit 110 can be set for a fourth purpose (for example, the multiplexing circuit 110 is set to a second injection state). At this time, the non-real-time acquisition video data output by the industrial computer 320 will be injected into the first controller 500 frame by frame through the video transmission processing module.

The second video interface 1302 and the source device 300 may be directly connected or connected via other circuits (such as an injection input unit). The multiplexing circuit 110 and the first controller 500 may be directly connected or connected via other circuits (such as an injection output unit).

4 , in one embodiment, the multiplexing circuit 110 may also be used to output the real-time collected video data through the fifth video interface 1305 when used for the second purpose, so that the real-time collected video data is fed back to the second controller 600 .

In the embodiment of the present application, the second controller 600 is a domain controller installed in a vehicle for use, and the second controller 600 needs to issue corresponding instructions based on the accessed real-time collected video data.

In some embodiments, the video capture device 200 (such as a camera) itself needs to send video data to the second controller 600. At this time, the output end of the multiplexing circuit 110 needs to be connected to the second controller 600. Therefore, the video signal of the real-time acquired video data input into the multiplexing circuit 110 will be output through the fifth video interface 1305 (such as a MIPI interface). Then, the video signal of the real-time acquired video data can be directly transmitted to the second controller 600, or transmitted to the second controller 600 after being added to the string. At the same time, the real-time acquired video data sent by the video capture device (such as a camera) to the second controller 600 can be bypassed and given to the processing device 420 through the first video interface 1301 for real-time or post-analysis, display, etc.

The fifth video interface 1305 and the second controller 600 may be directly connected or connected via other circuits (eg, a capture and output unit).

5 , in one embodiment, the multiplexing circuit 110 may include a data access unit 111 , a selection unit 112 , a data output unit 114 , and a data processing unit 113 ;

The data access unit 111 can be used to access the real-time collected video data from the third video interface 1303 when used for the first type of purpose; and output the accessed real-time collected video data to the data processing unit 113;

The data processing unit 113 may be used to perform preset processing on the real-time collected video data input to the data access unit 111 and then output it, or to output the real-time collected video data input to the data processing unit 113 (i.e., directly output it without the need for preset processing);

The data output unit 114 may be used to:

When used for the first purpose, the real-time collected video data (after preset processing, or directly transmitted without preset processing) output by the data processing unit 113 is fed back to the first computer 410 as the target device 400 through the first computer bus interface 1201;

When used for the second purpose, the real-time collected video data output by the data processing unit 113 is output through the first video interface 1301 so that the real-time collected video data is fed back to the processing device 420 as the target device 400 .

In the embodiment of the present application, the data output unit 114 may be provided with multiple channels for outputting different channels of video data.

In one embodiment, when the staff uses the video transmission processing module, the real-time collected video data output by the video acquisition device 200, such as a camera, is directly or indirectly transmitted (deserialization may or may not be involved during transmission), such as the real-time collected video data in MIPI format, which is input into the data access unit 111 through the third video interface 1303 (such as a MIPI interface) for data processing or directly transparently transmitted to the selection unit 112. When the data access unit 111 is a single channel, the selection unit 112 directly outputs the accessed real-time collected video data in MIPI format to the data processing unit 113; when there are multiple channels in the data access unit 111, and each channel is connected to one channel of real-time collected video data in MIPI format, the selection unit 112 selects the real-time collected video data in MIPI format that needs to be processed, and outputs the selected real-time collected video data in MIPI format to the data processing unit 113, so as to perform preset processing such as format conversion, frame rate conversion, resolution conversion, non-linear conversion, etc. before output, or directly transparently transmit it out when the preset processing is not required.

As shown in FIG. 6 , in one embodiment, when the video data captured by the video capture device 200 needs to be stored on disk, the multiplexing circuit 110 can be used to perform a first purpose, and the data output unit 114 outputs the processed real-time captured video data to the first computer 410 through the first computer bus interface 1201 such as a PCIe interface for storage on disk.

As shown in FIG. 7 , in another embodiment, when the video data collected by the video acquisition device 200 needs to be further analyzed or displayed, the multiplexing circuit 110 can be used to perform a second purpose, and the data output unit 114 outputs the processed real-time collected video data through the first video interface 1301 (e.g., a MIPI interface), and the processed real-time collected video data is transmitted to a processing device 420 such as a video analyzer or a display device for further analysis or display through direct or indirect transmission (string addition may or may not be involved during transmission).

8 , in one embodiment, the multiplexing circuit 110 may include a data access unit 111 , a selection unit 112 , a data output unit 114 , and a data processing unit 113 ;

The data access unit 111 is used to access the non-real-time collected video data from the second video interface 1302 when used for the fourth purpose; and directly or indirectly output the accessed non-real-time collected video data to the data processing unit 113;

The data processing unit 113 is used to perform preset processing on the non-real-time collected video data input to the data access unit 111 and then output it, or output the non-real-time collected video data input to the data processing unit 113;

The data output unit 114 is used to output the non-real-time video data (after preset processing, or directly passed without preset processing) output by the data processing unit 113 through the fourth video interface 1304 when used for the second purpose, so that the non-real-time video data is injected into the first controller 500.

When the staff uses the video transmission processing module, the source device 300 outputs non-real-time collected video data.

As shown in FIG9 , in one embodiment, when the video transmission processing module is connected to the industrial computer 320, the multiplexing circuit 110 can be used to perform the fourth purpose, and the non-real-time acquisition video data output by the industrial computer 320 will be input into the data access unit 111 through the second video interface 1302 (for example, the MIPI interface) for data processing or directly transparently transmitted to the selection unit 112. When the data access unit 111 is a single channel, the selection unit 112 directly outputs the accessed non-real-time acquisition video data in the MIPI format (that is, the MIPI signal of the non-real-time acquisition video data) to the data processing unit 113; when there are multiple channels in the data access unit 111, and each channel is connected to a non-real-time acquisition video data in the MIPI format, the selection unit 112 selects the non-real-time acquisition video data that needs to be processed. The processed MIPI format video data is selected, and the selected MIPI format non-real-time acquisition video data is output to the data processing unit 113 for output after preset processing such as format conversion, frame rate conversion, resolution conversion, non-linear conversion, or directly transparently transmitted when the preset processing is not required, and the data output unit 114 outputs the processed non-real-time acquisition video data (such as its MIPI signal) through the fourth video interface 1304 (such as the MIPI interface), and then, the non-real-time acquisition video data can be injected into the first controller 500 frame by frame; or, the signal obtained after the MIPI signal is processed by adding strings can be output to the first controller 500, so that the first controller 500 is injected with the non-real-time acquisition video data.

Optionally, the data access unit 111 is provided with a plurality of channels, and when each channel is connected to a non-real-time acquisition video data in MIPI format, the data access unit 111 can align the non-real-time video signal and then output it.

10 , in one embodiment, the multiplexing circuit 110 may include a data output unit 114, and the data output unit 114 may be used to:

When used for the third purpose, the image of the non-real-time acquisition video data is acquired from the second computer 310 as the source device 300 through the second computer bus interface 1202, and the acquired non-real-time acquisition video data is output through the fourth video interface 1304, so that the non-real-time acquisition video data is injected into the first controller 500. For example, the video signal of the non-real-time acquisition video data is directly injected into the first controller 500, or injected into the first controller 500 after being added to the string.

As shown in Figure 10, in this embodiment, when the staff is using the video transmission processing module and the video transmission processing module is connected to the second computer 310, the multiplexing circuit 110 can be used to perform the third purpose, and the non-real-time acquisition video data output by the second computer 310, such as the non-real-time acquisition video data transmitted based on the PCIe protocol, will be directly output to the data output unit 114, and the data output unit 114 will output the input non-real-time acquisition video data through the fourth video interface 1304 (for example, the MIPI interface), and then, the non-real-time acquisition video data can be injected into the first controller 500.

11 , in one embodiment, the multiplexing circuit 110 may include a buffer section 116 and a data output section 114 .

The cache unit 116 may be used, when used for the second purpose, to cache a target image of the non-real-time collected video data, and send the target image to the data output unit 114 based on the time information of the target image;

The data output unit 114 may be configured to output the acquired target image through the fourth video interface 1304 , so that the target image is injected into the first controller 500 .

It should be noted that when injecting non-real-time acquired video data into the first controller 500, the injection may not be based on time information (such as a timestamp), and the data output unit 114 may directly output the received non-real-time acquired video data; or the injection may be based on a timestamp, and the cache unit 116 may send the target image of the non-real-time acquired video data to the data output unit 114 frame by frame based on the timestamp, and the data output unit 114 may then output the acquired target image frame by frame through the fourth video interface 1304 (such as a MIPI interface), so that it is injected into the first controller 500.

12 , the data output unit 114 may also output the non-real-time collected video data to the buffer unit 116 for buffering, and then read the non-real-time collected video data according to the timestamp and inject it into the first controller 500 frame by frame.

In the embodiment of the present application, different channels of the data output unit 114 may be connected to different cache units 116 , or different address intervals of the same cache unit 116 .

When the staff uses the video transmission processing module, the real-time collected video data output by the video acquisition device 200 can also be output based on the timestamp using the cache unit 116. Of course, it can also be output without being based on the timestamp.

13 , in one embodiment, when the real-time collected video data collected by the video acquisition device 200 needs to be stored on a disk, the multiplexing circuit 110 can be used for a first purpose. At this time, the real-time collected video data of the video acquisition device 200 is transmitted to the data access unit 111 by the third video interface 1303 (such as a MIPI interface), and the data output unit 114 caches the processed frames of the real-time collected video data to the cache unit 116, and then reads the image from the cache unit 116 based on a timestamp (or not based on a timestamp), and then outputs it to the first computer 410 through the first computer bus interface 1201 such as a PCIe interface for storage on a disk.

In another embodiment, when the real-time collected video data collected by the video acquisition device 200 needs to be further analyzed or displayed, the multiplexing circuit 110 can be used for a second purpose. At this time, the real-time collected video data of the video acquisition device 200 is transmitted to the data access unit 111 by the third video interface 1303 such as the MIPI interface, and the data output unit 114 caches the processed frame images of the real-time collected video data to the cache unit 116, and then reads the image from the cache unit 116 based on the timestamp (or not based on the timestamp), and then outputs it to the processing device 420 such as the video analyzer and the display device through the first video interface 1301 (such as the MIPI interface) for further analysis or display.

Of course, in other embodiments, when the real-time acquired video data needs to be stored on the disk, the multiplexing circuit 110 can also be used for the second purpose. When the real-time acquired video data needs to be further displayed or analyzed, the multiplexing circuit 110 can also be used for the first purpose. The difference between the first purpose and the second purpose mainly lies in the different ways of outputting the real-time acquired video data, that is, the first purpose refers to the use of the video transmission processing module to output the real-time acquired video data in the form of a video signal; the second purpose refers to the use of the video transmission processing module to output the real-time acquired video data in a non-video signal manner (for example, in a PCIe manner); rather than the real-time acquired video data being sent to the target device for different purposes.

When the staff uses the video transmission processing module, the source device 300 outputs the non-real-time acquisition video data, and when the video transmission processing module is connected to the second computer 310, the multiplexing circuit 110 is used for the third purpose, and the cache unit 116 obtains the non-real-time acquisition video data output by the second computer 310 through the second computer bus interface 1202. In one embodiment, the data output unit 114 can directly read the non-real-time acquisition video data temporarily stored in the cache unit 116, and inject it into the first controller 500 frame by frame through the fourth video interface 1304 such as the MIPI interface based on the timestamp. In another embodiment, the non-real-time acquisition video data temporarily stored in the cache unit 116 is read by the data conversion module, and is output to the data output unit 114 after performing at least one of the preset processing such as format conversion, frame rate conversion, resolution conversion, non-linear conversion, etc., and then the data output unit 114 outputs it frame by frame based on the timestamp, so as to be injected into the first controller 500.

When the video transmission processing module is connected to the industrial computer 320, the multiplexing circuit 110 can be used for a fourth purpose. The industrial computer 320 transmits the non-real-time acquired video data to the data access unit 111 through the second video interface 1302, and the data output unit 114 caches the processed frames of the non-real-time acquired video data to the cache unit 116, and then reads the image from the cache unit 116 based on the timestamp, outputs it through the fourth video interface 1304, and is thus injected into the first controller 500.

Of course, in other embodiments, when the source device 300 is an industrial computer 320, the multiplexing circuit 110 can also be used for the third purpose. When the source device 300 is a second computer 310, the multiplexing circuit 110 can also be used for the fourth purpose. The industrial computer 320 can also be regarded as a computer, and when the computer is used in an embedded system, it can also be regarded as an industrial computer. Therefore, the difference between the third purpose and the fourth purpose mainly lies in the different ways of inputting non-real-time video data, that is, the third purpose refers to the use of the video transmission processing module to access non-real-time video data in the form of video signals; the fourth purpose refers to the use of the video transmission processing module to access non-real-time video data in the form of non-video signals (such as PCIe).

It can be understood that, in this embodiment, the second video interface 1302 and the third video interface 1303 can be the same interface or different interfaces; the first video interface 1301, the fourth video interface 1304 and the fifth video interface 1305 can be the same interface or different interfaces; the first computer bus interface 1201 and the second computer bus interface 1202 can be the same interface or different interfaces, and can be specifically configured according to the actual application scenario, which is not limited here.

Referring to FIGS. 13 and 14 , in one embodiment, the video transmission processing module may further include a configuration unit 115 , which may determine the state of the multiplexing circuit 110 in response to the configuration of at least one of the first computer 410 , the control unit 117 , and the memory;

The first category of use includes at least one of the first use and the second use, and the second category of use includes at least one of the third use and the fourth use;

When the multiplexing circuit 110 is used for the first purpose, it can be in the first acquisition state; when it is used for the second purpose, it can be in the second acquisition state; when it is used for the third purpose, it can be in the first injection state; when it is used for the fourth purpose, it can be in the second injection state.

In an embodiment of the present application, the configuration unit 115 may include an I2C processing unit and at least one register; the I2C processing unit may be used to perform I2C communication with the video acquisition device 200 and the second controller 600 to implement configuration and configuration response of the video acquisition device 200, the second controller 600, etc., and/or, the I2C processing unit may be used to communicate with the PC via PCIe to implement conversion between communication signals in I2C format and communication signals in PCIe format. For example, the I2C processing unit may include an I2C processing module and/or an I2C-PCIe conversion module; the memory may store configuration information, and the register may read it out.

Each module in the data access unit 111 can be configured to work or not through one or more registers.

The selection unit 112 can be configured to work or not and configure the channel to be selected through one or more registers.

Each module in the data processing unit 113 can be configured to convert or transparently transmit input data through one or more registers, and when the data processing unit 113 is configured to convert input data, it is also necessary to configure what kind of conversion and processing to be performed through registers.

Each module in the data output unit 114 can be configured through one or more registers, such as the injection or output of video data, whether bypass output to the processing device 420 or the first computer 410 is required, etc.

When each register configures modules such as the data access unit 111, the selection unit 112, and the data processing unit 113, its configuration data can be output by the first computer 410 and/or the control unit 117. For example, when the device needs to be connected to the first computer 410 and the control unit 117 is not installed in the device, the first computer 410 can configure the registers through the first computer bus interface 1201 (such as a PCIe interface); when the device does not need to be connected to the first computer 410 and the control unit 117 is installed in the device, the control unit 117 can configure each register; when the device needs to be connected to the first computer 410 and the control unit 117 is installed in the device, some registers can be configured by the first computer 410 and some registers can be configured by the control unit 117, or, in some uses, some registers can be configured by the control unit 117 and in some uses, some registers can be configured by the first computer 410.

Among them, the control unit 117 can be a Field Programmable Gate Array (FPGA) IP (Intellectual Property core) core, or it can be an ARM processor; the configuration logic of the register can be automatically implemented by the first computer 410 and/or the control unit 117, or it can be manually defined and given to the first computer 410 and/or the control unit 117.

When the first computer 410 and/or the control unit 117 automatically configures the registers, it can be automatically configured based on the connection status of the first video interface 1301, the second video interface 1302, the third video interface 1303, the fourth video interface 1304, the fifth video interface 1305, the first computer bus interface 1201 and the second computer bus interface 1202, and predefined information, wherein the predefined information includes how the data output unit 114 injects information, how the data processing unit 113 converts information, etc.

These connection conditions can be detected. For example, in one embodiment, each video interface can be connected to a detection circuit, and the detection circuit can detect whether the multiplexing circuit 110 is connected to the corresponding source device 300, the video acquisition device 200 and/or the processing device 420 through a certain video interface. In another embodiment, the I2C processing unit can detect whether the multiplexing circuit 110 is connected to the video acquisition device 200 and/or the processing device 420; whether the multiplexing circuit 110 is connected to the first computer 410 or the second computer 310 can be determined by exchanging corresponding signals based on whether the PCIe connector is connected to the computer bus interface or the PCIe card slot.

Specifically, if it is detected that the third video interface 1303 is directly or indirectly connected to the video acquisition device 200, the first video interface 1301 is not directly or indirectly connected to the processing device 420, and the first computer bus interface 1201 is connected to the first computer 410, it can be considered that the real-time video data acquired by the video acquisition device 200 needs to be output to the disk and stored in the first computer 410. The first computer 410 and/or the control unit 117 can configure each unit and module for the first purpose accordingly. At this time, the multiplexing circuit 110 is in the first acquisition state. The number of channels of each unit and the selection of multiple data by the selection unit 112 can be determined according to the specific connection status of the first computer bus interface 1201.

If it is detected that the third video interface 1303 is directly or indirectly connected to the video acquisition device 200, the first video interface 1301 is directly or indirectly connected to the processing device 420, and the first computer bus interface 1201 is not connected to the first computer 410, it can be considered that the real-time video data collected by the video acquisition device 200 needs to be output to the processing device 420 for further analysis or display. The control unit 117 can configure each unit and module for the second purpose. At this time, the multiplexing circuit 110 is in the second acquisition state. The number of channels of each unit and the selection of multiplexed data by the selection unit 112 can be determined according to the specific connection status of the first video interface 1301.

If it is also detected that the fifth video interface 1305 is directly or indirectly connected to the second controller 600 on this basis, it can be considered that while the real-time video data collected by the video acquisition device 200 is output to the processing device 420 for further analysis or display, the real-time video data is also bypassed and output to the second controller 600. At this time, the control unit 117 can still configure each unit and module for the second purpose, and the multiplexing circuit 110 is in the second acquisition state. The number of channels of each unit and the selection of multiplexed data by the selection unit 112 can be determined according to the specific connection conditions of the first video interface 1301 and the fifth video interface 1305.

If it is detected that the second video interface 1302 is not directly or indirectly connected to the source device 300, the fourth video interface 1304 is directly or indirectly connected to the first controller 500, and the second computer bus interface 1202 is connected to the second computer 310, it can be considered that the non-real-time acquisition video data stored in the second computer 310 needs to be injected into the first controller 500, and the control unit 117 can configure each unit and module for the third purpose. At this time, the multiplexing circuit 110 is in the first injection state. The number of channels of each unit and the selection of multiplexed data by the selection unit 112 can be determined according to the specific connection status of the fourth video interface 1304.

If it is detected that the second video interface 1302 is directly or indirectly connected to the source device 300, such as the industrial computer 320, the fourth video interface 1304 is directly or indirectly connected to the first controller 500, and the second computer bus interface 1202 is not connected to the second computer 310, it can be considered that the non-real-time acquisition video data output by the source device 300 needs to be injected into the first controller 500, and the control unit 117 can configure each unit and module for the fourth purpose accordingly, and the multiplexing circuit 110 is in the second injection state. And the number of channels of each unit working, and the selection of the multiplexed data by the selection unit 112 can be determined according to the specific connection situation of the fourth video interface 1304.

Optionally, the connection status of each video interface and computer bus interface can also be replaced by the external connection status of the device.

Optionally, the first computer 410 and/or the control unit 117 may configure each unit or module in other ways instead of registers, for example, directly sending down configuration related information.

Furthermore, when configuring the video acquisition device 200 , the configuration may be performed through the second controller 600 or the first computer 410 .

In one embodiment, the video capture device 200 can communicate with the second controller 600 through an I2C processing unit to complete some configurations of the video capture device 200 .

The real-time video data emitted by the video acquisition device 200 is accessed through the third video interface 1303, enters the corresponding channel of the data access unit 111, and is divided into 2, 3, 4 or more channels by the selection unit 112. The same signal enters each channel of the data processing unit 113. The data processing unit 113 can directly pass the received real-time video data through, or perform some simple processing on it, such as nonlinear transformation, to correct the image. Generally, no conversion of format, frame rate, resolution, etc. is performed, and then it is given to the data output unit 114 to output to the corresponding processing device 420 through the first video interface 1301 and/or output to the second controller 600 through the fifth video interface 1301.

In another embodiment, the video acquisition device 200 can communicate with the first computer 410 through a PCIe-I2C conversion module in the I2C processing unit to complete some configurations of the video acquisition device 200 .

The real-time video data sent by the video acquisition device 200 is accessed through the third video interface 1303, enters the corresponding channel of the data access unit 111, and is divided into 2, 3, 4 or more channels by the selection unit 112. The same signal enters each channel of the data processing unit 113. The data processing unit 113 can directly transmit the real-time video data, or perform some simple processing on it, such as nonlinear transformation, to correct the image. Generally, no conversion of format, frame rate, resolution, etc. is performed, and then it is given to the data output unit 114 to output to the corresponding second controller 600 and/or the first computer 410.

In one embodiment, the video transmission processing module may further include:

A deserializer, which is used to access the video acquisition device 200 and is electrically connected to the multiplexing circuit 110. The deserializer is also used to deserialize the real-time acquired video data output by the video acquisition device 200 and output it to the multiplexing circuit 110;

The serializer is used to access the first controller 500 and is electrically connected to the multiplexing circuit 110 , and is used to serialize the video data output by the multiplexing circuit 110 and then output it to the first controller 500 .

In addition, the deserializer and the serializer may be disposed in the video transmission processing module, or may not be disposed in the video processing module but be externally connected.

It should be noted that, since data collection usually occurs in a real vehicle and data injection occurs in a laboratory, which are completely different scenarios, the embodiments of the present application integrate different uses in different scenarios to construct a new video transmission processing module.

In addition, the video transmission processing module of the embodiment of the present application can be arranged on a circuit board, such as a main board.

In order to better implement the video transmission processing module of the embodiment of the present application, on the basis of the above embodiment, the embodiment of the present application also provides a device, as shown in Figure 15, the device may include the video transmission processing module in any one of the above embodiments, the multiplexing circuit 110 of the video transmission processing module is arranged on the main board 100, and the device may also include a capture input unit 1401 and multiple output units detachably connected to the main board 100, at least one of the multiple output units can be used as an injection output unit 1501.

Among them, the acquisition input unit 1401 can be used to receive a first signal of real-time acquisition video data from the video acquisition device 200 when connecting the main board 100 and the video acquisition device 200, deserialize the first signal into a first video signal, and then transmit the first video signal to the multiplexing circuit 110, so that the multiplexing circuit 110 performs the first type of purpose.

The injection output unit 1501 can be used to receive a second video signal of non-real-time video data output by the multiplexing circuit 110 by executing the second type of purpose when connecting the main board 100 and the first controller 500, and after serializing the second video signal into a second signal, transmit the second signal to the first controller 500.

It can be seen that the above-mentioned device can take into account two application scenarios and realize two different purposes (the purpose of reinjection in application scenario one, that is, the second type of purpose, and the purpose of vehicle-mounted data acquisition in application scenario two, that is, the first type of purpose), and different purposes can be switched by changing the input unit, output unit connected to the mainboard, and the devices corresponding to the input unit and output unit.

It should also be pointed out that, in consideration of the above two uses, the present application further designs some units to be detachably connected to the mainboard. Furthermore, when a unit is not needed, it can be disconnected from the mainboard, thereby saving overall space and resources. In addition, there is no need to design different mainboards for different situations. By connecting or disconnecting the units, different application requirements can be adapted, thereby facilitating mass production of a unified mainboard and reducing costs.

For example, in the prior art, if application scenario 1 requires the production of n devices, then n motherboards 1 need to be designed and produced, and if application scenario 2 requires the production of m devices, then m motherboards 2 need to be designed and produced, and motherboards 1 and 2 are different in circuit. For application scenario 1 and application scenario 2, this difference in circuit is largely reflected in input and output.

It can be seen that the present application decouples the input and/or output circuit parts from the mainboard, separates the input and output circuit parts that form significant differences, and unifies the mainboards that do not constitute significant differences in the circuits. In this way, if n devices for application scenario one and m devices for application scenario two are to be produced, for the mainboard, m+n mainboards can be mass-produced. The increase in output usually leads to a reduction in cost. At the same time, due to the decoupling of the input and/or output circuit parts from the mainboard, in the face of various possible input and/or output demands (even input and/or output demands that may occur in the future but have not yet been discovered), it is only necessary to use the corresponding input and output units. If it is not necessary, there is no need to redesign the mainboard, which further helps to reduce costs.

The applicant thought of the need to take both application scenarios into consideration because its product system involves both injection products (i.e. products for application scenario one) and vehicle-mounted data acquisition products (i.e. products for application scenario two). This need is unique to the applicant's product system and is not an obvious need in this field.

In the embodiment of the present application, when the input end of the acquisition input unit 1401 is connected to the video acquisition device 200 and the output end is connected to the multiplexing circuit 110 provided on the mainboard 100, a first signal of real-time acquisition video data output by the video acquisition device 200 can be received. The first signal can be a GMSL signal directly output by the video acquisition device 200 (such as a camera), and then the first signal is deserialized to obtain a corresponding first video signal. The first video signal here can be one of a MIPI signal, a DVP signal, and a LVDS signal. Then, the first video signal is input into the multiplexing circuit 110, so that the multiplexing circuit 110 can perform the first type of purpose and feed back the real-time acquisition video data to the target device 400 that is not the controller.

The input end of the injection output unit 1501 is connected to the multiplexing circuit 110 provided on the main board 100. When the output end is connected to the first controller 500, it can receive the second video signal of the non-real-time acquisition video data output by the multiplexing circuit 110. The non-real-time acquisition video data comes from the power source device 300. It can be understood that the multiplexing circuit 110 can output the second video signal by performing the second type of use. The second video signal here can be one of the MIPI signal, DVP signal, and LVDS signal. Then, the injection output unit 1501 can perform string processing on the second video signal to obtain the corresponding second signal and output it to the first controller 500. The second signal can be a GMSL signal, so that the first controller 500 can be trained or verified based on the non-real-time acquisition video data.

It can be understood that in the embodiment of the present application, the non-real-time video data can be real video data that has been previously sampled and stored, or it can be simulated video data obtained through a simulation experiment. The source device 300 can be a non-video acquisition device that stores non-real-time video data, such as a computer device, an industrial computer, a memory, etc.

Continuing with FIG. 15 , in one embodiment, at least one output unit can also be used as a first acquisition output unit 1502 , and at least one output unit can also be used as a second acquisition output unit 1503 .

Among them, the first acquisition output unit 1502 can be used to receive the third video signal of real-time acquisition video data output by the multiplexing circuit 110 when connecting the multiplexing circuit 110 on the main board 100 and the second controller 600, and after serializing the third video signal into a third signal, transmit the third signal to the second controller 600.

The second acquisition output unit 1503 can be used to receive a fourth video signal output by the multiplexing circuit 110 by executing the first type of purpose when connecting the multiplexing circuit 110 on the main board 100 and the target device 400, and after serializing the fourth video signal into a fourth signal, transmit the fourth signal to the target device 400, and the fourth video signal is the same as the third video signal.

In an embodiment of the present application, the acquisition input unit 1401 can be detachably connected to the video acquisition device 200 and the mainboard 100 respectively. When the acquisition input unit 1401 is connected to the video acquisition device 200 and the mainboard 100, it can receive a first signal of real-time acquired video data output by the video acquisition device 200, and deserialize the first signal into a first video signal and then output it to the multiplexing circuit 110 on the mainboard 100, so that the multiplexing circuit 110 performs corresponding video data processing operations or cache processing on the real-time acquired video data.

In order to be able to synchronously store, analyze, process or display the real-time collected video data while the video acquisition device 200 and the second controller 600 are collecting real-time video data, in the embodiment of the present application, the multiplexing circuit 110 can output two video signals (or can be understood as two groups of video signals) of completely synchronized and consistent real-time collected video data. For ease of understanding, it can be regarded as copying the real-time collected video data, so as to obtain real-time collected video bypass data that is completely synchronized and consistent with the real-time collected video data. Specifically, the selection unit 112 therein can have an input channel and an output channel. For the video signal of the real-time collected video data input by a group of input channels (for example, one or n input channels), two groups of output channels (for example, two or 2n output channels) can be driven to output it, thereby driving two channels to output based on a group (for example, one or n) of input video signals, and finally obtaining two channels (or can be understood as two groups) of the same video signals of the real-time collected video data.

The first acquisition output unit 1502 can be detachably connected to the multiplexing circuit 110 and the second controller 600 on the mainboard 100, respectively, so that when it is connected to the multiplexing circuit 110 and the second controller 600, it can receive the third video signal of the real-time acquisition video data output by the multiplexing circuit 110, and the third video signal here can be one of the MIPI signal, DVP signal, and LVDS signal, and the third video signal is serially processed into a third signal (such as a GMSL signal) and then output to the second controller 600, so that the second controller 600 can perform conventional control calculation work based on the real-time acquisition video data carried by the third signal, such as controlling the vehicle to avoid obstacles, turn, etc.

The second acquisition output unit 1503 can also be detachably connected to the multiplexing circuit 110 and the target device 400 on the mainboard 100, respectively, so that when it is connected to the multiplexing circuit 110 and the target device 400, it can receive the fourth video signal of the real-time acquisition video data (which can also be understood as real-time acquisition video bypass data that is synchronized and consistent with the real-time acquisition video data) output by the multiplexing circuit 110. It can be understood that the fourth video signal can also be one of the MIPI signal, DVP signal, and LVDS signal, and the acquisition output unit adds a string to the fourth video signal to process it into a fourth signal (such as a GMSL signal) and then outputs it to the target device 400, so that the target device 400 can perform at least one processing such as data analysis, calculation, presentation, and storage on the real-time acquisition video bypass data (which can also be understood as real-time acquisition video data) carried in the fourth signal.

In the embodiment of the present application, the real-time collected video data may be video data sampled in real time by the video acquisition device 200 mounted on the vehicle during the operation of the vehicle, and the target device 400 may be a video analysis device, a data display, etc. In addition, the target device 400 may also be a data recorder, a data acquisition workstation, etc. dedicated to data acquisition and disk storage.

As shown in Figure 15, in one embodiment, the device may also include an injection input unit 1402 detachably connected to the main board 100. The injection input unit 1402 can be used to receive a fifth video signal of non-real-time video data from the source device 300 when the main board 100 is connected to the source device 300, and convert the fifth video signal into a sixth video signal, and transmit the sixth video signal to the multiplexing circuit 110, so that the multiplexing circuit 110 performs the second type of use.

In the embodiment of the present application, the injection input unit 1402 can be detachably connected to the source device 300 and the mainboard 100, respectively. When the injection input unit 1402 is connected to the source device 300 and the mainboard 100, the fifth video signal of the non-real-time acquisition video data output by the source device 300 can be received. Here, the fifth video signal can be an HDMI signal, and the fifth video signal is converted into a sixth video signal (for example, a MIPI signal, a DVP signal, or a LVDS signal) and then output to the multiplexing circuit 110 (for example, output to the second video interface 1302 of the multiplexing circuit 110), so that the multiplexing circuit 110 can perform the second type of use based on the sixth video signal, for example, after performing corresponding video data processing operations or buffering processing on the non-real-time acquisition video data of the sixth video signal, the second video signal of the non-real-time acquisition video data is output to the injection output unit 1501, and the second video signal is processed into a second signal by the injection output unit 1501, and then output to the first controller 500.

16 , in one embodiment, the signal source device 300 is an industrial computer 320, and the injection input unit 1402 may include a transfer board detachably connected to the mainboard 100 and the industrial computer 320, respectively, and the second video interface 1302 may be located on the transfer board; the transfer board may be used to convert a fifth video signal of non-real-time video data acquired from the industrial computer 320 into a sixth video signal when connecting the industrial computer 320 to the mainboard 100, and output it to the multiplexing circuit 110 on the mainboard 100.

In the embodiment of the present application, the fifth video signal of the non-real-time collected video data output by the industrial computer 320 may be an HDMI signal. Therefore, in the present embodiment, the adapter board may be an HDMI adapter board.

A board-to-board connector may be provided on the main board 100, and the adapter board may be detachably connected to the second video interface 1302 of the main board 100 through the board-to-board connector. When the adapter board is connected to the industrial computer 320 and the main board 100, it may receive a fifth video signal such as an HDMI signal of non-real-time video data collected from the industrial computer 320, and then convert the fifth video signal into a sixth video signal and output it to the multiplexing circuit 110 on the main board 100.

In the embodiment of the present application, the sixth video signal may be a MIPI signal, or a DVP signal or a LVDS signal.

It can be understood that in some examples, the industrial computer 320 can also cache the non-real-time collected video data in the cache section 116 of the multiplexing circuit 110 through the adapter board, and then read the non-real-time collected video data from the cache section 116 based on the timestamp of the non-real-time collected video data, and send it to the injection output unit 1501 for injection into the first controller 500.

In this embodiment, the industrial computer 320 can be connected to the adapter board via four HDMI cables, thereby outputting four HDMI signals to the adapter board.

The adapter board can output MIPI signals or DVP signals to the main board 100, and has 1 high-speed clock channel and 4 high-speed data channels, which can run at a maximum speed of 2Gbps/lane, thereby supporting a total bandwidth of up to 8Gbps. In addition, the device can also support burst mode DSI video data transmission, as well as support flexible video data mapping paths. The integrated DSC encoder can achieve up to 3:1 visual lossless compression, thereby reducing the bandwidth requirements for Ultra High Definition (UHD) video transmission, and reducing power consumption and electromagnetic interference (EMI).

In the embodiment of the present application, the method of injecting non-real-time video data through HDMI signal can provide stable video data to the first controller 500 more conveniently and quickly.

As shown in Figure 16, in one embodiment, the injection output unit 1501 may include a first serial board that can be detachably connected to the main board 100 and the first controller 500, respectively, and the main board 100 can be connected to the first serial board through the fourth video interface 1304; the first serial board can be used to receive a second video signal of non-real-time video data collected by the multiplexing circuit 110 on the main board 100 when connecting the first controller 500 and the main board 100, and perform serial processing on the second video signal, and output the second signal after serial processing to the first controller 500, wherein the second video signal is one of a MIPI signal, a DVP signal or a LVDS signal, and the second signal can be a GMSL signal.

In an embodiment of the present application, the mainboard 100 can be configured with a board-to-board connector, and the first plus-string board can be detachably connected to the fourth video interface 1304 of the mainboard 100 through the board-to-board connector, and the first plus-string board can also be detachably connected to the first controller 500 through the Fakra connector.

When the first serial board is connected to the main board 100 and the first controller 500 , the multiplexing circuit 110 on the main board 100 can output the second video signal through the general-purpose input/output (GPIO) port configured therein.

It can be understood that if the second video signal output by the multiplexing circuit 110 is a MIPI signal, the first serial board can be a MIPI interface board corresponding to the MIPI signal; if the second video signal output by the multiplexing circuit 110 is a DVP signal, the first serial board can be a DVP interface board corresponding to the DVP signal; if the second video signal output by the multiplexing circuit 110 is an LVDS signal, the first serial board can be an LVDS interface board corresponding to the LVDS signal.

Specifically, the FPGA chip of the multiplexing circuit 110 can configure the corresponding GPIO port as a MIPI port, thereby outputting the MIPI signal to the first controller 500 through the MIPI interface board through the MIPI port; or, it can also configure the corresponding GPIO port as a DVP port, thereby outputting the DVP signal to the first controller 500 through the DVP interface board through the DVP port; it can also configure the corresponding GPIO port as an LVDS port, thereby outputting the LVDS signal to the first controller 500 through the LVDS interface board through the LVDS port.

In the embodiment of the present application, small boards can be flexibly added in series according to different controllers of users to expand the application of the main board 100.

As shown in FIG. 16 , in one embodiment, the acquisition input unit 1401 may include a deserialization board that is detachably connected to the mainboard 100 and the video acquisition device 200, respectively, and the mainboard 100 may be connected to the deserialization board through the third video interface 1303; the deserialization board may be used to deserialize the first signal of the real-time acquisition video data from the video acquisition device 200 when the video acquisition device 200 is connected to the mainboard 100, and obtain the first video signal to be transmitted to the multiplexing circuit 110 on the mainboard 100, wherein the first video signal is one of a MIPI signal, a DVP signal, and a LVDS signal. The first signal may be a GMSL signal.

In the embodiment of the present application, the video acquisition device 200 can be any existing shooting device such as a camera or a webcam, and the deserializer board can be a deserializer board that matches the model of the video acquisition device 200.

The deserialization board can be detachably connected to the third video interface of the main board 100 via a high-speed board-to-board connector, and the video acquisition device 200 and the deserialization board can be connected via a coaxial cable, so that the video acquisition device 200 can transmit the real-time acquired video data obtained by shooting to the deserialization board, and then the deserialization board deserializes the first signal of the real-time acquired video data, and outputs the corresponding first video signal to the multiplexing circuit 110 on the main board 100.

Since most sensors cannot be split into two, and cannot provide video data to the domain controller and pass the video data to the video analysis device, the embodiment of the present application splits the sensor data into two through the bypass acquisition function, without damaging the vehicle body wiring harness, to ensure the integrity of the video data, and to allow the acquisition and domain control to operate normally at the same time.

As shown in FIG. 16 , in one embodiment, the first acquisition output unit 1502 may include a second serial board detachably connected to the mainboard 100 and the second controller 600, respectively, and the first video interface 1301 of the mainboard 100 may be connected to the second serial board; the second serial board may be used to receive a third video signal of real-time acquisition video data sent by the multiplexing circuit 110 on the mainboard 100 when connecting the second controller 600 to the mainboard 100, and perform serial processing on the third video signal to obtain a third signal to be transmitted to the second controller 600, and the third video signal may be one of a MIPI signal, a DVP signal, and a LVDS signal. The third signal may be a GMSL signal.

In an embodiment of the present application, the mainboard 100 can be configured with a board-to-board connector, and the second plus-string board can be detachably connected to the first video interface 1301 of the mainboard 100 through the board-to-board connector, and the second plus-string board can also be detachably connected to the second controller 600 through a Fakra connector.

When the second serial board is connected to the main board 100 and the second controller 600, the multiplexing circuit 110 on the main board 100 can output a third video signal of real-time collected video data through the GPIO port configured therein.

It can be understood that if the third video signal output by the multiplexing circuit 110 is a MIPI signal, the second serial board can be a MIPI interface board corresponding to the MIPI signal; if the third video signal output by the multiplexing circuit 110 is a DVP signal, the second serial board can be a DVP interface board corresponding to the DVP signal; if the third video signal output by the multiplexing circuit 110 is an LVDS signal, the second serial board can be a LVDS interface board corresponding to the LVDS signal.

Specifically, the FPGA chip of the multiplexing circuit 110 can configure the corresponding GPIO port as a MIPI port, thereby transmitting the MIPI signal to the MIPI interface board through the MIPI port. The MIPI interface board serializes the received MIPI signal, and then outputs the serialized MIPI signal to the second controller 600 through the coaxial cable. Similarly, the corresponding GPIO port can be configured as a DVP port, thereby transmitting the DVP signal to the DVP interface board through the DVP port. The DVP interface board serializes the received DVP signal, and then outputs the serialized DVP signal to the second controller 600 through the coaxial cable. The corresponding GPIO port can also be configured as an LVDS port, thereby transmitting the LVDS signal to the LVDS interface board through the LVDS port. The LVDS interface board serializes the received LVDS signal, and then outputs the serialized LVDS signal to the second controller 600 through the coaxial cable.

As shown in Figure 16, in one embodiment, the second acquisition and output unit 1503 may include a third serial board that can be detachably connected to the mainboard 100 and the target device 400, respectively, and the first video interface 1301 corresponding to the target device 400, such as the processing device 420, can be connected to the third serial board; the third serial board can be used to receive a fourth video signal of real-time acquisition video bypass data emitted by the multiplexing circuit 110 on the mainboard 100 when connecting the target device 400 to the mainboard 100, and serialize the fourth video signal to obtain a fourth signal output to the target device 400, and the fourth video signal is one of a MIPI signal, a DVP signal, and a LVDS signal.

In the embodiment of the present application, the real-time acquired video bypass data is the same video data as the real-time acquired video data, and can be regarded as data obtained after the multiplexing circuit 110 synchronously copies the real-time acquired video data from the video acquisition device 200. Therefore, it can be understood that the real-time acquired video bypass data is video data that is synchronized and consistent with the real-time acquired video data.

The mainboard 100 may be configured with a board-to-board connector, through which the third plus-serial board may be detachably connected to the first video interface 1301 of the mainboard 100 , and the third plus-serial board may also be detachably connected to the target device 400 through a Fakra connector.

When the third serial board is connected to the main board 100 and the target device 400, the multiplexing circuit 110 on the main board 100 can output a fourth video signal of real-time collected video bypass data through its configured GPIO port.

It can be understood that if the fourth video signal output by the multiplexing circuit 110 is a MIPI signal, the third serial board can be a MIPI interface board corresponding to the MIPI signal; if the fourth video signal output by the multiplexing circuit 1108 is a DVP signal, the third serial board can be a DVP interface board corresponding to the DVP signal; if the fourth video signal output by the multiplexing circuit 1108 is an LVDS signal, the third serial board can be a LVDS interface board corresponding to the LVDS signal.

Specifically, the FPGA chip of the multiplexing circuit 110 can configure the corresponding GPIO port as a MIPI port, thereby transmitting the MIPI signal to the MIPI interface board through the MIPI port. The MIPI interface board serializes the received MIPI signal and then outputs the serialized MIPI signal to the target device 400 through the coaxial cable. Similarly, the corresponding GPIO port can be configured as a DVP port, thereby transmitting the DVP signal to the DVP interface board through the DVP port. The DVP interface board serializes the received DVP signal and then outputs the serialized DVP signal to the target device 400 through the coaxial cable. The corresponding GPIO port can also be configured as an LVDS port, thereby transmitting the LVDS signal to the LVDS interface board through the LVDS port. The LVDS interface board serializes the received LVDS signal and then outputs the serialized LVDS signal to the target device 400 through the coaxial cable.

As shown in Figure 17, in one embodiment, the mainboard 100 can adopt a high-speed serial computer expansion bus standard (Peripheral Component Interconnect Express, PCIe) mainboard, and the first computer bus interface 1201 can be a first PCIe interface, which is a standard PCIe gold finger interface. The first PCIe interface can be plugged into the first computer 410 to realize video data collection.

Specifically, the multiplexing circuit 110 on the mainboard 100 can transmit the real-time collected video data from the video capture device 200 to the first computer 410 through the first PCIe interface, so that the first computer 410 can perform at least one of the following processes on the real-time collected video data, such as storage on disk, analysis and processing, and presentation and display.

In addition, when transmitting signals, the mainboard 100 may also convert at least one of the format, frame rate, resolution, etc. of the images therein.

The mainboard 100 can be automatically configured based on its external connection status and predefined information, wherein the predefined information includes how to inject information (for example, whether to inject based on timestamp), how to convert information, etc.

All of these connection conditions can be detected. In one embodiment, the connection part of the mainboard 100 connected to the acquisition input unit 1401, the connection part connected to the injection input unit 1402, and the connection part connected to the injection output unit 1501, the first acquisition output unit 1502, the second acquisition output unit 1503 and/or the PCIe interface can be connected to a detection circuit. The detection circuit can detect whether the mainboard 100 is connected to the corresponding acquisition input unit 1401, the injection input unit 1402, the injection output unit 1501, the first acquisition output unit 1502, the second acquisition output unit 1503 and the PCIe interface.

Then, based on the connection situation, it can automatically determine where the data should be sent to, how to inject it, how to convert it, etc.

Through the above process, it can be ensured that the device can adaptively process and transmit video data according to the connected unit modules and connection conditions.

In an embodiment of the present application, the processing device 420 can be a non-domain controller device such as a video data analysis device, a video data display device, etc., so that while the video acquisition device 200 and the second controller 600 are acquiring video data, the processing device 420 can synchronously analyze or display the video data.

In addition, the first acquisition output unit 1502 (for example, the second string-adding board) and the second acquisition output unit 1503 (for example, the third string-adding board) are different output units, the injection output unit 1501 (for example, the first string-adding board) and the first acquisition output unit 1502 (for example, the second string-adding board) can be the same output unit, and the injection output unit 1501 (for example, the first string-adding board) and the second acquisition output unit 1503 (for example, the third string-adding board) can be the same output unit.

As shown in FIG. 17 , in one embodiment, the apparatus may further include a power consumption simulation circuit 160 for simulating the power consumption of a load device (eg, a CMOS sensor including a camera), and the power consumption simulation circuit 160 is connected to the multiplexing circuit 110 .

It should be noted that in actual applications, the controller needs to be directly connected to the video acquisition device 200 . In addition to powering the deserialization circuit of the video acquisition device 200 , it also needs to power the sensor (eg, CMOS sensor) in the video acquisition device 200 .

Specifically, when the controller receives the video image of the video acquisition device 200, it is usually necessary to power the CMOS sensor of the video acquisition device 200. In the string adding circuit, the power supply voltage can be obtained and transmitted to the multiplexing circuit 110 through the corresponding port. In the present embodiment, other power supply circuits can be designed in the multiplexing circuit 110 to power the video acquisition device 200. At this time, the input voltage from the controller transmitted to the multiplexing circuit 110 on the main board 100 through the string adding board will not act on the CMOS sensor of the video acquisition device 200. In this way, the power consumption generated under the input voltage power supply cannot reach the actual power supply for the CMOS sensor. The power consumption of electricity will result in that the power provided by the controller will not be able to normally restore the situation where the controller is powering the CMOS sensor. For example, when the CMOS sensor is normally powered, under the input voltage, the power that the controller needs to provide is, for example, P1. If there is no power consumption simulation circuit, the power provided by the controller is actually much less than P1, which is out of touch with the actual situation and cannot truly restore the situation where the controller is powering the CMOS sensor. Therefore, the present application introduces a power consumption simulation circuit 160 to simulate the power consumption of powering the CMOS sensor. When the controller provides the power supply voltage, the output current, power, etc. can truly simulate the actual situation of powering the CMOS.

Therefore, the size of the control voltage is matched to the general power consumption of the load device (such as a CMOS sensor). The control voltage can be provided by a processor implemented by an ARM or FPGA on the mainboard 100, which can be set in the multiplexing circuit 110, or generated by a voltage generator on the mainboard 100.

As shown in Figure 18, in one embodiment, the power consumption simulation circuit 160 may include a first operational amplifier U1, a first transistor Q1 and a first load resistor Rload; one end of the first load resistor Rload is connected to the first end of the first transistor Q1, and the other end is connected to the ground end; the second end of the first transistor Q1 is connected to the input voltage for powering the load device, and the control end of the first transistor Q1 is connected to the output end of the first operational amplifier U1; the in-phase input end of the first operational amplifier U1 is connected to the multiplexing circuit 110 for connecting to the control voltage, and the inverting input end of the first operational amplifier U1 is connected to the first node between the first transistor Q1 and the first load resistor Rload.

Specifically, the input voltage can be the output voltage provided by the controller. When the input voltage starts to power on, the power consumption simulation circuit 160 is in standby state; and when the multiplexing circuit 110 outputs a digital signal, the digital signal is converted into a control voltage by the digital-to-analog converter and provided to the non-inverting input terminal of the first operational amplifier U1, the output terminal of the first operational amplifier U1 outputs a high-level signal and turns on the first transistor Q1, thereby forming a feedback loop between the first operational amplifier U1 and the first transistor Q1. Due to the virtual short and virtual open characteristics of the operational amplifier, the voltage of the first node will be equal to the voltage of the non-inverting input terminal of the first operational amplifier U1, that is, the voltage of the first node will be equal to the control voltage, and the current consumed by the first load resistor Rload is I=DAC_SET/Rload.

As shown in Figure 19, in one embodiment, the device may also include a first temperature sensing module 170 and a second temperature sensing module 180; the first temperature sensing module 170 and the second temperature sensing module 170 are connected to the multiplexing circuit 110; wherein the first temperature sensing module 170 is arranged adjacent to the multiplexing circuit 110, and the second temperature sensing module 180 is located in the first area of the mainboard 100, and the temperature of the first area is lower than the temperature of other areas of the mainboard 100.

Exemplarily, the first temperature sensing module 170 and the second temperature sensing module 180 can use the TMP117AIDRVR chip to detect the temperature, and after the temperature is detected, it is transmitted to the multiplexing circuit 110 through the I2C bus, so that the multiplexing circuit 110 can control whether to turn on the corresponding fan for heat dissipation according to the detected temperature. At the same time, since the first temperature sensing module 170 can detect the temperature at the multiplexing circuit 110, and the second temperature sensing module 180 can detect the temperature of the lowest temperature area on the mainboard 100, it is beneficial to simultaneously detect the temperature of the multiplexing circuit 110 and the mainboard 100, so as to timely find out whether the temperature of the multiplexing circuit 110 is too high, or whether the temperature of the mainboard 100 is too high, so as to timely turn on the fan for heat dissipation to ensure the stable operation of the device.

As shown in Figures 19 and 20, in one embodiment, the device may also include a signal synchronization module 190 disposed on the mainboard 100 for synchronizing control signals to other mainboards. The signal synchronization module 190 may include a second transistor Q8, a first resistor R75, a third transistor Q9 and a second resistor R78; the control end of the second transistor Q8 is connected to the synchronization signal, the first end of the second transistor Q8 is grounded, one end of the first resistor R75 is connected to the power supply end, and the other end is connected to the second end of the second transistor Q8; the control end of the third transistor Q9 is connected to the first node between the second transistor Q8 and the first resistor R75, the first end of the third transistor Q9 is grounded, one end of the second resistor R78 is connected to the power supply end, and the other end is connected to the second end of the third transistor Q9.

It should be noted that after the first transistor Q1 receives the control signal, when the control signal is in a high-level state, the first transistor Q1 is turned on to pull the second node level down, so that the control end of the second transistor Q8 receives a low-level signal, and then the third transistor Q9 is turned off and the third node level between the second resistor R78 and the third transistor Q9 is pulled high, thereby indirectly outputting a high-level control signal through the second transistor Q8 and the third transistor Q9; conversely, when the control signal is in a low-level state, the first transistor Q1 is turned off and the second node level is pulled high, so that the control end of the second transistor Q8 receives a high-level signal, and then the third transistor Q9 is turned on and the third node level between the second resistor R78 and the third transistor Q9 is pulled low, thereby indirectly outputting a low-level control signal through the second transistor Q8 and the third transistor Q9.

In the above embodiment, since the signal synchronization module 190 is provided on the mainboard 110, the control signal output by the multiplexing circuit 110 can be synchronized to the video acquisition device or other mainboards and finally achieve the purpose of timing synchronization. For example, for multiple mainboards or video acquisition devices connected in series, when the control signal is a start signal of the video acquisition device or the mainboard, the signal synchronization module 190 can make multiple video acquisition devices 200 or multiple mainboards start synchronously; for another example, when the control signal is a shutdown signal of the video acquisition device or the mainboard, the signal synchronization module 190 can make multiple video acquisition devices and multiple mainboards shut down synchronously.

Based on the above embodiments, an embodiment of the present application further provides a collection system, which may include the video transmission processing module in any of the above embodiments, as well as a target device and a video collection device.

Since the acquisition system is provided with the video transmission processing module of the above-mentioned embodiment, it has all the beneficial effects of the video transmission processing module in any of the above-mentioned embodiments, which will not be described in detail here.

Based on the above embodiments, the embodiments of the present application also provide another acquisition system, which may include the apparatus in any of the above embodiments, as well as a target device and a video acquisition device.

Since the acquisition system is provided with the device of the above embodiment, it has all the beneficial effects of the device in any of the above embodiments, which will not be described in detail here.

Based on the above embodiments, an embodiment of the present application further provides an injection system, which may include a video transmission processing module in any of the above embodiments, and a source device.

Since the injection system is provided with the video transmission processing module of the above-mentioned embodiment, it has all the beneficial effects of the video transmission processing module in any of the above-mentioned embodiments, which will not be described in detail here.

Based on the above embodiments, the embodiments of the present application also provide another injection system, which may include the apparatus in any of the above embodiments and a signal source device.

Since the injection system is provided with the device of the above-mentioned embodiment, it has all the beneficial effects of the device of any of the above-mentioned embodiments, which will not be described in detail here.

In summary, although the present application has been disclosed as above with preferred embodiments, the above preferred embodiments are not intended to limit the present application. Ordinary technicians in this field can make various changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined in the claims.

Claims (20)

A video transmission processing module, wherein the video transmission processing module comprises a multiplexing circuit, and the multiplexing circuit is used for: When used for the first type of purpose, a video signal of real-time collected video data is obtained, and the real-time collected video data is fed back to a target device other than the controller; the real-time collected video data originates from a video acquisition device; When used for the second purpose, non-real-time video data is acquired, and the non-real-time video data is injected into the first controller by outputting a video signal of the non-real-time video data, wherein the non-real-time video data comes from a power source device. The video transmission processing module according to claim 1, wherein the first type of use includes at least one of a first use and a second use; The multiplexing circuit is used for: When used for the first purpose, feeding back the real-time collected video data to the target device via a computer bus interface; When used for the second purpose, the real-time collected video data is output through a video interface so that the real-time collected video data is fed back to the target device. The video transmission processing module according to claim 1, wherein the second type of use includes at least one of a third use and a fourth use; The multiplexing circuit is used for: When used for the third purpose, the non-real-time collected video data is obtained from the source device through a computer bus interface; When used for the fourth purpose, the non-real-time collected video data is obtained through a video interface. The video transmission processing module according to claim 2, wherein the multiplexing circuit is further used for: When used for the second purpose, the real-time collected video data is output through a video interface so that the real-time collected video data is fed back to the second controller. The video transmission processing module according to claim 2, wherein the multiplexing circuit comprises a data access unit, a data output unit and a data processing unit; The data access unit is used to access the real-time collected video data from the video interface when used for the first type of purpose; and output the accessed real-time collected video data to the data processing unit; The data processing unit is used to perform preset processing on the real-time collected video data input to the data access unit and then output it, or to output the real-time collected video data input to the data processing unit; The data output unit is used to, when used for the first purpose, feed back the real-time collected video data output by the data processing unit to the target device through a computer bus interface; when used for the second purpose, output the real-time collected video data output by the data processing unit through a video interface so that the real-time collected video data is fed back to the target device. The video transmission processing module according to claim 3, wherein the multiplexing circuit comprises a data access unit, a data output unit and a data processing unit; The data access unit is used to access the non-real-time collected video data from the video interface when used for the fourth purpose; and directly or indirectly output the accessed non-real-time collected video data to the data processing unit; The data processing unit is used to perform preset processing on the non-real-time collected video data input to the data access unit and then output it, or output the non-real-time collected video data input to the data processing unit; The data output unit is used to output the non-real-time collected video data output by the data processing unit through a video interface when used for the second type of purpose, so that the non-real-time collected video data is injected into the first controller. The video transmission processing module according to claim 3, wherein the multiplexing circuit comprises a data output section; The data output unit is used for: When used for the third purpose, the non-real-time acquisition video data is acquired from the source device through a computer bus interface, and the acquired non-real-time acquisition video data is output through a video interface, so that the non-real-time acquisition video data is injected into the first controller. The video transmission processing module according to claim 1, wherein the multiplexing circuit comprises: a buffer section and a data output section; The cache unit is used to cache the target image of the non-real-time collected video data when used for the second type of purpose, and send the target image to the data output unit based on the time information of the target image; The data output unit is used to output the acquired target image through a video interface so that the target image is injected into the first controller. The video transmission processing module according to claim 1, further comprising a configuration unit; The configuration unit is used to determine the state of the multiplexing circuit in response to the configuration of at least one of the first computer, the control unit, and the memory; The first category of use includes at least one of the first and second categories of use, and the second category of use includes at least one of the third and fourth categories of use; When the multiplexing circuit is used for the first purpose, the multiplexing circuit is in a first acquisition state; When the multiplexing circuit is used for the second purpose, the multiplexing circuit is in a second acquisition state; When the multiplexing circuit is used for the third purpose, the multiplexing circuit is in a first injection state; When the multiplexing circuit is used for the fourth purpose, the multiplexing circuit is in a second injection state. A device, comprising the video transmission processing module according to claim 1, wherein the multiplexing circuit is arranged on a main board, and the device further comprises a collection input unit and a plurality of output units detachably connected to the main board; The acquisition input unit is used to, when connecting the mainboard and the video acquisition device, receive a first signal of real-time acquisition video data from the video acquisition device, deserialize the first signal into a first video signal, and then transmit the first video signal to the multiplexing circuit, so that the multiplexing circuit performs the first type of purpose; At least one output unit among the plurality of output units can be used as an injection output unit; The injection output unit is used to receive the second video signal of the non-real-time acquired video data output by the multiplexing circuit by executing the second type of purpose when connecting the main board and the first controller, and after serializing the second video signal into a second signal, transmit the second signal to the first controller. The device of claim 10, wherein at least one output unit can be used as a first acquisition output unit, and at least one output unit can be used as a second acquisition output unit; The first acquisition output unit is used to receive the third video signal of the real-time acquired video data output by the multiplexing circuit when the main board is connected to the second controller, add a string to the third video signal to process it into a third signal, and then transmit the third signal to the second controller; The second acquisition and output unit is used to receive a fourth video signal output by the multiplexing circuit by executing the first type of purpose when the mainboard is connected to the target device, and after serializing the fourth video signal into a fourth signal, transmit the fourth signal to the target device, and the fourth video signal is the same as the third video signal. The device according to claim 10, further comprising an injection input unit detachably connected to the main board; The injection input unit is used to receive a fifth video signal of the non-real-time video data from the source device when the main board is connected to the source device, convert the fifth video signal into a sixth video signal, and transmit the sixth video signal to the multiplexing circuit so that the multiplexing circuit performs the second type of use. The device according to claim 10, wherein the first signal and the second signal are serial signals of the same type. The device according to claim 10, wherein the first video signal is a MIPI signal or a DVP signal, and the second video signal is a MIPI signal or a DVP signal. The device according to claim 11, wherein the third video signal is a MIPI signal or a DVP signal, the fourth video signal is a MIPI signal or a DVP signal, and the first signal, the second signal, the third signal and the fourth signal are the same type of serial signals. The device of claim 12, wherein the fifth video signal is an HDMI signal, and the sixth video signal is a MIPI signal or a DVP signal. A collection system, comprising the video transmission processing module as described in any one of claims 1 to 9, the target device, and the video collection device. A collection system, comprising the apparatus as described in any one of claims 10-16, the target device, and the video collection device. An injection system, comprising the video transmission processing module as described in any one of claims 1-9, and the source device. An injection system, comprising the apparatus as claimed in any one of claims 10 to 16, and the source device.