CN115391063A - Video capture method, device, electronic device and readable storage medium - Google Patents

Abstract

The embodiment of the application provides a video acquisition method and device, electronic equipment and a readable storage medium, and relates to the technical field of data processing. The method comprises the following steps: executing a target program in the first operating system, wherein the target program is developed based on the second operating system; the first terminal runs a first operating system; receiving a first access request sent by a target program, wherein the first access request is used for indicating that video equipment is accessed through a first target interface, and the first target interface is an interface based on a second operating system; and updating the first access request into a second access request, wherein the second access request is used for indicating that the video equipment is accessed through a second target interface, the second target interface is an interface based on the first operating system, and a first target access result which can be processed by a target program is obtained according to the second access request. According to the method and the device, the purpose that the target program can access the video equipment of the first terminal without modifying the function and the flow defined by the original video equipment accessed by the target program is achieved, and the change of transplantation is small.

Description

Video capture method, device, electronic device and readable storage medium

technical field

The present application relates to the technical field of data processing, and in particular, the present application relates to a video collection method, device, electronic equipment and readable storage medium.

Background technique

V4l2 (Video for linux2) is called the linux video device driver, which is a general framework for realizing video capture on the linux operating system. At present, most open source programs, such as webrtc, opencv, etc., generally default to accessing video devices such as cameras through the V4l2 interface corresponding to the V4l2 driver at the beginning of the design.

However, some operating systems do not support the V4l2 interface at present, and each of these operating systems provides a set of unique local interfaces for programs to access video devices. When transplanting programs that support the V4l2 interface to these operating systems that do not support the V4l2 interface, these programs need to adapt to the local interface when accessing video devices. The relevant interface functions for processing video data are modified to the corresponding local interface functions.

Each program's access to the video device, the defined interface functions and program flow are basically different, which leads to the fact that every time a new program is transplanted to an operating system that does not support the V4l2 interface, the new program almost needs to be repeated This kind of adaptation requires a lot of work and is cumbersome.

Contents of the invention

The embodiment of the present application provides a video acquisition method, device, electronic equipment, computer-readable storage medium, and computer program products, which are used to solve the adaptation work that almost all open source programs need to repeatedly access video equipment, and the workload is heavy. And cumbersome technical issues.

According to the first aspect of the embodiments of the present application, a video capture method is provided, the method comprising:

executing the target program in the first operating system, the target program is developed based on the second terminal operating system;

receiving a first access request sent by the target program, where the first access request is used to indicate access to the video device through the first target interface, where the first target interface is an interface based on the second operating system;

updating the first access request to a second access request, where the second access request is used to indicate access to the video device through a second target interface, where the second target interface is an interface based on the first operating system;

A first target access result that can be processed by the target program is obtained according to the second access request.

In a possible implementation manner, updating the first access request to the second access request includes:

Analyzing the first access request to obtain an identifier of the first target interface and a first target parameter; the first target parameter is a parameter that can be processed by an interface function corresponding to the first target interface;

converting the identification of the first target interface function to the identification of the second target interface function;

converting the first target parameter into a second target parameter, where the second target parameter is a parameter that can be processed by an interface function corresponding to the second target interface;

Encapsulating the identifier of the second target interface function and the second target parameter to obtain a second access request.

In a possible implementation manner, obtaining the first target access result processable by the target program according to the second access request includes:

According to the identification of the second target interface in the second access request, call the interface function corresponding to the second target interface to process the second target parameter, and obtain the first processing result;

transforming the first processing result into a second processing result;

The second processing result is used as the first target access result that can be processed by the target program.

In a possible implementation manner, converting the identifier of the first target interface into the identifier of the second target interface includes:

Determine the identifier of the second target interface corresponding to the identifier of the first target interface according to the pre-established first mapping relationship;

The first mapping relationship is the mapping relationship between the identifier of the first candidate interface and the identifier of the second candidate interface that has the same or similar access type as the first candidate interface; the first candidate interface and the second candidate interface are based on different operating systems ;

Convert the first target parameter to the second target parameter, including:

determining a second target parameter corresponding to the first target parameter according to a pre-established second mapping relationship;

The second mapping relationship is the first candidate parameter that can be processed by the interface function corresponding to the first candidate interface and the corresponding access type that is the same or similar to the interface function corresponding to the second candidate interface that can be processed and has the same or similar meaning as the first candidate parameter The mapping relationship between the second candidate parameters of .

In a possible implementation manner, converting the first processing result into the second processing result includes:

determining a second processing result corresponding to the first processing result according to a pre-established third mapping relationship;

The third mapping relationship is a mapping relationship between the first candidate result and the second candidate result;

The first candidate result is the result obtained by calling the interface function of the first candidate interface to process the first candidate parameter; the second candidate result is the call of the interface function pair of the second candidate interface with the same or similar access type as the first candidate interface A result obtained by processing a second candidate parameter that has a second mapping relationship with the first candidate parameter.

In a possible implementation, the first access request or the second access request includes at least one of the following access types:

Open type; Start preview type; Get image type; Stop preview type; Close type;

Among them, the open type is used to indicate to open the video device;

The startup preview type is used to indicate the video frame image captured by the preview video device;

The acquired image type is used to indicate to obtain the video frame image captured by the video device from the buffer;

The stop preview type is used to indicate to stop previewing the video frame image collected by the video device;

The shutdown type is used to indicate that the video device is turned off.

In a possible implementation, if the access type of the first access request is the startup preview type, before calling the interface function corresponding to the second target interface to process the second target parameter, further include

Register the frame callback function; the frame callback function is used to indicate the reception of the video frame image collected from the video device;

Run the frame callback function to obtain the video frame image from the video device, and store the video frame image in the buffer; the buffer includes a circular queue.

According to the second aspect of the embodiments of the present application, a video acquisition device is provided, the device includes:

The execution module is used to execute the target program in the first operating system, and the target program is developed based on the second operating system;

The receiving module is configured to receive a first access request sent by the target program, the first access request is used to indicate access to the video device through the first target interface, and the first target interface is an interface based on the second operating system;

An update module, configured to update the first access request to a second access request, where the second access request is used to indicate access to the video device through a second target interface, where the second target interface is an interface based on the first operating system;

An access result obtaining module, configured to obtain a first target access result that can be processed by the target program according to the second access request.

According to a third aspect of the embodiments of the present application, an electronic device is provided, the electronic device includes a memory, a processor, and a computer program stored on the memory, and the processor implements the steps of the method provided in the first aspect when executing the program .

According to a fourth aspect of the embodiments of the present application, there is provided a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method provided in the first aspect are implemented.

According to a fifth aspect of the embodiments of the present application, a computer program product is provided, the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The computer instruction is read, and the processor executes the computer instruction, so that the computer device executes the steps for realizing the method provided in the first aspect.

The beneficial effects of the technical solution provided by the embodiment of the present application are: execute the target program in the first operating system, and the target program is developed based on the second operating system; receive the first access request sent by the target program, and the first access request is used for Indicate access to the video device through the first target interface, the first target interface is an interface based on the second operating system; update the first access request to the second access request, and the second access request is used to indicate access to the video device through the second target interface , the second target interface is an interface based on the first operating system; a first target access result that can be processed by the target program is obtained according to the second access request. The embodiments of the present application can realize the target program accessing the video device without modifying the functions and processes defined by the target program's original access to the video device, so that the target program can be smoothly transplanted to the first operating system, and the transplantation changes are small, which improves the transplantation process. The efficiency reduces the difficulty of transplantation.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings that need to be used in the description of the embodiments of the present application.

FIG. 1 is a schematic flow diagram of a video acquisition method provided in an embodiment of the present application;

FIG. 2 is a schematic diagram of synchronously coordinating writing and reading of producer threads and consumer threads through a circular queue provided by the embodiment of the present application;

FIG. 3 is a schematic structural diagram of a video acquisition device provided in an embodiment of the present application;

FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

Embodiments of the present application are described below with reference to the drawings in the present application. It should be understood that the implementation manner described below in conjunction with the accompanying drawings is an exemplary description for explaining the technical solutions of the embodiments of the present application, and does not limit the technical solutions of the embodiments of the present application.

Those skilled in the art will understand that unless otherwise stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the terms "comprising" and "comprising" used in the embodiments of the present application mean that the corresponding features can be implemented as the presented features, information, data, steps, operations, elements and/or components, but do not exclude The realization is other features, information, data, steps, operations, elements, components and/or their combinations etc. supported by the technical field. It should be understood that when we say that an element is "connected" or "coupled" to another element, the one element can be directly connected or coupled to the other element, or it can mean that the one element and another element pass through intermediate elements. Establish a connection relationship. Additionally, "connected" or "coupled" as used herein may include wireless connection or wireless coupling. The term "and/or" used herein indicates at least one of the items defined by the term, for example, "A and/or B" can be implemented as "A", or as "B", or as "A and B ".

In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

The terms and related technologies involved in this application are described below:

V4L2 is the abbreviation of Video4linux2, which is the kernel driver of video equipment in linux, including video input (such as camera collecting video data), video output (such as VGA output, etc.) and data stream management functions such as video codec.

The following describes the technical solutions of the embodiments of the present application and the technical effects produced by the technical solutions of the present application by describing several exemplary implementations. It should be pointed out that the following embodiments may refer to, learn from or combine with each other, and the same terms, similar features, and similar implementation steps in different embodiments will not be described repeatedly.

A method of video acquisition is provided in the embodiment of the present application, as shown in Figure 1, the method includes:

Step S101, execute the target program in the first operating system, and the target program is developed based on the second operating system.

In the embodiment of the present application, the first operating system is an operating system that does not support the v4l2 driver, such as some domestic operating systems. The first operating system provides a set of unique local interfaces for applications to access video devices.

In the embodiment of the present application, the second operating system is an operating system that supports the v4l2 driver, such as the linux operating system, and the program compiled in the second operating system accesses the video device through the v4l2 interface corresponding to the v4l2 driver.

The target program in this embodiment of the present application may be any program that requires access to video equipment, such as open source programs such as webrtc and opencv programs, or common camera application programs, video application programs, and the like. The video device may be any device capable of collecting video, such as a camera.

Since the target program is developed based on the second operating system, the program compiled in the second operating system accesses the video device through the v4l2 interface corresponding to the v4l2 driver, so the target program accesses the video device through the v4l2 interface.

In the embodiment of the present application, after the target program is transplanted from the second operating system to the first operating system, the target program is executed in the first operating system.

Step S102, receiving a first access request sent by the target program, the first access request is used to instruct to access the video device through the first target interface, and the first target interface is an interface based on the second operating system.

When the target program in the embodiment of the present application needs to access the video device, it will send a first access request. The first access request is used to indicate access to the video device through the first target interface. The first target interface is an interface based on the second operating system, that is, The first target interface belongs to the v4l2 interface, and the target program intends to access the video device in the terminal running the second operating system through the first target interface.

Step S103, update the first access request to a second access request, the second access request is used to indicate access to the video device through the second target interface, the second target interface is an interface based on the first operating system, that is, the first operating system provides A set of interfaces for accessing video devices. This set of interfaces is generally unique to the first operating system, and is sometimes called a local interface.

The first access request is used to indicate to access the video device through the first target interface, but the target program is executed in the first operating system, and the first operating system does not support the first target interface to access the video device, so the target program is in the first When the operating system is executed, it cannot directly access the video device through the first target interface.

In this embodiment of the present application, after receiving the first access request, the first access request is converted into a second access request, the second access request is used to indicate access to the video device through the second target interface, and the second target interface is based on the first operation The interface of the system can access the video device through the second target interface, therefore, it is necessary to update the first access request to the second access request.

Step S104, obtaining the first target access result that can be processed by the target program according to the second access request.

Since the second access request indicates access to the video device through the second target interface, and the first operating system supports the second target interface, the first processing result can be obtained according to the second access request first, and the first operating system can process the first processing result Perform subsequent processing, and then convert the first processing result into a second processing result. The target program developed based on the second operating system can subsequently perform subsequent processing on the second processing result, and the second processing result can be used as the second processing result that the target program can process. A target access result, so that the target program can subsequently process the first target access result.

In the embodiment of the present application, the target program is executed in the first operating system, and the target program is developed based on the second operating system; the first access request sent by the target program is received, and the first access request is used to indicate access to the video device through the first target interface. A target interface is an interface based on the second operating system; the first access request is updated to a second access request, and the second access request is used to indicate access to the video device through the second target interface, and the second target interface is based on the first operating system an interface; obtaining a first target access result that can be processed by the target program according to the second access request. The embodiments of the present application can realize the target program accessing the video device without modifying the functions and processes defined by the target program's original access to the video device, so that the target program can be smoothly transplanted to the first operating system, and the transplantation changes are small, which improves the transplantation process. The efficiency reduces the difficulty of transplantation.

A possible implementation is provided in the embodiment of this application, updating the first access request to the second access request, including:

Analyzing the first access request to obtain an identifier of the first target interface and a first target parameter; the first target parameter is a parameter that can be processed by an interface function corresponding to the first target interface;

converting the identification of the first target interface to the identification of the second target interface;

converting the first target parameter into a second target parameter, where the second target parameter is a parameter that can be processed by an interface function corresponding to the second target interface;

Encapsulate the identifier of the second target interface and the second target parameter to obtain the second access request.

In the embodiment of the present application, in the process of updating the first access request to the second access request, the first access request is first parsed to obtain the first target interface identifier and the first target parameter, and according to the first target interface identifier The first target interface may be determined; the first target parameter is a parameter that can be processed by an interface function corresponding to the first target interface.

In this embodiment of the present application, the access type of the first access request can be determined according to the identifier of the first target interface and the first target parameter. Usually, the access type includes at least one of the following: open type, start preview type, acquire image type, stop preview type , shutdown type, etc.

Among them, the open type is used to indicate the opening of the video device; the start preview type is used to indicate the preview of the video frame image captured by the video device; the acquisition image type is used to indicate the video frame image captured by the video device; the stop preview type is used to indicate the stop of the video preview The video frame image captured by the device; the shutdown type is used to indicate that the video device is turned off.

The target program accesses the video device through the v4l2 interface. There are three core interfaces used by the v4l2 interface to access the video device, namely the open interface, the close interface and the ioctl interface. That is, the first target interface can be any of the above-mentioned v4l2 interfaces.

Among them, the open interface is the open type, which is used to indicate the opening of the video device. In order to open the video device, the open interface needs to be called. The parameter of the interface function corresponding to the open interface is a string, such as: "/dev/video1", "/dev/ video2", the parameter "/dev/video1" indicates that the first video device is opened, and "/dev/video2" indicates that the second video device is opened; the close interface is a close type, used to indicate that the video device is closed, and it is necessary to close the video device The close interface to be called; the ioctl interface may belong to the type of starting preview, or the type of obtaining images, or the type of stopping preview. The access type needs to be further determined according to the parameters that can be processed by the interface function corresponding to the ioctl interface. Specifically, if the parameter is "VIDIOC_STREAMON", it indicates the start preview type, that is, to preview the video frame image collected by the video device; if the parameter is "VIDIOC_DQBUF", it indicates the type of image to be obtained, that is, to obtain the video frame image collected by the video device; if The parameter is "VIDIOC_STREAMOFF", which represents the stop preview type, that is, stop previewing the video frame image collected by the video device.

In addition, the v4l2 interface also includes some other auxiliary interfaces, such as the select interface and the mmap interface. The select interface is used to determine the status of one or more sockets, and the mmap interface is used to indicate that a file or other objects are mapped into memory.

In this embodiment of the present application, after determining the identifier of the first target interface and the first target parameter, the identifier of the first target interface is converted into the identifier of the second target interface, the first target parameter is converted into the second target parameter, and the second target The parameters are parameters that can be processed by the interface function corresponding to the second target interface.

Specifically, it is assumed that the first operating system provides a camera interface function module is droidmedia, the open interface is a connect interface, and its corresponding interface function is DroidMediaCamera*droid_media_camera_connect (intcamera_number) function, the parameter of the interface function is the integer id of the camera .

If the ID of the first target interface is the ID of the open interface, and the first target parameter is "/dev/video1", the ID of the open interface needs to be converted to the ID of the corresponding second target interface connect interface, and the first target parameter "/dev/video1" translates to the second target parameter "1".

The disconnect interface provided by the first operating system is a disconnect interface, and its corresponding interface function is void droid_media_camera_disconnect(DroidMediaCamera*camera), and the parameter camera is the return value when the video device is turned on, which is a pointer type of DroidMediaCamera. If the mark of the first target interface function is the mark of the close interface, and the first target parameter is the return value when opening the video equipment (this return value can be queried according to the file descriptor fd), then the mark of the first target interface close interface needs to be Convert to the identifier of the corresponding second target interface disconnect interface, query the return value when opening the video device through fd, use the return value as the first target parameter, and convert the first target parameter into the corresponding DroidMediaCamera pointer type Two target parameters.

The interface of the first operating system startup preview type is start_preview, and its corresponding interface function is booldroid_media_camera_start_preview(DroidMediaCamera*camera). Before calling this function, a frame callback function needs to be registered to receive images collected from video devices. The frame callback function is : droid_media_camera_set_callbacks, the interface for registering the frame callback function is the frame callback interface. In the implementation of the frame callback function, each time a video frame image is received, the address and length of the video frame image are obtained, and the video frame image is written into the ring buffer, such as: mRingBufQueue.push(frameData, dataLen).

The interface for obtaining the image type in the first operating system is the mRingBufQueue interface, and its corresponding interface function is mRingBufQueue.pop(frameData, dataLen); the interface for stopping the preview type is the stop_preview interface, and its corresponding interface function is void droid_media_camera_stop_preview(DroidMediaCamera*camera ), the parameter camera is the return value when the video device is turned on, and can be queried according to fd.

Each first target interface generally has a second target interface with the same or similar access type as the first target interface. In this embodiment of the present application, the identification of the first target interface is converted into the identification of the second target interface, After a target parameter is converted into a second target parameter, the identifier of the second target interface and the second target parameter are encapsulated to obtain a second access request, through which the target program can access the video in the first operating system equipment.

A possible implementation is provided in the embodiment of this application. According to the second access request, the first target access result that can be processed by the target program is obtained, including:

Determine the second target interface according to the identifier of the second target interface in the second access request, and call an interface function corresponding to the second target interface to process the second target parameter to obtain a first processing result;

transforming the first processing result into a second processing result;

The second processing result is used as the first target access result that can be processed by the target program.

In the embodiment of the present application, the second access request includes the identification of the second target interface and the second target parameter, the second target interface can be determined according to the identification of the second target interface, and the interface function corresponding to the second target interface is called to modify the second target parameter After processing, the first processing result is obtained, that is, the embodiment of the present application essentially still calls the second target interface function, and does not call the first target interface function.

In the embodiment of the present application, the first operating system can subsequently process the first processing result. However, since the target program is developed based on the second operating system, the target program cannot subsequently process the first processing result. Therefore, the first The processing result is converted into a second processing result, the second processing result is based on the second operating system, the target program can process the second processing result later, and the second processing result is used as the first target access result that the target program can process.

A possible implementation is provided in the embodiment of this application, converting the identifier of the first target interface into the identifier of the second target interface, including:

Determine the identifier of the second target interface corresponding to the identifier of the first target interface according to the pre-established first mapping relationship;

The first mapping relationship is the mapping relationship between the identifier of the first candidate interface and the identifier of the second candidate interface that has the same or similar access type as the first candidate interface; the first candidate interface and the second candidate interface are based on different operating systems .

The embodiment of the present application establishes the first mapping relationship between the identifier of the interface corresponding to the first candidate interface and the identifier of the second candidate interface whose access type is the same as or similar to that of the first candidate interface. Specifically, for example, the open The first mapping relationship between the identifier of the interface (the interface based on the first operating system) and the connect interface (the interface based on the second operating system), the access types of the two are the same, both are open types, and other The first mapping relationship between the identifiers of the first candidate interfaces of the access type and the identifiers of the corresponding second candidate interfaces will not be exemplified one by one in this embodiment of the present application.

Convert the first target parameter to the second target parameter, including:

determining a second target parameter corresponding to the first target parameter according to a pre-established second mapping relationship;

The second mapping relationship is the first candidate parameter that can be processed by the interface function corresponding to the first candidate interface and the corresponding access type that is the same or similar to the interface function corresponding to the second candidate interface that can be processed and has the same or similar meaning as the first candidate parameter The mapping relationship between the second candidate parameters of .

In addition to establishing the first mapping relationship, the embodiment of the present application also establishes the first candidate parameters that can be processed by the interface function corresponding to the first candidate interface and the corresponding access types that can be processed by the interface function corresponding to the second candidate interface. The mapping relationship between the second candidate parameters that have the same or similar meaning as the first candidate parameter. Specifically, assuming that the first candidate interface is an open interface, the first candidate that can be processed by the interface function corresponding to the open interface (that is, the open function) The parameter is "/dev/videoX", where X is a positive integer representing the Xth video device; the second candidate interface in the first operating system that has the same or similar access type as the open function is the connect interface, and the corresponding interface function DroidMediaCamera*droid_media_camera_connect(intcamera_number), the second candidate parameter that the interface function corresponding to the second candidate interface can handle with the same meaning as the first candidate parameter "/dev/videoX" is "X", where X is a positive integer , representing the Xth video device.

A possible implementation is provided in the embodiment of this application, converting the first processing result into the second processing result, including:

determining a second processing result corresponding to the first processing result according to a pre-established third mapping relationship;

The third mapping relationship is a mapping relationship between the first candidate result and the second candidate result;

The first candidate result is the result obtained by calling the interface function of the first candidate interface to process the first candidate parameter; the second candidate result is the call of the interface function of the second candidate interface whose access type is the same as or similar to that of the first candidate interface function A result obtained by processing a second candidate parameter that has a second mapping relationship with the first candidate parameter.

The embodiment of the present application also establishes a third mapping relationship, the third mapping relationship is the mapping relationship between the first candidate result and the second candidate result; the first candidate result is the call of the interface function corresponding to the first candidate interface to the first candidate The result obtained by processing the parameters.

In this embodiment of the present application, the first processing result is converted into the second processing result. Specifically, the second processing result corresponding to the first processing result may be determined according to a pre-established third mapping relationship.

An embodiment of the present application provides a possible implementation manner, where the first access request or the second access request includes at least one of the following access types: open type; start preview type; acquire image type; stop preview type; close type.

Among them, the open type is used to indicate to open the video device;

The startup preview type is used to preview the video frame image collected by the video device;

The acquired image type is used to indicate the acquired video frame image captured by the video device;

The stop preview type is used to indicate to stop previewing the video frame image collected by the video device;

The shutdown type is used to indicate that the video device is turned off.

Each access type has been explained in the preceding embodiments, and details will not be repeated here in this embodiment of the present application.

A possible implementation is provided in the embodiment of the present application. If the access type of the first access request is the startup preview type, before calling the interface function corresponding to the second target interface to process the second target parameter, it also includes:

Register the frame callback function; the frame callback function is used to indicate the reception of the video frame image collected from the video device;

Run the frame callback function to obtain the video frame image from the video device, and store the video frame image in the buffer; the buffer includes a circular queue.

In the embodiment of the present application, for the first operating system, before invoking the interface function corresponding to the startup preview type, a frame callback function may also be registered, and the frame callback function is used to indicate to receive a video frame image collected from a video device. When running the frame callback function, the video frame image will be obtained from the video device, the address and length of each video frame image will be obtained, and each frame of video frame image will be written into the buffer. The buffer can be a ring queue, and the ring queue can be Guaranteed non-blocking, realizes writing without waiting to ensure real-time writing.

The video frame image or video data stream comes from the first candidate interface based on the first operating system. Usually, after the preview is started, the video frame image is sent to the program accessing the first candidate interface at a certain frame rate through the frame callback function. The target program in the embodiment of the application is developed based on the second operating system, and the target program cannot directly register the frame callback function. Therefore, when starting the preview, the first operating system itself or a related program registers the frame for the target program in the first operating system Callback.

The writing and reading of video frame images are performed by two different threads. The producer thread writes the video frame images into the buffer, which can be a circular queue. The producer thread is the provider of the video frame images, that is, the first A candidate interface is the provider; the consumer thread reads the video frame image from the buffer, and the consumer thread is the consumer that uses the video frame image, that is, the target program is the consumer

As shown in Figure 2, it exemplarily shows a schematic diagram of synchronously coordinating the writing and reading of the producer thread and the consumer thread through a circular queue, the producer thread continuously obtains the video frame image through the first candidate interface, and the Video frame images are written to the circular queue as video data; and consumer threads read video data out when needed. in and out are the buffer indexes of the ring queue, in is the index of the write buffer, and out is the index of the read buffer. When the two are equal, the ring queue is empty and no video data has been written. The initialization phase Set both to be equal.

After the producer thread writes a frame of data, the index in is incremented by 1. The producer does not need to care whether or when the consumer reads out. It can continuously write video data. The changes in the index in are as follows:

The consumer thread reads the data when needed, and the index out is incremented by 1. If it is found that in and out are equal when reading, the consumer thread needs to wait until new video data is written before continuing to read.

An embodiment of the present application provides a video capture device, which is applied to a first terminal, and the first terminal runs a first operating system. As shown in FIG. 3 , the video capture device 30 may include:

An execution module 310, configured to execute the target program in the first operating system, where the target program is developed based on the second operating system;

The receiving module 320 is configured to receive a first access request sent by the target program, the first access request is used to indicate access to the video device through the first target interface, and the first target interface is an interface based on the second operating system;

An update module 330, configured to update the first access request to a second access request, where the second access request is used to indicate access to the video device through a second target interface, where the second target interface is an interface based on the first operating system;

An access result obtaining module 340, configured to obtain a first target access result that can be processed by the target program according to the second access request.

In the embodiment of the present application, by executing the target program in the first operating system, the target program is developed based on the second operating system; receiving the first access request sent by the target program, the first access request is used to indicate access to the video device through the first target interface, The first target interface is an interface based on the second operating system; the first access request is updated to a second access request, the second access request is used to indicate access to the video device through the second target interface, and the second target interface is based on the first operation A system interface; obtaining a first target access result that can be processed by the target program according to the second access request. The embodiment of the present application can make the target program access the video device without modifying the functions and processes defined by the original access video device of the target program, so that the target program can be smoothly transplanted to the first operating system, and the transplantation changes are small, which improves the transplantation process. The efficiency reduces the difficulty of transplantation.

A possible implementation is provided in the embodiment of this application, and the update module includes:

The parsing submodule is configured to parse the first access request to obtain the identifier of the first target interface and the first target parameter; the first target parameter is a parameter that can be processed by the interface function corresponding to the first target interface;

A first converting submodule, configured to convert the identifier of the first target interface into the identifier of the second target interface;

The second conversion submodule is used to convert the first target parameter into a second target parameter, and the second target parameter is a parameter that can be processed by an interface function corresponding to the second target interface;

The encapsulation submodule is configured to encapsulate the identifier of the second target interface and the second target parameter to obtain the second access request.

A possible implementation is provided in the embodiment of this application, and the access result obtaining module includes:

The first processing result obtaining submodule is configured to process the second target parameter by calling the interface function corresponding to the second target interface according to the identifier of the second target interface in the second access request, to obtain the first processing result;

a third conversion submodule, configured to convert the first processing result into a second processing result;

The second processing result is used as the first target access result that can be processed by the target program.

An embodiment of the present application provides a possible implementation manner, the first conversion submodule is specifically configured to determine the identifier of the second target interface corresponding to the identifier of the first target interface according to the pre-established first mapping relationship;

The first mapping relationship is the mapping relationship between the identifier of the first candidate interface and the identifier of the second candidate interface that has the same or similar access type as the first candidate interface; the first candidate interface and the second candidate interface are based on different operating systems ;

The second conversion sub-module is specifically configured to determine a second target parameter corresponding to the first target parameter according to a pre-established second mapping relationship;

The second mapping relationship is the first candidate parameter that can be processed by the interface function corresponding to the first candidate interface and the corresponding access type that is the same or similar to the interface function corresponding to the second candidate interface that can be processed and has the same or similar meaning as the first candidate parameter The mapping relationship between the second candidate parameters of .

The embodiment of the present application provides a possible implementation manner, the third conversion sub-module is specifically configured to determine the second processing result corresponding to the first processing result according to the pre-established third mapping relationship;

The third mapping relationship is a mapping relationship between the first candidate result and the second candidate result;

The first candidate result is the result obtained by calling the interface function of the first candidate interface to process the first candidate parameter; the second candidate result is the call of the interface function of the second candidate interface whose access type is the same as or similar to that of the first candidate interface function A result obtained by processing a second candidate parameter that has a second mapping relationship with the first candidate parameter.

A possible implementation is provided in this embodiment of the application, where the first access request or the second access request includes at least one of the following access types:

Open type; Start preview type; Get image type; Stop preview type; Close type;

Among them, the open type is used to indicate to open the video device;

The startup preview type is used to indicate the video frame image captured by the preview video device;

The acquired image type is used to indicate to obtain the video frame image captured by the video device from the buffer;

The stop preview type is used to indicate to stop previewing the video frame image collected by the video device;

The shutdown type is used to indicate that the video device is turned off.

A possible implementation is provided in the embodiment of the present application. If the access type of the first access request is the startup preview type, the access result obtaining module further includes:

The registration sub-module is used to register the frame callback function; the frame callback function is used to indicate to receive the video frame image collected from the video device;

The running sub-module is used to run the frame callback function, obtain the video frame image from the video device, and store the video frame image in the buffer; the buffer includes a circular queue.

The device in the embodiment of the present application can execute the method provided in the embodiment of the present application, and its implementation principle is similar. The actions performed by the modules in the device in the embodiments of the present application are the same as the steps in the methods of the embodiments of the present application Correspondingly, for the detailed functional description of each module of the device, reference may be made to the description in the corresponding method shown above, which will not be repeated here.

An embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory. The processor executes the computer program to implement the steps of the video capture method. Compared with related technologies, the following can be realized: The target program is executed in the first operating system, and the target program is developed based on the second operating system; the first access request sent by the target program is received, and the first access request is used to indicate access to the video device through the first target interface, and the first target interface is based on The interface of the second operating system; the first access request is updated to the second access request, and the second access request is used to indicate access to the video device through the second target interface, and the second target interface is an interface based on the first operating system; according to the first access request The second access request obtains the first object access result that the object program can handle. The embodiment of the present application can make the target program access the video device without modifying the functions and processes defined by the original access video device of the target program, so that the target program can be smoothly transplanted to the first operating system, and the transplantation changes are small, which improves the transplantation process. The efficiency reduces the difficulty of transplantation. .

An optional embodiment provides an electronic device, as shown in FIG. 4 , the electronic device 4000 shown in FIG. 4 includes: a processor 4001 and a memory 4003 . Wherein, the processor 4001 is connected to the memory 4003 , such as through a bus 4002 . Optionally, the electronic device 4000 may further include a transceiver 4004, and the transceiver 4004 may be used for data interaction between the electronic device and other electronic devices, such as sending data and/or receiving data. It should be noted that, in practical applications, the transceiver 4004 is not limited to one, and the structure of the electronic device 4000 does not limit the embodiment of the present application.

The processor 4001 can be a CPU (Central Processing Unit, central processing unit), a general-purpose processor, a DSP (Digital Signal Processor, a data signal processor), an ASIC (Application Specific Integrated Circuit, an application specific integrated circuit), an FPGA (Field Programmable Gate Array, field programmable gate array) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various illustrative logical blocks, modules and circuits described in connection with the present disclosure. The processor 4001 may also be a combination that implements computing functions, for example, a combination of one or more microprocessors, a combination of DSP and a microprocessor, and the like.

Bus 4002 may include a path for communicating information between the components described above. The bus 4002 may be a PCI (Peripheral Component Interconnect, Peripheral Component Interconnect Standard) bus or an EISA (Extended Industry Standard Architecture, Extended Industry Standard Architecture) bus or the like. The bus 4002 can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 4 , but it does not mean that there is only one bus or one type of bus.

Memory 4003 can be ROM (Read Only Memory, read-only memory) or other types of static storage devices that can store static information and instructions, RAM (Random Access Memory, random access memory) or other types of static storage devices that can store information and instructions A dynamic storage device can also be EEPROM (Electrically Erasable Programmable Read Only Memory, Electrically Erasable Programmable Read-Only Memory), CD-ROM (Compact DiscRead Only Memory, CD-ROM) or other CD storage, CD storage (including compact CD, Laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media, other magnetic storage devices, or any other medium that can be used to carry or store computer programs and can be read by a computer, without limitation.

The memory 4003 is used to store the computer programs for executing the embodiments of the present application, and the execution is controlled by the processor 4001 . The processor 4001 is configured to execute the computer program stored in the memory 4003 to implement the steps shown in the foregoing method embodiments.

Among them, the electronic equipment package may include but not limited to such as mobile phone, notebook computer, digital broadcast receiver, PDA (personal digital assistant), PAD (tablet computer), PMP (portable multimedia player), vehicle terminal (such as vehicle navigation terminal ) and the like as well as stationary terminals such as digital TVs, desktop computers and the like. The electronic device shown in FIG. 4 is only an example, and should not limit the functions and scope of use of the embodiments of the present disclosure.

An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps and corresponding contents of the aforementioned method embodiments can be realized. Compared with the prior art, it can be realized that the target program is executed in the first operating system, and the target program is developed based on the second operating system; the first access request sent by the target program is received, and the first access request is used to indicate the To access the video device, the first target interface is an interface based on the second operating system; the first access request is updated to a second access request, and the second access request is used to indicate access to the video device through the second target interface, and the second target interface is Based on the interface of the first operating system; obtaining the first target access result that can be processed by the target program according to the second access request. The embodiment of the present application can make the target program access the video device without modifying the functions and processes defined by the original access video device of the target program, so that the target program can be smoothly transplanted to the first operating system, and the transplantation changes are small, which improves the transplantation process. The efficiency reduces the difficulty of transplantation.

It should be noted that the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable medium or any combination of the above two. A computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device . Program code embodied on a computer readable medium may be transmitted by any appropriate medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

The embodiment of the present application also provides a computer program product, including a computer program. When the computer program is executed by a processor, the steps and corresponding content of the aforementioned method embodiments can be realized. Compared with the prior art, it can be realized that the target program is executed in the first operating system, and the target program is developed based on the second operating system; the first access request sent by the target program is received, and the first access request is used to indicate the To access the video device, the first target interface is an interface based on the second operating system; the first access request is updated to a second access request, and the second access request is used to indicate access to the video device through the second target interface, and the second target interface is Based on the interface of the first operating system; according to the second access request, the first target access result that can be processed by the target program is obtained. The embodiment of the present application can make the target program access the video device without modifying the functions and processes defined by the original access video device of the target program, so that the target program can be smoothly transplanted to the first operating system, and the transplantation changes are small, which improves the transplantation process. The efficiency reduces the difficulty of transplantation.

The terms "first", "second", "third", "fourth", "1", "2", etc. (if any) in the description and claims of this application and the above drawings are used for Distinguishes between similar objects and does not necessarily describe a particular order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the application described herein can be practiced in sequences other than those illustrated or described in writing.

It should be understood that although arrows indicate various operation steps in the flow chart of the embodiment of the present application, the execution order of these steps is not limited to the order indicated by the arrows. Unless otherwise specified herein, in some implementation scenarios of the embodiments of the present application, the implementation steps in each flowchart may be performed in other orders as required. In addition, part or all of the steps in each flow chart may include multiple sub-steps or multiple stages based on actual implementation scenarios. Some or all of these sub-steps or stages may be executed at the same time, and each of these sub-steps or stages may also be executed at different times. In scenarios where execution times are different, the execution order of these sub-steps or stages can be flexibly configured according to requirements, which is not limited in this embodiment of the present application.

The above are only optional implementations of some implementation scenarios of this application. It should be pointed out that for those of ordinary skill in the art, on the premise of not departing from the technical concept of this application, other similar methods based on the technical ideas of this application can be adopted. The means of implementation also belong to the scope of protection of the embodiments of the present application.

Claims (10)

1. A method of video capture, the method comprising:

executing a target program in a first operating system, wherein the target program is developed based on a second operating system;

receiving a first access request sent by the target program, wherein the first access request is used for indicating that video equipment is accessed through a first target interface, and the first target interface is an interface based on a second operating system;

updating the first access request into a second access request, wherein the second access request is used for indicating that the video equipment is accessed through a second target interface, and the second target interface is an interface based on a first operating system;

and obtaining a first target access result which can be processed by the target program according to the second access request.

2. The method of claim 1, wherein updating the first access request to a second access request comprises:

analyzing the first access request to obtain an identifier of a first target interface and a first target parameter; the first target parameter is a parameter which can be processed by an interface function corresponding to the first target interface;

converting the identifier of the first target interface into the identifier of a second target interface;

converting the first target parameter into a second target parameter, wherein the second target parameter is a parameter which can be processed by an interface function corresponding to the second target interface;

and encapsulating the identifier of the second target interface and the second target parameter to obtain a second access request.

3. The method according to claim 2, wherein the obtaining a first target access result that can be processed by the target program according to the second access request comprises:

determining a second target interface according to the identifier of the second target interface in the second access request, and calling an interface function corresponding to the second target interface to process the second target parameter to obtain a first processing result;

converting the first processing result into a second processing result;

and taking the second processing result as a first target access result which can be processed by the target program.

4. The method of claim 3, wherein translating the identity of the first target interface to the identity of the second target interface comprises:

determining the identifier of a second target interface corresponding to the identifier of the first target interface according to a pre-established first mapping relation;

the first mapping relation is a mapping relation between the identification of a first candidate interface and the identification of a second candidate interface which has the same or similar access type with the first candidate interface; the first candidate interface and the second candidate interface are based on different operating systems;

the converting the first target parameter into a second target parameter includes:

determining a second target parameter corresponding to the first target parameter according to a second mapping relation established in advance;

the second mapping relation is a mapping relation between a first candidate parameter which can be processed by an interface function corresponding to the first candidate interface and a second candidate parameter which can be processed by an interface function corresponding to a second candidate interface with the same or similar access type and has the same or similar meaning with the first candidate parameter.

5. The method of claim 4, wherein converting the first processing result into a second processing result comprises:

determining a second processing result corresponding to the first processing result according to a pre-established third mapping relation;

the third mapping relationship is a mapping relationship between the first candidate result and the second candidate result;

the first candidate result is obtained by calling an interface function of the first candidate interface to process the first candidate parameter; the second candidate result is obtained by calling an interface function of a second candidate interface with the same or similar access type as the first candidate interface to process a second candidate parameter with a second mapping relation with the first candidate parameter.

6. The method of any of claims 1-5, wherein the first access request or the second access request comprises at least one of the following access types:

an open type; starting a preview type; acquiring an image type; stopping the preview type; a shutdown type;

wherein the open type is used to indicate that the video device is opened;

the starting preview type is used for indicating to preview the video frame image collected by the video equipment;

the acquisition image type is used for indicating that the video frame image acquired by the video equipment is acquired from a buffer area;

the preview stopping type is used for indicating to stop previewing the video frame image collected by the video equipment;

the shutdown type is used to indicate that the video device is shut down.

7. The method according to claim 6, wherein before the invoking of the interface function corresponding to the second target interface to process the second target parameter if the access type of the first access request is a start preview type, the method further comprises

Registering a frame callback function; the frame callback function is used for indicating to receive video frame images collected from the video equipment head;

running the frame callback function, acquiring a video frame image from the video equipment, and storing the video frame image in a buffer area; the buffer includes a circular queue.

8. A video capture device, the device comprising:

the execution module is used for executing a target program in a first operating system, and the target program is developed based on a second operating system;

a receiving module, configured to receive a first access request sent by the target program, where the first access request is used to indicate that a video device is accessed through a first target interface, and the first target interface is an interface based on a second operating system;

an updating module, configured to update the first access request to a second access request, where the second access request is used to indicate that a video device is accessed through a second target interface, and the second target interface is an interface based on a first operating system;

and the access result obtaining module is used for obtaining a first target access result which can be processed by the target program according to the second access request.

9. An electronic device comprising a memory, a processor and a computer program stored on the memory, characterized in that the processor executes the computer program to implement the steps of the method of any of claims 1-7.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.

Images