CN115002335B - Video processing method, apparatus, electronic device, and computer-readable storage medium - Google Patents

Abstract

The embodiment of the application provides a video processing method, a video processing device, electronic equipment and a computer readable storage medium, wherein the method comprises the following steps: acquiring shooting mode switching operation in the process of shooting video by adopting a first shooting mode; switching the first shooting mode to the second shooting mode in response to shooting mode switching operation, and recording tag information of shooting mode switching, wherein the tag information of shooting mode switching is used for marking that the first shooting mode is switched to the second shooting mode in the video shooting process; acquiring a target video obtained by video shooting in a first shooting mode and a second shooting mode; generating a first video file based on the tag information and the target video; editing a switching process of switching a first shooting mode in the first video file to a second shooting mode in the first video file based on tag information in the first video file to obtain a second video file.

Description

Video processing method, device, electronic device and computer readable storage medium

Technical Field

The present application relates to the field of computer technology, and in particular to a video processing method, device, electronic device and computer-readable storage medium.

Background technique

In the related art, in order to obtain a video with good quality, the user first needs to use the camera function of the electronic device to shoot a video to obtain the shot video; then, the user needs to use the video editing function of the electronic device to manually edit the shot video to obtain the edited video. Therefore, the operation process for the user to obtain the final desired video is relatively complicated, resulting in a poor user experience.

Summary of the invention

In view of this, the embodiments of the present application provide a video processing method, device, electronic device and computer-readable storage medium, which are conducive to solving the problem that the operation process for users to obtain the final processed video is complicated, resulting in a poor user experience.

In a first aspect, an embodiment of the present application provides a video processing method, including:

In the process of shooting a video in the first shooting mode, obtaining a shooting mode switching operation;

In response to the shooting mode switching operation, the first shooting mode is switched to a second shooting mode, and tag information of the shooting mode switching is recorded, wherein the tag information of the shooting mode switching is used to mark that the first shooting mode is switched to the second shooting mode during the video shooting process;

Acquire a target video obtained by shooting a video using the first shooting mode and the second shooting mode;

Based on the tag information and the target video, generate a first video file;

Based on the tag information in the first video file, the switching process from the first shooting mode to the second shooting mode in the first video file is edited to obtain a second video file.

Optionally, the tag information recording the switching of the shooting mode includes:

Recording the switching identifier of the shooting mode switching, the start timestamp of the shooting mode switching, and the end timestamp of the shooting mode switching, wherein the tag information includes: the switching identifier, the start timestamp, and the end timestamp.

Optionally, the recording of the switching identifier of the shooting mode switching, the start timestamp of the shooting mode switching, and the end timestamp of the shooting mode switching includes:

determining a switching identifier of the shooting mode switching based on the first shooting mode before the shooting mode switching and the second shooting mode after the shooting mode switching;

triggering a switch start callback function when the shooting mode switch starts, and determining the timestamp recorded by the switch start callback function as the start timestamp of the shooting mode switch; and

When the shooting mode switching ends, a switching end callback function is triggered, and a timestamp recorded by the switching end callback function is determined as an end timestamp of the shooting mode switching.

Optionally, generating a first video file based on the tag information and the target video includes:

The newly added tag setting interface is called to write the tag information into the video information description area of the target video, and the stop interface is called to complete the generation of the first video file.

Optionally, the editing, based on the tag information in the first video file, a switching process from the first shooting mode to the second shooting mode in the first video file to obtain the second video file includes:

Extracting the tag information in the first video file;

Determine, according to the tag information, a start timestamp and an end timestamp of the shooting mode switching in the first video file;

Based on the time period from the start timestamp to the end timestamp, the switching process from the first shooting mode to the second shooting mode in the first video file is edited to obtain the second video file.

Optionally, the editing, based on the time period from the start timestamp to the end timestamp, of the switching process from the first shooting mode to the second shooting mode in the first video file to obtain the second video file includes:

Get the switching image frame;

Insert the switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain a processed video, and edit the processed video to obtain the second video file; or, in the process of editing the target video, insert the switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain the second video file.

Optionally, acquiring the switching image frame includes:

Intercepting a target image frame from a video obtained by shooting the video in the first shooting mode; adjusting the corresponding image parameters of the target image frame based on the change parameters of switching from the first shooting mode to the second shooting mode to obtain the switched image frame; or

The target image frame is captured from a video obtained by shooting a video in the first shooting mode, wherein the switching image frame includes the target image frame.

Optionally, the adjusting corresponding image parameters of the target image frame based on the change parameters of switching from the first shooting mode to the second shooting mode to obtain the switched image frame includes:

In the case where the switching from the first shooting mode to the second shooting mode is a switching between different shooting speeds, obtaining a speed difference between a first shooting speed of the first shooting mode and a second shooting speed of the second shooting mode, and adjusting image parameters of the target image frame corresponding to the speed difference to obtain the switching image frame; or

When the switching from the first shooting mode to the second shooting mode is a switch between different lens focal lengths, the focal length difference between the first shooting focal length of the first shooting mode and the second shooting focal length of the second shooting mode is obtained, and the image parameters of the target image frame corresponding to the focal length difference are adjusted to obtain the switched image frame.

Optionally, the editing, based on the time period from the start timestamp to the end timestamp, of the switching process from the first shooting mode to the second shooting mode in the first video file to obtain the second video file includes:

Acquire a predetermined number of video image frames before the start timestamp;

Determine a third time period based on a first time period from the start timestamp to the end timestamp and a second time period in which the predetermined number of video image frames are located, wherein the third time period is the sum of the first time period and the second time period;

In the target video, the second time period where the predetermined number of video image frames are located is extended to the third time period to obtain a processed video, and the processed video is edited to obtain the second video file; or, in the process of editing the target video, the second time period where the predetermined number of video image frames are located is extended to the third time period in the target video to obtain the second video file.

Optionally, the editing the processed video to obtain the second video file includes:

Get pre-defined video editing templates;

The processed video is edited using the predetermined video editing template to obtain the second video file.

Optionally, the shooting mode switching includes at least one of the following: switching between different lens modes, switching between transitions within the same lens mode, switching between different shooting speeds, and switching between different lens focal lengths.

In a second aspect, an embodiment of the present application provides a video processing device, including:

A receiving module, used for obtaining a shooting mode switching operation during video shooting in a first shooting mode;

a processing module, configured to switch the first shooting mode to a second shooting mode in response to the shooting mode switching operation, and record tag information of the shooting mode switching, wherein the tag information of the shooting mode switching is used to mark that the first shooting mode is switched to the second shooting mode during the video shooting process;

An acquisition module, used for acquiring a target video obtained by shooting a video in the first shooting mode and the second shooting mode;

A generating module, configured to generate a first video file based on the tag information and the target video;

An editing module is used to edit the switching process from the first shooting mode to the second shooting mode in the first video file based on the tag information in the first video file to obtain a second video file.

Optionally, the processing module includes:

A recording unit is used to record a switching identifier of the shooting mode switching, a start timestamp of the shooting mode switching, and an end timestamp of the shooting mode switching, wherein the tag information includes: the switching identifier, the start timestamp, and the end timestamp.

Optionally, the recording unit includes:

A recording subunit is used to determine the switching identifier of the shooting mode switching based on the first shooting mode before the shooting mode switching and the second shooting mode after the shooting mode switching; trigger a switching start callback function when the shooting mode switching starts, and determine the timestamp recorded by the switching start callback function as the starting timestamp of the shooting mode switching; and trigger a switching end callback function when the shooting mode switching ends, and determine the timestamp recorded by the switching end callback function as the ending timestamp of the shooting mode switching.

Optionally, the generating module includes:

The writing unit is used to call the newly added tag setting interface to write the tag information into the video information description area of the target video, and call the stop interface to complete the generation of the first video file.

Optionally, the editing module includes:

An extraction unit, used for extracting the tag information in the first video file;

a determining unit, configured to determine a start timestamp and an end timestamp of the shooting mode switching in the first video file according to the tag information;

An editing unit is used to edit the switching process of switching from the first shooting mode to the second shooting mode in the first video file based on a time period from the start timestamp to the end timestamp to obtain the second video file.

Optionally, the editing unit includes:

A first acquisition subunit, used for acquiring a switching image frame;

An inserting subunit is used to insert the switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain a processed video, and edit the processed video to obtain the second video file; or, in the process of editing the target video, insert the switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain the second video file.

Optionally, the first acquiring subunit includes:

A first acquisition sub-subunit is configured to capture a target image frame from a video obtained by shooting the video in the first shooting mode; based on a change parameter when the first shooting mode is switched to the second shooting mode, adjust the corresponding image parameters of the target image frame to obtain the switched image frame; or

The first acquisition sub-subunit is used to capture the target image frame from the video obtained by video shooting in the first shooting mode, wherein the switching image frame includes the target image frame.

Optionally, the first acquisition sub-subunit is used to:

In the case where the switching from the first shooting mode to the second shooting mode is a switching between different shooting speeds, obtaining a speed difference between a first shooting speed of the first shooting mode and a second shooting speed of the second shooting mode, and adjusting image parameters of the target image frame corresponding to the speed difference to obtain the switching image frame; or

When the switching from the first shooting mode to the second shooting mode is a switch between different lens focal lengths, the focal length difference between the first shooting focal length of the first shooting mode and the second shooting focal length of the second shooting mode is obtained, and the image parameters of the target image frame corresponding to the focal length difference are adjusted to obtain the switched image frame.

Optionally, the editing unit includes:

A second acquisition subunit, configured to acquire a predetermined number of video image frames before the start timestamp;

a determination subunit, configured to determine a third time period based on a first time period from the start timestamp to the end timestamp and a second time period in which the predetermined number of video image frames are located, wherein the third time period is the sum of the first time period and the second time period;

A processing subunit is used to extend the second time period in the target video where the predetermined number of video image frames are located to the third time period to obtain a processed video, and edit the processed video to obtain the second video file; or, during the process of editing the target video, extend the second time period in the target video where the predetermined number of video image frames are located to the third time period to obtain the second video file.

Optionally, the editing unit includes:

A third acquisition subunit is used to acquire a predetermined video editing template;

The editing subunit is used to edit the processed video using the predetermined video editing template to obtain the second video file.

Optionally, the shooting mode switching includes at least one of the following: switching between different lens modes, switching between transitions within the same lens mode, switching between different shooting speeds, and switching between different lens focal lengths.

In a third aspect, an embodiment of the present application provides an electronic device, comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute any one of the methods described in the first aspect.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute any one of the methods described in the first aspect above.

In a fifth aspect, an embodiment of the present application provides a computer program product, which includes executable instructions. When the executable instructions are executed on a computer, the computer executes any one of the methods described in the first aspect above.

By adopting the technical solution provided in the embodiment of the present application, when shooting and obtaining a target video, the tag information of the shooting mode switch obtained during the video shooting process is combined with the obtained target video to generate a first video file, so that the video can be automatically edited based on the tag information in the first video file to obtain a second video file. The user only needs to execute the shooting process, and after the shooting is completed, a second video file with good quality after processing the shooting mode switch is obtained. There is no need to manually edit the shooting mode switch in the video, and a second video file with good quality is automatically generated during the shooting process. Therefore, by combining the tag information of the shooting mode switch obtained during the video shooting process with the obtained target video to generate a first video file, the efficiency of the user in obtaining a video with good quality is effectively improved, and the user's one-click filming experience is satisfied.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

FIG1 is a schematic diagram of an electronic device provided in an embodiment of the present application;

FIG2A is a schematic diagram of a front and rear dual-camera mode shooting scene provided in an embodiment of the present application;

FIG2B is a schematic diagram of a front and back picture-in-picture mode shooting scene provided by an embodiment of the present application;

FIG2C is a schematic diagram of a rear-mounted picture-in-picture mode shooting scene provided in an embodiment of the present application;

FIG3 is a schematic diagram of a processing process of a video method provided in an embodiment of the present application;

FIG4 is a schematic diagram of a shooting mode switching scenario provided in an embodiment of the present application;

FIG5 is a flow chart of a video processing method provided in an embodiment of the present application;

FIG6 is a schematic diagram of tag information of shooting mode switching recorded during video shooting according to an embodiment of the present application;

FIG7 is a flow chart of a method for generating tag information for switching shooting modes provided in an embodiment of the present application;

8 is a flow chart of generating a first video file based on tag information and a target video according to an embodiment of the present application;

FIG9 is a flow chart of a video editing method in a video processing method provided in an embodiment of the present application;

FIG10 is a schematic diagram of a flow chart of editing a target video in a first video file provided by an embodiment of the present application;

FIG11 is a schematic diagram of editing a shooting mode switch in a target video based on tag information provided by an embodiment of the present application;

FIG12 is a schematic diagram of editing a shooting mode switch in a target video based on tag information provided by an embodiment of the present application;

FIG13 is a schematic diagram of a video processing method provided in an embodiment of the present application;

FIG14 is a software structure block diagram of an electronic device provided in an embodiment of the present application;

FIG15 is a structural block diagram of a video processing device provided in an embodiment of the present application.

Detailed ways

In order to better understand the technical solution of the present application, the embodiments of the present application are described in detail below with reference to the accompanying drawings.

It should be clear that the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.

The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

It should be understood that the term "and/or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character "/" in this article generally indicates that the associated objects before and after are in an "or" relationship.

FIG1 is a schematic diagram of an electronic device provided by an embodiment of the present application. As shown in FIG1 , a mobile phone 100 is used as an example to exemplarily illustrate the electronic device in FIG1 . FIG1 shows a front view and a rear view of the mobile phone 100. Two front cameras 111 and 112 are configured on the front side of the mobile phone 100, and four rear cameras 121, 122, 123, and 124 are configured on the rear side of the mobile phone 100. Through the multiple cameras configured, a variety of shooting modes can be provided for the user, for example, a front shooting mode, a rear shooting mode, a front and rear dual shooting mode, etc. The user can select a corresponding shooting mode to shoot according to the shooting scene to improve the user experience.

It is understandable that what is shown in FIG. 1 is only an exemplary illustration and should not be used as a limitation on the scope of protection of this application. For example, different mobile phones may have different numbers and locations of cameras. In addition, in addition to mobile phones, the electronic devices involved in the embodiments of the present application may also be tablet computers, personal computers (PCs), personal digital assistants (PDAs), smart watches, netbooks, wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, vehicle-mounted devices, smart cars, smart speakers, robots, smart glasses, smart TVs, etc.

It should be noted that in some possible implementations, the electronic device may also be called a terminal device, a user equipment (UE), etc., which is not limited in the embodiments of the present application.

In some possible implementations, the shooting modes involved in the electronic device may include a single-camera mode and a multi-camera mode. The single-camera mode may include a front single-camera mode and a rear single-camera mode, etc. The multi-camera mode may include a front dual-camera mode, a rear dual-camera mode, a front and rear dual-camera mode, a front picture-in-picture mode, a rear picture-in-picture mode, and a front and rear picture-in-picture mode.

In single-camera mode, one camera is used for video shooting; in multi-camera mode, two or more cameras are used for video shooting.

Specifically, in the front single-camera mode, one front camera is used for video shooting; in the rear single-camera mode, one rear camera is used for video shooting; in the front dual-camera mode, two front cameras are used for video shooting; in the rear dual-camera mode, two rear cameras are used for video shooting; in the front and rear dual-camera mode, one front camera and one rear camera are used for video shooting; in the front picture-in-picture mode, two front cameras are used for video shooting, and the picture shot by one front camera is placed in the picture shot by the other front camera; in the rear picture-in-picture mode, two rear cameras are used for video shooting, and the picture shot by one rear camera is placed in the picture shot by the other rear camera; in the front and rear picture-in-picture modes, one front camera and one rear camera are used for video shooting, and the picture shot by the front camera or the rear camera is placed in the picture shot by the rear camera or the front camera.

Figure 2A is a schematic diagram of a front and rear dual camera mode shooting scene provided in an embodiment of the present application. As shown in Figure 2A, in the front and rear dual camera mode, a front camera is used to capture the foreground image, and a rear camera is used to capture the background image. The foreground image and the background image are displayed simultaneously in the display interface.

Figure 2B is a schematic diagram of a front and back picture-in-picture mode shooting scene provided in an embodiment of the present application. As shown in Figure 2B, in the front and back picture-in-picture mode, a front camera is used to capture the foreground image, and a rear camera is used to capture the background image, and the foreground image is placed in the background image.

Figure 2C is a schematic diagram of a rear-mounted picture-in-picture mode shooting scene provided in an embodiment of the present application. As shown in Figure 2C, in the rear-mounted picture-in-picture mode, one rear camera is used to capture a distant image, and another rear camera is used to capture a close-up image, and the close-up image is placed in the distant image.

It should be pointed out that the above-mentioned shooting modes are only some possible implementation methods listed in the embodiments of the present application. Those skilled in the art can configure other shooting modes according to actual needs, and the embodiments of the present application do not impose specific limitations on this.

In some possible implementations, the shooting mode may also be described as a single-channel mode, a dual-channel mode, or a multi-channel mode. It is understood that the single-channel mode uses one camera for shooting, the dual-channel mode uses two cameras for shooting, and the multi-channel mode uses more than two cameras for shooting.

In some possible implementations, the shooting mode may also be described as a single-view mode, a dual-view mode, and a picture-in-picture mode. The single-view mode may include a front single-camera mode and a rear single-camera mode; the dual-view mode may include a front dual-camera mode, a rear dual-camera mode, and a front and rear dual-camera mode; the picture-in-picture mode may include a front picture-in-picture mode, a rear picture-in-picture mode, and a front and rear picture-in-picture mode.

During the video shooting process, the user may need to switch the shooting mode. See Table 1 for some possible shooting mode switching scenarios listed in the embodiments of the present application.

Table I:

In some possible implementations, the shooting modes involved in the electronic device may include different shooting states. Different shooting states correspond to different shooting modes. For example, different shooting parameters are used for shooting. The different shooting parameters may be different shooting speeds, or different shooting focal lengths, or different shooting speeds and different shooting focal lengths, etc.

For example, when shooting in single-shot mode, you can use fast shooting, slow shooting and normal shooting. When shooting in multi-shot mode, you can specify a certain lens to use fast shooting, slow shooting and normal shooting, etc. It should be noted that the fast shooting involved in the embodiments of the present application can also be divided into multiple levels, for example, 2x speed shooting, 1.5x speed shooting, etc. Slow shooting can also be divided into multiple levels, for example, 0.5x shooting, 0.25x shooting, etc. Therefore, when an electronic device uses different speed parameters for shooting, it uses different shooting modes for shooting.

For another example, when shooting in single-camera mode, you can use telephoto shooting, close-up shooting, and normal shooting. When shooting in multi-camera mode, you can specify a lens to use telephoto shooting, close-up shooting, and normal shooting. Therefore, when the electronic device uses different focal length parameters for shooting, it uses different shooting modes for shooting.

During the video shooting process, the user may need to switch the above shooting modes. See Table 2 for some possible shooting mode switching scenarios listed in the embodiment of the present application.

Table II:

During the video shooting process, after the user uses the above-mentioned shooting mode switching to shoot, the shot video is obtained. However, for the shooting mode switching process, since the reaction of the camera of the electronic device is required, the obtained shot video may appear blurred in the shooting mode switching interval, resulting in discontinuity of the picture. When the reaction time is long, a dark screen may also appear. Therefore, in order to obtain a higher quality video, it is necessary to manually process the shooting mode switching interval when editing the video later. When the shooting mode switching interval of the video is manually processed, the processing efficiency is low, which affects the user's experience of quickly obtaining the video.

In view of this problem, an embodiment of the present application provides a video processing method. FIG3 is a schematic diagram of a processing process of a video method provided by an embodiment of the present application. As shown in FIG3, in an embodiment of the present application, during the video shooting process, when receiving the shooting mode switching operation of the user, the tag information of the shooting mode switching is recorded (such as the switching mark, the switching start time and the switching end time in FIG3). After obtaining the target video after mixing the audio and video streams of the entire shooting process, the tag information of the shooting mode switching obtained during the video shooting process is combined with the obtained target video to generate a first video file. The user only needs to execute the shooting process, and after the shooting is completed, a second video file with better quality after processing the shooting mode switching can be obtained (such as the second video file with the shooting mode switching filled in as shown in the figure). There is no need to manually edit the shooting mode switching in the video, which effectively improves the efficiency of the user in obtaining a video with better quality and satisfies the user's one-click filming experience.

FIG4 is a schematic diagram of a shooting mode switching scenario provided by an embodiment of the present application. As shown in FIG4, when a user is shooting a video through an electronic device, the display interface can display the video screen of the shooting process in real time. In addition, the display interface also includes a shooting mode selection window, and the user can select the corresponding shooting mode in the shooting mode selection window to shoot the video. For example, the front single camera mode, the rear single camera mode, the front and rear dual camera mode, the front and rear picture-in-picture mode, etc.

In the application scenario shown in FIG4 , the user first selects the front single-camera mode for video shooting, and the foreground image is displayed in real time in the display interface 401. When the user triggers the "front and rear dual-camera" control in the shooting mode selection window 402, the electronic device receives the shooting mode switching operation and switches the front single-camera mode to the front and rear dual-camera mode. During the mode switching process, the electronic device responds to the mode switching process and displays a blurred image in the display interface 401, that is, the display of the foreground image before the switch ends, but the foreground image and the background image after the switch are not yet displayed, and a flow interruption phenomenon occurs in the display interface 401. After the switch is completed, the video image shot in the front and rear dual-camera mode is displayed in real time in the display interface 401, for example, the foreground image and the background image shown in FIG4. That is, in the front and rear dual-camera mode, the foreground image and the background image are collected by the front camera and the rear camera, respectively, and the foreground image and the background image are displayed in the display interface 401, respectively.

It is understandable that in the process of video shooting, in addition to displaying the captured video screen in the display interface 401, the captured video screen can also be encoded into a video file (for example, a video file in MP4 format), that is, a target video, and stored in an electronic device. If the above-mentioned mode switching process is not processed during editing, when the obtained video file is played later, the above-mentioned picture blur will appear. If the process of switching the shooting mode in the above-mentioned target video is processed manually to obtain a video with better quality, it will result in a low efficiency of obtaining the video, affecting the user's experience of quickly obtaining the video. In an embodiment of the present application, the tag information of the shooting mode switching is recorded during the process of shooting the video, and the recorded tag information is combined with the obtained target video to generate a first video file, and then the video in the first video file can be automatically edited according to the tag information carried in the first video file, so as to realize the automatic processing of the shooting mode switching, obtain a video with better quality, and realize the user's one-click film experience.

Fig. 5 is a flow chart of a video processing method provided in an embodiment of the present application. The method can be applied to the electronic device shown in Fig. 1 , as shown in Fig. 5 , the process mainly includes the following steps.

Step S501: in the process of taking a video in a first shooting mode, obtaining a shooting mode switching operation.

The first shooting mode involved in the embodiment of the present application can be any one of the front single-camera mode, the rear single-camera mode, the front dual-camera mode, the rear dual-camera mode, the front and rear dual-camera mode, the front picture-in-picture mode, the rear picture-in-picture mode, and the front and rear picture-in-picture mode; the first shooting mode involved in the embodiment of the present application can also be a shooting mode corresponding to different shooting states, for example, it can be any one of the fast shooting mode, the slow shooting mode and the normal shooting mode, and can also be any one of the far-focus shooting mode, the near-focus shooting mode and the normal shooting mode. The embodiment of the present application does not impose specific restrictions on this.

In a specific implementation, the video images shot in the first shooting mode may be monitored, and the monitored video images shot in the first shooting mode may be sent to a display interface of the electronic device for display.

In actual applications, when a user needs to switch shooting modes during video shooting, he/she may input a shooting mode switching operation in the electronic device to switch the first shooting mode to the second shooting mode. The user may input the shooting mode switching operation through a touch screen, physical buttons, gesture control, voice control, etc.

The shooting mode switching involved in the embodiments of the present application can be any one of the shooting mode switching scenarios in Tables 1 and 2 above, and the embodiments of the present application do not impose specific limitations on this.

Step S502: In response to the shooting mode switching operation, the first shooting mode is switched to the second shooting mode, and tag information of the shooting mode switching is recorded, wherein the tag information of the shooting mode switching is used to mark the switching of the first shooting mode to the second shooting mode during the video shooting process.

In an embodiment of the present application, in response to a shooting mode switching operation, the first shooting mode is switched to the second shooting mode, video shooting is performed using the second shooting mode, and the video screen shot in the second shooting mode is monitored, and the monitored video screen shot in the second shooting mode is sent to the display interface of the electronic device for display.

In the embodiment of the present application, during the shooting mode switching process, the tag information of the shooting mode switching from the first shooting mode to the second shooting mode during the video shooting process is recorded. That is, the position of the shooting mode switching during the video shooting process is recorded. The tag information of the shooting mode switching is mainly used to identify the shooting mode switching process, and may include a variety of information, for example, it may include: a switching identifier for identifying the shooting mode switching, the starting time point of the shooting mode switching, and the ending time point of the shooting mode switching.

It should be noted that the tag information of the above-mentioned shooting mode switching belongs to a type of information in the video tag information. For example, the video tag information may also include other information. See Table 3 for some information included in the video tag of the embodiment of the present application.

Table 3:

The tag information of the shooting mode switching may be the transition information, the fast and slow speed information and the Zoom information (zoom information through lens zooming) in the video tag information shown in Table 3.

Among them, the label information of the shooting mode switch from the first shooting mode to the second shooting mode during the video shooting process can be recorded in a variety of ways. For example, to record the switching mark of the shooting mode switch, you can first obtain the mode adopted before the shooting mode switch (such as the first shooting mode mentioned above), and the mode adopted after the shooting mode switch (such as the second shooting mode mentioned above), and then determine the switching mark based on the first shooting mode before the shooting mode switch and the second shooting mode after the shooting mode switch. For another example, to record the time period of the shooting mode switch, it can be achieved by recording a timestamp. For example, the start timestamp of the shooting mode switch and the end timestamp of the shooting mode switch can be recorded, wherein the label information includes: the above-mentioned switching mark, the above-mentioned start timestamp and the above-mentioned end timestamp.

Among them, the switching mark involved in the embodiment of the present application is used to identify the shooting mode switch. In the process of shooting a video, more than one shooting mode switch may be involved. For example, in a complete video shooting process, it may involve the shooting mode switch from the single-channel shooting mode to the dual-channel shooting mode, and also involve the switching of the front and back shooting modes to the picture-in-picture shooting mode, and so on. In order to distinguish the above two shooting mode switching processes, different switching marks can be used to implement it. Different switching marks are used to represent different shooting mode switches. It is convenient to read the tag information later. When editing the video based on the tag information, different corresponding animation effects are filled in for different shooting mode switches.

It should be noted that the switching mark can be expressed in various forms. For example, when expressed in numbers, 1 indicates that the front single-camera mode is switched to the front and rear dual-camera mode, 2 indicates that the front and rear dual-camera mode is switched to the front single-camera mode, and so on; when expressed in letters, A indicates that the front single-camera mode is switched to the front dual-camera mode, B indicates that the rear single-camera mode is switched to the front dual-camera mode, and so on; when expressed in symbols, @ indicates that the fast shooting mode is switched to the normal shooting mode, # indicates that the slow shooting mode is switched to the fast shooting mode, and so on.

Among them, when recording the start time point and end time point of the shooting mode switch by recording the timestamp, the baseline of the recording time point can be set first, for example, the time point corresponding to the first frame image encoded by the preview stream displayed on the display interface when the electronic device starts shooting is used as the time baseline, and the time of the first frame image started to be shot is T0; the start time point of the shooting mode switch uses the timestamp corresponding to the last frame image before the shooting mode switch, and the end time point uses the timestamp corresponding to the first frame image after the shooting mode switch. Figure 6 is a schematic diagram of the label information of the shooting mode switch recorded during the video shooting process provided by an embodiment of the present application. As shown in Figure 6, 1 is the switching mark of the shooting mode switch, indicating that the shooting mode switch currently executed is: the front single camera mode is switched to the front and rear dual camera mode. T1 is the start time point of the shooting mode switch, which uses the timestamp corresponding to the last frame image before the shooting mode switch, and T2 is the timestamp corresponding to the first frame image after the shooting mode switch.

As an optional embodiment, when recording the start timestamp of the shooting mode switch and the end timestamp of the shooting mode switch, multiple methods can be used. For example, a callback function can be set for the start of the shooting switch to obtain the start timestamp of the shooting mode switch; a callback function can be set for the end of the shooting switch to obtain the end timestamp of the shooting mode switch. The callback functions set for the start of the shooting switch and the end of the shooting switch are mainly used to trigger the corresponding record for the start of the shooting switch and the corresponding record at the end of the shooting switch. For example, the switch start callback function is triggered at the start of the shooting mode switch, and the timestamp recorded by the switch start callback function is determined as the start timestamp of the shooting mode switch; and the switch end callback function is triggered at the end of the shooting mode switch, and the timestamp recorded by the switch end callback function is determined as the end timestamp of the shooting mode switch. By recording the start timestamp of the shooting mode switch and the end timestamp of the shooting mode switch in the above callback function recording manner, the start timestamp of the shooting mode switch and the end timestamp of the shooting mode switch can be accurately recorded, so that the tag information of the shooting mode switch recorded during the video shooting process is more accurate.

The process of generating the tag information of the above-mentioned shooting mode switching and writing the generated tag information into the shot video is described below with an example.

FIG7 is a flow chart of a method for generating label information for shooting mode switching provided in an embodiment of the present application. As shown in FIG7 , in an embodiment of the present application, in the process of shooting a video, the label information for switching the video shooting mode involves the generation of two types of label information. One is the label information for the shooting mode switching corresponding to the lens scene switching, for example, it can be the label information for the shooting mode switching from a single-channel shooting mode to a dual-channel shooting mode. The other is the label information for the shooting mode switching of the lens switching transition, for example, it can be the switching from the front-to-back picture-in-picture shooting mode (i.e., the shooting mode in which the foreground picture captured by the front camera is placed in the background picture captured by the rear camera) to the rear-to-front picture-in-picture shooting mode (i.e., the shooting mode in which the background picture captured by the rear camera is placed in the foreground picture captured by the front camera) in the dual-channel shooting mode.

Step S701: the electronic device starts a camera application, and the camera application loads a multi-lens mode;

Step S702: In the multi-lens mode, loading the video tag function of the camera application;

Step S703: The video tag function of the camera application registers a callback function, for example, configures a monitoring function for the shooting mode switch, for example, configures the trigger conditions of the callback function corresponding to recording the start of the shooting mode switch and the end of the shooting mode switch. For example, by configuring the trigger conditions of the switch start callback function, when the trigger conditions are met, the switch start callback function records the start timestamp of the shooting mode switch; by configuring the trigger conditions of the switch end callback function, when the trigger conditions are met, the switch end callback function records the end timestamp of the shooting mode switch.

Step S704: the electronic device receives a mode switching operation input by the user, the mode switching operation is used to determine the shooting mode of the electronic device when starting shooting (i.e., the first shooting mode mentioned above, i.e., the shooting mode before the lens scene is switched, and in this embodiment, the first shooting mode is taken as the single-channel shooting mode as an example), and the mode switcher of the electronic device switches the multi-lens mode in response to the mode switching operation, and determines to adopt the first shooting mode for shooting;

Step S705: The mode switcher turns on the camera through the device factory;

Step S706: the device factory and the camera capture session controller create a session flow;

Step S707: the camera capture session controller calls back the preview stream to the mode switcher. That is, in this embodiment, the single-channel shooting mode is started, and the video is shot in the single-channel shooting mode, and the video screen obtained by shooting is displayed on the display interface of the electronic device;

Step S708: the mode switch of the electronic device receives a start shooting instruction input by the user, that is, the camera starts shooting in a single-channel shooting mode;

Step S709: In response to the start shooting instruction, the time base of the tag (TAG) is recorded, that is, the start time point of the timestamp. For example, the timestamp of the first frame of the preview stream encoding can be obtained and recorded as the time base T0 of the tag recording.

Step S710: the video tag function module records the shot scene TAG, starting with timestamp T0;

Step S711: the mode switch receives a (shooting) mode switching instruction input by the user, and in response to the mode switching instruction, switches the current single-channel shooting mode to a dual-channel shooting mode.

Step S712: the video tag function module records the shot scene TAG, and the end timestamp is the timestamp T1 of the last frame image before the mode switching;

Step S713: the video tag function module monitors the shooting mode switching operation (ie, the switching operation from the single-channel shooting mode to the dual-channel shooting mode), and records the start timestamp of the current shooting mode switching and the end timestamp of the shooting mode switching.

In specific implementation, assuming that the trigger condition of the above-mentioned configuration switching start callback function is to monitor the last frame image of the shooting mode before switching, when the video tag function module monitors the last frame image of the single-channel shooting mode, it triggers the switching start callback function to record the timestamp of the last frame image as the start timestamp T1 of the shooting mode switching.

Step S714: the video tag function module monitors the shooting mode switching operation (ie, the switching operation from the single-channel shooting mode to the dual-channel shooting mode), and records the end timestamp of the current shooting mode switching.

Assuming that the trigger condition of the above-configured switching end callback function is when the first frame image of the shooting mode after switching is monitored, the video tag function module triggers the switching end callback function when monitoring the first frame image of the dual-channel shooting mode to record the timestamp of the first frame image as the end timestamp T2 of the shooting mode switching.

Step S715: After the electronic device switches to the two-way shooting mode, the switched two-way shooting mode is used for shooting, and the video stream obtained after shooting in the two-way shooting mode is displayed on the display interface of the electronic device. For example, when the two-way shooting mode is a front and back picture-in-picture shooting mode, what is displayed on the display interface of the electronic device is that the foreground picture captured by the front camera is placed in the background picture captured by the rear camera.

Step S716: The mode switcher of the electronic device receives the lens transition instruction, and in response to the lens transition instruction, switches the current front-back picture-in-picture shooting mode to the rear-front picture-in-picture shooting mode (i.e., the shooting mode in which the rear scene captured by the rear camera is placed in the foreground scene captured by the front camera). After switching to the rear-front picture-in-picture shooting mode, what is displayed on the display interface of the electronic device is that the rear scene captured by the rear camera is placed in the foreground scene captured by the front camera.

Step S717: the video tag function module monitors the shooting mode switching operation (ie, the switching operation of switching the front and back picture-in-picture shooting mode to the back and front picture-in-picture shooting mode), and records the start timestamp of the current shooting mode switching.

In specific implementation, assuming that the trigger condition of the above-mentioned configuration switching start callback function is to monitor the last frame image of the shooting mode before switching, the video tag function module will trigger the switching start callback function when monitoring the last frame image of the front and back picture-in-picture shooting mode, and record the timestamp of the last frame image as the start timestamp T3 of the shooting mode switching.

Step S718: the video tag function module monitors the shooting mode switching operation (ie, the switching operation of switching the front and back picture-in-picture shooting mode to the back and front picture-in-picture shooting mode), and records the end timestamp of the current shooting mode switching.

Assuming that the trigger condition of the above-configured switching end callback function is when the first frame image of the shooting mode after switching is monitored, the video tag function module will trigger the switching end callback function when monitoring the first frame image of the back-to-front picture-in-picture shooting mode, and record the timestamp of the first frame image as the end timestamp T4 of the shooting mode switching.

Step S719: The electronic device receives the end shooting instruction input by the user, and in response to the end shooting instruction, the multi-lens mode of the camera application generates a shot video (i.e., the above-mentioned target video, which can be an MP4 video) based on the captured video stream. After the video tag function module monitors the above-mentioned end shooting instruction, it combines the tag information corresponding to the above-mentioned two shooting mode switches with the above-mentioned target video to generate a first video file.

Through the above processing, during the video shooting process, when the shooting mode is switched, corresponding tag information will be generated for the shooting mode switch, which provides a basis for subsequently writing the tag information into the video file obtained by shooting.

It should be noted that the shooting mode switching corresponding to the above-mentioned lens scene switching and the shooting mode of the lens switching transition are only an implementation and can also be applied to other mode switching.

In addition, the above embodiment only lists two shooting mode switches. During the process of shooting a video, the number of shooting mode switches may not be limited, for example, it may be one, three, or more.

Step S503: Acquire a target video obtained by shooting videos in the first shooting mode and the second shooting mode.

In the embodiment of the present application, when shooting in the first shooting mode and shooting in the second shooting mode, the target video can be obtained by mixing the audio and video while shooting. That is, the video image and the audio in the shooting process from the beginning of shooting in the first shooting mode to the end of shooting in the second shooting mode are mixed to obtain the target video.

Step S504: Generate a first video file based on the tag information and the target video.

In the embodiment of the present application, after obtaining the tag information of the shooting mode switching, the tag information is combined with the target video obtained by shooting, and then the first video file is obtained. Therefore, the first video file obtained carries the tag information identifying the shooting mode switching, and thus the shooting mode switching process during the video shooting process can be identified according to the tag information.

In one implementation, the target video is a mixed video of audio and video obtained by mixing audio and video obtained by video shooting. In step S504, combining the tag information with the target video to generate the first video file includes calling a newly added tag setting interface, writing the tag information into the video information description area of the target video, and calling a stop interface to complete the generation of the first video file.

FIG8 is a flowchart of generating a first video file based on tag information and a target video provided by an embodiment of the present application. As shown in FIG8, in the related art, during the process of video shooting by an electronic device (a camera in an electronic device), two data tracks are generated, namely an audio track and a video track. After the video shooting is completed, these two tracks need to be mixed and packaged to generate a final video file (for example, an MP4 video file). In an embodiment of the present application, the process of generating a video file by shooting a video by an electronic device is roughly as follows:

S801, after the camera shoots the video, it can call the addTrack (track addition) interface in the MediaMuxer class ((third) media mixer) through the transparent transmission of the first media mixer (HwMediaMuxerEx) and the second media mixer (HwMediaMuxer) to add the audio track and the video track to the MPEG4Writer class (writer).

S802, the camera calls the start interface and the WriteSampleData interface in the MediaMuxer class to start mixing audio and video to obtain a target video (for example, an MP4 video).

S803, the camera calls the setUserTag (tag setting) interface in the MediaMuxer class, and writes the TAG information corresponding to the target video into the video information description area of the target video (the video information description area is the area where the field to which the TAG information belongs is stored). For example, when the recorded TAG information is scene information, the scene identifier corresponding to the scene information (for example, the identifier corresponding to the single-mode shooting mode), the start timestamp of the scene, and the end timestamp of the scene are written into the scene field corresponding to the scene information. For another example, when the recorded TAG information is transition information, the transition identifier corresponding to the transition information (for example, the switching identifier for switching from the single-mode shooting mode to the dual-mode shooting mode, the start timestamp of the transition, and the end timestamp of the transition are written into the transition field corresponding to the transition information).

For example, the following code can be used to call the setUserTag interface to write the tag information into the information field corresponding to the target video. That is, the tag information passed by the camera application is copied to the memory through the following code, and then written to the MP4 file together with other video information:

S804, the camera calls the stop interface to generate a final MP4 video file, and the obtained MP4 video file is the first video file, thereby completing the purpose of combining the tag information with the target video to generate the first video file.

In the related art, generally, after audio and video are mixed in step S702 and the target video is obtained, the stop interface (i.e., the stop interface mentioned above) can be called to generate an MP4 video file. However, in order to achieve the goal of writing the TAG information recorded during the video shooting process (i.e., the tag information corresponding to the shooting mode switch mentioned above) into the MP4 video (i.e., the target video mentioned above), in the embodiment of the present application, the setUserTag interface (i.e., the tag setting interface mentioned above) is added to the MPEG4Writer class and the MediaMuxer class, and the HwMediaMuxer class is added for the camera to call. Before calling the stop interface, the camera first calls the setUserTag interface in the MediaMuxer class through the HwMediaMuxer class to write the TAG information corresponding to the target video into the video information description area corresponding to the target video to obtain the first video file.

It should be noted that the first video file involved in the embodiment of the present application may include multiple areas, and the multiple different areas are used to store different contents. For example, the multiple areas may include an information area and a video area, wherein the information area is used to store description information, and the video information description area referred to above belongs to the information area; the video area is used to store the video stream itself (for example, the target video).

When the tag information is combined with the target video to generate the first video file, the following method may be used:

When the camera calls the start (start) interface and WriteSampleData (data writing) interface in the MediaMuxer class to mix audio and video and obtain an audio and video mixed stream, it can start the encoding thread for the audio and video mixed stream, send the audio and video mixed stream to the predetermined encoder, and use the predetermined encoder to encode it into a video file in a predetermined format (for example, a video file in MP4 format). After the audio and video mixing is completed, call the setUserTag (tag setting) interface in the MediaMuxer class to write the TAG information corresponding to the target video into the video information description area of the target video (that is, the field corresponding to the above tag information). After the encoding of the audio and video mixed stream corresponding to the target video is completed, the encoding operation continues to use the predetermined encoder to encode the TAG information field written in the video information description area, and refresh the encoded TAG information into the video file in the predetermined format. After the TAG information encoding is completed, call the stop interface to generate the final MP4 video file, that is, the first video file.

Based on the above optional embodiment, after obtaining the tag information corresponding to the above shooting mode switching, the tag information can be combined with the target video obtained by shooting to generate a first video file. The first video file obtained in this way carries the tag information of all shooting mode switches included in the entire shooting process. After obtaining the above first video file through the camera application, the obtained first video file can be directly sent to the video editing application, or the obtained first video file can be stored locally or in the media library. When the video editing application needs to operate based on the user, the first video file is called based on the path of the file.

Step S505: based on the tag information in the first video file, the switching process from the first shooting mode to the second shooting mode in the first video file is edited to obtain a second video file.

In a specific implementation, when a first video file carrying tag information is obtained, the switching process of switching from the first shooting mode in the first video file to the second shooting mode in the first video file can be edited based on the tag information in the first video file to obtain an edited second video file. For example, the camera application can send the first video file obtained by shooting to a video editing application. When the video editing application obtains the first tag file, it can first decode the first tag file using a decoder corresponding to the encoder in the camera application to obtain the target video in the first video file and the tag information corresponding to the identification mode switching. Then, based on the tag information in the first video file, the switching process of switching from the first shooting mode in the first video file to the second shooting mode in the first video file is edited to obtain a second video file.

In addition, based on the tag information in the first video file, different video editing strategies may be used to edit the switching process of switching from the first shooting mode in the first video file to the second shooting mode in the first video file to obtain the second video file. Different video editing strategies may edit the switching process of switching from the first shooting mode in the first video file to the second shooting mode in the first video file in different ways, and thus the obtained second video files may also be different.

As an optional implementation, the video editing strategy may be to perform video editing according to a predetermined video editing template, or to edit the switching process from the first shooting mode to the second shooting mode in the first video file by randomly calling resources required for the video generation process.

FIG9 is a flow chart of a video editing method in a video processing method provided in an embodiment of the present application. As shown in FIG9 , the video editing method includes the following process:

Step S901: Start a video editing application, and display the interface of the video editing application on the display interface of the electronic device. The interface displays selection controls identifying video editing strategies, including: randomly generated video controls and template generated video controls.

Step S902: receiving a video editing strategy selection instruction input by a user, and generating a video in response to the video editing strategy selection instruction.

Step S903: When the video editing strategy selection instruction received by the electronic device is to randomly generate a video, a random video generation method is used to generate a video. For example, the opening and ending materials are randomly selected for the video in the first video file, the filter parameters of the filter are randomly selected, the sticker materials are randomly selected, the video border is randomly selected, etc. When the process of switching the shooting mode is processed based on the tag information in the first video file, a random special effects processing method is used for processing. Based on the above random processing method, the edited video is obtained, and then the second video file referred to above is generated.

Step S904: When the video editing strategy selection instruction received by the electronic device is to generate a video for a video editing template, a predetermined video editing template is used to generate a video. For example, the video in the first video file is edited based on the material configured by the predetermined video editing template to obtain an edited video, and then the second video file referred to above is generated. For example, the opening and ending materials configured in the video editing template are used to edit the opening and ending, the filter parameters configured in the video editing template are used to adjust the filter to process the video, the sticker material configured in the video editing template is used to add stickers to the video, and the border material configured in the video editing template is used to add a border to the video, etc. When processing the process of switching the shooting mode based on the tag information in the first video file, the processing method configured in the video editing template (for example, the method of inserting the switching image frame described in detail below, the method of extending the playback of the image frame before switching, etc.) is used to process the switching of the shooting mode. Based on the above random processing method, the edited video is obtained, and then the second video file referred to above is generated.

Through the above processing, since the first video file used for editing includes tag information for shooting mode switching, when editing the video in the first video file, the shooting mode switching can be selectively and automatically processed based on the tag information. While ensuring the quality of the produced video, the video production efficiency is also high.

It should be noted that the above video editing strategies only list strategies for randomly generating videos and strategies for generating videos using video editing templates, but a combination of the two strategies or other strategies for generating videos may also be adopted, which are not limited here.

As an optional embodiment, editing the switching process of switching from the first shooting mode in the first video file to the second shooting mode in the first video file to obtain the second video file may include: when the video editing strategy includes editing using a video editing template, obtaining a video editing template, and using the obtained video editing template to edit the switching process of switching from the first shooting mode in the first video file to the second shooting mode in the first video file to obtain the second video file. When the video editing template is used to edit the switching process of switching from the first shooting mode in the first video file to the second shooting mode in the first video file, the calling resources in the video editing template can also be flexibly and randomly selected in a certain resource library. For example, when it is necessary to insert a certain motion effect in the switching process of switching the shooting mode, the video editing template can only set the inserted motion effect to belong to a certain style, without determining a specific motion effect from the many motion effects of the certain style. With the above processing, even if the video editing template is used to edit the switching process of switching from the first shooting mode in the first video file to the second shooting mode, a diverse video can be obtained to avoid the situation where the obtained video is too single and the viewing experience is poor.

As an optional implementation, when a video editing template is used to edit the switching process of switching the first shooting mode in the first video file to the second shooting mode in the first video file to obtain the second video file, the video editing template can be selected from a large number of video editing templates. For a video editing template, there are corresponding materials and/or parameters configured for the template. For example, there are materials corresponding to the opening and ending of the target video, filter parameters corresponding to the filter function performed for the target video, stickers corresponding to the configuration of the target video, special effects materials configured for the target video, and border materials configured for the target video. For example, the predetermined video editing template may include: the opening and ending are to play predetermined background music, the filter parameters corresponding to black, white and gray are used in the middle of the target video in the 2nd to 3rd minute to achieve a retro effect, stickers are added to the video frame image in the 4th to 5th minute of the target video, a special effect in the special effects resource library is played on the video frame image in the 6th to 7th minute of the target video, and a pure black border is set for the target video. Therefore, after editing using this video editing template, what is obtained is a video that adds a pure black border to the original video content, plays the above-mentioned predetermined background music at the beginning and end of the video, introduces a filter to present a retro effect in the 2nd to 3rd minutes, has stickers on the video frame image in the 4th to 5th minutes, and plays special effects in the 6th to 7th minutes.

Based on the above optional embodiment, when a first video file carrying tag information of shooting mode switching is obtained, the switching process of switching from the first shooting mode in the first video file to the second shooting mode in the first video file can be edited based on the tag information in the first video file to obtain a second video file. For example, when editing the switching process of switching from the first shooting mode in the first video file to the second shooting mode in the first video file based on the above tag information, multiple methods can be used. For example, the following process can be used to edit the switching process of switching from the first shooting mode in the first video file to the second shooting mode in the first video file.

FIG10 is a schematic diagram of a process for editing a video in a first video file provided by an embodiment of the present application. As shown in FIG10 , the process includes the following steps:

Step S1001: extracting tag information from a first video file.

As an optional implementation, before editing the switching process from the first shooting mode to the second shooting mode in the first video file, the information related to the target video can be read from the video information description area in the first video file, for example, the tag information written in the video shooting stage is read from the video information description area. Among them, the video information description area can be the information description area of the above-mentioned target video, or it can be the information area of the video tag reset to store the tag information. In the embodiment of the present application, it is not specifically limited. It should be noted that before editing the switching process from the first shooting mode to the second shooting mode in the first video file, other information of the video may also be read from the video information description area, for example, the size of the video, the encoding method of the video, the format of the video, etc., but the process of reading this information is similar to the practice of the related art, and will not be described in detail here.

Step S1002: Determine the start timestamp and the end timestamp of the shooting mode switch in the first video file according to the tag information.

As an optional implementation, based on the tag information extracted from the first video file, relevant information of the shooting mode switching is determined, for example, identification information for identifying the shooting mode switching, the start timestamp of the shooting mode switching, and the end timestamp of the shooting mode switching, so as to subsequently locate the position of the shooting mode switching process in the video.

Step S1003: based on the time period from the start timestamp to the end timestamp, the switching process of switching the first shooting mode in the first video file to the second shooting mode in the first video file is edited to obtain a second video file.

As an optional implementation, based on the time period from the start timestamp to the end timestamp, the switching process of switching from the first shooting mode to the second shooting mode in the first video file is edited to obtain the second video file. By locating the time period corresponding to the shooting mode switching in the target video, and processing and editing the time period of the target video based on a predetermined video editing strategy, a second video file with better quality is automatically obtained.

Specifically, when the switching process from the first shooting mode in the first video file to the second shooting mode in the first video file is edited based on the time period from the start timestamp to the end timestamp to obtain the second video file, a processing method for the shooting mode switching item can be added to the configuration of the predetermined video editing template on the basis of editing the switching process from the first shooting mode in the first video file to the second shooting mode in the first video file based on the predetermined video editing template as described above. Therefore, when editing the switching process from the first shooting mode in the first video file to the second shooting mode in the first video file based on the predetermined video editing template, the shooting mode switching is processed using the processing method configured in the video editing template for shooting mode switching, thereby completing the automated production of the video and truly achieving one-click filming.

As an optional implementation, based on the time period from the start timestamp to the end timestamp, the switching process from the first shooting mode to the second shooting mode in the first video file is edited to obtain the second video file. When editing using a video editing template, a variety of processing methods can be configured in the video editing template for shooting mode switching. Different processing methods are used to edit videos to automatically complete video production. The process is also different, and examples are given below to illustrate each of them.

As an optional implementation, based on the time period from the start timestamp to the end timestamp, editing the video in the first video file to obtain the second video file may include: obtaining a switching image frame; inserting the switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain a processed video, and editing the processed video to obtain a second video file; or, in the process of editing the target video, inserting the switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain the second video file. Through the above processing, that is, by inserting the image frame in the time period corresponding to the shooting mode switch to fill the process of the shooting mode switch, it is effectively avoided that the image is blurred when displaying the switching process, so that the user cannot perceive the switch when watching the video later.

Therefore, as an optional implementation, when editing the switching process from the first shooting mode to the second shooting mode in the first video file based on the time period from the start timestamp to the end timestamp to obtain the second video file, it can be that the target video in the first video file is first processed based on the time period from the start timestamp to the end timestamp to obtain the processed video, and then the processed video is edited based on the video editing template to obtain the second video file. It can also be that in the process of editing the target video using the video editing template, when editing the time period from the start timestamp to the end timestamp in the target video, the time period is processed to obtain the second video file. Therefore, when editing a video using the video editing template, the video editing template can be used to edit the original target video, and the video editing template can also be used to edit the processed video.

It should be noted that regardless of whether the above-mentioned method of first processing the video and then editing the processed video to obtain the second video file is adopted, or the method of processing the video while editing (i.e. processing the video during the editing process) is adopted to obtain the second video file, a predetermined encoder can be used to encode the edited video stream to obtain a second video file in a predetermined encoding format.

Figure 11 is a schematic diagram of editing the shooting mode switching in a video based on tag information provided in an embodiment of the present application. As shown in Figure 11, image frames are inserted in the time period from the start timestamp T1 to the end timestamp T2. When such a processing method is adopted, the image frames originally shot in the first shooting mode and the image frames shot in the second shooting mode are all within the corresponding time period, which will not affect the original information of the original video, and the originally shot video content can be most realistically reflected in the edited video.

As an optional implementation, the image frames in the process of inserting the shooting mode switching can be obtained in a variety of ways. For example, obtaining the switching image frame may include: intercepting the target image frame from the target video obtained by shooting the video in the first shooting mode; adjusting the corresponding image parameters of the target image frame based on the change parameters of the first shooting mode switching to the second shooting mode to obtain the switching image frame. It should be noted that the intercepted target image frame can be a frame of image or multiple frames of image. For example, when the target image frame is a frame of image, it can be the last frame of image obtained when shooting the video in the first shooting mode, or it can be other frames of image before the last frame of image, which can be flexibly selected according to the needs. For another example, when the target image frame is a multi-frame image, it can be a continuous multi-frame image intercepted from the video image frame obtained by shooting the video in the first shooting mode, it can be a multi-frame image starting from the last frame of image, or it can be a multi-frame image starting from the middle frame before the last frame.

When adjusting the corresponding image parameters of the target image frame based on the change parameters of switching from the first shooting mode to the second shooting mode to obtain the switching image frame, a variety of methods can be used. For example, when the target image frame is a single-frame image, the image adjustment parameters corresponding to each switching image frame in the switching process are calculated according to the shooting mode switching strategy (switching duration, switching frame rate, switching effect, etc.), and the target image frame is adjusted according to the corresponding image adjustment parameters to obtain the corresponding switching image frame. For another example, when the target image frame is a multi-frame image, the number of switching image frames required to be obtained for the multi-frame image is calculated according to the shooting mode switching strategy (switching duration, switching frame rate, switching effect, etc.), and the image adjustment parameters of the corresponding number of switching image frames are calculated for each frame image in the multi-frame image, and the frame image is adjusted based on the corresponding image adjustment parameters to obtain the switching image frame corresponding to the frame image. Afterwards, based on the position of each frame image in the multi-frame image, the corresponding switching image frame is arranged after the frame image to obtain all the switching frame images included in the switching process of the shooting mode switching.

It should be pointed out that when the switching image frame is inserted into the time period from the start timestamp to the end timestamp, smoothness can be achieved as long as the blurred time period of the picture can be filled. For example, the target image frame can be directly selected from the video image frame obtained by shooting the video in the first shooting mode for filling. The direct filling method is simple to operate, but when the generated video is played, since the target image frame has been played in the previous time, if it is played again, it may cause the picture to be repeated, causing the viewer to see the picture stagnant. When the image parameters of the target image frame captured from the video image frame are adjusted to obtain the switching image frame, on the one hand, it will not cause the above-mentioned picture stagnation. Since it is obtained by adjusting the image parameters of the image frame of the original picture, it has a certain similarity with the original picture, and there will be no abrupt situation caused by excessive picture difference, thus achieving the benefit of smooth transition switching.

As an optional implementation, when adjusting the corresponding image parameters of the target image frame based on the change parameters when the first shooting mode is switched to the second shooting mode to obtain the switched image frame, the following method can be adopted: when the switching from the first shooting mode to the second shooting mode is a switch between different shooting speeds, the speed difference between the first shooting speed of the first shooting mode and the second shooting speed of the second shooting mode is obtained, and the image parameters of the target image frame are adjusted corresponding to the speed difference to obtain the switched image frame; or, when the switching from the first shooting mode to the second shooting mode is a switch between different lens focal lengths, the focal length difference between the first shooting focal length of the first shooting mode and the second shooting focal length of the second shooting mode is obtained, and the image parameters of the target image frame are adjusted corresponding to the focal length difference to obtain the switched image frame.

For example, when the switching from the first shooting mode to the second shooting mode is a switching between different shooting speeds, for example, the shooting speed of the first shooting mode is 2 times the shooting speed, and the shooting speed of the second shooting mode is 0.5 times the shooting speed, then based on the speed difference between the shooting speeds of the first shooting mode and the shooting speeds of the second shooting mode, the shooting speed of the target image frame can be adjusted from 2 times to the normal shooting speed of 1 times, thereby obtaining a switching image frame. For another example, when the switching from the first shooting mode to the second shooting mode is a switching between different lens focal lengths, the shooting focal length of the first shooting mode is 1, and the shooting focal length of the second shooting mode is 0.8, based on the focal length difference between the shooting focal length of the first shooting mode and the shooting focal length of the second shooting mode, the shooting focal length of the target image frame can be adjusted from 1 to 0.9, thereby obtaining a switching image frame.

It should be noted that when obtaining the image adjustment parameters corresponding to the switching image frame, multiple methods can be used, for example, the image adjustment parameters can be calculated by a calculation module in the OpenGL renderer. In addition, the image adjustment parameters can also include multiple types, for example, they can include rotation angle, scaling, transparency, blur, displacement, etc.

When processing the shooting mode switch in the target video by inserting the switching image frame, there can be two corresponding processing forms corresponding to the above two encoding methods: one is to insert the switching image frame into the position corresponding to the shooting mode switching process in the target video to obtain a complete video stream, and then encode the complete video stream using a predetermined encoder to obtain a second video file in a predetermined file format; the other is to encode the video stream before the shooting mode switch in the target video using a predetermined encoder to obtain a video file in a predetermined file format, and when encoding to the start timestamp of the shooting mode switch, continue to encode the inserted switching image frame, and update the encoded stream corresponding to the switching image frame to the file in the predetermined file format, and when encoding to the end time position of the shooting mode switch, continue to encode the video stream after the shooting mode switch in the target video, and continue to update the encoded stream of the video stream after the shooting mode switch to the video file in the predetermined format to obtain the second video file.

As an optional implementation, based on the time period from the start timestamp to the end timestamp, the switching process of switching from the first shooting mode to the second shooting mode in the first video file is edited to obtain the second video file. The following method can also be used: obtain a predetermined number of video image frames before the start timestamp; determine a third time period based on the first time period from the start timestamp to the end timestamp and the second time period of the predetermined number of video image frames, wherein the third time period is the sum of the first time period and the second time period; extend the second time period where the predetermined number of video image frames are located in the target video to the second time period to obtain a processed video, and edit the processed video to obtain a second video file; or, in the process of editing the target video, extend the second time period where the predetermined number of video image frames are located in the target video to the third time period to obtain the second video file. Through the above processing, that is, by adjusting the playback parameters of the predetermined number of video image frames before the shooting mode switching, the predetermined number of video image frames are extended to play, thereby filling the process of the shooting mode switching, effectively avoiding the situation of image blur when displaying the switching process, and also enabling the user to not perceive the switch when watching the video later.

As an optional embodiment, editing the processed video to obtain a second video file includes: obtaining a predetermined video editing template; using the predetermined video editing template to edit the processed video to obtain a second video file. The above-mentioned processed video is a video obtained by inserting a switching image frame in the time period from the start timestamp to the end timestamp in the target video; or, a video obtained by extending the second time period where a predetermined number of video image frames are located to the second time period in the target video. As above, the predetermined video editing template can also be used to edit the switching process from the first shooting mode to the second shooting mode in the first video file to obtain a second video file.

FIG12 is a schematic diagram of editing the shooting mode switching in the target video based on tag information provided by an embodiment of the present application. As shown in FIG12, the timestamp corresponding to the predetermined number of video image frames from the start timestamp T1 to the start timestamp T1 is T3, and the predetermined number of image frames are adjusted from the original playback in the time period (T5-T1) from the timestamp T5 to the start timestamp T1 to the time period (T5-T2) from the timestamp T5 to the end timestamp T2, that is, by adjusting the predetermined number of image frames from the playback in the time period (T5-T1) to the playback in the time period (T5-T2), since the time period (T5-T2) is greater than the time period (T5-T1), the extended playback of the predetermined number of video image frames is achieved. When such a processing method is adopted, there is also a playback image in the switching process (T1-T2) of the shooting mode switching, and there will be no image blur or dark screen. Moreover, in the process of switching the shooting mode, only the original normal playback image frames are slowed down, and there will not be much difference visually, and there is no need to obtain additional switching image frames, the operation is simple, and the processing efficiency is high.

When processing the shooting mode switch in the target video by extending the playback of a predetermined number of video image frames, there are two corresponding processing forms corresponding to the above two encoding methods: one is to first extend the playback of the predetermined number of video image frames to obtain a complete video stream, and then encode the complete video stream using a predetermined encoder to obtain a second video file in a predetermined file format; the other is to encode the video stream of the time period before the extended playback in the target video using a predetermined encoder to obtain a video file in a predetermined file format, and when encoding to the start timestamp corresponding to the time period of extended playback, continue to encode the video image frames in the time period, and update the encoded streams corresponding to the video image frames in the time period to the file in the predetermined file format, and when encoding to the end time position of the shooting mode switch, continue to encode the video stream after the shooting mode switch in the target video, and continue to update the encoded stream of the video stream after the shooting mode switch to the video file in the predetermined format to obtain the second video file.

FIG13 is a schematic diagram of a video processing method provided by an embodiment of the present application. The method can be applied to the electronic device of FIG1 . As shown in FIG13 , the video processing method includes two aspects of processing: the first aspect is mainly that the camera application starts the corresponding camera lens to shoot a video, and records the tag information of the shooting mode switch executed during the shooting process in real time, and combines the recorded tag information with the video obtained by shooting to generate a video file (i.e., the above-mentioned first video file) (such as the processing process shown in FIG7 and FIG8 above, which will not be described in detail here); the second aspect is mainly that the video editing application obtains the video file obtained by the camera application, and generates a video based on the tag information carried in the video file. The following is explained in conjunction with FIG13 . As shown in FIG13 , the video processing method includes the following process.

Step S1301: Use a camera application to shoot a video, and during the video shooting process, record tag information of the shooting mode switching.

After the video shooting is completed, the original video shot by the camera application is obtained (for example, stored in the above-mentioned target video). After obtaining the original video, the following operations can be performed: a video file is generated based on the original video and the relevant description information of the video. The relevant description information of the video includes: the tag information of the above-mentioned record, the special type tag No. 0 that identifies the video type (for example, dual-camera video), the size information of the video, the encoding method information of the video, etc.

Step S1302: After performing the above operations, the obtained first video file carrying the tag information is stored in the camera directory, that is, stored in the predetermined storage space of the camera application.

Step S1303: Since the video in the first video file is newly shot, the camera will store the relevant description information of the newly shot video in the media provider (MediaProvider), so as to provide the relevant description information of the first video file to the demander who needs the first video file later.

Step S1304: When the media provider receives the relevant description information of the first video file, a corresponding notification message is triggered, and the notification message is used to notify the media database to synchronize the relevant description information of the new first video file.

Step S1305: After receiving the notification, the media database scans and parses the extended meta information such as the special type tag No. 0, and stores the relevant description information of the video in the first video file.

Step S1306: After the video file carrying the tag information corresponding to the shooting mode switching is stored and locally synchronized, the display interface of the electronic device can be jumped, for example, the shooting display interface of the camera can be jumped to the video editing interface. When jumping to the video editing interface, the path of the first video file can be carried.

Step S1307: Based on the path of the first video file, read the first video file from the file storage.

Step S1308: Read the tag information carried in the first video file, and then edit the mode switching process in the first video file based on the tag information and a predetermined video editing strategy to obtain a second video file. For example, it can be a 15-30s Vlog short film generated based on a predetermined video editing template (including a music template or a background image template).

Step S1309: Store the obtained second video file in the file storage.

FIG14 is a software structure block diagram of an electronic device provided in an embodiment of the present application. The software architecture of this embodiment is only used as an example and can also be applied to other operating systems. In this embodiment, the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, namely, the application layer, the framework layer, the hardware abstraction layer, and the hardware layer from top to bottom.

The application layer (Application, App) can include a series of application packages. For example, the application package can include a camera application. The application layer can be divided into display interface and application logic.

The display interface of the camera application includes single view mode, dual view mode, picture-in-picture mode, etc. Among them, in the single view mode, only one shooting screen is displayed; in the dual view mode, two shooting screens are displayed side by side; in the picture-in-picture mode, two shooting screens are displayed, and one shooting screen is located in the other shooting screen.

The application logic of the camera application includes a switching control module, a video tag function module, a multi-camera encoding module, etc. The switching control module is used to control the switching of shooting modes; the video tag function is used to record the tag information of the shooting mode switching during the shooting mode switching process; the multi-camera encoding is used to maintain the encoding during the shooting mode switching process and generate a video file.

The framework layer (Framework, FWK) provides application programming interface (application programming interface, API) and programming framework for the application layer, including some predefined functions. In Figure 14, the framework layer includes the camera access interface (Camera2 API). Camera2 API is a set of interfaces for accessing camera devices launched by Android. It adopts a pipeline design to make the data flow from the camera to the Surface. Camera2 API includes camera management (CameraManager) and camera device (CameraDevice). CameraManager is the management class of the Camera device. Through this class object, the Camera device information of the device can be queried to obtain the CameraDevice object. CameraDevice provides a series of fixed parameters related to the Camera device, such as basic settings and output format.

The hardware abstraction layer (HAL) is an interface layer between the operating system kernel and the hardware circuit, and its purpose is to abstract the hardware. It hides the hardware interface details of a specific platform and provides a virtual hardware platform for the operating system, making it hardware-independent and portable on multiple platforms. In Figure 14, HAL includes the camera hardware abstraction layer (Camera HAL), and the Camera HAL includes Device 1, Device 2, Device 3, etc. It can be understood that Device 1, Device 2, and Device 3 are abstract devices.

The hardware layer (HardWare, HW) is the hardware at the bottom layer of the operating system. In FIG14 , HW includes CameraDevice 1, CameraDevice 2, CameraDevice 3, etc. Among them, CameraDevice 1, CameraDevice 2, and CameraDevice 3 may correspond to multiple cameras on an electronic device.

Figure 15 is a structural block diagram of a video processing device provided in an embodiment of the present application. The video processing can be applied to the above-mentioned electronic device. As shown in Figure 15, the video processing device includes: a receiving module 1501, a processing module 1502, an acquisition module 1503, a generation module 1504 and an editing module 1505. The device is described below.

The receiving module 1501 is used to obtain a shooting mode switching operation during video shooting in the first shooting mode;

a processing module 1502, connected to the receiving module 1501, for switching the first shooting mode to the second shooting mode in response to the shooting mode switching operation, and recording tag information of the shooting mode switching, wherein the tag information of the shooting mode switching is used to mark that the first shooting mode is switched to the second shooting mode during the video shooting process;

An acquisition module 1503, connected to the processing module 1502, is used to acquire a target video obtained by shooting a video in the first shooting mode and the second shooting mode;

A generating module 1504, connected to the acquiring module 1503, for generating a first video file based on the tag information and the target video;

The editing module 1505 is connected to the generating module 1504 and is used to edit the switching process of switching the first shooting mode in the first video file to the second shooting mode in the first video file based on the tag information in the first video file to obtain the second video file.

As an optional embodiment, the processing module 1502 includes:

The recording unit is used to record a switching identifier of the shooting mode switching, a start timestamp of the shooting mode switching, and an end timestamp of the shooting mode switching, wherein the tag information includes: the switching identifier, the start timestamp, and the end timestamp.

As an optional embodiment, the recording unit includes:

A recording subunit is used to determine a switching identifier for a shooting mode switch based on a first shooting mode before the shooting mode switch and a second shooting mode after the shooting mode switch; trigger a switching start callback function at the start of the shooting mode switch, and determine the timestamp recorded by the switching start callback function as the start timestamp of the shooting mode switch; and trigger a switching end callback function at the end of the shooting mode switch, and determine the timestamp recorded by the switching end callback function as the end timestamp of the shooting mode switch.

As an optional embodiment, the generating module 1504 includes:

The writing unit is used to call the newly added tag setting interface to write the tag information into the video information description area of the target video, and call the stop interface to complete the generation of the first video file.

As an optional embodiment, the editing module 1505 includes:

An extraction unit, used to extract tag information from the first video file;

A determination unit, configured to determine a start timestamp and an end timestamp of a shooting mode switch in a first video file according to the tag information;

The editing unit is used to edit the switching process of switching the first shooting mode in the first video file to the second shooting mode in the first video file based on the time period from the start timestamp to the end timestamp to obtain the second video file.

As an optional embodiment, the editing unit includes:

A first acquisition subunit, used for acquiring a switching image frame;

The inserting subunit is used to insert a switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain a processed video, and edit the processed video to obtain a second video file; or, in the process of editing the target video, insert a switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain a second video file.

As an optional embodiment, the first acquisition subunit includes:

A first acquisition sub-subunit is used to capture a target image frame from a video obtained by shooting a video in a first shooting mode; based on a change parameter when the first shooting mode is switched to a second shooting mode, adjust the corresponding image parameters of the target image frame to obtain a switched image frame; or

The first acquisition sub-subunit is used to capture a target image frame from a video obtained by shooting a video in a first shooting mode, wherein the switching image frame includes the target image frame.

As an optional embodiment, the first acquisition sub-subunit is used to:

In the case where the switching from the first shooting mode to the second shooting mode is a switching between different shooting speeds, a speed difference between a first shooting speed of the first shooting mode and a second shooting speed of the second shooting mode is obtained, and an image parameter of a target image frame is adjusted corresponding to the speed difference to obtain a switching image frame; or

When the switch from the first shooting mode to the second shooting mode is a switch between different lens focal lengths, the focal length difference between the first shooting focal length of the first shooting mode and the second shooting focal length of the second shooting mode is obtained, and the image parameters of the target image frame are adjusted corresponding to the focal length difference to obtain a switched image frame.

As an optional embodiment, the editing unit includes:

A second acquisition subunit, used to acquire a predetermined number of video image frames before the start timestamp;

A determination subunit, configured to determine a third time period based on a first time period from a start timestamp to an end timestamp and a second time period in which a predetermined number of video image frames are located, wherein the third time period is the sum of the first time period and the second time period;

The processing subunit is used to extend the second time period in the target video where a predetermined number of video image frames are located to a third time period to obtain a processed video, and edit the processed video to obtain a second video file; or, in the process of editing the target video, extend the second time period in the target video where a predetermined number of video image frames are located to a third time period to obtain a second video file.

As an optional embodiment, the editing unit includes:

A third acquisition subunit is used to acquire a predetermined video editing template;

The editing subunit is used to edit the processed video using a predetermined video editing template to obtain a second video file.

As an optional embodiment, the shooting mode switching includes at least one of the following: switching between different lens modes, switching between transitions within the same lens mode, switching between different shooting speeds, and switching between different lens focal lengths.

Corresponding to the above-mentioned method embodiment, the present application also provides an electronic device, which includes a memory for storing computer program instructions and a processor for executing program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute some or all of the steps in the above-mentioned method embodiment.

In a specific implementation, the present application also provides a computer storage medium, wherein the computer storage medium may store a program, wherein when the program is running, the device where the computer readable storage medium is located is controlled to perform some or all of the steps in the above embodiment. The storage medium may be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).

In a specific implementation, an embodiment of the present application further provides a computer program product, which includes executable instructions. When the executable instructions are executed on a computer, the computer executes some or all of the steps in the above method embodiment.

In the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And/or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and/or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character "/" generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, c can be single or multiple.

Those skilled in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented in a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present invention.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

In several embodiments provided by the present invention, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program codes.

The above are only specific embodiments of the present invention. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. The protection scope of the present invention should be based on the protection scope of the claims.

Claims (24)

1. A video processing method, comprising: In the process of shooting a video in the first shooting mode, obtaining a shooting mode switching operation; In response to the shooting mode switching operation, the first shooting mode is switched to a second shooting mode, and tag information of the shooting mode switching is recorded, wherein the tag information of the shooting mode switching is used to mark that the first shooting mode is switched to the second shooting mode during the video shooting process; Acquire a target video obtained by shooting a video using the first shooting mode and the second shooting mode; Based on the tag information and the target video, generate a first video file; Based on the tag information in the first video file, the switching process from the first shooting mode to the second shooting mode in the first video file is edited to obtain a second video file; the tag information in the first video file includes a start timestamp and an end timestamp of the shooting mode switching in the first video file; The step of editing the switching process from the first shooting mode to the second shooting mode in the first video file based on the tag information in the first video file to obtain a second video file includes: A switching image frame is inserted in the target video within the time period from the start timestamp to the end timestamp to obtain the second video file; the switching image frame is captured from the video obtained by shooting the video in the first shooting mode, or the switching image frame is obtained by adjusting image parameters of an image frame captured from the video obtained by shooting the video in the first shooting mode. 2. The method according to claim 1, wherein the tag information recording the switching of the shooting mode comprises: Recording the switching identifier of the shooting mode switching, the start timestamp of the shooting mode switching, and the end timestamp of the shooting mode switching, wherein the tag information includes: the switching identifier, the start timestamp, and the end timestamp. 3. The method according to claim 2, characterized in that the recording of the switching identifier of the shooting mode switching, the start timestamp of the shooting mode switching, and the end timestamp of the shooting mode switching comprises: determining a switching identifier of the shooting mode switching based on the first shooting mode before the shooting mode switching and the second shooting mode after the shooting mode switching; triggering a switch start callback function when the shooting mode switch starts, and determining the timestamp recorded by the switch start callback function as the start timestamp of the shooting mode switch; and When the shooting mode switching ends, a switching end callback function is triggered, and a timestamp recorded by the switching end callback function is determined as an end timestamp of the shooting mode switching. 4. The method according to claim 1, wherein generating the first video file based on the tag information and the target video comprises: The newly added tag setting interface is called to write the tag information into the video information description area of the target video, and the stop interface is called to complete the generation of the first video file. 5. The method according to claim 1, characterized in that the step of editing the switching process from the first shooting mode to the second shooting mode in the first video file based on the tag information in the first video file to obtain the second video file comprises: Extracting the tag information in the first video file; Determine, according to the tag information, a start timestamp and an end timestamp of the shooting mode switching in the first video file; Based on the time period from the start timestamp to the end timestamp, the switching process from the first shooting mode to the second shooting mode in the first video file is edited to obtain the second video file. 6. The method according to claim 5, characterized in that the step of editing the switching process from the first shooting mode to the second shooting mode in the first video file based on the time period from the start timestamp to the end timestamp to obtain the second video file comprises: Get the switching image frame; Insert the switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain a processed video, and edit the processed video to obtain the second video file; or, in the process of editing the target video, insert the switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain the second video file. 7. The method according to claim 6, wherein acquiring the switching image frame comprises: Intercepting a target image frame from a video obtained by shooting the video in the first shooting mode; adjusting the corresponding image parameters of the target image frame based on the change parameters of switching from the first shooting mode to the second shooting mode to obtain the switched image frame; or The target image frame is captured from a video obtained by shooting a video in the first shooting mode, wherein the switching image frame includes the target image frame. 8. The method according to claim 7, characterized in that the step of adjusting the corresponding image parameters of the target image frame based on the change parameters of switching from the first shooting mode to the second shooting mode to obtain the switched image frame comprises: In the case where the switching from the first shooting mode to the second shooting mode is a switching between different shooting speeds, obtaining a speed difference between a first shooting speed of the first shooting mode and a second shooting speed of the second shooting mode, and adjusting image parameters of the target image frame corresponding to the speed difference to obtain the switching image frame; or When the switching from the first shooting mode to the second shooting mode is a switch between different lens focal lengths, the focal length difference between the first shooting focal length of the first shooting mode and the second shooting focal length of the second shooting mode is obtained, and the image parameters of the target image frame corresponding to the focal length difference are adjusted to obtain the switched image frame. 9. The method according to claim 5, characterized in that the step of editing the switching process from the first shooting mode to the second shooting mode in the first video file based on the time period from the start timestamp to the end timestamp to obtain the second video file comprises: Acquire a predetermined number of video image frames before the start timestamp; Determine a third time period based on a first time period from the start timestamp to the end timestamp and a second time period in which the predetermined number of video image frames are located, wherein the third time period is the sum of the first time period and the second time period; In the target video, the second time period where the predetermined number of video image frames are located is extended to the third time period to obtain a processed video, and the processed video is edited to obtain the second video file; or, in the process of editing the target video, the second time period where the predetermined number of video image frames are located is extended to the third time period in the target video to obtain the second video file. 10. The method according to claim 6 or 9, characterized in that the step of editing the processed video to obtain the second video file comprises: Get pre-defined video editing templates; The processed video is edited using the predetermined video editing template to obtain the second video file. 11. The method according to any one of claims 1 to 9, characterized in that the shooting mode switching includes at least one of the following: switching between different lens modes, switching between transitions within the same lens mode, switching between different shooting speeds, and switching between different lens focal lengths. 12. A video processing device, comprising: A receiving module, used for obtaining a shooting mode switching operation during video shooting in a first shooting mode; a processing module, configured to switch the first shooting mode to a second shooting mode in response to the shooting mode switching operation, and record tag information of the shooting mode switching, wherein the tag information of the shooting mode switching is used to mark that the first shooting mode is switched to the second shooting mode during the video shooting process; An acquisition module, used for acquiring a target video obtained by shooting a video in the first shooting mode and the second shooting mode; A generating module, configured to generate a first video file based on the tag information and the target video; an editing module, configured to edit the switching process of switching from the first shooting mode to the second shooting mode in the first video file based on the tag information in the first video file, so as to obtain a second video file; the tag information in the first video file includes a start timestamp and an end timestamp of the shooting mode switching in the first video file; The editing module is also used to insert a switching image frame in the switching process from the first shooting mode to the second shooting mode in the first video file based on the tag information in the first video file to obtain the second video file; the switching image frame is captured from the video obtained by adopting the first shooting mode for video shooting, or the switching image frame is obtained by adjusting image parameters of an image frame captured from the video obtained by adopting the first shooting mode for video shooting. 13. The device according to claim 12, wherein the processing module comprises: A recording unit is used to record a switching identifier of the shooting mode switching, a start timestamp of the shooting mode switching, and an end timestamp of the shooting mode switching, wherein the tag information includes: the switching identifier, the start timestamp, and the end timestamp. 14. The device according to claim 13, wherein the recording unit comprises: A recording subunit is used to determine the switching identifier of the shooting mode switching based on the first shooting mode before the shooting mode switching and the second shooting mode after the shooting mode switching; trigger a switching start callback function when the shooting mode switching starts, and determine the timestamp recorded by the switching start callback function as the starting timestamp of the shooting mode switching; and trigger a switching end callback function when the shooting mode switching ends, and determine the timestamp recorded by the switching end callback function as the ending timestamp of the shooting mode switching. 15. The device according to claim 12, wherein the generating module comprises: The writing unit is used to call the newly added tag setting interface to write the tag information into the video information description area of the target video, and call the stop interface to complete the generation of the first video file. 16. The device according to claim 12, wherein the editing module comprises: An extraction unit, used for extracting the tag information in the first video file; a determining unit, configured to determine a start timestamp and an end timestamp of the shooting mode switching in the first video file according to the tag information; An editing unit is used to edit the switching process of switching from the first shooting mode to the second shooting mode in the first video file based on a time period from the start timestamp to the end timestamp to obtain the second video file. 17. The device according to claim 16, wherein the editing unit comprises: A first acquisition subunit, used for acquiring a switching image frame; An inserting subunit is used to insert the switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain a processed video, and edit the processed video to obtain the second video file; or, in the process of editing the target video, insert the switching image frame in the time period from the start timestamp to the end timestamp in the target video to obtain the second video file. 18. The device according to claim 17, wherein the first acquisition subunit comprises: A first acquisition sub-subunit is configured to capture a target image frame from a video obtained by shooting the video in the first shooting mode; based on a change parameter when the first shooting mode is switched to the second shooting mode, adjust the corresponding image parameters of the target image frame to obtain the switched image frame; or The first acquisition sub-subunit is used to capture the target image frame from the video obtained by video shooting in the first shooting mode, wherein the switching image frame includes the target image frame. 19. The device according to claim 18, wherein the first acquisition sub-subunit is used to: In the case where the switching from the first shooting mode to the second shooting mode is a switching between different shooting speeds, obtaining a speed difference between a first shooting speed of the first shooting mode and a second shooting speed of the second shooting mode, and adjusting image parameters of the target image frame corresponding to the speed difference to obtain the switching image frame; or When the switching from the first shooting mode to the second shooting mode is a switch between different lens focal lengths, the focal length difference between the first shooting focal length of the first shooting mode and the second shooting focal length of the second shooting mode is obtained, and the image parameters of the target image frame corresponding to the focal length difference are adjusted to obtain the switched image frame. 20. The device according to claim 16, wherein the editing unit comprises: A second acquisition subunit, configured to acquire a predetermined number of video image frames before the start timestamp; a determination subunit, configured to determine a third time period based on a first time period from the start timestamp to the end timestamp and a second time period in which the predetermined number of video image frames are located, wherein the third time period is the sum of the first time period and the second time period; A processing subunit is used to extend the second time period in the target video where the predetermined number of video image frames are located to the third time period to obtain a processed video, and edit the processed video to obtain the second video file; or, during the process of editing the target video, extend the second time period in the target video where the predetermined number of video image frames are located to the third time period to obtain the second video file. 21. The device according to claim 16 or 20, characterized in that the editing unit comprises: A third acquisition subunit is used to acquire a predetermined video editing template; The editing subunit is used to edit the processed video using the predetermined video editing template to obtain the second video file. 22. The device according to any one of claims 12 to 20, characterized in that the shooting mode switching includes at least one of the following: switching between different lens modes, switching between transitions within the same lens mode, switching between different shooting speeds, and switching between different lens focal lengths. 23. An electronic device, characterized in that it comprises a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method according to any one of claims 1 to 11. 24. A computer-readable storage medium, characterized in that the computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 11.