WO2025139877A1 - Video editing method and apparatus, and electronic device and storage medium - Google Patents

Abstract

Provided in the embodiments of the present disclosure are a video editing method and apparatus, and an electronic device and a storage medium. The video editing method comprises: in response to a trigger operation on a video editing template, presenting a video editing interface; in response to a material import operation in respect of a target video segment, presenting identifiers of at least one image material in a segment editing area of the target video segment, wherein at least one video segment comprises the target video segment, and the at least one image material is material which is imported into the target video segment on the basis of the material import operation; and in response to a trigger operation for editing processing, generating a video editing result on the basis of the video editing template and the at least one image material.

Description

Video editing method and device, electronic device and storage medium

This application claims priority to Chinese Patent Application No. 202311843312.4 filed on December 28, 2023, and the contents of the above-mentioned Chinese patent application disclosure are hereby cited in their entirety as a part of this application.

Technical Field

Embodiments of the present disclosure relate to a video editing method and device, an electronic device, and a storage medium.

Background Art

Video content production can be seen everywhere in daily life. Users use video content production to record their lives, show their personality, and output value. There are usually two ways to produce videos. One is to record and edit the video by yourself; the other is to make videos using video templates. Since making videos using video templates is convenient, fast, and has rich effects, it has become the main way to share video content.

Summary of the invention

At least one embodiment of the present disclosure provides a video editing method, comprising: in response to a trigger operation on a video editing template, displaying a video editing interface, the video editing template comprising structural information and editing information, the structural information being used to indicate at least one video segment, the editing information being used to indicate at least one editing effect applied in the at least one video segment, the video editing interface comprising segment editing areas corresponding to the at least one video segment respectively; in response to a material import operation for a target video segment, displaying an identifier of at least one image material in the segment editing area of the target video segment, the at least one video segment comprising the target video segment, the at least one image material being a material imported into the target video segment based on the material import operation; and in response to a trigger operation for editing processing, generating a video editing result according to the video editing template and the at least one image material, the portion of the video editing result corresponding to the target video segment being an editing result obtained based on a target editing effect and at least one image material, the target editing effect matching an editing effect of the at least one editing effect located within the target video segment.

At least one embodiment of the present disclosure further provides a video editing device, comprising: a first display unit, configured to display a video editing interface in response to a trigger operation on a video editing template, wherein the video editing template includes structural information and editing information, the structural information is used to indicate at least one video segment, the editing information is used to indicate at least one editing effect applied in the at least one video segment, and the video editing interface includes segment editing areas corresponding to the at least one video segment respectively; a second display unit, configured to display an identifier of at least one image material in the segment editing area of the target video segment in response to a material import operation for a target video segment, the at least one video segment includes the target video segment, and the at least one image material is a material imported into the target video segment based on the material import operation; and a result generating unit, configured to generate a video editing result according to the video editing template and the at least one image material in response to a trigger operation of an editing process, wherein the portion of the video editing result corresponding to the target video segment is an editing result obtained based on a target editing effect and the at least one image material, and the target editing effect matches an editing effect of the at least one editing effect located within the target video segment.

At least one embodiment of the present disclosure also provides an electronic device, comprising: a processor; a memory, comprising one or more computer program modules; wherein the one or more computer program modules are stored in the memory and configured to be executed by the processor, and the one or more computer program modules include instructions for implementing the video editing method described in any embodiment of the present disclosure.

At least one embodiment of the present disclosure further provides a storage medium for storing non-transitory computer-readable instructions. When the non-transitory computer-readable instructions are executed by a computer, the video editing method described in any embodiment of the present disclosure can be implemented.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same reference numerals represent the same elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

FIG1A is a schematic diagram showing a flow chart of a video editing method provided by at least one embodiment of the present disclosure;

FIG1B is a schematic diagram showing a video editing method provided by at least one embodiment of the present disclosure;

FIG1C shows a schematic diagram of structural information provided by at least one embodiment of the present disclosure;

FIG1D shows a schematic diagram of a video editing interface provided by at least one embodiment of the present disclosure;

FIG2 shows a schematic diagram of adjusting the editing effect in a video editing template to obtain the editing effect in a video editing result provided by some embodiments of the present disclosure;

FIG. 3 shows a method flow chart of step S30 in FIG. 1A provided by at least one embodiment of the present disclosure;

FIG4 is a schematic diagram showing a preview page provided by at least some embodiments of the present disclosure;

5A to 5F are schematic diagrams showing a method of modifying subtitles provided by at least some embodiments of the present disclosure;

FIG6 is a schematic block diagram of a video editing device provided by some embodiments of the present disclosure;

FIG7 is a schematic block diagram of an electronic device provided by some embodiments of the present disclosure;

FIG8 is a schematic block diagram of another electronic device provided by some embodiments of the present disclosure; and

FIG. 9 is a schematic diagram of a storage medium provided in some embodiments of the present disclosure.

DETAILED DESCRIPTION

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and/or in parallel. In addition, the method embodiments may include additional steps and/or omit the steps shown. The scope of the present disclosure is not limited in this respect.

The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more". "Plurality" should be understood as two or more.

The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

As the effects and types of video templates increase, the demand and scenarios for video production and sharing based on video templates will increase. However, most of the current video templates are for short videos. Video templates for short videos have fixed slots, and users need to import the same number of materials, the same number of video clips, and the same length of video clips as the video template. Therefore, video templates for short videos have higher requirements for the materials imported by users, more restrictions, and the use of video templates is not flexible.

In view of the above problems, at least one embodiment of the present disclosure provides a video editing method and apparatus, an electronic device and a storage medium, which can reduce the requirements and restrictions of video templates on materials imported by users and improve the flexibility of using video templates.

At least one embodiment of the present disclosure provides a method for generating videos using video templates, which method not only reduces the requirements for materials and makes the use of video templates more flexible, but also is applicable to medium videos in addition to short videos. Short videos usually refer to videos that are originally created by users and are generally less than 1 minute in length, that is, user-generated content (UGC). Long videos usually refer to videos that are professionally produced and are more than 30 minutes long, with higher content quality, that is, professionally generated content (PGC). Medium videos are between short videos and long videos. Although they are original content generated by users, the professional level of users is higher than that of short videos, that is, professionally generated content (PUGC) and the length of medium videos is usually between short videos and long videos. From the user's perspective, short videos do not require deliberate time to watch, and they deliver fragmented content. They can obtain the key content of the video in a relatively short period of time, but it may not be retained. Medium and long videos require finding a suitable time and place to watch, and require more effort, so that the video content can be retained in memory for a longer period of time.

It should be noted that, in the embodiments of the present disclosure, the meanings of video template and template video are the same, both refer to templates used as reference when making videos, and the template is displayed in the form of a video.

At least one embodiment of the present disclosure provides a video editing method, a video editing device, an electronic device, and a computer-readable storage medium. The video editing method includes: in response to a trigger operation on a video editing template, displaying a video editing interface, the video editing template includes structural information and editing information, the structural information is used to indicate at least one video segment, the editing information is used to indicate at least one editing effect applied in the at least one video segment, and the video editing interface includes a segment editing area corresponding to the at least one video segment; in response to a material import operation for a target video segment, displaying an identifier of at least one image material in the segment editing area of the target video segment, the at least one video segment includes a target video segment, and the at least one image material is a material imported into the target video segment based on the material import operation; and in response to a trigger operation of an editing process, generating a video editing result according to the video editing template and at least one image material, the portion of the video editing result corresponding to the target video segment is an editing result in which the target editing effect is applied to the at least one image material, and the target editing effect matches an editing effect located in the target video segment among the at least one editing effect. This video editing method does not limit the at least one imported image material to match the video editing template, but applies the editing effect of the video editing template to the at least one imported image material. There are no requirements on the quantity and time length of the at least one imported image material. This not only reduces the requirements on the image material, making the use of video editing templates more flexible, but also the method is applicable to medium videos in addition to short videos.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

Figure 1A is a flowchart of a video editing method provided by at least one embodiment of the present disclosure; Figure 1B is a schematic diagram of a video editing method provided by at least one embodiment of the present disclosure; Figure 1C is a schematic diagram of structural information provided by at least one embodiment of the present disclosure; Figure 1D is a schematic diagram of a video editing interface provided by at least one embodiment of the present disclosure.

As shown in FIG. 1A , in at least one embodiment, the method includes the following operations.

Step S10: In response to a triggering operation on a video editing template, a video editing interface is displayed, wherein the video editing template includes structural information and editing information, wherein the structural information is used to indicate at least one video segment, and the editing information is used to indicate at least one editing effect applied in at least one video segment, and the video editing interface includes segment editing areas corresponding to the at least one video segment.

Step S20: In response to a material import operation for a target video segment, an identifier of at least one image material is displayed in a segment editing area of the target video segment, at least one video segment includes the target video segment, and at least one image material is a material imported into the target video segment based on the material import operation.

Step S30: In response to a triggering operation of the editing process, a video editing result is generated according to a video editing template and at least one image material, wherein the portion of the video editing result corresponding to the target video segment is an editing result in which a target editing effect is applied to at least one image material, and the target editing effect matches at least one editing effect located within the target video segment.

For example, in step S10, the triggering operation of the video editing template is, for example, clicking on the use icon in the main page of the video editing template. As shown in FIG1B , the main page of the video editing template is page 101, and the page 101 includes a use icon 102. If the client receives a click operation on the use icon 102, the video editing interface 103 shown in FIG1D is displayed.

For example, the video editing method is applied to a video application, and multiple video editing template covers are displayed in the template recommendation page of the video application. If the user selects the cover of a certain video editing template, the demonstration video of the video editing template is played for the user's reference. When the demonstration video ends, the main page of the video editing template is entered. The user can operate in the main page (for example, page 101) to use the video editing template or not. If the user performs a trigger operation in the main page, it means that the user chooses to use the video editing template, and then enters the video editing interface 103 of the video editing template to perform video editing in the video editing interface 103.

In some embodiments of the present disclosure, a video editing template includes structural information and editing information. The structural information is used to indicate at least one video segment, and the editing information is used to indicate at least one editing effect applied in indicating a video segment. The editing information may include at least one of subtitles, dubbing, soundtrack, text, filters, and transition animations.

As shown in Fig. 1C, the video editing template includes structure information 100. The structure information 100 is set by, for example, the producer of the video editing template. For example, the publishing link and the vimo platform support adding the video editing template structure information. For example, the structure information 100 shown in Fig. 1 is added through the vimo platform.

As shown in FIG. 1C , the structural information 100 includes three parts: overall description, intelligent capability, and template structure decomposition.

The template structure includes the first part 1, and allows adding more parts. The first part 1 represents a video segment, and the title, description and other information of the video segment can be filled in by the operator. For example, by clicking the add more parts control 2 to add the second part, the third part, etc., each part represents a video segment.

The overall description part is controlled by the operator, for example, to fill in the description of the video editing template, such as content, style, etc. The overall description part does not limit the maximum number of characters to be entered.

For example, intelligent capabilities can be selected by operators, such as intelligent subtitle addition and intelligent dubbing. Operators can choose whether to select intelligent capabilities and which one or more intelligent capabilities to select. If an intelligent capability is selected, the video editing template has the intelligent capability.

The structure of each part in the structural information is similar, for example, the first part 1 is used as an example for explanation. For example, the first part 1 includes a title, a description, a start and end time, and a start and end segment. The title is, for example, a refined description of the template image material of the first part 1 in the video editing template. The template image material is, for example, the material used in the video editing template. The description is, for example, a general description of the template image material of the first part 1.

In some embodiments of the present disclosure, the structural information indicates each of at least one video segment by a time interval or a serial number of continuous video segments. For example, in the structural information of FIG. 1C , each video segment is determined by a start and end time, or each video segment is determined by a start and end segment.

For example, the template image material is at least one continuous video segment, the start and end time is selected from the Kth second to the Lth second (time interval) from the at least one continuous video segment as the material of the first part 1, and the start and end segments are, for example, selected from the jth segment to the ith segment from the at least one continuous video segment as the material of the first part 1. j and i are examples of serial numbers of video segments.

It should be noted that the division of the start and end time and the start and end segments by the structural information is for the purpose of understanding the video editing template and facilitating the production of videos for users, and the materials imported by users are not necessarily divided according to the structural information. For example, users can import materials of any form, and then perform segmentation, highlight slicing, etc. on the materials imported by users according to the structural information.

In the above embodiment, the video editing template includes the template image material. In some other embodiments of the present disclosure, the video editing template may not include the template image material.

In some embodiments of the present disclosure, the video editing template of the medium video can directly reuse the production and publishing process of the short video template. After exporting the project file through the editing tool, select "Publish Template" to obtain the video editing template.

After the medium video template is released, it supports storage and management in the vimo background, and reuses the short video template logic. For example, by manually marking it on vimo, it is determined whether the template is of the "medium video template" type. Vimo supports batch addition of identifiers of the "medium video template" type. For the medium video template type, it is necessary to add an attribute field of the "medium video template" type to the metadata, and distinguish the video type through the type attribute field identifier (for example, the identifier is video_type_id). For those marked as medium video template types, the medium video template logic is performed on the overall template link.

For editing information, for example, it can be similar to a short video template. Producers can add text information, dubbing information, music information, sticker information, filter information, transition animation information and other editing information according to their own ideas and needs. The editing information indicates the editing effects, and the editing effects include at least one of subtitles, dubbing, music, text, filters, and transition animations.

As shown in FIG1D , the video editing interface 103 includes at least one paragraph editing area corresponding to each video segment, and each paragraph editing area is used as an editing area for a theme, and displays video clips of different themes. For example, the paragraph editing area 11 corresponding to the video segment indicated by the first part 1 in FIG1C , if the content entered in the title of the first part 1 is "finished dish", then the title of the paragraph editing area 11 corresponding to the video segment indicated by the first part 1 is "finished dish", for example, the structural information also includes a second part, if the content entered in the title of the second part is "food preparation process", then the video segment indicated by the second part can correspond to the paragraph editing area 12, and the title of the paragraph editing area 12 is "food preparation process".

Each video segment is regarded as a subject, and each segment editing area is regarded as an editing area of a subject. In the following description, the video segment is referred to as a subject, and the segment editing area is referred to as an editing area of a subject.

The video editing interface 103 can be divided into multiple parts, each part is used to display different content. For example, in the example of Figure 1D, the video editing interface 103 includes a navigation bar title 113, in which the title is "Select Material", and the video editing interface 103 also includes M topics arranged in sequence. The editing area, M is a positive integer. For example, the first theme is "Finished Dish", and the second theme is "Food Production Process". The user can import the corresponding creative video clips or pictures for each theme in the editing area of each theme; or choose not to import creative video clips or pictures in at least one of the M themes. Below the editing area of each theme, the relevant description 163 of the video segment corresponding to the theme can be included. If there is no relevant description of the theme in the video editing template, for example, if the corresponding characters are not entered in the description part of Figure 1C, the relevant description will not be displayed.

It should be noted that in the embodiments of the present disclosure, the video editing template can be generated based on the video editing draft, and the video editing draft contains materials (such as video, audio, pictures) and editing information. The video editing template needs to indicate which materials in the video editing draft need to be replaced. There are two main differences between the medium video template and the short video template. On the one hand, the medium video template has a paragraph structure, the video paragraph corresponds to a timeline interval, and the video paragraph includes one or more video clips, while the short video template has no structural paragraph. The short video template is a video editing draft in which some video clips are designated as materials that need to be replaced and filled; on the other hand, from the perspective of template use, the medium video template is to apply the video editing effect in each paragraph separately, and the application logic in the paragraph is based on the editing operation in the paragraph indicated by the editing information, which is applied to the material imported into the paragraph after changes (because the number of materials is not bound to the clips in the template, the editing operation cannot be directly reused on the material), and the application logic of the short video template is to import the video clips in the template into the material, and the editing operation directly acts on the material, without the need to divide the paragraphs or change the editing operation.

For step S20, as shown in FIG1D , the editing area of each theme includes an add entry 123. For example, in response to a click operation on the add entry 123, an album list is pulled up for the user to select an image material to be imported into the theme from the album list. That is, the material import operation is, for example, a click operation on the add entry 123 and a selection of an image material to be imported into the theme from the album list.

In some embodiments of the present disclosure, the adding entry 123 has no slot concept and does not limit the number of segments and the length of the segments.

For example, after a material import operation is performed on a target video segment (also referred to as a target theme), an identifier of at least one video material is displayed in a segment editing area of the target theme.

In some embodiments of the present disclosure, for example, if the video editing template includes a total of M themes, then a target theme can be selected from the M themes for a material import operation. For example, if the user selects N themes in sequence for a material import operation, then the N themes are all used as target video segments. M and N are both positive integers. Information prompt paragraph Information prompt paragraph In the example of FIG. 1D , for example, in response to the user clicking on the add entry 123 in “Dish Finished Product”, the album list 133 is pulled up for the user to select at least one image material related to the dish finished product from the album list 133. Afterwards, the identification of each of the at least one image material is displayed in the paragraph editing area 11 of the target theme “Dish Finished Product”. The identification of each of the at least one image material is, for example, a frame of image extracted from each image material, for example, the first frame of image of each image material is extracted as the identification of the image material. For example, in the example of FIG. 1D , the user imports image material 1 and image material 8 from the album list 133, and the first frame of image material 1 and image material 8 are images showing the number 1 and the number 8, respectively, and the images showing the number 1 and the number 8 are displayed in the paragraph editing area 11.

The user can click the add entry 123 in the "food making process" to pull up the album list 133 again, so that the user can select at least one video material related to the food making process from the album list 133. In the embodiment of the present disclosure, the user can perform a material selection operation for each theme, or only perform a material selection operation for some of the M themes.

Compared with short videos, medium videos have obvious editing structure routines. According to their structural information, one or more image materials imported by users are grouped and sorted. In this embodiment, the video editing interface of the video editing template includes M themes arranged in sequence, so that one or more image materials are grouped according to themes, so that the video structure is rationalized. In the embodiment of the present disclosure, there is basically no restriction on the amount and duration of user-imported materials, and batch selection and deletion of currently selected materials are supported. However, in order to avoid extreme situations, in some embodiments of the present disclosure, the amount and duration of imported materials can be subject to maximum restrictions. For example, the duration of a single material (i.e., a video clip) can only be 30 minutes at most. If it exceeds, it will prompt "only videos within 30 minutes can be imported at most", and the upper limit of the number of imported materials for each theme is 100 clips. If it exceeds, it will prompt "only 100 clips can be imported at most". For example, the total duration of at least one image material is limited by the upper limit of the total duration of user materials in Figure 1C.

In some embodiments of the present disclosure, the album list may include a prompt text, for example, when no image material is selected, the default prompt text is "Select the image material to be imported"; when the image material has been selected, the prompt text is changed to "%d segments have been selected" according to the number of materials. As shown in FIG. 1D, image material 1 and image material 8 are selected, and the prompt text is "2 segments have been selected". As shown in FIG. 1D, the album list may also include a confirmation add button 143. The confirmation add button 143 includes two states: lit and grayed out. After the segment is imported, the state of the confirmation add button 143 is lit, that is, the lighting logic is that when a segment of image material is imported, the button is lit, otherwise it is grayed out; after clicking the add button, the image material imported by the user is placed in the corresponding frame in its order. As shown in FIG. 1D, after clicking the add button 143, the logos of image material 1 and image material 8 are placed in the theme of the paragraph editing area 11 with the theme of "finished dish". If the current theme frame is filled with image materials, enter the album list, and the added image materials are displayed by default.

In some embodiments of the present disclosure, the addition entry 123 moves backward following the position of the filled material, and the image material added later is automatically sorted behind the existing image material. If it exceeds one line, it will automatically wrap. The added image material will display the length of its original image material, and will be intelligently captured and split when entering the next step of synthesis.

In some embodiments of the present disclosure, image material deletion operations are supported. In response to the deletion operation of the image material, the image material is deleted, and the image material of the subject is automatically postponed to the front row. For example, the delete button can be selected in the album list page and the video editing interface 103 to perform the deletion operation. In some embodiments of the present disclosure, the user can also sort and edit the imported image materials. For example, the positions of two image materials are swapped, or editing operations such as beautification and cropping are performed on a certain image material.

In the embodiments of the present disclosure, the image material may be a video clip or a picture.

For step S30, the triggering operation of the editing process is, for example, a selection operation of an export control or a preview control after the editing is completed through the video editing interface. For example, by selecting the export control, an export synthesized video or an export generated file can be generated based on the video editing template and at least one image material. For example, by selecting the preview control, a preview object of the preview page is generated based on the video editing template and at least one image material. The preview object can be a video or a picture, etc.

The video editing result includes, for example, a plurality of video parts, each of which corresponds to a target video segment, that is, each video part is an editing result in which a target editing effect is applied to at least one video material in the target video segment. The target editing effect is obtained based on an editing effect located in the target video segment among at least one editing effect.

For example, the first image material is imported into the theme "Finished Dish", and for the target video segment of the theme "Finished Dish", the target editing effect is applied to the first image material, and the target editing effect is an editing effect that matches the editing effect located in the target video segment in the video editing template.

For example, the target editing effect is the same as the editing effect in the video editing template located in the target video segment, or the target editing effect is obtained by changing the editing effect in the video editing template located in the target video segment.

In some embodiments of the present disclosure, step S30 includes: in response to a triggering operation of editing processing, adjusting the editing effect according to a matching strategy to obtain a target editing effect; applying the target editing effect to at least a portion of at least one image material according to a video editing template to obtain a video portion of a target video segment; and generating a video editing result based on the video portion corresponding to each target video segment in at least one video segment.

In some embodiments of the present disclosure, the matching strategy includes: when the editing effect includes a first text, the target editing effect includes a second text, the text format of the second text is the same as the text format of the first text, and the text content of the second text matches at least one image material.

In some embodiments of the present disclosure, the copy may refer to all texts except subtitles, such as decorative texts such as titles. For example, each theme adds a copy content, and the copy content takes effect based on the theme.

FIG2 shows a schematic diagram of adjusting the editing effects in a video editing template to obtain the editing effects in a video editing result provided by some embodiments of the present disclosure.

As shown in FIG2(a), in the video editing template, the text of Topic 1 is Text 1, the text of Topic 2 is Text 2, and the text of Topic 3 is Text 3, that is, Text 1 corresponds to Topic 1 and is only effective for Topic 1, File 2 corresponds to Topic 2 and is only effective for Topic 2, and File 3 corresponds to Topic 3 and is only effective for Topic 3. Topic 1 is, for example, the "finished dish" theme in FIG1D, and Topic 2 is, for example, the "food production process" theme in FIG1D. Topic 3 is, for example, another added theme. Text 1, Text 2, and Text 3 are examples of the first text.

The text format includes, for example, the font, color, and style of the text.

For example, if text 1 is in regular font, the font of the text in Topic 1 in the video editing result will also be in regular font; if text 2 is in gradient color, the font of the text in Topic 2 in the video editing result will also be in the same gradient color; if text 3 is in italic font, the font of the text in Topic 3 in the video editing result will also be in italic font.

For example, step S30 also includes obtaining the content of the second copy. For example, in the example of FIG. 1C , the video editing interface 103 may also include an information prompt section 104, and the user may enter prompt information in the information prompt section 104 to explain and describe the subject. In this embodiment, obtaining the content of the second copy includes: analyzing the prompt information and at least one video material to obtain an analysis result; and generating the content of the second copy according to the analysis result.

For example, a neural network for natural language processing may be used to analyze the prompt information to obtain an analysis result, thereby more accurately understanding the user's demands. For example, a sequence-to-sequence neural network model, a long short-term memory network, etc. may be used to understand the prompt information to obtain an analysis result. For example, feature recognition of image materials is performed using image processing technology to obtain an analysis result of at least one image material. Combining the analysis result of the prompt information with the analysis result of at least one image material, a second copy matching the prompt information and at least one image material is generated.

For example, if the prompt message is "sweet and sour" and at least one image material is a picture of a beverage, the second copy content can be "sour and sweet, refreshing".

In some embodiments of the present disclosure, for example, the influence of the analysis result on the content of the second copy is greater than the influence of at least one image material on the content of the second copy. For example, when the neural network generates the content of the second copy, the weight of the analysis result is greater than the weight of at least one image material, which can better meet the user's demands and the generated copy content is more in line with the user's expectations.

In the above embodiments, in the process of generating the video editing results, the copy adapted to the image material is intelligently generated. For example, the copy content is intelligently written based on the text structure of the video editing template, the image material and the prompt information. For example, the intelligently generated copy only changes the copy content in the video editing template, does not change the copy format in the video editing template, and is consistent with the copy format in the video editing template. In some embodiments of the present disclosure, the number of words in the text of the intelligently generated copy is close to the number of words in the video editing template, for example, the number of words between the two is within 5 words. For example, the copy of the video editing template is "Home Record", the influencing material is food, and the prompt information is food production, then the content of the corresponding copy can be "Making Food Record". In some other embodiments of the present disclosure, the copy in the video editing template can also be directly presented in the process of generating the video editing results, or the user can personalize it on the preview page. Please refer to the description below for the preview page.

The format of the first copy is applied to the content of the second copy, thereby obtaining the second copy included in the target editing effect. Afterwards, the second copy is applied to at least one image material corresponding to the target video segment (for example, image material 1 and image material 8 imported in theme 1).

In some embodiments of the present disclosure, the matching strategy also includes: in response to the first copy being applied to the entire paragraph of the target video segment, the second copy is applied to the entire part of the video portion; in response to the first copy being applied to a partial time period in the target video segment, the second copy is applied to a partial time period in the video portion.

In some embodiments of the present disclosure, it is determined whether the text of a certain theme is displayed for the entire theme or only for a certain duration. When the first text in the video editing template covers the entire theme, the second text is also effective for the entire target theme. When the first text in the video editing template only covers a certain duration of a certain theme, the second file is effective for the duration of the target theme consistent with the duration.

As shown in Figures 2(a) and (b), in the video editing template, text 2 (an example of the first text) is displayed from the 0th second to the 60th second of Topic 2, then in the video editing result, text 2 (an example of the second text) is also only displayed from the 0th second to the 60th second of Topic 2 of the video editing result. In this example, the first text and the second text have the same content and format. In the video editing template, text 3 is displayed throughout the duration of Topic 3, then in the video editing result, text 3 is also displayed throughout the duration of Topic 3. Figures 2(c) and (d) are also similar and will not be repeated here.

When the user modifies the display duration of the text and subsequently modifies the image material, it will be displayed according to the duration range modified by the user; if the duration of the image material becomes shorter, the duration will be shortened accordingly.

In some other embodiments of the present disclosure, the copy can be displayed according to the effective duration range of the copy in the video editing template. As shown in Figure 2(e), for example, in the video editing template, the text 3 is displayed for the entire duration of Topic 3 (for example, a total of 2 minutes), but the duration of Topic 3 in the video editing result is a total of 3 minutes, then the copy is also only displayed within the first 2 minutes of Topic 3 in the video editing result. In the video editing template, the text 1 is displayed for the entire duration of Topic 1 (for example, a total of 1 minute), but the duration of Topic 1 in the video editing result is a total of 2 minutes, then the copy is also only displayed within the first 1 minute of Topic 3 in the video editing result.

In some embodiments of the present disclosure, the text in the target video segment can directly adopt the text in the video editing template, which can increase the speed of synthesizing the video editing result. In some embodiments of the present disclosure, the content of the text can be intelligently rewritten so that the text is more compatible with the imported material.

In some embodiments of the present disclosure, for example, image recognition is performed on the second material to identify the scene and tone of the second material, thereby generating text content corresponding to the scene and tone video based on the understanding of the second material. The text format used in the video editing template is directly applied to the text content to obtain the second text.

In some embodiments of the present disclosure, the matching strategy includes: when the editing effect includes a transition animation, the target editing effect includes the transition animation.

When the video editing template includes M themes, and material import operations are performed on N themes, in the case where N<M, for the first theme without imported image material, the transition animation between the first theme and the next theme after the first theme in the video editing template is deleted. That is, if a theme in the video editing template does not import image material, the transition animation immediately after the theme is also deleted. In this embodiment, only the transition animation corresponding to the target video segment in the video editing template is applied to the target video segment with imported image material.

As shown in FIG2(a), there is a transition animation (abbreviated as “transition”) 1 between Topic 1 and Topic 2, and there is a transition 2 between Topic 2 and Topic 3. The transition animation is used to make the video clips of adjacent topics transition naturally, making the switching of the content in the video more natural and smooth.

As shown in FIG. 2( b ), if the initial material is not imported into Topic 1, the Transition 1 after Topic 1 is also deleted, and the video editing template including Transition 2 between Topic 2 and Topic 3 is also applied to Topic 2 and Topic 3 in the video editing result.

In some embodiments of the present disclosure, as shown in Figure 1D, the structural information further includes an information prompt section 104, and the information prompt section 104 is used to obtain prompt information. Step S30 includes: receiving prompt information input in the information prompt section; and performing semantic analysis on the prompt information to obtain an analysis result.

For example, a neural network for natural language processing may be used to analyze the prompt information to obtain analysis results, thereby more accurately understanding the user's demands. For example, a sequence-to-sequence neural network model, a long short-term memory network, etc. may be used to understand the prompt information.

FIG. 3 shows a method flow chart of step S30 in FIG. 1A provided by at least one embodiment of the present disclosure.

As shown in FIG. 3 , the method includes steps S301 to S304 .

Step S301: In response to a triggering operation of an editing process, the prompt information and at least one image material are analyzed to obtain an analysis result.

Step S302: in response to the editing effect including subtitles and/or dubbing, the content of the subtitles and/or dubbing in the target editing effect is obtained according to a matching strategy of matching the content of the subtitles and/or dubbing in the target editing effect with the analysis result.

Step S303: according to the matching strategy that the format of the subtitles in the target editing effect is the same as the format of the subtitles in the editing effect, the format of the subtitles in the target editing effect is obtained.

Step S304: according to the matching strategy that the sound parameters of the dubbing in the target editing effect are the same as the sound parameters of the dubbing in the editing effect, the sound parameters of the dubbing in the target editing effect are obtained.

In some embodiments of the present disclosure, if the video editing template includes tags for intelligently adding subtitles and/or intelligently adding dubbing, subtitles and/or dubbing are automatically added to the video editing result.

The method can adapt the content with subtitles and/or dubbing to the prompt information, thereby improving the user experience.

For step S301, the analysis results obtained by analyzing the prompt information and at least one image material are similar to those in the previous embodiment and will not be repeated here. For example, based on the image material imported by the user and the prompt information input, the content and appeal are understood, and appropriate subtitles and/or dubbing content are generated. If it is recognized that the image material imported by the user includes sound, then appropriate subtitles and/or dubbing content can be generated by combining the original sound in the image material and the image content of the image material and the prompt information. Alternatively, regardless of whether the image material itself includes sound, intelligent dubbing is used by default.

For example, it is determined through image recognition technology that the video material is an image about making delicious food, and the prompt information is "weekend", then it is determined that the subtitles in the preview video can include "happy weekend".

For steps S302 to S304, the matching strategy includes a matching strategy for the content of the subtitles and/or the content of the dubbing, a matching strategy for the subtitle format, and a matching strategy for the sound parameters.

For the content of subtitles and/or dubbing, the matching strategy may be that the content of subtitles and/or dubbing in the target editing effect matches the analysis result. The matching of the content of subtitles and/or dubbing with the analysis result is similar to the matching of the content of the copywriting with the analysis result described above, and will not be repeated.

For subtitle format, the matching strategy can be that the format of subtitles in the target editing effect is the same as that in the editing effect. For example, the format of subtitles in the target editing effect can be the same as that in the editing effect in the video editing template. When there is no subtitle format information in the template video, a default font style such as "white background with black border" can be used. The subtitle format includes, for example, the text font, text color, and text style of the subtitle.

The sound parameters of dubbing may include, for example, the timbre, frequency, pitch, etc. of the dubbing. For the sound parameters, the matching strategy is, for example, that the sound parameters of the dubbing in the target editing effect are the same as the sound parameters of the dubbing in the editing effect. For example, the timbre of the dubbing in the target editing effect is the same as the timbre, frequency, and pitch of the dubbing in the editing effect in the video editing template. That is, the subtitle format and the sound parameters of the sound can directly apply the format and sound parameters in the editing effect in the video editing template. When there is no timbre in the editing effect in the video editing template (that is, the video editing template is the original sound of the video), the default timbre is used, and the default timbre can be pre-set. That is, when the image material of the video editing template has an original sound and the video editing template retains the original sound, when the video editing template is used to synthesize the video editing result, the original sound in the video editing template will not be retained by default.

For example, when the video editing template already contains audio content such as text reading or recording, automatic muting is performed.

In some embodiments of the present disclosure, for example, subtitles and/or dubbing may be effective for the entire video editing result.

For example, subtitles are automatically added to the final video of all the video materials imported by the user, that is, the subtitles are displayed according to the duration of the final video. When the duration of a single clip of the user is less than a preset duration threshold, such as 3 seconds, no subtitles and/or dubbing are added to the clip. As shown in Figures 2(a) to 2(e), the duration of the subtitles is the same as the duration of the final video.

In some embodiments of the present disclosure, subtitles and dubbing can be one-to-one. The underlying content of the dubbing is the subtitle content. If the subtitle content is modified, it is allowed to apply the modified content to the dubbing, and the reading content of the dubbing also changes automatically. In some embodiments of the present disclosure, playing the dubbing and displaying the subtitles are decoupled. For example, Table 1 shows an example of decoupling dubbing and subtitles provided by at least some embodiments of the present disclosure.

Table 1

As shown in Scene 1, Scene 2, Scene 3 and Scene 4 in Table 1, dubbing and subtitles are decoupled. If the video editing template includes the "Smart Add Dubbing" tag and the "Smart Add Subtitles" tag, for example, the structural information of Figure 1C, the synthesized video editing result is also expected to have dubbing and subtitles. If the video editing template does not include the "Smart Add Dubbing" tag and the "Smart Add Subtitles" tag, the synthesized video editing result is also expected to not include dubbing and subtitles. If the video editing template includes the "Smart Add Dubbing" tag but does not include the "Smart Add Subtitles" tag, the synthesized video editing result is expected to include dubbing but not subtitles. If the video editing template does not include the "Smart Add Dubbing" tag but includes the "Smart Add Subtitles" tag, the synthesized video editing result is expected to not include dubbing but include subtitles.

In some embodiments of the present disclosure, when the target editing effect includes only subtitles, the dubbing mark in the preview video corresponding to the video editing result is displayed as a closed state. When the target editing effect includes only dubbing, the subtitle mark in the preview video corresponding to the video editing result is displayed as a closed state. For example, in scene 2, the dubbing mark is in the open state and the subtitle mark is in the closed state; in scene 3, the dubbing mark is in the closed state and the subtitle mark is in the open state. Those skilled in the art can set arbitrary icons to represent dubbing and subtitles respectively. The dubbing icon includes two different display states, respectively representing the closed state and the open state, and the subtitle icon also includes two different display states, respectively representing the closed state and the open state.

In some embodiments of the present disclosure, step S30, for example, includes splicing the video parts corresponding to each target video segment to obtain a video editing result.

Table 2 shows an example of a material import method provided by some embodiments of the present disclosure.

As shown in Table 2, the template video includes Topic 1, Topic 2, and Topic 3 arranged in sequence, the image material imported into Topic 1 includes Segment A, Segment B, and Segment C, and the three segments are arranged as Segment A, Segment B, and Segment C, the image material of Topic 2 includes Segment D, and the image material of Topic 3 includes Segment E, Segment F, and Segment G, and the three segments are arranged as Segment E, Segment F, and Segment G. The video part of Topic 1, the video part of Topic 2, and the video part of Topic 3 are spliced in the order of the themes to obtain the video editing result. As described above, the video part of each theme is obtained based on the image material and the target editing effect. For example, the target editing effect is applied to the image material. The video editing result is obtained by applying the first target editing effect to Segment A, Segment B, and Segment C, applying the second target editing effect to Segment D, and applying the third target editing effect to Segment E, Segment F, and Segment G, and then combining them in order.

If the video material of subject 1 includes segment A, segment B and segment C, and the three segments are ordered as segment A, segment B and segment C, and no material is imported into subject 2, and no material is imported into subject 3. Multiple segments are spliced together in the order of the themes to obtain a video that is combined in the order of segment A, segment B, and segment C, and the first target editing effect is applied to the spliced video of segment A, segment B, and segment C to obtain a video editing result.

If the image material of subject 1 includes segment A, segment B and segment C, and the three segments are arranged in the order of segment A, segment B and segment C, subject 2 is not imported, and the image material of subject 3 includes segment E, segment F and segment G, and the three segments are arranged in the order of segment E, segment F and segment G. Multiple segments are spliced in the order of themes to obtain a spliced video combined in the order of segment A, segment B, segment C, segment E, segment F and segment G, and the first target editing effect is applied to the parts of segment A, segment B and segment C in the spliced video, and the third target editing effect is applied to the parts of segment F and segment G in the spliced video to obtain a video editing result.

If no material is imported into Topic 1, the image material of Topic 2 includes Segment D, and the image material of Topic 3 includes Segment E, Segment F, and Segment G, and the three segments are arranged in the order of Segment E, Segment F, and Segment G. Multiple segments are spliced in the order of themes to obtain a spliced video that is combined in the order of Segment D, Segment E, Segment F, and Segment G, and the second target editing effect is applied to a portion of Segment D in the spliced video, and the third target editing effect is applied to portions of Segments F and G in the spliced video to obtain a video editing result.

In some embodiments of the present disclosure, when N<M, for the first theme without imported optimized material, a video clip is selected from the second theme with imported image material as the target clip of the first theme; or the first theme is skipped in the process of splicing multiple video parts in sequence of M themes, and the video part of the theme after the first theme is spliced.

For example, when there is no material for the second theme (e.g., the theme of "food making process" in FIG. 1D ), it is automatically postponed to the third theme for splicing with the first theme, and the material of the third theme is directly placed behind the material of the first theme.

For example, if the video editing template is set to "default fill", even if no material is imported into the theme, a segment will be selected from the imported material (for example, randomly selected) for filling to ensure the integrity of the overall preview effect.

In some embodiments of the present disclosure, at least one editing effect includes not only the above-mentioned paragraph editing effects for each theme, such as text, subtitles, and dubbing, but also a global editing effect. The global editing effect includes, for example, at least one of music, filters, and subtitles. In this embodiment, step S30 includes: in response to the triggering operation of the editing process, adjusting the time length of the global editing effect to match the time length of the target image material used in the video editing result, and obtaining the adjusted global editing effect. On this basis, for example, based on the adjusted global editing effect and the video portion corresponding to each target video paragraph, a video editing result is generated.

The target image material is, for example, an image material included in the video editing result. In some embodiments of the present disclosure, the at least one image material imported by the user does not need to be used to generate the video editing result. For example, at least one image material can be used to perform highlight processing to obtain a highlight segment to generate the video editing result. In this embodiment, the time length of the image material used in the target video segment is less than the time length of the at least one image material imported into the target video segment.

In some embodiments of the present disclosure, for example, the target image material included in the video editing result is obtained by splicing highlight clips of one or more target video segments. If the global editing effect includes music, the duration of the music playback is adjusted to match the duration of the target image material. For example, if the duration of the music playback in the video editing template is a first duration and the duration of the target image material is a second duration, the duration of the music playback is adjusted from the first duration to the second duration.

For example, in response to the second duration being greater than the first duration, the playback time of the music is extended to the second duration, and the time when the music starts playing in the video editing result is the same as the time when the music starts playing in the video editing template; or in response to the second duration being less than the first duration, the playback time of the music is shortened to the second duration, and the music gradually weakens until it disappears in the video editing result.

In the embodiments of the present disclosure, the music is global to the video and there is only one music. For example, a video editing template includes a music, and the music serves as the background music of the video editing template. The background music in the video editing template can be directly applied to the generated video editing result, but the time length of the background music is appropriately adjusted.

As shown in FIG2(a), the video editing template 201 includes theme 1, theme 2 and theme 3. At least one template image material of theme 1 includes segment 1 and segment 2, at least one template image material of theme 2 includes segment 3, segment 4, segment 5, segment 6 and segment 7, and at least one template image material of theme 3 includes segment 8, segment 9, segment 10 and segment 11. The music in the video editing template 201 runs through the entire template video, for example, the entire video editing template uses the music as background music, and the original duration of the music (i.e., the first duration) is consistent with the video time length of the video editing template 201.

As shown in FIG2(b), if the user only imports video materials into Theme 2 and Theme 3 in the video editing interface, and does not import video materials into Theme 1, so that the playback time of the target video material in the video editing result is less than the time length of the combination of multiple template video materials of the video editing template 201 (hereinafter referred to as "video time length"), the original time length of the music is directly shortened to the playback time length of the target video material used by Theme 2 and Theme 3. In addition, the background music in the video editing result gradually weakens until it disappears, that is, the background music is faded out.

As shown in FIG2(c), although the user has imported video materials into Topic 1, Topic 2, and Topic 3 in the video editing interface, the playback time of the target video material in the adopted video material is shorter than the video time length of the video editing template 201, and the original duration of the music is also directly shortened to be consistent with the playback time length of the target video material. In addition, the background music in the video editing result gradually weakens until it disappears, that is, the background music is faded out.

As shown in Figure 2(d), the user imported image materials into Theme 1, Theme 2 and Theme 3 respectively in the video editing interface. However, the playback duration of the target image material in the image materials used is longer than the video time length of the video editing template 201. In this case, the original duration of the music is extended to be consistent with the playback duration of the target image material.

In some embodiments of the present disclosure, when the playback duration of the target image material is longer than the playback duration of the template image material in the video editing template, the end time of the music in the video editing template is extended backward, and the start time of the music in the video editing result is aligned with the video editing template.

In some embodiments of the present disclosure, if the total duration of the music is long, the remaining music will be played continuously. For example, if the total duration of the music is 3 minutes, but the video editing template only uses the duration range of 0-1 minutes (i.e., the original duration is 1 minute), if the target video material exceeds 1 minute, the remaining content after 1 minute of the music can be played continuously.

If the total duration of the music is shorter than the playback duration of the target video material, the music can be extended by intelligently extending the music. For example, the intelligently extending music can automatically generate a music clip that connects to the current music by using a neural network, or find a melody or music that matches the current music from a music library.

In some embodiments of the present disclosure, if there is a situation where intelligent extension is difficult to achieve, the playing time is extended by automatically looping the current music.

In some embodiments of the present disclosure, the global editing effect includes a filter. For example, in response to the target image material playing time being longer than the video time, the filter effective time length in the video editing template is extended; or in response to the target image material playing time being shorter than the video time length, the filter effective time length in the video editing template is shortened.

As shown in (b) and (c) of FIG. 2 , the effective time length of the first filter is, for example, the original time length. When the playback time length of the target image material is shorter than the original time length, the effective time length of the filter is shortened to the playback time length of the target image material. As shown in (d) of FIG. 2 , when the playback time length of the target image material is longer than the original time length, the effective time length of the filter is extended to the playback time length of the target image material. The adjustment method of the filter configuration is similar to the adjustment method of the music configuration.

In some embodiments of the present disclosure, subtitles can also be used as a global editing effect. The processing logic of subtitles as a global editing effect is similar to that of the aforementioned filters and music, and will not be repeated here.

In some of the above embodiments, step S30 generates a video editing result based on a matching strategy. In some other embodiments of the present disclosure, step S30 may include: in response to a trigger operation of the editing process, using a neural network to process at least one image material and an editing effect to obtain a video editing result.

For example, in response to a trigger operation of editing processing, the image material and the editing effect are analyzed through a neural network, and the editing effect adapted to the image material is applied to the image material to obtain a video editing result.

The neural network may include, for example, a neural network for image processing, such as a convolutional neural network, a deep learning neural network, etc.

In some embodiments of the present disclosure, step S30 includes: in response to a triggering operation of editing processing, first pre-processing at least one image material to obtain a target image material, and then applying a corresponding editing effect to the target image material to obtain a video editing result. Pre-processing includes, for example, highlight recognition, material segmentation, etc.

For example, step S30 includes: extracting a target segment from at least one image material in response to a triggering operation of the editing process; and generating a video editing result according to the video editing template and the target segment.

Extracting the target segment from at least one image material may be, for example, performing highlight recognition on at least one image material to obtain a target segment at a highlight moment of at least one image material. The target segment at a highlight moment refers to, for example, an optimal material obtained by intercepting an optimal portion of at least one of the at least one image material.

In this embodiment, at least one image material can be automatically identified to obtain a preferred segment of at least one image material to generate a video editing result.

In some embodiments of the present disclosure, step S30 includes: in response to a trigger operation of editing processing, if there is a first image material in at least one image material, dividing the first image material into multiple sub-segments, wherein the first image material is a material with a duration greater than a preset duration; and generating a video editing result based on the video editing template and the multiple sub-segments.

In each theme, the user can import at least one image material as shown in FIG1D . In at least one image material, there may be a first image material whose time length is greater than a preset time length. In the embodiment of the present disclosure, the first image material whose time length is greater than the preset time length can be segmented and processed, and the first image material is segmented into a plurality of sub-segments. These sub-segments are still used as materials of the theme corresponding to the first image material and are not used across themes to avoid unexpected user effects. Dividing the first image material into a plurality of sub-segments is conducive to identifying and utilizing the sub-segments, at least partially avoiding the problem of long processing time caused by excessively long image materials, and is conducive to the flexible use of sub-segments.

In some embodiments of the present disclosure, for example, in a video editing interface page, the image material and prompt information imported by the user are analyzed and identified in advance, and when the trigger operation of the editing process is obtained, the image material is directly extracted (i.e., intercepted) and segmented according to the analysis result, thereby reducing the waiting time for generating the video editing result. For example, as long as the user imports one or more materials, the material is analyzed, without waiting for the user to perform the trigger operation of the editing process before starting the analysis.

In some embodiments of the present disclosure, when a user starts to select materials for another theme, it is considered that the previous theme has been processed, and compatibility with user modifications needs to be considered.

In some embodiments of the present disclosure, the method further includes playing a preview video on a preview page according to the video editing result. Playing the preview video allows the user to watch the video draft generated according to the image material, which is convenient for the user to modify in time when the user needs to modify. In some embodiments of the present disclosure, when the analysis result indicates that the prompt information includes a preset playback time, the playback time of at least part of the material is consistent with the preset playback time.

For example, if the prompt information input by the user is "Learn 3 delicacies in 20 minutes", then the semantic analysis of the prompt information shows that the playback duration of the video the user hopes to produce is 20 minutes, and the duration of the target image material extracted from the image material and applied to the video editing result is also 20 minutes.

FIG. 4 shows a schematic diagram of a preview page provided by at least some embodiments of the present disclosure.

As shown in FIG. 4 , the preview page 401 includes a video playback window 411 , a material display window 421 , and an editing entry window 431 .

The video playback window 411 is used to display or play the preview video. The material display window 421 includes multiple material sub-windows for displaying at least part of each of the multiple image materials in the preview video. At least part of each of the multiple image materials is, for example, a target segment in each of the multiple image materials. For example, the multiple material sub-windows include a material sub-window 4211 for displaying theme 1 and a material sub-window 4212 for displaying theme 2. That is, in some embodiments of the present disclosure, each theme corresponds to a material sub-window for displaying the material used in the theme, and each material sub-window includes multiple material window units, and each material window unit is used to display a material in the theme. As shown in Figure 4, four material window units are displayed in theme 1, namely material window unit A, material window unit B, material window unit C and material window unit D, and the four material window units respectively display different materials in the theme 1.

In some embodiments of the present disclosure, the material display window 421 further includes a material adding sub-window 4213 for adding materials. In this embodiment, the video editing method further includes: in response to a triggering operation on the material adding sub-window when a material window unit in the multiple material sub-windows 4213 is selected, displaying multiple materials for selection; and according to the adding selection operation on the multiple materials for selection, adding the target material after the material window unit.

As shown in FIG4 , if the material window unit B is selected, the material adding sub-window 4213 is clicked, and the album list is pulled up to display multiple image materials for selection. If the user adds and selects a target material from the multiple image materials for selection, the target material is added after the material window unit B. For example, a material window unit E is added between the material window unit B and the material window unit C to display the target material. Please refer to the above description for the album list.

The editing entry window 431 is used to display the entry for editing the material. For example, the editing entry window 431 includes at least one of a subtitle entry 4311 for editing subtitles, a music entry 4312 for editing music, a filter entry 4313 for editing filters, and a text entry 4314 for editing text. The editing entry window 431 may also include an entry for other functions, which can be set in the editing entry window by those skilled in the art according to editing requirements. In some embodiments of the present disclosure, when clicking on the subtitle entry 4311 to enter the subtitle editing page, a dubbing editing entry for editing dubbing may be included in the subtitle editing page. The dubbing editing entry may be resident on the subtitle editing page, and the dubbing editing entry may be displayed regardless of whether dubbing is performed. If there is no dubbing in the video editing template, after clicking to enter the dubbing editing entry, dubbing is disabled by default.

In some embodiments of the present disclosure, for the subtitle entry 4311, if the video editing template includes a tag for intelligently adding subtitles or a tag for intelligently adding dubbing, the condition for intelligently adding subtitles to the preview video is met, and the subtitle entry 4311 is displayed in the editing entry window 431. If the template video does not include a tag for intelligently adding subtitles or a tag for intelligently adding dubbing, the subtitle entry 4311 is not displayed in the editing entry window 431.

In some embodiments of the present disclosure, some video editing templates may have only dubbing or only subtitles. When there is only dubbing, the subtitle entry 4311 is normally displayed in the editing entry window 431, but the "subtitle" display in the subtitle editing page is closed by default, and the subtitle only serves the dubbing and reading content. In some template videos, there may be only subtitles, and the subtitle entry 4311 is normally displayed in the editing entry window 431, but the "dubbing" display in the subtitle editing page is closed by default, and only the subtitles are displayed without reading and dubbing.

On the subtitle editing page, users can modify the subtitle content, set the subtitle duration, read the text aloud, and delete it.

5A to 5F are schematic diagrams showing a method of modifying subtitles provided by at least some embodiments of the present disclosure.

For example, as shown in FIG5A , in the first-level subtitle page (i.e., the subtitle editing page) 501, the subtitles "abcd", "efg" and "higk" are displayed. If the subtitle "efg" is selected in the subtitle editing page 501, and the subtitle "efg" is also displayed on the screen at this time, the second-level subtitle page 502 shown in FIG5B is entered, or the subtitle content is directly clicked to enter the subtitle editing page 502. In the subtitle editing page 502, click the "Edit" entry 512 to enter the subtitle content modification. In some embodiments of the present disclosure, the selected state of the subtitle follows the sliding operation to select different subtitles, and the selected subtitles are automatically displayed on the screen.

As shown in Figures 5C to 5D, when the subtitle content is modified, the input box 504 and the keyboard 503 are automatically pulled up to modify the subtitle content using the input box 504 and the keyboard 503. Support the "Delete" button on the upper screen; or delete the subtitles in the deletion method of the subtitle secondary page. For example, as shown in Figure 5B, the delete button 522 is located at the last one of the subtitle secondary page. The subtitle position can be dragged, and after dragging, it is applied globally by default, and all subtitles are changed to the new position. For example, after the modification of the subtitle content is completed, it is applied in the preview video by clicking the effective icon 505. In some embodiments of the present disclosure, after clicking the effective icon 505, a pop-up window 506 shown in Figure 5D may appear, and the pop-up window 506 is used to ask the user whether to apply the subtitle to dubbing. If the user chooses to apply to dubbing, the dubbing is modified to be consistent with the changed subtitles accordingly.

As shown in FIGS. 5B and 5D , the subtitle secondary page 502 may further include a subtitle duration setting button 532 .

For example, after the user selects a corresponding subtitle, he clicks the subtitle duration setting button 532, and the segment range 542 corresponding to the subtitle is displayed at the bottom of the subtitle secondary page, supporting the selection of a retractable duration range. Other subtitles 552 can be displayed above the displayed segment range 542 corresponding to the subtitle, and by selecting other subtitles 552, the display can be switched to other subtitle duration ranges.

In some embodiments of the present disclosure, a "change a batch" button 562 may be permanently located on the subtitles primary page 501 and the subtitles secondary page 502. In response to a click operation on the "change a batch" button 562, new subtitle content is regenerated. When the subtitles are slid in the subtitles primary page 501 or the subtitles secondary page 502, the "change a batch" button 562 may disappear, and when the sliding stops, the "change a batch" button 562 continues to appear.

In some embodiments of the present disclosure, the first subtitle page 501 and the second subtitle page 502 may further include a first viewing icon for viewing the previous subtitle and a second viewing icon for viewing the next subtitle. Clicking the first viewing icon returns to the previous version, and clicking the second viewing icon continues to generate new subtitles.

In some embodiments of the present disclosure, the subtitles level 1 page 501 and the subtitles level 2 page 502 may further include a subtitles switch entry 511. When there are applied subtitles, the icon of the subtitles switch entry 511 is in a selected state, and the subtitles are displayed in the preview video. After clicking to close, the subtitles switch entry 511 becomes unselected, and the subtitles are hidden and not displayed on the preview video, and are only used for reading. When switching between the display and hidden states, when clicking to expand, it prompts "Subtitles are displayed", and when clicking to hide, it prompts "Subtitles are hidden".

As described above, as shown in FIG5F, the subtitle editing page 502 may include a dubbing editing entry 562 for editing the dubbing. By selecting the dubbing editing entry 562, the dubbing editing page 507 is entered, and the timbre can be modified in the dubbing editing page 507. In the dubbing editing page 507, the currently applied timbre is selected by default. For example, in FIG5F, timbre 1 is the currently applied timbre and is in a selected state. Click to switch to other timbres to immediately preview their effects and read the current subtitle content. If the "Disable" button is clicked in the dubbing editing page, the dubbing will not be read.

The dubbing editing page supports setting the dubbing volume and the original video sound volume. When there is dubbing, the original video sound defaults to 0.

In some embodiments of the present disclosure, it can be selected in the dubbing editing page whether to apply the set dubbing globally. If the dubbing is applied globally, the new dubbing effect will take effect on all subtitles.

In some embodiments of the present disclosure, for example, if the user clicks on the effective icon, the new dubbing modification is saved and the dubbing takes effect. If the effective icon is not clicked or the exit icon is clicked, the dubbing modification is not saved and the user returns to the previous page of the dubbing editing page.

In some embodiments of the present disclosure, click on the music entry 4312 to enter the music editing page. In the music editing page, music can be recommended by similar music. For example, music with a similarity greater than a predetermined value in the video editing template is recommended. Alternatively, music is recommended based on the understanding of the second material and the prompt information.

In the music editing page, the user can select music on his own and set the volume of the music. In some embodiments of the present disclosure, the music can also be processed at the point of the music.

In some embodiments of the present disclosure, the editing entry window also includes: a delete icon for selecting and deleting multiple preferred materials in the preview video. For example, the editing entry window 431 of the preview page includes a "delete" entry, which is located at the last position of the editing entry window 431. Select a single material and click the "delete" icon in the preview page to delete the selected material. After the selected material is deleted, other materials in the theme where the selected material is located will automatically move forward, and materials in other themes will not jump to the theme.

In some embodiments of the present disclosure, the editing entry window 431 and the material display window 421 support left and right sliding to display more editing entries and materials. For example, sliding the editing entry window 431 to the left displays a delete icon.

In some embodiments of the present disclosure, the editing entry window also includes a reorganization entry, and the method also includes: in response to the reorganization entry being selected, displaying a sorting panel, the sorting panel including a second material and prompt information; receiving an organization operation on the second material in the sorting panel, and reorganizing the second material.

For example, the editing entry window of the preview page also includes a reorganization entry. After clicking the reorganization entry, the sorting panel is displayed. For example, the logic of the sorting panel is the same as that of the original structural framework. Except that the sorting panel includes the second material and prompt information imported previously, the other is the same as the above structural framework, so as to modify the prompt information and import the second material. In response to entering the sorting panel through the reorganization entry, the previously filled prompt information is displayed in the structural framework, and each second material is displayed according to each theme, and the copy is also displayed according to the original copy. The organization operation includes, for example, modification, addition, deletion and drag sorting of the imported material (able to sort across themes) and modification of the prompt information. Receive the modification, addition, deletion and drag sorting of the prompt information and the imported material in the structural framework (able to sort across themes), and save the above modifications after receiving the effective instruction. When it comes to changes in the prompt information and material filling content, the synthesis of the algorithm material and all the intelligent effects of the algorithm must be regenerated (including: material splicing selection, overall packaging synthesis, intelligent rewriting of copy, intelligent generation of subtitles/dubbing, intelligent recommendation of music), and after taking effect, return to the previous page. If the user modifies the structure framework and receives an exit command, all modifications will not take effect.

In some embodiments of the present disclosure, in addition to reorganizing the entry, the order of the materials can also be reordered through special operations (for example, long pressing a certain clip material). For example, the special operation can support cross-group ordering.

In some embodiments of the present disclosure, the material can also be intercepted. For example, the interception range of the material is positioned as the actual selected range by default, and the interception range can be adjusted instead of a fixed duration.

In some embodiments of the present disclosure, various operations such as adding and deleting materials can be performed on the preview page, or the video editing interface can be re-displayed through the reorganization entrance in the preview page, and operations such as adding, deleting and sorting image materials can be performed in the video editing interface, and the capture time range of a single image material can be adjusted. In the video editing interface re-displayed through the reorganization entrance in the preview page, the prompt information can also be modified.

When the video material changes (for example, adding, deleting and sorting the material), the newly imported video material is analyzed to identify the target segment and segment the material; for the original material (previously imported material), the original processing effect is retained without reprocessing. If the original material is reordered on the basis of importing the new video material, the new video part is re-joined. Based on the new video material, re-packaging, including corresponding filters, music, text, transition effects, please refer to the description above.

In some embodiments of the present disclosure, for newly imported image materials, subtitles and dubbing need to be regenerated. For original materials, the original processing effects continue to be retained and there is no need to regenerate subtitles and dubbing. For deleted materials, the corresponding subtitles/dubbing are also deleted. For new image material sorting, the subtitles and dubbing are regenerated according to the new sorting.

In some embodiments of the present disclosure, there is no need to regenerate text for newly imported video materials. For the text of the original materials, the original processing effect is retained without reprocessing. If the deleted materials result in a certain theme having no materials at all, the text corresponding to the theme is also deleted. For the new image material sorting, the text display position is also reprocessed according to the new sorting.

In some embodiments of the present disclosure, when the material only changes in the interception time, it is selected according to the user's interception range, no new highlight recognition will be performed, and the new intercepted material will be re-stitched. Based on the latest material duration, the material is repackaged according to the processing method of the music, filter and copy described above. For example, the music, filter and copy in the regenerated video editing result only change the playback time and the effective time, and do not change the content itself. When the image material only changes in the interception time, new subtitles and dubbing are generated according to the new image material duration. When the user's single clip duration is less than 3s, the clip is not subtitled and dubbed. At this time, the existing subtitles and dubbing can be not retained because it is too short to display and play. When the image material only changes in the interception time, there is no need to regenerate the copy. For the text that takes effect on the global theme, the length of the material is as long as the text display time; for the copy that takes effect according to the theme part, if the image material becomes longer, the copy is still displayed according to the original duration; if the material becomes shorter, the text is displayed according to the shortened duration of the material.

In some embodiments of the present disclosure, if the theme and style of the prompt information changes, all subtitles and/or dubbing will be refreshed.

In some embodiments of the present disclosure, when the subtitles and dubbing are changed, if the subtitles are longer than the subtitles before the modification, they will continue to be displayed according to the duration range of the subtitles before the modification, and the subtitles will automatically wrap, and the line wrap logic will be aligned with the current subtitle wrap. If the subtitles are shorter than the subtitles before the modification, they will continue to be displayed according to the original duration range of the subtitles, and as many subtitles as there are will be displayed. If the duration range of the subtitles spans multiple segments, resulting in multiple subtitles overlapping, they can be displayed according to the re-effect.

When the subtitle is too long, causing the corresponding dubbing to be too long, it will be read normally according to the length of the dubbing reading, and support the full playback of the imported video material. When a clip has multiple dubbing audios overlapping, keep playing the multiple audios together. When the subtitle becomes shorter, causing the corresponding dubbing to be shorter, it will be read normally according to the length of the shortened dubbing reading.

In some embodiments of the present disclosure, there is a conflict between the algorithm re-synthesizing the video editing results and the user editing. For example, in the process of synthesizing the video editing results, the user performs editing operations on the material, dubbing, etc. When the material modified by the user again coincides with the material processed by the current algorithm, the material effect after the user's active modification is displayed first. For example, if the user has manually intercepted the duration range of a certain segment of material, it is selected according to its duration, rather than selecting the target segment as described above. If in the process of the algorithm re-synthesizing the video editing results, in response to the selection operation of the subtitle editing entrance or the dubbing editing entrance, a notification message is displayed on the preview page to inform the user that subtitles and dubbing are being generated. Wait for the video editing results to be re-synthesized, and the preview page is displayed normally and supports operations. If the upper screen subtitle is selected in the process of the algorithm re-synthesizing the video editing results, normal editing and modification are performed, and the intelligent subtitle progress is loaded normally. When the user confirms to save the modification, the subtitle content modified by the user in the segment is displayed first, and the intelligent generation progress of the subtitle segment stops. When the user does not save the modification, the intelligent subtitle is loaded and displayed normally. When the rewritten copy has not been generated, the text content is displayed as the original template copy; if the re-synthesis is triggered after the second editing, when the new rewritten copy has not been generated, the current copy is displayed. The user can edit and modify the content normally, and the rewritten copy is loaded normally, effectively displaying the text modified by the user in this segment, and the progress of this segment of intelligent rewriting copy stops.

In some embodiments of the present disclosure, a video editing template can be converted from a project file. For example, after exporting the project file through the editing tool, select "Publish Template". By adding the structural routine information of the video template in the publishing link and the vimo platform, and through the template editing characteristics, it is possible to identify at which nodes to split each group of shots and the corresponding themes of each group of shots. After the medium video template is published, it can be stored and managed in the vimo background. For example, by adding a medium video template identifier on vimo, it is determined whether the template is a medium video template type through manual identification by the operator. For example, the "medium video template" type is added to the material category, and a new attribute field of the "medium video template" type is added to the metadata.

For input of template structure information, for example, on the vimo platform, the "Modify Structure Information" entry is added through the template management entry, template material management entry, and operation details entry. The page for modifying structure information is mainly divided into three parts, namely overall description, intelligent capabilities, and template structure disassembly. The overall description part is used to provide an overall description of the video editing template. There is no limit on the maximum number of characters to be entered. When displayed on the application page, if it exceeds the design range, a fading mask will be displayed.

The intelligent capability section supports operators to check intelligent capabilities, including intelligent subtitle addition and intelligent dubbing. The template structure disassembly section is automatically disassembled into multiple parts according to the template structure. The content of each part includes: title, description, start and end time, start and end segments, upper limit of the total duration of user materials, default padding and default placeholder. There is no limit on the maximum number of characters for the title. When the display on the application page exceeds the design range, a fade-out mask is displayed. There is no limit on the maximum number of characters for the description. When the display on the application page exceeds the design range, a fade-out mask is displayed. The start and end time are used to describe the video clip from the second to the second. The start and end segments are used to describe the segment from the beginning to the end. The upper limit of the total duration of user materials is used to explain that when the imported material is relatively long, the algorithm can refer to the upper limit so that the final intercepted and synthesized material is not too long, so as to achieve the best effect. Default padding means that when no material is imported into this group, a segment is selected from the imported material for filling to ensure the integrity of the overall preview effect. The default placeholder means that no material is imported into this group. When entering the preview page, the material display of this group is blank. If you confirm the template structure disassembly part, a secondary confirmation pop-up window will pop up. After clicking the secondary pop-up window, the video editing template will be officially launched.

In some embodiments of the present disclosure, as long as there is a material filled in, the "Preview" button will light up and you can enter the preview page. When the material is empty, the "Preview" button will be grayed out and you cannot enter the preview page. The "Preview" button can be fixed at the bottom of the page and will not follow the slide. When other content exceeds one screen, you need to slide down to view more.

FIG6 is a schematic block diagram of a video editing device provided by some embodiments of the present disclosure. As shown in FIG6, the video editing device 600 includes a first display unit 110, a second display unit 120, and a result generation unit 130. For example, the video editing device 600 can be applied to a user terminal, or to any device or system that needs to implement a preview of a design material, and the embodiments of the present disclosure are not limited to this.

The first display unit 110 is configured to display a video editing interface in response to a trigger operation on a video editing template, wherein the video editing template includes structural information and editing information, the structural information is used to indicate at least one video segment, the editing information is used to indicate at least one editing effect applied in the at least one video segment, and the video editing interface includes segment editing areas corresponding to the at least one video segment. For example, the first display unit 110 can perform step S10 of the video editing method shown in FIG1A.

The second display unit 120 is configured to display an identifier of at least one image material in a segment editing area of a target video segment in response to a material import operation for the target video segment, wherein the at least one video segment includes the target video segment, and the at least one image material is a material imported into the target video segment based on the material import operation. For example, the second display unit 120 can execute step S20 of the video editing method as shown in Figure 1A.

The result generation unit 130 is configured to generate a video editing result according to the video editing template and the at least one video material in response to a triggering operation of the editing process, wherein the portion of the video editing result corresponding to the target video segment is an editing result in which a target editing effect is applied to the at least one video material, and the target editing effect matches an editing effect of the at least one editing effect located within the target video segment. For example, the page display unit 130 may execute step S30 of the video editing method as shown in FIG1A.

The video editing device not only reduces the requirements for materials, making the use of video templates more flexible, but also the method is applicable to medium videos in addition to short videos.

For example, the first display unit 110, the second display unit 120, and the result generation unit 130 may be hardware, software, firmware, or any feasible combination thereof. For example, the first display unit 110, the second display unit 120, and the result generation unit 130 may be a dedicated or general circuit, chip, or device, or may be a combination of a processor and a memory. The embodiments of the present disclosure do not limit the specific implementation of the first display unit 110, the second display unit 120, and the result generation unit 130.

It should be noted that in the embodiment of the present disclosure, each unit of the video editing device 600 corresponds to each step of the aforementioned video editing method. For the specific functions of the video editing device 600, reference can be made to the relevant description of the video editing method above, which will not be repeated here. The components and structure of the video editing device 600 shown in FIG6 are only exemplary and not restrictive. The video editing device 600 may also include other components and structures as needed.

FIG7 is a schematic block diagram of an electronic device provided by some embodiments of the present disclosure. As shown in FIG7, the electronic device 200 includes a processor 210 and a memory 220. The memory 220 is used to store non-transitory computer-readable instructions (e.g., one or more computer program modules). The processor 210 is used to run non-transitory computer-readable instructions, and when the non-transitory computer-readable instructions are run by the processor 210, one or more steps in the video editing method described above can be executed. The memory 220 and the processor 210 can be interconnected via a bus system and/or other forms of connection mechanisms (not shown).

For example, the processor 210 may be a central processing unit (CPU), a digital signal processor (DSP), or other forms of processing units with data processing capabilities and/or program execution capabilities, such as a field programmable gate array (FPGA), etc.; for example, the central processing unit (CPU) may be an X86 or ARM architecture, etc. The processor 210 may be a general-purpose processor or a dedicated processor, and may control other components in the electronic device 200 to perform desired functions.

For example, the memory 220 may include any combination of one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and/or cache memory (cache), etc. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, erasable programmable read-only memory (EPROM), portable compact disk read-only memory (CD-ROM), USB memory, flash memory, etc. One or more computer program modules may be stored on the computer-readable storage medium, and the processor 210 may run one or more computer program modules to implement various functions of the electronic device 200. Various applications and various data, as well as various data used and/or generated by the application, etc. may also be stored in the computer-readable storage medium.

It should be noted that, in the embodiment of the present disclosure, the specific functions and technical effects of the electronic device 200 can refer to the above description of the video editing method, which will not be repeated here.

FIG8 is a schematic block diagram of another electronic device provided by some embodiments of the present disclosure. The electronic device 300 is suitable for implementing the video editing method provided by the embodiments of the present disclosure, for example. The electronic device 300 may be a user terminal, etc. It should be noted that the electronic device 300 shown in FIG8 is only an example, and does not impose any limitation on the functions and scope of use of the embodiments of the present disclosure.

As shown in FIG8 , the electronic device 300 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 310, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 320 or a program loaded from a storage device 380 to a random access memory (RAM) 330. In the RAM 330, various programs and data required for the operation of the electronic device 300 are also stored. The processing device 310, the ROM 320, and the RAM 330 are connected to each other via a bus 340. An input/output (I/O) interface 350 is also connected to the bus 340.

Typically, the following devices may be connected to the I/O interface 350: an input device 360 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 370 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 380 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 390. The communication device 390 may allow the electronic device 300 to communicate with other electronic devices wirelessly or by wire to exchange data. Although FIG. 9 shows an electronic device 300 having various devices, it should be understood that it is not required to implement or have all of the devices shown, and the electronic device 300 may alternatively implement or have more or fewer devices.

For example, according to an embodiment of the present disclosure, the video editing method shown in FIG. 1A can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the above-mentioned video editing method. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 390, or installed from a storage device 380, or installed from a ROM 320. When the computer program is executed by the processing device 310, the functions defined in the video editing method provided in the embodiment of the present disclosure can be executed.

At least one embodiment of the present disclosure further provides a storage medium for storing non-transitory computer-readable instructions, which can implement the video editing method described in any embodiment of the present disclosure when the non-transitory computer-readable instructions are executed by a computer. Using the storage medium not only reduces the requirements for materials, making the use of video templates more flexible, but also the method is applicable to medium videos in addition to short videos.

Fig. 9 is a schematic diagram of a storage medium provided by some embodiments of the present disclosure. As shown in Fig. 9, the storage medium 400 is used to store non-transitory computer-readable instructions 410. For example, when the non-transitory computer-readable instructions 410 are executed by a computer, one or more steps in the video editing method described above can be executed.

For example, the storage medium 400 may be applied to the electronic device 200. For example, the storage medium 400 may be the memory 220 in the electronic device 200 shown in FIG7. For example, the relevant description of the storage medium 400 may refer to the corresponding description of the memory 220 in the electronic device 200 shown in FIG7, and will not be repeated here.

In the above, the video editing method, video editing device, electronic device and storage medium provided by the embodiments of the present disclosure are described in combination with Figures 1A to 9. The video editing method provided by the embodiments of the present disclosure not only reduces the requirements for materials, making the use of video templates more flexible, but also is applicable to medium videos in addition to short videos.

It should be noted that the storage medium (computer-readable medium) disclosed above may be a computer-readable signal medium or a non-transitory computer-readable storage medium or any combination of the above two. Non-transitory computer-readable storage media may be, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any combination of the above. More specific examples of non-transitory computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a non-transitory computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than a non-transitory computer readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

In some embodiments, the client and server can communicate using any currently known or future developed network protocol, such as Hyper Text Transfer Protocol (HTTP), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), internets (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device performs one or more steps in the video editing method described above. The computer program code for performing the operation of the present disclosure can be written in one or more programming languages or a combination thereof, and the programming language includes but is not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and also includes conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed completely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on the remote computer, or completely on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, such as a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).

The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit does not, in some cases, limit the unit itself.

The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

In the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The above description is only a partial embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other.

In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

Although the subject matter has been described in language specific to structural features and/or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims (24)

A video editing method, comprising: In response to a triggering operation on a video editing template, displaying a video editing interface, wherein the video editing template includes structure information and editing information, the structure information is used to indicate at least one video segment, the editing information is used to indicate at least one editing effect applied to the at least one video segment, and the video editing interface includes segment editing areas corresponding to the at least one video segment respectively; In response to a material import operation for a target video segment, displaying an identifier of at least one image material in a segment editing area of the target video segment, the at least one video segment including the target video segment, and the at least one image material being a material imported into the target video segment based on the material import operation; and In response to a triggering operation of the editing process, a video editing result is generated according to the video editing template and the at least one image material, wherein the part of the video editing result corresponding to the target video segment is an editing result obtained based on a target editing effect and the at least one image material, and the target editing effect matches the editing effect of the at least one editing effect located within the target video segment. The method according to claim 1, wherein the step of generating a video editing result according to the video editing template and the at least one video material in response to the triggering operation of the editing process comprises: In response to the triggering operation of the editing process, adjusting the editing effect according to the matching strategy to obtain the target editing effect; According to the video editing template, applying the target editing effect to at least a portion of the at least one video material to obtain a video portion of the target video segment; and The video editing result is generated based on the video portion corresponding to each of the target video segments in the at least one video segment. The method according to claim 2, wherein the matching strategy comprises: In the case where the editing effect includes a first text, the target editing effect includes a second text, wherein a text format of the second text is the same as a text format of the first text, and text content of the second text matches the at least one image material. The method according to claim 3, wherein the matching strategy further comprises: In response to the first copy being applied to the entire segment of the target video segment, the second copy is applied to the entire portion of the video portion; In response to the first text being applied to a partial time period in the target video segment, the second text is applied to a partial time period in the video portion. The method according to claim 3, wherein the generating of the video editing result according to the video editing template and the at least one video material in response to the triggering operation of the editing process further comprises: Get the content of the second copy, The structural information further includes an information prompt paragraph, and the information prompt paragraph is used to obtain prompt information. Obtaining the content of the second copy includes: Analyzing the prompt information and the at least one image material to obtain an analysis result; and The content of the second copy is generated according to the analysis result. The method according to claim 5, wherein the influence of the analysis result on the content of the second copy is greater than the influence of the at least one image material on the content of the second copy. The method according to claim 2, wherein the matching strategy comprises: In the case where the editing effect includes a transition animation, the target editing effect includes the transition animation. The method according to claim 2, wherein the structural information further includes an information prompt paragraph, and the information prompt paragraph is used to obtain prompt information. In response to the triggering operation of the editing process, adjusting the editing effect according to the matching strategy to obtain the target editing effect includes: In response to the triggering operation of the editing process, analyzing the prompt information and the at least one image material to obtain an analysis result; In response to the editing effect including subtitles and/or dubbing, obtaining the content of the subtitles and/or dubbing in the target editing effect according to a matching strategy of matching the content of the subtitles and/or dubbing in the target editing effect with the analysis result; According to the matching strategy that the format of the subtitles in the target editing effect is the same as the format of the subtitles in the editing effect, obtaining the format of the subtitles in the target editing effect; and According to the matching strategy that the sound parameters of the dubbing in the target editing effect are the same as the sound parameters of the dubbing in the editing effect, the sound parameters of the dubbing in the target editing effect are obtained. The method according to claim 2, wherein generating the video editing result based on the video portion corresponding to each of the target video segments in the at least one video segment comprises: The video parts corresponding to each of the target video segments are spliced to obtain the video editing result. The method according to claim 1, wherein the step of generating a video editing result according to the video editing template and the at least one video material in response to the triggering operation of the editing process comprises: In response to a triggering operation of the editing process, the at least one image material and the editing effect are processed using a neural network to obtain the video editing result. The method according to claim 2, wherein the at least one editing effect further comprises a global editing effect applied to the at least one video segment, The step of generating a video editing result according to the video editing template and the at least one video material in response to the triggering operation of the editing process further includes: In response to the triggering operation of the editing process, adjusting the time length of the global editing effect to match the time length of the target image material used in the video editing result, to obtain an adjusted global editing effect; The generating the video editing result based on the video portion corresponding to each of the target video segments in the at least one video segment includes: The video editing result is generated based on the adjusted global editing effect and the video portion corresponding to each target video segment. The method according to claim 10 or 11, wherein the global editing effect includes at least one of music, filters and subtitles. The method according to claim 1, wherein the structural information indicates each of the at least one video segment by a time interval or a serial number of consecutive video segments. The method according to claim 1, wherein the step of generating a video editing result according to the video editing template and the at least one video material in response to the triggering operation of the editing process comprises: In response to the triggering operation of the editing process, extracting a target segment from the at least one image material; and The video editing result is generated according to the video editing template and the target segment. The method according to claim 1, wherein the step of generating a video editing result according to the video editing template and the at least one video material in response to the triggering operation of the editing process comprises: In response to the triggering operation of the editing process, if there is a first image material in the at least one image material, dividing the first image material into a plurality of sub-segments, wherein the first image material is a material having a duration greater than a preset duration; and The video editing result is generated based on the video editing template and the multiple sub-segments. The method according to any one of claims 1 to 15, further comprising: According to the video editing result, the preview video is played on the preview page. The method according to claim 16, wherein In the case where the editing effect only includes subtitles, the dubbing mark in the preview page is displayed as a closed state. In the case where the editing effect only includes dubbing, the subtitle mark in the preview page is displayed as the closed state. The method according to claim 16 or 17, wherein the preview page includes a video playback window, a material display window and an editing entry window, The video playback window is used to play the preview video, the material display window includes multiple material sub-windows for displaying at least part of each of the multiple image materials in the preview video, and the editing entry window is used to display an entry for editing the image material. The method according to claim 18, wherein the material display window further includes a material adding sub-window, The method further comprises: In response to a material window unit in the plurality of material sub-windows being selected, a triggering operation of adding a sub-window to the material is performed to display a plurality of materials for selection; According to the adding and selecting operation on the plurality of selectable materials, the target material is added after the material window unit. The method according to claim 18, wherein the editing entry window includes at least one of a subtitle entry for editing the subtitles, a filter entry for editing filters, a text entry for editing text, and a music entry for editing music, The editing entry window also includes: a deletion icon for selecting and deleting multiple preferred materials in the preview video. The method according to claim 20, wherein the editing entry window further comprises reorganizing the entry, the method further comprising: In response to the reorganization portal being selected, displaying a sorting panel, wherein the sorting panel includes the at least one image material; and An organization operation performed on the at least one image material in the sorting panel is received, and the at least one image material is reorganized. A video editing device, comprising: A first display unit is configured to display a video editing interface in response to a trigger operation on a video editing template, wherein the video editing template includes structure information and editing information, the structure information is used to indicate at least one video segment, the editing information is used to indicate at least one editing effect applied to the at least one video segment, and the video editing interface includes segment editing areas corresponding to the at least one video segment respectively; a second display unit, configured to display, in response to a material import operation for a target video segment, an identification of at least one image material in a segment editing area of the target video segment, wherein the at least one video segment includes the target video segment, and the at least one image material is a material imported into the target video segment based on the material import operation; and A result generating unit is configured to generate a video editing result in response to a triggering operation of an editing process, based on the video editing template and the at least one image material, wherein a portion of the video editing result corresponding to the target video segment is an editing result obtained based on a target editing effect and the at least one image material, and the target editing effect matches an editing effect of the at least one editing effect located within the target video segment. An electronic device, comprising: processor; a memory including one or more computer program instructions; The one or more computer program instructions are stored in the memory and, when executed by the processor, implement the video editing method according to any one of claims 1 to 21. A computer-readable storage medium non-temporarily stores computer-readable instructions, wherein when the computer-readable instructions are executed by a processor, the video editing method according to any one of claims 1 to 21 is implemented.