CN116304126A - Media search method, device, device and medium across natural language - Google Patents

Abstract

Media search methods, apparatus, devices, and media are provided that span natural language. In one method, media data matching keywords is searched in a media store of an application based on keywords entered by a user in the application, first language data in the media data being represented by a first natural language. A second natural language understood by the user is determined based on the natural language involved in the user's historical interactions with the application. In response to determining that the first natural language is different from the second natural language, the first language data is translated into second language data represented by the second natural language. Media data is presented in an application along with second language data. With the exemplary implementation of the present disclosure, in this way, it is possible to improve the search efficiency of the user and the efficiency with which the user obtains information.

Description

Media search method, device, device and medium across natural language

technical field

Exemplary implementations of the present disclosure relate generally to data search, and in particular to a method, apparatus, device, and computer-readable storage medium for media search across natural language.

Background technique

Data search techniques have been widely used in many types of applications. For example, in a media application, matching media data can be searched based on keywords input by the user. With the development of internationalization, the range of users of certain applications has crossed different countries and regions, and these users usually use different natural languages (eg, Chinese, English, French, etc.). This requires the application to provide a variety of natural language processing capabilities. At this time, how to provide users with data search services in a more effective and user-friendly manner has become a difficulty and a hot spot in the development of cross-language applications.

Contents of the invention

In a first aspect of the present disclosure, a method of media search across natural language is provided. In this method, based on the keyword input by the user in the application, media data matching the keyword is searched in the media storage library of the application, and the first language data in the media data is represented by the first natural language. Based on the natural language involved in the user's historical interactions associated with the application, a second natural language understood by the user is determined. In response to determining that the first natural language is different from the second natural language, the first language data is translated into second language data represented by the second natural language. Present media data as well as second language data in the application.

In a second aspect of the present disclosure, a media search device across natural language is provided. The device includes: a search module configured to search a media storage library of the application for media data matching the keyword based on the keyword input by the user in the application, the first language data in the media data is generated by the first represented by natural language; a determining module configured to determine a second natural language understood by the user based on the natural language involved in historical interactions between the user and the application; a translation module configured to respond to determining the first The natural language is different from the second natural language, the first language data is translated into the second language data represented by the second natural language; and the presentation module is configured to present the media data and the second language data in the application.

In a third aspect of the present disclosure, an electronic device is provided. The electronic device includes: at least one processing unit; and at least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, cause the electronic device to A method according to the first aspect of the present disclosure is performed.

In a fourth aspect of the present disclosure, there is provided a computer-readable storage medium on which is stored a computer program which, when executed by a processor, causes the processor to implement the method according to the first aspect of the present disclosure.

It should be understood that what is described in this Summary is not intended to limit key or important features of implementations of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood through the following description.

Description of drawings

Hereinafter, the above and other features, advantages and aspects of various implementations of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the drawings, the same or similar reference numerals indicate the same or similar elements, wherein:

FIG. 1 shows a block diagram of an application environment according to an exemplary implementation of the present disclosure;

2 illustrates a block diagram of media search across natural language, according to some implementations of the present disclosure;

Figure 3 shows a block diagram of language data in media data according to some implementations of the present disclosure;

4 shows a block diagram of determining a second natural language based on historical interactions according to some implementations of the present disclosure;

FIG. 5A shows a block diagram of an interface for performing language setting in an application, according to some implementations of the present disclosure;

5B shows a block diagram of an interface for performing language setting in an operating system according to some implementations of the present disclosure;

6 shows a block diagram of an interface for selecting a translation target language according to some implementations of the present disclosure;

Figure 7 shows a block diagram of a search results page according to some implementations of the present disclosure;

Fig. 8 shows a block diagram of a play page according to some implementations of the present disclosure;

FIG. 9 shows a flowchart of a method for media search across natural language according to some implementations of the present disclosure;

Figure 10 shows a block diagram of a media search device across natural language according to some implementations of the present disclosure; and

Figure 11 shows a block diagram of a device capable of implementing various implementations of the present disclosure.

Detailed ways

Implementations of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain implementations of the present disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the implementations set forth herein; It is for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and implementation manners of the present disclosure are for exemplary purposes only, and are not intended to limit the protection scope of the present disclosure.

In the description of the implementation of the present disclosure, the term "comprising" and its similar expressions should be interpreted as an open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "an implementation" or "the implementation" should be understood as "at least one implementation". The term "some implementations" should be read as "at least some implementations". Other definitions, both express and implied, may also be included below. As used herein, the term "model" may represent an association relationship between various data. For example, the above association relationship may be obtained based on various technical solutions currently known and/or to be developed in the future.

It can be understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of data) should comply with the requirements of corresponding laws and regulations and relevant regulations.

It can be understood that before using the technical solutions disclosed in the embodiments of the present disclosure, the user should be informed of the type, scope of use, and use scenarios of the personal information involved in the present disclosure in an appropriate manner in accordance with relevant laws and regulations, and the authorization of the user should be obtained .

For example, in response to receiving the user's active request, send prompt information to the user to clearly remind the user that the requested operation will require the acquisition and use of the user's personal information. Thus, the user can independently choose whether to provide personal information to software or hardware such as electronic devices, application programs, servers, or storage media that perform the operations of the technical solution of the present disclosure according to the prompt information.

As an optional but non-limiting implementation, in response to receiving the user's active request, the method of sending prompt information to the user may be, for example, a pop-up window, and the pop-up window may present prompt information in the form of text . In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

It can be understood that the above process of notifying and obtaining user authorization is only illustrative and does not limit the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.

As used herein, the term "responsive" means the occurrence of a corresponding event or the state of being satisfied. It will be understood that the execution timing of the subsequent action executed in response to the event or condition is not necessarily strongly correlated with the time when the event occurs or the condition is established. For example, in some cases, the follow-up action may be executed immediately when the event occurs or the condition is established; while in other cases, the follow-up action may be executed after a period of time after the event occurs or the condition is established.

example environment

Data search techniques have been widely used in many types of applications. For example, in a media application, matching media data can be searched based on keywords input by the user. An application environment according to an exemplary implementation of the present disclosure is described with reference to FIG. 1 , which shows a block diagram 100 of an application environment according to an exemplary implementation of the present disclosure. In a multilingual application environment, the application 110 can support multiple natural languages. In other words, users can use different natural languages to post media data, perform searches, comment, forward, or communicate with other users in the application 110, among others. The application 110 may provide user interfaces expressed in different natural languages, and media data posted by users may also involve different natural languages, and so on.

As shown in FIG. 1 , a keyword (for example, "coffee making") may be input in a certain natural language in the application 110, so as to search for media data matching the keyword in the media storage library of the application 110. At this time, the found media data may be represented by the same or different language than the natural language used by the keyword. In the example of FIG. 1 , a user may input a keyword "coffee making" in Chinese and perform a search. The returned search results may include media data expressed in Chinese, and may also include media data expressed in other natural languages. For example, media data 120 may be represented in English, and media data 130 may be represented in French, and so on.

In an internationalized environment, search results may involve video data produced in a natural language that users cannot understand, which leads to poor user experience. In addition, for some minor language users, the media repository may only include a very small number (or even none) of videos produced in the minor language, which makes it difficult for search results to meet user requirements. At this time, how to provide users with data search services in a more effective and user-friendly manner has become a difficulty and a hot spot in the development of cross-language applications.

An overview of cross-language media search

In the context of the present disclosure, details of cross-language search will be described taking video as an example of media data. It will be appreciated that the video herein is merely an example of media data, which may alternatively and/or additionally include data in other formats. For example, in an audio application, the media data may refer to audio data; in an image application, the media data may include image data; and in a news application, the media data may include multimedia data combining multiple Insert video, audio, pictures and other data formats into the text.

In order to at least partly solve the deficiencies in the prior art, according to an exemplary implementation manner of the present disclosure, a media search method across natural language is proposed. An overview according to one example implementation of the present disclosure is described with reference to FIG. 2 , which shows a block diagram 200 of media search across natural language according to some implementations of the present disclosure. As shown in FIG. 2 , the user 230 can input a keyword into the application 110 and can search the media storage library of the application 110 for media data matching the keyword. Here, the media data may include one or more language data, and the language data may be represented by the first natural language 210 . For example, the title of the media data 120 shown in FIG. 2 is expressed in English, and the title of the media data 130 is expressed in French.

Further, in order to present search results in a manner understandable by the user 230 , a second natural language understandable by the user 230 may be determined based on the natural language involved in historical interactions 240 associated with the user 230 with the application 110 . It will be appreciated that the historical interactions 240 herein may involve a variety of types. For example, the historical interaction 240 may involve the user 230 setting the translation target language in the application 110 , and at this time, the translation target language may be directly used as the second natural language 220 . For another example, the historical interaction 240 may involve the user 230 posting information in the application 110. Assuming that the user 110 has been using Chinese to post information, Chinese may be used as the second natural language 220, and so on.

Further, it may be determined whether the first natural language 210 used by the found media data is the same as the second natural language 220 familiar to the user 230 . If the two are different, the language data represented by the first natural language 210 in the media data may be translated into language data represented by the second natural language 220 . In turn, the media data can be presented in the application 110 along with the translated language data. For convenience of description, language data represented by the first natural language 210 may be referred to as first language data, and language data represented by the second natural language 220 may be referred to as second language data.

Utilizing the exemplary implementation of the present disclosure, no matter what natural language the user 230 uses to input keywords, and no matter what kind of natural language media data is retrieved in the media storage library, the user 230 can follow the natural language that the user 230 can understand to present search results to the user 230 . In this way, on the one hand, the user's ability to understand the search results can be improved, and on the other hand, the search scope can be expanded to provide the user 230 with richer search results matching the search keywords. Especially for minor language users, in addition to performing searches in media repositories represented by the minor language, searches may also be performed in related media repositories in common languages (eg, English, French, etc.). In this manner, the efficiency of the user in obtaining media data can be greatly improved, thereby improving the user experience.

Detailed process of cross-language media search

Having described the overview of cross-language media search, more details of an exemplary implementation according to the present disclosure will be described below with reference to FIGS. 3 to 8 . According to an exemplary implementation manner of the present disclosure, the language data expressed in the first natural language 210 in the media data 120 may include multiple types. FIG. 3 shows a block diagram 300 of language data in media data according to some implementations of the disclosure. As shown in FIG. 3 , the media data 120 here can be video data, and the language data in the video data can include at least any of the following: sound data, image data, title data, subtitle data, comment data, barrage data.

As shown in FIG. 3 , the sound data 310 may relate to utterances expressed in the video using the first natural language 210 , such as character monologues, character dialogues, narration, and lyrics in background music, and the like. Caption data 360 may correspond to audio data 310 in the video, ie, a textual representation of the audio data 310 . The image data 320 may relate to the text in the frame in the video, for example, the text “coffee” on the coffee cup shown in FIG. 3 , and other text in the frame, such as slogans, posters, and so on. Title data 330 may relate to text in a video title, eg, text in a main title and/or a subtitle. Comment data 340 may relate to comment information under the video, eg, one or more comments for the video, and so on. Bullet chat data 350 may relate to bullet chat posted by one or more users for the video.

According to an exemplary implementation manner of the present disclosure, various types of language data may be extracted from the media data 120 based on various technologies currently known and/or to be developed in the future. For example, the textual representation of sound data 310 may be obtained based on speech recognition techniques, the textual representation of image data 320 may be extracted based on optical character recognition (OCR) techniques, and so on.

It will be appreciated that while FIG. 3 illustrates the case where multiple types of language data are represented in a single language (eg, English), alternatively and/or additionally, the multiple types of language data may relate to different languages. For example, sound data 310 may be expressed in English, and comment data 340 may include comments posted in Chinese and English, and so on. Using the exemplary implementation of the present disclosure, various types of language data in the media data 120 can be identified, and then translation data of various aspects can be provided to the user. In this manner, it is easier for the user 230 to understand the various information in the search results, and thus obtain search results that better match the input keywords.

According to an exemplary implementation of the present disclosure, prompt information about the translation function can be provided to the author of the published media data. Acquire media data and perform corresponding translation operations. If the author does not allow the application 110 to translate the media data published by himself, the translation function may be disabled. According to an exemplary implementation manner of the present disclosure, the prompt information of whether the translation function is supported may be provided on the setting page of the application 110, and the prompt information may also be provided when the author publishes certain media data. In this manner, it is possible for other users of the application 110 to obtain search results with better readability while ensuring the author's right to publish the media data.

According to an exemplary implementation manner of the present disclosure, the second natural language 220 understandable by the user 230 may be determined based on the natural language related to the historical interaction 240 between the user 230 and the application 110 . FIG. 4 shows a block diagram 400 for determining a second natural language based on historical interactions, according to some implementations of the present disclosure. It will be understood that the historical interaction 240 may include multiple types, including but not limited to: the user sets the target language of the translation operation in the application; the user sets the application language used to present the application in the application; The system language is set in the operating system; the user sets the preferred language order in the operating system used to run the application; the user sets the locale in the operating system used to run the application; the user performs a post in the application; the user performs a comment in the application; the user A retweet is performed in the app; a user performs a communication within the app with other users of the app; a user performs a search within the app, and so on.

At this time, based on different types of historical interactions 240, the natural languages involved may include target language 420, application language 421, system language 422, release language 423, comment language 424, forwarding language 425, and communication language as shown in FIG. 426 and the search language 427, and so on. Specific examples of natural language involved in interacting with different types of history 240 will be described in detail below.

According to an exemplary implementation of the present disclosure, pages for setting various languages may be provided in the application 110 . Specifically, FIG. 5A shows a block diagram 500A of an interface for performing language setting in application 110 according to some implementations of the present disclosure. As shown in FIG. 5A , user 230 may select a language settings menu in application 110 to present language settings page 510 . In the language setting page 510, a selection box 512 for setting an application language may be provided. Here, the application language may refer to the language set in the application 110 for presenting the application interface of the application. As shown in FIG. 5A , when the user 230 selects "English" in the selection box 512, the interface (eg, menus, buttons, dialog boxes, etc.) in the application 110 will be presented in English. Alternatively and/or additionally, language setting page 510 may provide a selection box 516 for setting a target language for translation operations. Here, the target language may indicate which language the user expects to translate the language data in the searched media data into.

The user 230 can set the corresponding language in the above interface, and can use the set language as the target language of the translation operation. As shown in the figure, when the user 230 selects "Chinese" in the selection box 516, the language data in the media data in the search results will be translated into Chinese and presented together with the media data in Chinese. Alternatively and/or additionally, assuming that the user 230 has not set a target language (ie, the selection box 516 is "empty"), the application language in the selection box 512 may be used as the target language of the translation operation.

According to an exemplary implementation of the present disclosure, the language setting page 510 may further include a selection box 514 indicating whether the user 230 desires to activate the translation function. If it is determined that the user 230 has started the translation function (that is, the selection box 514 is set to "on"), the language data expressed in the first natural language 210 in the media data may be translated into a language expressed in the second natural language 220 data. According to an exemplary implementation of the present disclosure, if it is determined that the user 230 has turned off the translation function (ie, the selection box 514 is set to "off"), the retrieved original media data may be directly presented in the application 110 .

According to an exemplary implementation of the present disclosure, the translation function can be enabled or disabled for all search operations on the language setting page 510, and an "on/off" option can also be provided in the interface for inputting specific keywords, so as to target specific searches to determine whether translation functionality is available. With the exemplary implementation of the present disclosure, it is possible to support the user to enable or disable the translation function in a more flexible manner, thereby providing better user experience.

According to an exemplary implementation manner of the present disclosure, the historical interaction 240 may further include the historical interaction between the user 230 and the operating system of the terminal device running the application 110 . 5B shows a block diagram 500B of an interface for performing language settings in an operating system, according to some implementations of the present disclosure. As shown in FIG. 5B, the operating system may provide a system setting page 520, and the system setting page 520 may include an option for setting "language and region". At this point, the system setting page 520 may provide a selection box 522 for setting the system language, where the system language refers to the language used to provide operating system related content. Further, the system setting page 520 may provide a selection box 524 for setting the order of preferred languages. User 230 may add one or more candidate languages to the selection box. In this way, the order represented by different languages can be presented in the order set by the user. Alternatively and/or additionally, the system settings page may provide a selection box 526 for selecting the region where the user 230 is located.

According to an exemplary implementation of the present disclosure, the translation operation may be performed based on one or more natural languages set in the user interface shown in FIG. 5B or the mainstream language used in the region where the user 230 is located. Generally speaking, the language set by the user 230 in the setting page of the operating system is a language he is familiar with and can understand. In this way, without the user making separate settings in the application 110, media data that the user cannot understand can still be translated into a language that the user can understand. Thus, the user's setting steps in the application 110 can be simplified, and the ability to obtain more desired information by using cross-language search can be improved.

Returning to FIG. 4 , according to an exemplary implementation of the present disclosure, the history interaction 240 may further include at least any of the following: the user performs a post in the application; the user performs a search in the application; the user performs a comment in the application; to perform reposting in the app; to communicate with other users of the app in the app, to perform searches in the app, and so on. Generally speaking, the language used by the user 230 to perform the above interaction in the application is a language he is familiar with and can understand, so the language used for the above interaction can be used as the target language of the translation operation. In this way, the accuracy of determining the target language can be improved, thereby improving the efficiency of presenting understandable search results to users.

According to an exemplary implementation manner of the present disclosure, the target language of the translation operation may be determined according to the priority order of each language as shown in FIG. 4 . It will be understood that the search language (ie, the language of the keyword) used by the user to perform the search is not necessarily the language that the user 230 is proficient in (eg, mother tongue). In some cases, when the user 230 searches for some specific term (for example, a person's name, a place name, or a certain product), he usually uses English or other relatively common languages to perform the search, so as to find more search results. If the search results are presented directly in the search language, it may happen that the user 230 cannot accurately understand the search results. Thereby, the search language can be set to have a lower priority.

According to an exemplary implementation of the present disclosure, the second natural language 220 may be determined based on the intersection of multiple languages as shown in FIG. 4 . Alternatively and/or additionally, the language determination model 410 may be developed based on machine learning technology, so that the output second natural language 220 is more in line with the user's 230 own language ability.

According to an exemplary implementation of the present disclosure, the language determination model 410 may output multiple candidate second natural languages that the user 230 can understand. Then at this time, prompt information for selecting the second natural language may be further provided to the user 230 . FIG. 6 shows a block diagram 600 of an interface for selecting a translation target language, according to some implementations of the present disclosure. As shown in FIG. 6 , during the return of search results, prompt information 610 may be presented in the application 110 and instruct the user 230 to select a desired target language from a plurality of candidate languages 630 in a selection box 620 . Further, based on the user 230's feedback on the prompt information 610, a second natural language may be selected from multiple candidate languages, and then a corresponding translation operation may be performed.

Assuming that the user 230 expects to search for media data that introduces the latest electronic products released at present, there may only be media data published in a common language (for example, English) in the media repository at this time and there is no media data published in other languages, At this time, the user 230 can set the translation target language of the current search as English. Assuming that the user 230 desires to search for an introduction of a certain movie star, the translation target language of the current search can be set to Chinese, and so on. Utilizing exemplary implementations of the present disclosure, the user 230 may be allowed to individually select the target language used in the current search results each time a search is performed. In this manner, a translation strategy with finer granularity can be provided, thereby facilitating users to obtain more desired information.

According to an exemplary implementation of the present disclosure, after the language data and the second natural language 220 have been obtained, the second Second language data expressed in natural language 220 . Further, the media data and corresponding second language data may be presented in the application 110 .

According to an exemplary implementation of the present disclosure, a preview window of the media data may be presented on the search result page in the application 110, and further, the media data and corresponding second language data may be presented in the preview window. Here, the search result page may further include another preview window for presenting another media file corresponding to the keyword in the media storage library. More details of the search results page are described with reference to FIG. 7, which shows a block diagram 700 of a search results page according to some implementations of the present disclosure.

As shown in Figure 7, search result page 710 can comprise the preview window for a plurality of search results, for example, preview window 720 can present the media data 120 that retrieves in preview mode, and preview window 722 can present the media data 130 that retrieves . It will be understood that at this point the language data in each piece of media data has been translated into the target language desired by the user 230 . For example, the title of the media data 120 (or translated subtitle data, etc.) may be displayed below the preview window 720 . It will be appreciated that while FIG. 7 shows by way of example the translated language data being presented below the preview window 720, the language data may alternatively and/or additionally be presented inside the preview window. At this point, the translated language data will be superimposed on the media data in a semi-transparent manner.

At this point, the user 230 can obtain content information about multiple search results on a single search result page 710 in a preview manner, thereby increasing the speed at which the user 230 obtains information. Using the exemplary implementation of the present disclosure, the translated language data can provide the user 230 with richer information about search results, and can help the user 230 determine whether to play certain media data separately.

According to an exemplary implementation of the present disclosure, the user 230 may perform interaction with each preview window in the search result page 710 . As shown in FIG. 7 , if an interaction between the user 230 and the preview window 720 is received, corresponding media data can be played on the play page in the application 110 . More details about the playback page are described with reference to FIG. 8, which shows a block diagram 800 of the playback page according to some implementations of the present disclosure.

As shown in FIG. 8 , various types of language data in the media data 120 have been translated into Chinese and presented on the playing page. In FIG. 8, the sound data 810 can retain the original natural language, and the image data 820, title data 830, comment data 840, barrage data 850 and subtitle data 860 can respectively correspond to various language data as shown in FIG. Subtitles (eg, in Chinese) intelligible to the user 230 . Using the exemplary implementation of the present disclosure, various information about the media data 120 can be presented to the user 230 in a manner comprehensible to the user 230, thereby improving the user 230 to obtain search results that are more in line with their expectations.

According to an exemplary implementation of the present disclosure, as the media data 120 is played, the language data contained in the part currently being played can be continuously obtained, and the translation process can be dynamically performed to obtain the translation expressed in the second natural language 220 data. In this manner, comprehensible media data may be presented to user 230 in real time, thereby improving user experience.

According to an exemplary implementation of the present disclosure, user 230 may be enabled to define a presentation mode in which translation data is presented. For example, a selection page may be provided to the user 230 to allow the user 230 to select the font, font size, line spacing, length of the translation data (eg, how many words or characters to display on a line), etc., for presenting the translation data. Further, the presentation mode may include presenting the translated language data outside the playing screen of the media data, or presenting the translated and translated language data on the playing screen in a semi-transparent manner, and so on. After user 230 selects a presentation mode, the translation data may be presented using the selected presentation mode. Using the exemplary implementation of the present disclosure, each user can set the presentation mode according to their own requirements. In this manner, each user may be provided with a customization function, thereby making the manner of presenting search results more in line with each user's aesthetic requirements.

The specific steps of the media search method across natural language have been described with reference to the accompanying drawings. With the exemplary implementation of the present disclosure, it is possible to determine a natural language that a user can understand in an accurate and efficient manner. Further, the language data in the media data involved in the search result may be translated from a natural language incomprehensible to the user into a natural language understandable to the user. In this way, the user's search efficiency can be improved and the user's efficiency in obtaining information can be improved.

By using the exemplary implementation of the present disclosure, the user's efficiency in filtering search results can be improved, and the video content can be understood more quickly. For video data including a large amount of language data, the benefit of subtitle translation for improving screening efficiency is more obvious. Further, the cross-language search method described above can support users to understand multilingual videos, which is more helpful to explore the cross-language publishing space and solve the problem of insufficient video data expressed in languages they are familiar with. In particular, translated subtitles can remove barriers to video language understanding, so that each video can be understood by people of any language background, thereby expanding the search resource pool from a specific language to multiple languages, and then utilizing video storage in a more adequate way Multilingual data in the library.

example process

FIG. 9 shows a flowchart of a method 900 of media search across natural language according to some implementations of the present disclosure. At block 910, based on the keyword input by the user in the application, media data matching the keyword is searched in the media storage library of the application, and the first language data in the media data is represented by the first natural language. At block 920, a second natural language understood by the user is determined based on the natural language involved in the user's historical interactions associated with the application. At block 930, it is determined whether the first natural language is different from the second natural language. If yes, method 900 proceeds to block 940 . At block 940, the first language data is translated into second language data represented by a second natural language. At block 950, the media data is presented in the application along with the second language data.

According to an exemplary implementation manner of the present disclosure, the first language data includes at least any one of the following: sound data, subtitle data, image data, title data, subtitle data, comment data, and barrage data.

According to an exemplary implementation of the present disclosure, determining the second natural language further includes: in response to determining that there are multiple candidate second natural languages understood by the user, providing prompt information for selecting the second natural language to the user; and For the feedback of the prompt information, the second natural language is selected from multiple candidate second natural languages.

According to an exemplary implementation of the present disclosure, presenting the media data and the second language data in the application includes: presenting a preview window of the media data on the search result page of the application, and the search result page further includes presenting a preview window of the media storage library. Another preview window of another media file corresponding to the keyword; and presenting the media data and the second language data in the preview window.

According to an exemplary implementation of the present disclosure, the method 900 further includes: in response to receiving the interaction between the user and the preview window, playing the media data on the playing page of the application; The translation data of the language data associated with the part being played in the media data, the translation data is represented by the second natural language.

According to an exemplary implementation of the present disclosure, the method 900 further includes: providing the user with a selection page for selecting a presentation mode for presenting the translation data, where the presentation mode includes at least any one of the following: font and font size for presenting the translation data , line spacing, length of translation data.

According to an exemplary implementation of the present disclosure, presenting the translation data further includes: in response to receiving a user's selection of the presentation mode, presenting the translation data using the selected presentation mode.

According to an exemplary implementation of the present disclosure, searching the media data includes: obtaining the media data in response to determining that the author of the media data allows the language data in the media data to be translated into a language other than the first natural language.

According to an exemplary implementation manner of the present disclosure, translating the first language data into the second language data includes: in response to determining that the user activates a translation function, translating the first language data into the second language data.

According to an exemplary implementation of the present disclosure, the historical interaction between the user and the application includes at least any of the following: the user sets the target language of the translation operation in the application; the user sets the application language for presenting the application in the application; The system language is set in the operating system the app is running on; the user sets the preferred language order in the operating system the app is running in; the user sets the locale in the operating system the app is running in; A comment is performed in the app; a user performs a retweet in the application; a user performs a communication with other users of the application in the application; a user performs a search in the application.

Example Apparatus and Equipment

FIG. 10 shows a block diagram of a media search device 1000 across natural language according to some implementations of the present disclosure. The device 1000 includes: a search module 1010 configured to search the media storage library of the application for media data matching the keyword based on the keyword input by the user in the application, the first language data in the media data is composed of represented by the first natural language; the determination module 1020 is configured to determine the second natural language understood by the user based on the natural language involved in the historical interaction associated with the user and the application; the translation module 1030 is configured to respond Upon determining that the first natural language is different from the second natural language, translating the first language data into second language data represented by the second natural language; and a rendering module 1040 configured to render the media data and the second natural language in the application language data.

According to an exemplary implementation manner of the present disclosure, the first language data includes at least any one of the following: sound data, subtitle data, image data, title data, subtitle data, comment data, and barrage data.

According to an exemplary implementation of the present disclosure, the determining module 1020 includes: a prompting module configured to provide prompt information for selecting a second natural language to the user in response to determining that there are multiple candidate second natural languages understood by the user and a selection module configured to select a second natural language from a plurality of candidate second natural languages based on the user's feedback on the prompt information.

According to an exemplary implementation manner of the present disclosure, the presenting module 1040 includes: a preview window presenting module configured to present a preview window of media data on the search result page of the application, and the search result page further includes a preview window for presenting media data stored in the media repository. another preview window of another media file corresponding to the keyword; and a preview module configured to present the media data and the second language data in the preview window.

According to an exemplary implementation of the present disclosure, the apparatus 1000 further includes: a playing module configured to play media data on the playing page of the application in response to receiving user interaction with the preview window; and a dynamic presentation module configured to It is configured to present translation data of the language data associated with the part of the media data being played on the playing page during the playing of the media data, the translation data being represented by the second natural language.

According to an exemplary implementation of the present disclosure, the apparatus 1000 further includes: a mode presentation module configured to provide the user with a selection page for selecting a presentation mode for presenting translation data, and the presentation mode includes at least any one of the following: font, font size, line spacing, and length of the translation data for presenting the translation data; and the dynamic presentation module includes: a selection mode-based presentation module configured to utilize the selected presentation mode in response to receiving a user selection for the presentation mode to present translation data.

According to an exemplary implementation of the present disclosure, the search 1010 includes: an acquisition module configured to acquire the media data in response to determining that the author of the media data allows the language data in the media data to be translated into a language other than the first natural language .

According to an exemplary implementation of the present disclosure, the translation module 1030 includes: an activation module configured to translate the first language data into the second language data in response to determining that the user activates the translation function.

According to an exemplary implementation of the present disclosure, the historical interaction between the user and the application includes at least any of the following: the user sets the target language of the translation operation in the application; the user sets the application language for presenting the application in the application; The system language is set in the operating system the app is running on; the user sets the preferred language order in the operating system the app is running in; the user sets the locale in the operating system the app is running in; A comment is performed in the app; a user performs a retweet in the application; a user performs a communication with other users of the application in the application; a user performs a search in the application.

FIG. 11 shows a block diagram of a device 1100 capable of implementing various implementations of the present disclosure. It should be understood that the computing device 1100 shown in FIG. 11 is exemplary only, and should not constitute any limitation as to the functionality and scope of the implementations described herein. The computing device 1100 shown in FIG. 11 can be used to implement the methods described above.

As shown in FIG. 11 , computing device 1100 is in the form of a general-purpose computing device. Components of computing device 1100 may include, but are not limited to, one or more processors or processing units 1110, memory 1120, storage devices 1130, one or more communication units 1140, one or more input devices 1150, and one or more output devices 1160. The processing unit 1110 may be an actual or virtual processor and is capable of performing various processes according to programs stored in the memory 1120 . In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capability of the computing device 1100 .

Computing device 1100 typically includes a plurality of computer storage media. Such media can be any available media that is accessible to computing device 1100, including but not limited to, volatile and nonvolatile media, removable and non-removable media. Memory 1120 can be volatile memory (e.g., registers, cache, random access memory (RAM), nonvolatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM) , flash memory) or some combination of them. Storage device 1130 may be removable or non-removable media, and may include machine-readable media, such as flash drives, magnetic disks, or any other media that may be capable of storing information and/or data (e.g., training data for training ) and can be accessed within computing device 1100.

The computing device 1100 may further include additional removable/non-removable, volatile/nonvolatile storage media. Although not shown in FIG. 11, a disk drive for reading from or writing to a removable, nonvolatile disk (such as a "floppy disk") and a disk drive for reading from a removable, nonvolatile disk may be provided. CD-ROM drive for reading or writing. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. Memory 1120 may include a computer program product 1125 having one or more program modules configured to perform various methods or actions of various implementations of the present disclosure.

The communication unit 1140 enables communication with other computing devices through communication media. Additionally, the functionality of the components of computing device 1100 may be implemented in a single computing cluster or as a plurality of computing machines capable of communicating via communication links. Accordingly, computing device 1100 may operate in a networked environment using logical connections to one or more other servers, a network personal computer (PC), or another network node.

The input device 1150 may be one or more input devices, such as a mouse, keyboard, trackball, and the like. Output device 1160 may be one or more output devices, such as a display, speakers, printer, or the like. The computing device 1100 can also communicate with one or more external devices (not shown) through the communication unit 1140 as needed, such as storage devices, display devices, etc., and one or more devices that enable the user to interact with the computing device 1100 communicate with, or communicate with, any device (eg, network card, modem, etc.) that enables computing device 1100 to communicate with one or more other computing devices. Such communication may be performed via an input/output (I/O) interface (not shown).

According to an exemplary implementation of the present disclosure, there is provided a computer-readable storage medium on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of the present disclosure, there is also provided a computer program product tangibly stored on a non-transitory computer-readable medium and comprising computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation manner of the present disclosure, a computer program product is provided, on which a computer program is stored, and when the program is executed by a processor, the method described above is implemented.

Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus, apparatus, and computer program products implemented according to the disclosure. It should be understood that each block of the flowcharts and/or block diagrams, and combinations of blocks in the flowcharts and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine such that when executed by the processing unit of the computer or other programmable data processing apparatus , producing an apparatus for realizing the functions/actions specified in one or more blocks in the flowchart and/or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause computers, programmable data processing devices and/or other devices to work in a specific way, so that the computer-readable medium storing instructions includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks in flowcharts and/or block diagrams.

computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other equipment, so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process, Instructions executed on computers, other programmable data processing devices, or other devices can thus implement the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various implementations of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, a program segment, or a portion of an instruction that contains one or more executable instruction. In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified function or action , or may be implemented by a combination of dedicated hardware and computer instructions.

Having described various implementations of the present disclosure above, the foregoing description is exemplary, not exhaustive, and is not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The choice of terminology used herein aims to best explain the principle of each implementation, practical application or improvement of technology in the market, or to enable other ordinary skilled in the art to understand each implementation disclosed herein.

Claims (12)

1. A method for media search across natural language comprising: Based on the keyword entered by the user in the application, search for media data matching the keyword in the media storage library of the application, where the first language data in the media data is represented by a first natural language ; determining a second natural language understood by the user based on natural language involved in historical interactions of the user with the application; in response to determining that the first natural language is different from the second natural language, translating the first language data into second language data represented by the second natural language; and The media data and the second language data are presented in the application. 2. The method according to claim 1, wherein the first language data comprises at least any one of the following: sound data, subtitle data, image data, title data, subtitle data, comment data, barrage data. 3. The method of claim 1, wherein determining the second natural language further comprises: providing prompt information to the user for selecting the second natural language in response to determining that there are a plurality of candidate second natural languages understood by the user; and Selecting the second natural language from the plurality of candidate second natural languages based on the user's feedback on the prompt information. 4. The method of claim 1 , wherein presenting the media data and the second language data in the application comprises: Presenting a preview window of the media data in a search result page of the application, the search result page further comprising another window for presenting another media file corresponding to the keyword in the media repository preview window; and The media data and the second language data are presented in the preview window. 5. The method of claim 4, further comprising: in response to receiving said user interaction with said preview window, Play the media data in the play page of the application; and During the playing of the media data, the translation data of the language data associated with the part being played in the media data is presented on the playing page, the translation data is represented by the second natural language . 6. The method of claim 5, further comprising: providing the user with a selection page for selecting a presentation mode for presenting the translation data, the presentation mode comprising at least any one of: for presenting the translation data font, font size, line spacing, and length of the translation data; and presenting the translation data further includes: In response to receiving the user selection of the presentation mode, the translation data is presented using the selected presentation mode. 7. The method of claim 1 , wherein searching the media data comprises: responsive to determining that an author of the media data allows language data in the media data to be translated into a language other than the first natural language , to get the media data. 8. The method of claim 1 , wherein translating the first language data into the second language data comprises translating the first language data into the second language data in response to determining that the user initiates a translation function. Second language data. 9. The method of claim 1, wherein the historical interactions of the user with the application include at least any of the following: The user sets the target language of the translation operation in the application; The user sets an application language for presenting the application in the application; The user sets the system language in the operating system used to run the application; said user sets a preferred language order in the operating system used to run said application; The user sets the locale in the operating system used to run the application; the user performs a post in the application; the user performs a comment in the application; The user performs forwarding in the application; the user performs communications within the application with other users of the application; The user performs a search in the application. 10. A media search device across natural language, comprising: The search module is configured to search the media storage library of the application for media data matching the keyword based on the keyword input by the user in the application, the first language data in the media data is provided by Expressed in the first natural language; a determining module configured to determine a second natural language understood by the user based on natural language involved in historical interactions of the user associated with the application; a translation module configured to translate the first language data into second language data represented by the second natural language in response to determining that the first natural language is different from the second natural language; and A presentation module configured to present the media data and the second language data in the application. 11. An electronic device comprising: at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit that, when executed by the at least one processing unit, cause the electronic The device performs the method according to any one of claims 1 to 9. 12. A computer-readable storage medium having stored thereon a computer program which, when executed by a processor, causes the processor to implement the method according to any one of claims 1 to 9.

Images