CN108574680B - A kind of real-time reminder method and device in audio-video real-time dialogue - Google Patents
A kind of real-time reminder method and device in audio-video real-time dialogue Download PDFInfo
- Publication number
- CN108574680B CN108574680B CN201710146401.1A CN201710146401A CN108574680B CN 108574680 B CN108574680 B CN 108574680B CN 201710146401 A CN201710146401 A CN 201710146401A CN 108574680 B CN108574680 B CN 108574680B
- Authority
- CN
- China
- Prior art keywords
- real
- time
- user
- voice data
- conversation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000006870 function Effects 0.000 claims description 8
- 238000000605 extraction Methods 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000004590 computer program Methods 0.000 claims 4
- 238000010586 diagram Methods 0.000 description 5
- 230000003993 interaction Effects 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Telephonic Communication Services (AREA)
- Information Transfer Between Computers (AREA)
Abstract
本发明公开一种实时对话中的实时提醒方法及装置，所述方法包括：接收预设的提醒关键信息及用户标识，并保存所述提醒关键信息与所述用户标识之间的对应关系。其次，实时接收语音数据时，获取所述语音数据所属的实时对话中参与对话的各个用户的用户标识。再次，利用所述语音数据，与所述实时对话中参与用户的用户标识分别对应的提醒关键信息进行实时匹配。当所述语音数据与提醒关键信息匹配成功，获取与所述提醒关键信息具有对应关系的用户标识。最后，向具有所述用户标识的用户发送实时提醒信号。本发明提供的实时对话中的实时提醒方法能够根据用户的需求提醒用户，从而降低用户遗漏或错过实时对话中的关键信息的几率。
The invention discloses a real-time reminder method and device in a real-time dialogue. The method includes: receiving preset reminder key information and user identification, and saving the corresponding relationship between the reminder key information and the user identification. Secondly, when the voice data is received in real time, the user identifiers of each user participating in the dialogue in the real-time dialogue to which the voice data belongs are acquired. Thirdly, the voice data is used to perform real-time matching with the reminder key information corresponding to the user IDs of the participating users in the real-time dialogue. When the voice data is successfully matched with the reminder key information, a user ID corresponding to the reminder key information is obtained. Finally, a real-time reminder signal is sent to the user with the user identification. The real-time reminder method in the real-time dialogue provided by the present invention can remind the user according to the needs of the user, thereby reducing the probability of the user missing or missing key information in the real-time dialogue.
Description
Technical Field
The invention relates to the field of data processing, in particular to an audio and video real-time reminding method and device in real-time conversation.
Background
In the internet era, communication modes between people are more and more diversified, for example, people in different places can use a chat tool to have real-time conversation, and the distance between people is shortened.
In real life, real-time conversations may also be applied to various scenarios, such as voice or video conferencing, among others. However, for various reasons, a user may miss or miss some critical information during a real-time conversation, and an effective solution is needed to reduce the occurrence of the above situations.
Disclosure of Invention
The invention provides a real-time reminding method in audio and video real-time conversation, which can remind a user in real time according to the requirement of the user in the real-time conversation process, thereby reducing the probability that the user misses or misses key information in the real-time conversation.
The invention provides a real-time reminding method in real-time conversation, which comprises the following steps:
receiving preset reminding key information and a user identifier, and storing a corresponding relation between the reminding key information and the user identifier;
when voice data are received in real time, user identifications of all users participating in conversation in real-time conversation to which the voice data belong are obtained;
matching the voice data with reminding key information respectively corresponding to user identifications participating in the user in the real-time conversation in real time by using the voice data;
when the voice data is successfully matched with the reminding key information, acquiring a user identifier corresponding to the reminding key information;
and sending a real-time reminding signal to the user with the user identification.
Preferably, the method further comprises:
and when the voice data is successfully matched with the reminding key information, recognizing the voice data, and storing text data converted from the voice data.
Preferably, the method further comprises:
and when the voice data is successfully matched with the reminding key information, storing the user identification of the user sending the voice data and the time information when the user sends the voice data.
Preferably, the method further comprises:
and generating a conversation record of the real-time conversation, wherein the conversation record comprises the text data converted by the voice data, the user identification of the user sending the voice data and the corresponding relation between the time information when the user sends the voice data, and the conversation record of the real-time conversation is used for being downloaded by the participating users in the real-time conversation.
Preferably, the method further comprises:
when a request for downloading a conversation record of the real-time conversation from a user in the real-time conversation is received, sending the conversation record to the user;
and receiving and storing the conversation record subjected to the secondary editing by the user for downloading by the participating user in the real-time conversation.
Preferably, the reminding key information is voice data;
correspondingly, the matching, by using the voice data, with the reminding key information respectively corresponding to the user identifiers of the participating users in the real-time conversation includes:
extracting features of the voice data, wherein the features comprise waveform information;
and matching the characteristics of the voice data with the characteristics of the reminding key information respectively corresponding to the user identification of each user in the real-time conversation.
Preferably, the reminding key information is text data;
correspondingly, the matching, by using the voice data, with the reminding key information respectively corresponding to the user identifiers of the participating users in the real-time conversation includes:
recognizing the voice data and converting the voice data into text data;
and matching the text data with the reminding key information respectively corresponding to the user identifications of the participating users in the real-time conversation.
Preferably, the method further comprises:
and when the client of the user receives the reminding signal, responding to the reminding signal and starting the audio or video recording function.
The invention also provides a real-time reminding device in real-time conversation, which comprises:
the first storage module is used for receiving preset reminding key information and user identification and storing the corresponding relation between the reminding key information and the user identification;
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring user identifications of all users participating in conversation in a real-time conversation to which voice data belongs when the voice data is received in real time;
the matching module is used for matching the reminding key information which corresponds to the user identification participating in the user in the real-time conversation in real time by utilizing the voice data;
the second acquisition module is used for acquiring a user identifier which has a corresponding relation with the reminding key information when the voice data is successfully matched with the reminding key information;
and the first sending module is used for sending a real-time reminding signal to the user with the user identification.
Preferably, the apparatus further comprises:
and the second storage module is used for identifying the voice data and storing the text data converted from the voice data when the voice data is successfully matched with the reminding key information.
Preferably, the apparatus further comprises:
and the third storage module is used for storing the user identification of the user sending the voice data and the time information when the user sends the voice data when the voice data is successfully matched with the reminding key information.
Preferably, the apparatus further comprises:
and the generation module is used for generating a conversation record of the real-time conversation, wherein the conversation record comprises the text data converted from the voice data, the user identification of the user sending the voice data and the corresponding relation between the time information when the user sends the voice data, and the conversation record of the real-time conversation is used for being downloaded by the participating user in the real-time conversation.
Preferably, the apparatus further comprises:
the second sending module is used for sending the conversation record to the user when receiving a downloading request of the user in the real-time conversation to the conversation record of the real-time conversation;
and the third storage module is used for receiving and storing the conversation record subjected to the secondary editing by the user so as to be downloaded by the participating user in the real-time conversation.
Preferably, the reminding key information is voice data;
correspondingly, the matching module comprises:
the extraction submodule is used for extracting the characteristics of the voice data, and the characteristics comprise waveform information;
and the first matching sub-module is used for matching the characteristics of the voice data with the characteristics of the reminding key information respectively corresponding to the user identifications of the participating users in the real-time conversation.
Preferably, the reminding key information is text data;
correspondingly, the matching module comprises:
the conversion submodule is used for identifying the voice data and converting the voice data into text data;
and the second matching submodule is used for matching the text data with the reminding key information respectively corresponding to the user identifications of the participating users in the real-time conversation.
The invention provides a real-time reminding method in audio and video real-time conversation, which comprises the steps of receiving preset reminding key information and a user identification, and storing the corresponding relation between the reminding key information and the user identification. Secondly, when voice data are received in real time, user identifications of all users participating in conversation in the real-time conversation to which the voice data belong are obtained. And thirdly, matching the reminding key information respectively corresponding to the user identification participating in the user in the real-time conversation with the voice data in real time. And when the voice data is successfully matched with the reminding key information, acquiring a user identifier which has a corresponding relation with the reminding key information. And finally, sending a real-time reminding signal to the user with the user identification. The real-time reminding method in the real-time conversation can remind the user according to the requirement of the user, so that the probability that the user misses or misses key information in the real-time conversation is reduced.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.
FIG. 1 is a flow chart of a real-time reminding method in a real-time dialogue according to the present invention;
fig. 2 is a signaling interaction diagram of a real-time reminding method in a real-time session according to the present invention;
FIG. 3 is a schematic structural diagram of a real-time reminder device in a real-time conversation according to the present invention;
fig. 4 is a schematic partial structural diagram of a computer according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, a flowchart of a real-time reminding method in a real-time conversation provided in an embodiment of the present invention is specifically provided, where the method specifically includes:
s101: receiving preset reminding key information and user identification, and storing the corresponding relation between the reminding key information and the user identification.
In the embodiment of the invention, when the user carries out the real-time conversation, the reminding key information can be set for the real-time conversation in advance. Specifically, after the user in the real-time conversation sets the reminding key information at the client, the reminding key information is sent to the server. And after receiving the reminding key information and the user identification set by the user, the server stores the corresponding relation between the reminding key information and the user identification. The real-time conversation comprises audio and video real-time conversation, and the user identification comprises information which can uniquely identify the user in the audio and video conversation, such as a user nickname, a user ID and the like.
S102: when voice data are received in real time, user identifications of all users participating in conversation in real-time conversation to which the voice data belong are obtained.
In the real-time conversation, each section of voice spoken by a user can be sent to a server as voice data, and when the server receives the voice data in the real-time conversation, user identifications of the users participating in the real-time conversation are firstly obtained.
S103: and matching the reminding key information respectively corresponding to the user identifications participating in the user in the real-time conversation with the voice data in real time.
In the embodiment of the invention, after the server acquires the user identification of each user participating in the real-time conversation, the server respectively acquires the pre-stored reminding key information corresponding to the user identification of each user. Specifically, some users in the current real-time conversation may not preset the reminding key information, so the embodiment of the present invention only obtains the reminding key information of the user preset in the current real-time conversation.
In practical application, the received voice data is used for matching with the reminding key information corresponding to the user identification of each user in the current real-time conversation, and the reminding key information successfully matched with the voice data is determined.
The reminding key information preset by the user in the embodiment of the invention can be voice data or text data. Specifically, the way of matching with different types of reminding key information is also different.
The matching mode for the reminding key information being the voice data comprises the following steps: firstly, preprocessing such as denoising, filtering and sampling is carried out on the received voice data, secondly, feature extraction is carried out on the voice data after preprocessing, and then the extracted features are matched with the features of the reminding key information of each user in the real-time conversation. In one implementation, the features include waveform information, specifically, similarity between the waveform information of the voice data and waveform information of the pre-stored reminding key information is calculated, and if the similarity meets a preset value, it is determined that the two are successfully matched. The specific condition for successful matching is not limited to the above manner.
In addition, the matching mode for the reminding key information being the text data comprises the following steps: firstly, after denoising the received voice data, recognizing the voice data, and converting the voice data into text data. And then, matching the text data with the reminding key information of each user in the real-time conversation. In one implementation, if the text data contains or is contained in any one of the reminding key information, the matching of the two is determined to be successful. The specific condition for successful matching is not limited to the above manner.
S104: and when the voice data is successfully matched with the reminding key information, acquiring a user identifier which has a corresponding relation with the reminding key information.
In the embodiment of the invention, if the voice data is successfully matched with any reminding key information preset by any user in the real-time conversation, the user identification corresponding to the reminding key information is obtained.
S105: and sending a real-time reminding signal to the user with the user identification.
In order to avoid that the user misses or misses the key information in the real-time conversation, the embodiment of the invention sends the real-time reminding signal to the user preset with the reminding key information after the voice data is successfully matched with the reminding key information, so as to play a role in reminding the user to pay attention to the real-time conversation.
In the embodiment of the present invention, after the client of the user receives the real-time reminding signal, the user can be reminded in real time through various reminding manners, for example, a screen flashing manner or a text suspension manner.
In the real-time reminding method in the real-time conversation provided by the embodiment of the invention, the preset reminding key information and the user identification are received at first, and the corresponding relation between the reminding key information and the user identification is stored. Secondly, when voice data are received in real time, user identifications of all users participating in conversation in the real-time conversation to which the voice data belong are obtained. And thirdly, matching the reminding key information respectively corresponding to the user identification participating in the user in the real-time conversation with the voice data in real time. And when the voice data is successfully matched with the reminding key information, acquiring a user identifier which has a corresponding relation with the reminding key information. And finally, sending a real-time reminding signal to the user with the user identification. The real-time reminding method in the real-time conversation provided by the embodiment of the invention can remind the user in real time according to the requirement of the user, thereby reducing the probability that the user misses or misses the key information in the real-time conversation.
An embodiment of the present invention further provides a real-time reminding method in a real-time conversation, and referring to fig. 2, the method is a signaling interaction diagram of the real-time reminding method in the real-time conversation provided in the embodiment of the present invention, and the method includes:
s200: the server receives and stores the reminding key information respectively set by the first user of the first client and the second user of the second client.
The user reminding method in the real-time conversation provided by the embodiment of the invention can be applied to the real-time conversation of two or more people, and the following example is only to establish the real-time conversation between two users (a first user and a second user). Specifically, the server establishes in advance a corresponding relationship between the user identifier of the first user and the first reminding key information, and a relationship between the user identifier of the second user and the second reminding key information. It is noted that the user may set and send the reminder key before the real-time session is established, or may set and send the reminder key during the real-time session.
S202: and the server receives voice data in real time, and the voice data is sent by the first user.
In the embodiment of the invention, a first user initiates a real-time conversation, firstly sends a real-time conversation request to a server, then the server forwards the request to a second user, and the second user successfully establishes the real-time conversation with the first user after agreeing to establish the real-time conversation.
In the embodiment of the invention, during the real-time conversation between the first user and the second user, the voice data sent by each other needs to be forwarded by the server. In the following, the example is only given that the server receives voice data from the first user.
S204: and after processing the voice data, the server matches with the preset reminding key information of the first user and the second user in the real-time conversation.
In the embodiment of the invention, after being processed, the voice data sent by the first user is matched with the reminding key information preset by the first user and the second user in the real-time conversation, if the matching is successful, the voice data is identified, and the text data converted from the voice data is stored, so that the user can inquire the content of the real-time conversation.
S206: and if the matching is successful, recognizing the voice data, storing text data converted from the voice data, a user identifier of a user sending the voice data and time information when the user sends the voice data, and generating a conversation record of the real-time conversation.
In the embodiment of the invention, if the matching is successful, the text data converted from the voice data, the user identification of the user sending the voice data and the corresponding relation between the time information when the user sends the voice data are stored, and the conversation record of the real-time conversation is generated according to the corresponding relation.
S208: and if the matching is successful, sending a reminding signal to the first user.
In addition, after the matching is successful, the embodiment of the invention also sends a reminding signal to the first user sending the voice information so as to remind the first user to pay attention to the real-time conversation, and key information in the real-time conversation is prevented from being missed or missed.
After the first client receives the reminding signal, the recording function of the audio or video can be started so as to record the subsequent content in the real-time conversation. In addition, the first user can upload the recorded audio and video files to the server to share the audio and video files with other users.
S210: the first user and the second user request to download the conversation record of the real-time conversation.
S212: and the server issues a conversation record of the real-time conversation.
In the embodiment of the invention, after the real-time conversation is finished, the first user and the second user can request the server to download the conversation records of the real-time conversation. In addition, the first user and the second user can also perform secondary editing on the conversation record, and upload the conversation record subjected to the secondary editing to the server so as to share the conversation record to other users.
The real-time reminding method in the real-time conversation provided by the embodiment of the invention not only can remind the user according to the requirement of the user, thereby reducing the probability that the user misses or misses key information in the real-time conversation, but also can generate the conversation record of the real-time conversation for the user to check subsequently.
An embodiment of the present invention further provides a real-time reminding device in a real-time conversation, and referring to fig. 3, the device is a schematic structural diagram of the real-time reminding device in the real-time conversation provided in the embodiment of the present invention, and the device includes:
a first saving module 301, configured to receive preset reminding key information and a user identifier, and save a corresponding relationship between the reminding key information and the user identifier;
a first obtaining module 302, configured to obtain, when voice data is received in real time, user identifiers of users participating in a conversation in a real-time conversation to which the voice data belongs;
the matching module 303 is configured to perform real-time matching on the reminding key information respectively corresponding to the user identifiers of the users participating in the real-time conversation by using the voice data;
a second obtaining module 304, configured to, when the voice data is successfully matched with the reminding key information, obtain a user identifier having a corresponding relationship with the reminding key information;
a first sending module 305, configured to send a real-time alert signal to the user with the user identifier.
In addition, the apparatus may further include:
and the second storage module is used for identifying the voice data and storing the text data converted from the voice data when the voice data is successfully matched with the reminding key information.
The device further comprises:
and the third storage module is used for storing the user identification of the user sending the voice data and the time information when the user sends the voice data when the voice data is successfully matched with the reminding key information.
The device further comprises:
and the generation module is used for generating a conversation record of the real-time conversation, wherein the conversation record comprises the text data converted from the voice data, the user identification of the user sending the voice data and the corresponding relation between the time information when the user sends the voice data, and the conversation record of the real-time conversation is used for being downloaded by the participating user in the real-time conversation.
The device further comprises:
the second sending module is used for sending the conversation record to the user when receiving a downloading request of the user in the real-time conversation to the conversation record of the real-time conversation;
and the third storage module is used for receiving and storing the conversation record subjected to the secondary editing by the user so as to be downloaded by the participating user in the real-time conversation.
The reminding key information is voice data;
correspondingly, the matching module comprises:
the extraction submodule is used for extracting the characteristics of the voice data, and the characteristics comprise waveform information;
and the first matching sub-module is used for matching the characteristics of the voice data with the characteristics of the reminding key information respectively corresponding to the user identifications of the participating users in the real-time conversation.
The reminding key information is text data;
correspondingly, the matching module comprises:
the conversion submodule is used for identifying the voice data and converting the voice data into text data;
and the second matching submodule is used for matching the text data with the reminding key information respectively corresponding to the user identifications of the participating users in the real-time conversation.
The real-time reminding device in the real-time conversation provided by the embodiment of the invention can realize the following functions: receiving preset reminding key information and user identification, and storing the corresponding relation between the reminding key information and the user identification. When voice data are received in real time, user identifications of all users participating in conversation in real-time conversation to which the voice data belong are obtained. And matching the reminding key information respectively corresponding to the user identifications participating in the user in the real-time conversation with the voice data in real time. And when the voice data is successfully matched with the reminding key information, acquiring a user identifier which has a corresponding relation with the reminding key information. And sending a real-time reminding signal to the user with the user identification. The user reminding device in the real-time conversation provided by the embodiment of the invention can remind the user according to the requirement of the user, so that the probability that the user misses or misses key information in the real-time conversation is reduced.
Correspondingly, an embodiment of the present invention further provides a computer, as shown in fig. 4, which may include:
a processor 401, a memory 402, an input device 403, and an output device 404. The number of the processors 401 in the browser server may be one or more, and one processor is taken as an example in fig. 4. In some embodiments of the present invention, the processor 401, the memory 402, the input device 403, and the output device 404 may be connected by a bus or other means, wherein the connection by the bus is illustrated in fig. 4.
The memory 402 may be used to store software programs and modules that the processor 401 may execute by operating on the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. The input device 403 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the browser server.
Specifically, in this embodiment, the processor 401 loads the executable file corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 401 runs the application programs stored in the memory 402, thereby implementing various functions:
receiving preset reminding key information and a user identifier, and storing a corresponding relation between the reminding key information and the user identifier;
when voice data are received in real time, user identifications of all users participating in conversation in real-time conversation to which the voice data belong are obtained;
matching the voice data with reminding key information respectively corresponding to user identifications participating in the user in the real-time conversation in real time by using the voice data;
when the voice data is successfully matched with the reminding key information, acquiring a user identifier corresponding to the reminding key information;
and sending a real-time reminding signal to the user with the user identification.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The method and the device for real-time reminding in real-time conversation provided by the embodiment of the invention are described in detail, a specific example is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (16)
1. A real-time reminding method in an audio and video real-time conversation is characterized by comprising the following steps:
receiving preset reminding key information and a user identifier, and storing a corresponding relation between the reminding key information and the user identifier;
when voice data are received in real time, user identifications of all users participating in conversation in real-time conversation to which the voice data belong are obtained;
matching the voice data with reminding key information respectively corresponding to user identifications participating in the user in the real-time conversation in real time by using the voice data;
when the voice data is successfully matched with the reminding key information, acquiring a user identifier corresponding to the reminding key information;
and sending a real-time reminding signal to the user with the user identification to remind the first user of paying attention to the subsequent content in the real-time conversation, so that after the first client receives the reminding signal, the audio or video recording function is started to record the subsequent content in the real-time conversation.
2. The method of real-time alerting in an audiovisual real-time conversation of claim 1, further comprising:
and when the voice data is successfully matched with the reminding key information, recognizing the voice data, and storing text data converted from the voice data.
3. The method of real-time alerting in an audiovisual real-time conversation of claim 2, further comprising:
and when the voice data is successfully matched with the reminding key information, storing the user identification of the user sending the voice data and the time information when the user sends the voice data.
4. A method of real-time alerting in an audiovisual real-time conversation in accordance with claim 3, characterized in that the method further comprises:
and generating a conversation record of the real-time conversation, wherein the conversation record comprises the text data converted by the voice data, the user identification of the user sending the voice data and the corresponding relation between the time information when the user sends the voice data, and the conversation record of the real-time conversation is used for being downloaded by the participating users in the real-time conversation.
5. The method of real-time reminders in an audiovisual real-time conversation according to claim 4, further comprising:
when a request for downloading a conversation record of the real-time conversation from a user in the real-time conversation is received, sending the conversation record to the user;
and receiving and storing the conversation record subjected to the secondary editing by the user for downloading by the participating user in the real-time conversation.
6. The real-time reminding method in audio-video real-time conversation according to claim 1, characterized in that the reminding key information is voice data;
correspondingly, the matching, by using the voice data, with the reminding key information respectively corresponding to the user identifiers of the participating users in the real-time conversation includes:
extracting features of the voice data, wherein the features comprise waveform information;
and matching the characteristics of the voice data with the characteristics of the reminding key information respectively corresponding to the user identification of each user in the real-time conversation.
7. The real-time reminding method in audio-video real-time conversation according to claim 1, characterized in that the reminding key information is text data;
correspondingly, the matching, by using the voice data, with the reminding key information respectively corresponding to the user identifiers of the participating users in the real-time conversation includes:
recognizing the voice data and converting the voice data into text data;
and matching the text data with the reminding key information respectively corresponding to the user identifications of the participating users in the real-time conversation.
8. A real-time reminder device in an audio-visual real-time conversation, the device comprising:
the first storage module is used for receiving preset reminding key information and user identification and storing the corresponding relation between the reminding key information and the user identification;
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring user identifications of all users participating in conversation in a real-time conversation to which voice data belongs when the voice data is received in real time;
the matching module is used for matching the reminding key information which corresponds to the user identification participating in the user in the real-time conversation in real time by utilizing the voice data;
the second acquisition module is used for acquiring a user identifier which has a corresponding relation with the reminding key information when the voice data is successfully matched with the reminding key information;
and the first sending module is used for sending a real-time reminding signal to the user with the user identification so as to remind the first user of paying attention to the subsequent content in the real-time conversation, so that after the first client receives the reminding signal, the audio or video recording function is started so as to record the subsequent content in the real-time conversation.
9. The real-time reminder device in an audiovisual real-time conversation according to claim 8, characterized in that the device further comprises:
and the second storage module is used for identifying the voice data and storing the text data converted from the voice data when the voice data is successfully matched with the reminding key information.
10. A real-time reminder device in an audiovisual real-time conversation according to claim 9, characterized in that the device further comprises:
and the third storage module is used for storing the user identification of the user sending the voice data and the time information when the user sends the voice data when the voice data is successfully matched with the reminding key information.
11. A real-time reminder device in an audiovisual real-time conversation according to claim 10, characterized in that the device further comprises:
and the generation module is used for generating a conversation record of the real-time conversation, wherein the conversation record comprises the text data converted from the voice data, the user identification of the user sending the voice data and the corresponding relation between the time information when the user sends the voice data, and the conversation record of the real-time conversation is used for being downloaded by the participating user in the real-time conversation.
12. A real-time reminder device in an audiovisual real-time conversation according to claim 11, characterized in that the device further comprises:
the second sending module is used for sending the conversation record to the user when receiving a downloading request of the user in the real-time conversation to the conversation record of the real-time conversation;
and the third storage module is used for receiving and storing the conversation record subjected to the secondary editing by the user so as to be downloaded by the participating user in the real-time conversation.
13. The real-time reminding device in audio-video real-time dialogue according to claim 8, wherein the reminding key information is voice data;
correspondingly, the matching module comprises:
the extraction submodule is used for extracting the characteristics of the voice data, and the characteristics comprise waveform information;
and the first matching sub-module is used for matching the characteristics of the voice data with the characteristics of the reminding key information respectively corresponding to the user identifications of the participating users in the real-time conversation.
14. The real-time reminding device in the real-time dialogue according to claim 8, wherein the reminding key information is text data;
correspondingly, the matching module comprises:
the conversion submodule is used for identifying the voice data and converting the voice data into text data;
and the second matching submodule is used for matching the text data with the reminding key information respectively corresponding to the user identifications of the participating users in the real-time conversation.
15. A server, comprising: a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to execute a computer program stored in the memory;
the computer program is used for executing the real-time reminding method in the audio-video real-time conversation of any one of claims 1 to 7.
16. A computer-readable storage medium, characterized in that the storage medium has stored therein a computer program for executing the real-time alerting method in an audiovisual real-time conversation according to any of claims 1-7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710146401.1A CN108574680B (en) | 2017-03-13 | 2017-03-13 | A kind of real-time reminder method and device in audio-video real-time dialogue |
| PCT/CN2018/077980 WO2018166367A1 (en) | 2017-03-13 | 2018-03-05 | Real-time prompt method and device in real-time conversation, storage medium, and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710146401.1A CN108574680B (en) | 2017-03-13 | 2017-03-13 | A kind of real-time reminder method and device in audio-video real-time dialogue |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108574680A CN108574680A (en) | 2018-09-25 |
| CN108574680B true CN108574680B (en) | 2021-05-04 |
Family
ID=63521767
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710146401.1A Active CN108574680B (en) | 2017-03-13 | 2017-03-13 | A kind of real-time reminder method and device in audio-video real-time dialogue |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108574680B (en) |
| WO (1) | WO2018166367A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109104535B (en) * | 2018-09-30 | 2020-10-27 | 联想(北京)有限公司 | Information processing method, electronic equipment and system |
| CN109451158B (en) * | 2018-11-09 | 2021-07-27 | 维沃移动通信有限公司 | A reminder method and device |
| CN112735421A (en) * | 2019-10-28 | 2021-04-30 | 北京京东尚科信息技术有限公司 | Real-time quality inspection method and device for voice call |
| CN113223558B (en) * | 2021-04-30 | 2024-03-15 | 广州虎牙科技有限公司 | Audio data silencing method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102970210A (en) * | 2012-11-02 | 2013-03-13 | 北京百度网讯科技有限公司 | Method and device for reminding group messages in instant chat tool |
| WO2015106586A1 (en) * | 2014-01-16 | 2015-07-23 | 华为技术有限公司 | Method and apparatus for processing reminder notification messages |
| CN105827501A (en) * | 2015-07-30 | 2016-08-03 | 维沃移动通信有限公司 | Message reminding method and electronic equipment |
| CN106302933A (en) * | 2016-08-31 | 2017-01-04 | 宇龙计算机通信科技(深圳)有限公司 | Voice information whose processing method and terminal |
| CN106330685A (en) * | 2016-09-18 | 2017-01-11 | 依偎科技（南昌）有限公司 | Group message prompt method and terminal |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101931701A (en) * | 2010-08-25 | 2010-12-29 | 宇龙计算机通信科技(深圳)有限公司 | Method, system and mobile terminal for prompting contact information in communication process |
| US8848026B2 (en) * | 2013-02-01 | 2014-09-30 | Maitland M. DeLand | Video conference call conversation topic sharing system |
| CN105681564A (en) * | 2016-01-25 | 2016-06-15 | 宇龙计算机通信科技(深圳)有限公司 | Message reminding method and device |
-
2017
- 2017-03-13 CN CN201710146401.1A patent/CN108574680B/en active Active
-
2018
- 2018-03-05 WO PCT/CN2018/077980 patent/WO2018166367A1/en not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102970210A (en) * | 2012-11-02 | 2013-03-13 | 北京百度网讯科技有限公司 | Method and device for reminding group messages in instant chat tool |
| WO2015106586A1 (en) * | 2014-01-16 | 2015-07-23 | 华为技术有限公司 | Method and apparatus for processing reminder notification messages |
| CN105827501A (en) * | 2015-07-30 | 2016-08-03 | 维沃移动通信有限公司 | Message reminding method and electronic equipment |
| CN106302933A (en) * | 2016-08-31 | 2017-01-04 | 宇龙计算机通信科技(深圳)有限公司 | Voice information whose processing method and terminal |
| CN106330685A (en) * | 2016-09-18 | 2017-01-11 | 依偎科技（南昌）有限公司 | Group message prompt method and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018166367A1 (en) | 2018-09-20 |
| CN108574680A (en) | 2018-09-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11870942B2 (en) | Systems and methods to automatically join conference | |
| CN108574680B (en) | A kind of real-time reminder method and device in audio-video real-time dialogue | |
| CN109741753B (en) | Voice interaction method, device, terminal and server | |
| JP2020525903A (en) | Managing Privilege by Speaking for Voice Assistant System | |
| CN104519108B (en) | Push accounts information, the method for importing relation chain, apparatus and system | |
| JP2017529711A (en) | Method, apparatus and system for voice confirmation | |
| CN111047184A (en) | Method and device for updating meeting room usage time | |
| CN113162777B (en) | Notification message generation method and device, electronic device and storage medium | |
| CN103841272A (en) | Method and device for sending voice messages | |
| CN104092653B (en) | Data processing method and system | |
| CN111641554B (en) | A message processing method, device and computer-readable storage medium | |
| CN108989864B (en) | Wheat connecting method, device, equipment and storage medium | |
| CN108881766B (en) | Video processing method, device, terminal and storage medium | |
| CN108320757B (en) | Delivery information prompting method, device, smart speaker and storage medium | |
| CN110971984A (en) | Wheat connecting method, device, system, equipment and storage medium | |
| CN106303015A (en) | Communication message processing method and device and terminal equipment | |
| CN110996180B (en) | Network live broadcast chatting method, system and server | |
| CN113542101A (en) | Help seeking information sending and responding method, device and storage medium | |
| CN106796523B (en) | Method, device, electronic device and system for intelligent control | |
| WO2017080243A1 (en) | Method, apparatus and system for synchronizing information | |
| US20190304446A1 (en) | Artificial intelligence assistant recommendation service | |
| CN104407846B (en) | Information processing method and device | |
| CN111726283B (en) | WeChat receiving method and device for vehicle-mounted intelligent sound box | |
| CN110430127B (en) | Voice processing method and device based on picture book reading and storage medium | |
| CN110691256B (en) | Video associated information processing method and device, server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |