CN116668387A - Multimedia communication processing method and related products - Google Patents

Abstract

The application provides a multimedia communication processing method and related products; the method comprises the following steps: displaying a human-computer interaction interface; the man-machine interaction interface comprises a multimedia communication invitation inlet; responding to triggering operation for a multimedia communication invitation inlet, displaying at least one candidate account, and displaying communication reference information of each candidate account; the communication reference information comprises time zone time information of the candidate account and an online state corresponding to the time zone time information; in response to a multimedia communication invitation operation directed to at least one target account of the at least one candidate account, a multimedia communication invitation message is sent to the at least one target account. The application can intelligently remind the account information participating in the multimedia communication so as to improve the success rate of initiating account to establish the multimedia communication.

Description

Multimedia communication processing method and related products

technical field

The present application relates to multimedia communication technology, and in particular to a multimedia communication processing method, device, electronic equipment, computer-readable storage medium and computer program product.

Background technique

With the development of Internet technology, it is possible to communicate with users in different regions through multimedia communication technology, for example, to establish audio calls between multiple users, or to establish video calls between multiple users, thereby speeding up the communication efficiency of users .

In the related art, when the multimedia communication method is applied to people across time zones, since users in different time zones are in different local times and have different behavior states, the success rate of establishing multimedia communication is low, resulting in low efficiency of human-computer interaction.

Contents of the invention

Embodiments of the present application provide a multimedia communication processing method, device, electronic equipment, computer-readable storage medium, and computer program product, which can intelligently remind the information of accounts participating in multimedia communication, so as to improve the success rate of initiating accounts to establish multimedia communication .

The technical scheme of the embodiment of the application is realized in this way:

An embodiment of the present application provides a method for processing multimedia communication, including:

Displaying a human-computer interaction interface; wherein, the human-computer interaction interface includes a multimedia communication invitation portal;

In response to a trigger operation on the multimedia communication invitation portal, at least one candidate account is displayed, and communication reference information of each candidate account is displayed; wherein, the communication reference information includes time zone and time information of the candidate account and time information related to the candidate account. The online status corresponding to the time zone time information;

In response to a multimedia communication invitation operation directed to at least one target account in the at least one candidate account, a multimedia communication invitation message is sent to the at least one target account.

An embodiment of the present application provides a multimedia communication processing device, including:

The first display module is configured to display a human-computer interaction interface; wherein, the human-computer interaction interface includes a multimedia communication invitation portal;

The second display module is configured to display at least one candidate account and display communication reference information of each candidate account in response to a trigger operation on the multimedia communication invitation portal; wherein the communication reference information includes the candidate The time zone and time information of the account and the online status corresponding to the time zone and time information;

An invitation module, configured to send a multimedia communication invitation message to the at least one target account in response to the multimedia communication invitation operation for at least one target account in the at least one candidate account.

In the above solution, the second display module is further configured to: when the number of the at least one candidate account is multiple, display a plurality of the candidate accounts in order; wherein the order is one of the following: The ascending order of the social distance between the multiple candidate accounts and the initiating account of the multimedia communication, the descending order of the activity of the multiple candidate accounts, and the latest interaction between the multiple candidate accounts and the initiating account Descending order of time.

In the above solution, before displaying the at least one candidate account, the second display module is further configured to: obtain the candidate account that meets at least one of the following conditions: the candidate account is online; the candidate The social distance between the account and the initiating account of the multimedia communication is less than a social distance threshold; the activity of the candidate account is greater than the activity threshold; the latest interaction time between the candidate account and the initiating account is greater than the interaction time threshold ; The candidate account is in the same communication connection as the initiating account.

In the above solution, when the candidate account and the initiating account are in the same communication connection, the second display module is further configured to: exclude the initiating account from the target group corresponding to the communication connection At least one other communication account is used as at least one candidate account, and the at least one candidate account is displayed, wherein the initiating account belongs to the target group; or the target communication account in the communication connection is used as the candidate account, and display the candidate account.

In the above solution, the second display module is further configured to: when the multimedia communication is real-time multimedia communication, display the communication reference information of each candidate account, the communication reference information including the candidate account The real-time time zone and the real-time online status corresponding to the candidate account in the real-time time zone.

In the above solution, when displaying the communication reference information of each of the candidate accounts, the second display module is further configured to: when the number of the at least one candidate account is multiple, for a plurality of the candidate accounts The communication reference information corresponding to the account respectively applies a differentiated display style; wherein, the significance of the display style of the real-time time zone time of the candidate account is positively correlated with the time zone difference, and the time zone difference is used to represent the difference between the candidate account and the time zone. The time difference between the initiating accounts of the multimedia communication; the significant degree of the display style of the real-time online status is positively correlated with the status difference, and the status difference is the difference between the online status of the candidate account and the online status of the initiating account difference between.

In the above solution, before displaying the communication reference information of each of the candidate accounts, the second display module is further configured to: obtain the real-time online status of each of the candidate accounts; wherein, each of the candidate accounts The real-time online status is determined in response to the setting operation of the candidate account.

In the above solution, before displaying the communication reference information of each of the candidate accounts, the second display module is further configured to: determine the real-time online status of each of the candidate accounts in the following manner: obtain a plurality of sample communication accounts Respectively corresponding historical schedule information; perform the following processing for each of the sample communication accounts: extract the historical online status of each historical period from the historical schedule information of the sample communication accounts; Perform statistical processing on the historical online status of the historical period to obtain the statistical status corresponding to each of the historical periods; determine the statistical status corresponding to the historical period in which the real-time time zone time is located as the real-time status of the candidate account online status.

In the above solution, before displaying the communication reference information of each of the candidate accounts, the second display module is further configured to: determine the real-time online status of each of the candidate accounts in the following manner: obtain the information of the candidate accounts Historical schedule information and historical schedule information of a plurality of sample communication accounts; extracting the historical state characteristics of the candidate account from the historical schedule information of the candidate account, and extracting the historical status characteristics of the candidate account from the historical schedule information of the multiple sample communication accounts The historical state characteristics of the plurality of sample communication accounts; the historical state characteristics of the candidate account and the historical state characteristics of the plurality of sample communication accounts are fused to obtain the fusion state characteristics; and the fusion state characteristics are mapped. , to obtain the real-time online status of the candidate account.

In the above solution, before responding to the multimedia communication invitation operation for at least one target account in the at least one candidate account, the invitation module is further configured to: when the real-time time zone of the candidate account is in the communicable period , and when the real-time online status of the candidate account is a communicable status, determine the candidate account as the at least one target account, and display the target account in the selected status.

In the above solution, the second display module is further configured to: when the multimedia communication is scheduled multimedia communication, display the time zone time and online status corresponding to each candidate account at the scheduled time, wherein the The appointment time includes at least one of the following: an appointment time point; an appointment time period.

In the above solution, when displaying the communication reference information of each of the candidate accounts, the second display module is further configured to: when the number of the at least one candidate account is multiple, for a plurality of the candidate accounts The communication reference information corresponding to the account respectively applies a differentiated display style; wherein, the significance of the display style of the time zone time corresponding to the candidate account at the reservation time is positively correlated with the time zone difference, and the time zone difference is used to represent the The time difference between the candidate account and the initiating account of the multimedia communication; the significant degree of the display style of the online state corresponding to the candidate account at the reservation time is positively correlated with the state difference, and the state difference is that the candidate account is in The difference between the online status corresponding to the reserved time and the online status of the initiating account.

In the above solution, before displaying the communication reference information of each of the candidate accounts, the second display module is further configured to: obtain the online status corresponding to each of the candidate accounts at the appointment time; wherein, each The online states corresponding to the candidate accounts at the appointment time are determined in response to the setting operation of the candidate accounts.

In the above solution, before displaying the communication reference information of each of the candidate accounts, the second display module is further configured to: determine the online status corresponding to each of the candidate accounts at the appointment time in the following manner: Obtain historical schedule information corresponding to multiple sample communication accounts; perform the following processing for each of the sample communication accounts: extract the historical online status of each historical period from the historical schedule information of the sample communication accounts; Statistical processing is performed on the historical online status of each communication account in each of the historical periods to obtain the statistical status corresponding to each of the historical periods; The corresponding statistical status is determined as the online status corresponding to the candidate account at the reservation time.

In the above solution, before displaying the communication reference information of each of the candidate accounts, the second display module is further configured to: determine the online status corresponding to each of the candidate accounts at the appointment time in the following manner: Acquiring the historical schedule information of the candidate account and the historical schedule information of multiple sample communication accounts; extracting the historical state characteristics of the candidate account from the historical schedule information of the candidate account, and extracting the historical status characteristics of the candidate account from the multiple sample communication accounts Extracting the historical status features of the multiple sample communication accounts from the historical schedule information; performing fusion processing on the historical status features of the candidate accounts and the historical status features of the multiple sample communication accounts to obtain the fusion status features; The state features are fused to perform mapping processing to obtain the online state corresponding to the candidate account at the reservation time.

In the above solution, before displaying the communication reference information of each of the candidate accounts, the second display module is further configured to: respond to the operation of setting the reservation time for the multimedia communication, acquire the The time zone time and online status corresponding to the reservation time; after displaying the communication reference information of each of the candidate accounts, the method further includes: responding to the multimedia communication initiation account for the reservation time of the multimedia communication The modification operation is to update the communication reference information of each candidate account according to the modified appointment time, where the updated communication reference information is the communication reference information of each candidate account at the modified appointment time.

In the above solution, before responding to the multimedia communication invitation operation for at least one target account in the at least one candidate account, the invitation module is further configured to: when the candidate account is at the time corresponding to the reservation time When the time zone time is in the communicable period, and the online state corresponding to the appointment time of the candidate account is in the communicable state, the candidate account is determined as the at least one target account, and the selected account is displayed. target account.

In the above solution, the communication reference information further includes at least one of the following: location information of the candidate account, weather information of the location of the candidate account, schedule information of the candidate account; when the communication reference information When the location information of the candidate account is included, the prominence of the display style of the communication reference information is positively correlated with the distance, and the distance is between the geographic location corresponding to the candidate account and the geographic location corresponding to the initiating account. distance; when the communication reference information includes the weather information of the location where the candidate account is located, the prominence of the display style of the communication reference information is positively correlated with the bad weather represented by the weather information; when the communication reference When the information includes the schedule information of the candidate account, the prominence of the display style of the communication reference information is positively correlated with the number of schedules represented by the schedule information.

In the above solution, before responding to the multimedia communication invitation operation for at least one target account, the invitation module is further configured to: respond to the selection operation for the at least one candidate account, select the The candidate account is determined as the at least one target account, and the target account in the selected state is displayed; or the candidate account that meets the automatic selection condition is determined as the at least one target account, and the target account in the selected state is displayed.

In the above solution, the automatic selection condition includes at least one of the following: the social distance between the candidate account and the initiating account is less than a social distance threshold; the activity of the candidate account is greater than the activity threshold; the candidate The latest interaction time between the account and the initiating account is greater than the interaction time threshold.

In the above scheme, the invitation module is further configured to: perform the following processing for each of the candidate accounts: obtain decision reference data, wherein the decision reference data includes at least one of the following: historical schedules of the candidate accounts information, the setting information of the multimedia communication, the historical communication information of the candidate account, and the communication reference information of the candidate account; extract the decision-making reference feature from the decision-making reference data, and predict the decision-making reference feature based on the decision-making reference feature A probability that a candidate account can respond to the multimedia communication; when the probability is greater than a probability threshold, it is determined that the candidate account satisfies the automatic selection condition.

In the above solution, before sending the multimedia communication invitation message to the at least one target account, the invitation module is further configured to: display a first prompt when there is a target account in the at least one target account that meets the prompt condition information, the first prompt information indicates that the communication start time of the multimedia communication conflicts with the communication reference information of the target account; in response to the confirmation operation for the first prompt information, it is determined to transfer to the at least one target The process of sending a multimedia communication invitation message by an account.

In the above solution, the prompt condition includes at least one of the following: at the start time of the communication, the time zone of the target account is in the non-communication period of the target account; at the start time of the communication, the time zone of the target account The time zone time of the target account is within the communication period of the target account, and the time interval between the time zone time of the target account and the non-communication period of the target account is less than the time interval threshold; at the communication start time, the time interval of the target account The online state is a non-communication state.

In the above solution, the invitation module is further configured to: display the account identifier of each target account and the real-time communication reference information of each target account during the multimedia communication, and the target The real-time communication reference information of the account includes at least one of the following: the real-time time zone time of the target account and the real-time online state corresponding to the real-time time zone time of the target account; when the real-time online state is a non-communication state, and displaying second prompt information, where the second prompt information is used to prompt the initiating account of the multimedia communication to end the multimedia communication.

An embodiment of the present application provides an electronic device, including:

memory for storing executable instructions;

The processor is configured to implement the multimedia communication processing method provided in the embodiment of the present application when executing the executable instruction stored in the memory.

An embodiment of the present application provides a computer-readable storage medium, storing executable instructions for implementing the multimedia communication processing method provided in the embodiment of the present application when executed by a processor.

An embodiment of the present application provides a computer program product, including a computer program or an instruction. When the computer program or instruction is executed by a processor, the multimedia communication processing method provided in the embodiment of the present application is implemented.

The embodiment of the present application has the following beneficial effects:

Before the invitation for multimedia communication, the time zone time of each candidate account and the online status corresponding to the time zone time are displayed to the initiating account of the multimedia communication, so that the initiating account of the multimedia communication invites the target account from the candidate account for multimedia communication. The initiating account can refer to the time zone and corresponding online status of each candidate account to select a suitable candidate account to establish multimedia communication, thereby improving the success rate of the invitation operation.

Description of drawings

FIG. 1 is a schematic structural diagram of a multimedia communication processing system provided by an embodiment of the present application;

Fig. 2 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

3A-3D are schematic flowcharts of a method for processing multimedia communication provided by an embodiment of the present application;

4A-4J are schematic diagrams of the display interface of the multimedia communication processing method provided by the embodiment of the present application;

FIG. 5 is a schematic diagram of an interaction process of a method for processing multimedia communication provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the application clearer, the application will be further described in detail below in conjunction with the accompanying drawings. All other embodiments obtained under the premise of creative labor belong to the scope of protection of this application.

In the following description, references to "some embodiments" describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or a different subset of all possible embodiments, and Can be combined with each other without conflict.

In the following description, the term "first\second\third" is only used to distinguish similar objects, and does not represent a specific ordering of objects. Understandably, "first\second\third" Where permitted, the specific order or sequencing may be interchanged such that the embodiments of the application described herein can be practiced in sequences other than those illustrated or described herein.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of the present application, and are not intended to limit the present application.

Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are described, and the nouns and terms involved in the embodiments of the present application are applicable to the following explanations.

1) Response, used to indicate the condition or state on which the executed operation depends. When the dependent condition or state is met, one or more operations to be executed may be real-time or have a set delay; Unless otherwise specified, there is no restriction on the order in which the operations are performed.

2) Time zone, due to the different longitudes of countries and regions in the world, the time zone time is also different, so it will be divided into different time zones. The official time zone division includes 24 time zones, each time zone is represented by an English letter.

3) Multimedia communication. Multimedia communication is online communication including at least one of audio and video. Multimedia communication includes two types: real-time and reservation. A typical application of reservation multimedia communication is online meeting.

With the advent of globalization, people from different countries need to communicate with each other. Various instant messaging software has become a communication bridge for people in different countries. When the applicant implemented the embodiment of the present application, he found that time and space became obstacles to instant communication, and because he was in different regions, he could not know the time in the current time zone of his social friends in time, so that he could not successfully establish communication. For example, communication account A sent communication Account B sends an audio and video call, but the current time zone of communication account B may be three in the middle of the night, and the user corresponding to communication account B is in a rest state, or communication account A wants to reserve an audio and video call with communication account B, but because I don’t know the time zone and time of communication account B (especially in countries with winter time and daylight saving time), and I don’t know the status of the user corresponding to communication account B, which makes it impossible to reserve a suitable audio and video call time.

There is no similar function to support displaying the time zone time of the other party in the audio and video call of the related technology. The user can only query the time zone time of the other party. Manually dial forward or backward by one hour. There are two disadvantages in this process: 1. The user’s self-inquiry is error-prone. It is necessary to know the location of the other party’s country and city to know the time in the other’s time zone. Some countries have multiple time zones, and the time zones in different time zones are different. Some countries have winter time and daylight saving time, and need to manually dial forward or backward by one hour; 2. The operation is complicated and lacks automation: the user needs to manually query and calculate the current time zone of the other party. When there are contacts in multiple countries 3. The amount of information that can be expressed by time is limited. Whether the user can respond to audio and video calls depends not only on the time zone but also on the user's status. If only relying on time information The invitation is issued as a reference, and it is still difficult to guarantee the success rate of the invitation.

Aiming at the technical problem in the related art that the low invitation success rate leads to low human-computer interaction efficiency, the embodiments of the present application provide a multimedia communication processing method, device, electronic equipment, computer program product, and computer-readable storage medium, which can improve the generation And send dynamic human-computer interaction diversity.

The exemplary application of the electronic device provided by the embodiment of the present application is described below. The electronic device provided by the embodiment of the present application for realizing the processing method of multimedia communication can be implemented as a notebook computer, a tablet computer, a desktop computer, a set-top box, a mobile device (such as , mobile phones, portable music players, personal digital assistants, dedicated message devices, portable game devices) and other types of user terminals.

Referring to FIG. 1, FIG. 1 is a schematic diagram of the architecture of a multimedia communication processing system provided by an embodiment of the present application. In order to support a social application, the terminal 400-1 and the terminal 400-2 are connected to the server 200 through the network 300, and the network 300 may be a wide area network. Or LAN, or a combination of both.

The terminal 400-2 receives the local status set by the candidate account, the terminal 400-2 sends the local status and the local time to the server 200, and the server 200 sends the time zone time information of the candidate account and the online status corresponding to the time zone time information to the corresponding initiating account Terminal 400-1, it can be understood that, in the embodiment of this application, user-related data such as the time zone time information of the candidate account and the online status corresponding to the time zone time information, when the embodiment of the application is applied to a specific product or technology, need to obtain the user's permission or consent, and the collection, use and processing of relevant data need to comply with the relevant laws, regulations and standards of the relevant countries and regions, the terminal 400-1 receives the trigger operation of the initiation account for the multimedia communication invitation entrance , at least one candidate account is displayed on the human-computer interaction interface of the terminal 400-1, and the communication reference information of each candidate account is displayed, the terminal 400-1 receives a multimedia communication invitation operation for at least one candidate account, and through the server 200 Send a multimedia communication invitation message to the terminal 400-2 corresponding to the candidate account.

In some embodiments, the terminal or the server may implement the multimedia communication processing method provided in the embodiment of the present application by running a computer program. For example, a computer program can be a native program or software module in the operating system; it can be a local (Native) application program (APP, Application), that is, a program that needs to be installed in the operating system to run, instant messaging client, video Conference client, social network client; it can also be a small program, that is, a program that only needs to be downloaded into the browser environment to run; it can also be a small program that can be embedded in any APP. In a word, the above-mentioned computer program can be any form of application program, module or plug-in.

The embodiment of the present application can be realized by means of cloud technology (Cloud Technology). Cloud technology refers to a kind of hosting that unifies a series of resources such as hardware, software, and network in a wide area network or a local area network to realize data calculation, storage, processing, and sharing. technology.

Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, and application technology based on cloud computing business models. It can form a resource pool and be used on demand, which is flexible and convenient. Cloud computing technology will become an important support. The background service of the technical network system requires a large amount of computing and storage resources.

As an example, the server 200 can be an independent physical server, or a server cluster or a distributed system composed of multiple physical servers, and can also provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, Cloud servers for basic cloud computing services such as cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The terminal 400-1 may be a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, a vehicle terminal, etc., but is not limited thereto. The terminal 400-1 and the server 200 may be connected directly or indirectly through wired or wireless communication, which is not limited in this embodiment of the present application.

Referring to FIG. 2, FIG. 2 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The terminal 400-1 shown in FIG. Various components in the terminal 400 - 1 are coupled together through the bus system 440 . It can be understood that the bus system 440 is used to realize connection and communication among these components. In addition to the data bus, the bus system 440 also includes a power bus, a control bus and a status signal bus. However, for clarity of illustration, the various buses are labeled as bus system 440 in FIG. 2 .

The processor 410 may be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware Components, etc., wherein the general-purpose processor can be a microprocessor or any conventional processor, etc.

User interface 430 includes one or more output devices 431 that enable presentation of media content, including one or more speakers and/or one or more visual displays. The user interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

Memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid state memory, hard drives, optical drives, and the like. Memory 450 optionally includes one or more storage devices located physically remote from processor 410 .

Memory 450 includes volatile memory or nonvolatile memory, and may include both volatile and nonvolatile memory. The non-volatile memory may be a read only memory (ROM, Read Only Memory), and the volatile memory may be a random access memory (RAM, Random Access Memory). The memory 450 described in the embodiment of the present application is intended to include any suitable type of memory.

In some embodiments, memory 450 is capable of storing data to support various operations, examples of which include programs, modules, and data structures, or subsets or supersets thereof, as exemplified below.

Operating system 451, including system programs for processing various basic system services and performing hardware-related tasks, such as framework layer, core library layer, driver layer, etc., for implementing various basic services and processing hardware-based tasks;

A network communication module 452 for reaching other computing devices via one or more (wired or wireless) network interfaces 420. Exemplary network interfaces 420 include: Bluetooth, Wireless Compatibility Authentication (WiFi), and Universal Serial Bus ( USB, Universal Serial Bus), etc.;

Presentation module 453 for enabling presentation of information via one or more output devices 431 (e.g., display screen, speakers, etc.) associated with user interface 430 (e.g., a user interface for operating peripherals and displaying content and information );

The input processing module 454 is configured to detect one or more user inputs or interactions from one or more of the input devices 432 and translate the detected inputs or interactions.

In some embodiments, the multimedia communication processing device provided by the embodiment of the present application can be realized by software. FIG. 2 shows the multimedia communication processing device 455 stored in the memory 450, which can be in the form of programs, plug-ins, etc. The software includes the following software modules: the first display module 4551, the second display module 4552 and the invitation module 4553. These modules are logical, so they can be combined or further divided arbitrarily according to the realized functions. The function of each module will be explained below.

The method for processing multimedia communication provided by the embodiment of the present application will be described in conjunction with the exemplary application and implementation of the terminal provided in the embodiment of the present application.

Referring to FIG. 3A , FIG. 3A is a schematic flowchart of a multimedia communication processing method provided by an embodiment of the present application, which will be described in conjunction with steps 101 to 103 shown in FIG. 3A .

In step 101, a human-computer interaction interface is displayed.

As an example, the human-computer interaction interface includes a multimedia communication invitation entry, see FIG. 4A, FIG. 4A is a schematic diagram of a display interface of a multimedia communication processing method provided by an embodiment of the present application, and the human-computer interaction interface 401A is a group instant messaging interface. The multimedia communication invitation entry 402A is displayed on the human-computer interaction interface 401A. In addition to being embedded in the instant messaging interface of the group, the multimedia communication invitation entry can also be embedded in at least one of the following: office applications, private chat instant messaging interfaces, and instant messaging applications. functional interface.

In step 102, at least one candidate account is displayed, and communication reference information of each candidate account is displayed in response to a trigger operation on the multimedia communication invitation portal.

As an example, the communication reference information includes time zone and time information of the candidate account and online status corresponding to the time zone and time information. The online status can be displayed in the form of graphics or text. The online status is used to represent the schedule status of the candidate account in the time zone. The online status includes work, leave, offline, break, lunch, entertainment, meeting, team building, etc. Referring to FIG. 4B, FIG. 4B is a schematic diagram of the display interface of the multimedia communication processing method provided by the embodiment of the present application. The human-computer interaction interface 401B is an instant messaging interface for groups, and the multimedia communication invitation entry 402B is displayed on the human-computer interaction interface 401B. In response to the trigger operation for the multimedia communication invitation entry 401B, at least one candidate account 405B, the time zone and time information 403B of the candidate account, and the online status 404B corresponding to the time zone and time information of the candidate account are displayed on the human-computer interaction interface 401B.

In step 103, a multimedia communication invitation message is sent to at least one target account in response to a multimedia communication invitation operation directed at at least one target account among the at least one candidate account.

As an example, the target account is selected from at least one candidate account. Referring to FIG. 4C, FIG. 4C is a schematic diagram of the display interface of the multimedia communication processing method provided by the embodiment of the present application. In the human-computer interaction interface 401C, at least one candidate account 402C, the local time of the candidate account 403C, and the time in the time zone of the candidate account are displayed. The online status 404C corresponding to the information, the target account is a candidate account with a check mark 405C, in response to the trigger operation for the invitation control 406C, send a multimedia communication invitation message to the target account (that is, to the terminal of the target account), and the invitation message can be sent to the target account. Send it to the instant messaging interface of the target account.

Before inviting a multimedia communication, the time zone time information and online status of each candidate account are displayed to the initiating account of the multimedia communication, so that the initiating account of the multimedia communication can refer to each when inviting the target account from the candidate account to perform multimedia communication. The time zone time information and online status of the candidate account can improve the success rate of the invitation operation, thereby improving the efficiency of human-computer interaction.

In some embodiments, displaying at least one candidate account in step 102 may be achieved through the following technical solution: when the number of at least one candidate account is multiple, multiple candidate accounts are displayed in order; wherein, the order is one of the following: The ascending order of the social distance between the multiple candidate accounts and the initiating account of the multimedia communication, the descending order of the activities of the multiple candidate accounts, and the descending order of the latest interaction time between the multiple candidate accounts and the initiating account. By displaying the plurality of candidate accounts in ascending order or descending order, the initiating account can be prompted with a preferred call partner among the plurality of candidate accounts, thereby improving the efficiency of human-computer interaction.

It can be understood that, in the embodiment of the present application, data related to social distance, activity level, and recent interaction time are involved. When the embodiment of the present application is applied to a specific product or technology, user permission or consent is required, and The collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

As an example, referring to FIG. 4C, at least one candidate account 402C, time zone and time information 403C of the candidate account, and online status 404C corresponding to the time zone and time information of the candidate account are displayed in the human-computer interaction interface 401C. The order of the candidate accounts can be multiple The ascending order of the social distance between the candidate account and the initiating account of the multimedia communication, for example, the social distance between the candidate account with the user name "Awen" and the initiating account is 1, the candidate account with the user name "dcnche" and the initiating account The social distance between the accounts is 2 (indicating that both have common friends), and the order of the candidate accounts can be the descending order of the activity of multiple candidate accounts. For example, the activity of the candidate account named "Awen" is high Based on the activity of the candidate account with the user name "dcnche", the activity can be calculated according to the behavior data of the candidate account. For example, the behavior includes like behavior, comment behavior, message behavior, etc., and the order of candidate accounts can be is the descending order of the latest interaction time between multiple candidate accounts and the initiating account. For example, the latest interaction time between the candidate account with the username "Awen" and the initiating account is December 12, 2021, and the user name is "Awen". The latest interaction time between the candidate account of "dcnche" and the originating account is December 11, 2021. When sorting and displaying, the ascending order can be switched to the descending order, and the descending order can be switched to the ascending order. The human-computer interaction interface can provide a sorting preference option for the user to choose.

In some embodiments, when the candidate account and the initiating account are in the same communication connection, at least one candidate account is displayed in step 102, which can be achieved through the following technical solutions: perform any of the following processes: when the communication connection is the target group During the communication connection, at least one communication account other than the originating account in the target group corresponding to the communication connection is used as at least one candidate account, and at least one candidate account is displayed, wherein the originating account of the multimedia communication belongs to the target group; when When the communication connection is a communication connection between the target communication account and the initiating account, the target communication account in the communication connection is used as a candidate account, and the candidate account is displayed. Directly use the communication account in the target group as the displayed candidate account or use the communication account of the friend as the candidate account. The account has a social relationship with the initiating account, so the communication account of the friend can establish a communication connection with the initiating account, so that the communication account of the friend is the target communication account in the communication connection. Through the embodiment of the present application, a user with an initiating account can be provided with a reliable selection range of call objects, thereby reducing human-computer interaction caused by the user searching for candidate objects, and improving the efficiency of human-computer interaction.

It can be understood that, in the embodiments of this application, data related to social relations and the like are involved. When the embodiments of this application are applied to specific products or technologies, it is necessary to obtain user permission or consent, and the collection, use and Processing needs to comply with relevant laws, regulations and standards of relevant countries and regions.

As an example, referring to Fig. 4B, the human-computer interaction interface 401B is the instant messaging interface of the target group, and the multimedia communication invitation entry 402B is displayed in the human-computer interaction interface 401B, and the multimedia communication invitation entry 402B can be set on the communication connection interface, such as the target group In the chat interface of the group or in the single chat interface with the target communication account, in response to the trigger operation for the multimedia communication invitation entry 401B, display at least one candidate account 402B, the time zone and time information 403B of the candidate account in the human-computer interaction interface 401B and The online status 404B corresponding to the candidate account and the time zone time information. The candidate account can be any communication account in the target group except the initiating account. In addition, the candidate account can also have a social relationship with the initiating account and be in a certain The target communication account of the communication connection.

In some embodiments, at least one candidate account is displayed in step 102, which can also be achieved through the following technical solutions: performing any of the following processes: using at least one communication account in the target group other than the originating account as at least one candidate account , and display at least one candidate account, wherein the initiating account of the multimedia communication belongs to the target group; at least one communication account having a social relationship (such as a friend relationship, or a following relationship, a subscription relationship) with the initiating account is used as at least one candidate account, And display at least one candidate account. Directly using the communication accounts in the target group as the displayed candidate accounts or using the communication accounts of friends as the candidate accounts can provide the user with the originating account with a reliable selection range of call partners, thereby reducing the user's search for candidate targets. Human-computer interaction improves the efficiency of human-computer interaction.

As an example, referring to FIG. 4B, the human-computer interaction interface 401B is the instant messaging interface of the target group, and the multimedia communication invitation entry 402B is displayed in the human-computer interaction interface 401B, and the multimedia communication invitation entry 402B can be set outside a specific chat interface For example, the multimedia communication invitation entry is directly set in the function bar of the social APP, so that it is not limited to selecting the target account for sending the invitation from a specific target group or a specific target communication account. In response to the triggering of the multimedia communication invitation entry 401B Operation, at least one candidate account 402B, the local time 403B of the candidate account and the local state 404B corresponding to the local time of the candidate account are displayed in the human-computer interaction interface 401B. The candidate account can be any communication in the target group except the originating account In addition, the candidate account can also be any social relationship with the initiating account.

In some embodiments, before at least one candidate account is displayed in step 102, a candidate account that meets at least one of the following conditions is obtained: the candidate account is online; the social distance between the candidate account and the initiating account is less than the social distance threshold; the candidate The activity of the account is greater than the activity threshold; the latest interaction time between the candidate account and the initiating account is greater than the interaction time threshold; the candidate account and the initiating account are in the same communication connection. Screen candidate accounts based on social distance, activity, and recent interaction time to obtain candidate accounts that meet at least one of the above conditions, thereby providing users with a valuable range of call partners and reducing human-computer interaction caused by users searching for candidates , improving the efficiency of human-computer interaction.

As an example, the online status of the candidate account indicates that the candidate account can receive invitation information in a timely manner, and the social distance between the candidate account and the initiating account indicates the social relationship between the two. For example, the candidate account with the username "Awen" and The social distance between the initiating accounts is 1, indicating that the two are friends with each other, and the social distance between the candidate account with the user name "dcnche" and the initiating account is 2 (indicating that the two have no direct friends but both have common friends), The activity of the candidate account is greater than the activity threshold, indicating that the activity of the candidate account within a unit time (for example, the number of behaviors per unit time) is greater than the activity threshold (for example, the number of behaviors per unit time threshold), the candidate account and the originating account The latest interaction time between them is greater than the interaction time threshold. For example, the latest interaction time between the candidate account named "Awen" and the initiating account is December 12, 2021, and the interaction time threshold is December 11, 2021. , that is, the latest interaction time is greater than the interaction time threshold, the candidate account and the initiating account are in the same communication connection, and the multimedia communication invitation entry can be set on the interface of the communication connection, such as the chat interface of the target group or the single chat with the target communication account In the interface, for example, from the chat interface of the target group (the communication connection has been established), the multimedia communication invitation entry is triggered to display candidate accounts, and the communication accounts in the target group other than the originating account can be displayed as candidate accounts, for example , triggering the multimedia communication invitation portal from the chat interface of the single chat (the communication connection has been established) to display the candidate account, and the communication account used as the chat object in the single chat can be displayed as the candidate account.

In some embodiments, when the number of at least one candidate account is multiple, a differentiated display style is applied to the communication reference information respectively corresponding to the multiple candidate accounts; wherein, the prominence of the display style of the time zone and time information of the candidate accounts It is positively correlated with the time zone difference, and the time zone difference is used to represent the time difference between the candidate account and the initiating account of the multimedia communication. When the multimedia communication is real-time multimedia communication, the time zone time information is the real-time time zone time. When the multimedia communication is scheduled multimedia communication, The time zone time information is the time zone time corresponding to the reservation time; the significance of the display style of the online status is positively related to the status difference, and the status difference is the difference between the online status of the candidate account and the online status of the initiating account. When the multimedia communication is In real-time multimedia communication, the online status is the online status corresponding to the real-time time zone time. When the multimedia communication is scheduled multimedia communication, the online status is the online status corresponding to the scheduled time. The difference can be characterized by the status similarity. The status similarity It is the similarity between the online status of the candidate account and the online status of the initiating account at the same time, applying differentiated display styles for different communication reference information, so as to prompt the user with candidate accounts that need additional attention through the difference in display styles, That is, candidate accounts that differ greatly from the time zone time information and online status of the originating account, thereby improving the efficiency of human-computer interaction.

As an example, refer to FIG. 4D. FIG. 4D is a schematic diagram of a display interface of a multimedia communication processing method provided by an embodiment of the present application. A plurality of candidate accounts 402D and 405D, and time zone and time information 403D of a candidate account 402D are displayed in the human-computer interaction interface 401D , the time zone time information 406D of the candidate account 405D, the online status 404D corresponding to the time zone time information 403D of the candidate account 402D, the online status 407D corresponding to the time zone time information 406D of the candidate account 405D, and the communication references corresponding to multiple candidate accounts respectively Differentiated display styles are applied to the information. The prominence of the display style of the time zone and time information of the candidate account is positively related to the time zone difference. The prominence is used to describe the attractiveness of the display style of an object to the human eye. The prominence can be related to the font The depth of the color, the size of the font size, and the thickness of the strokes are positively correlated. For example, the time zone difference between the candidate account 402D and the originating account is 2 time zones, and the time zone difference between the candidate account 405D and the originating account is 1 time zone. That is, the display style of the time zone and time information 403D of the candidate account 402D is more prominent than the display style of the time zone and time information 406D of the candidate account 405D, for example, the font of the time zone and time information 403D is darker than the font of the time zone and time information 406D And the strokes are thicker, and the salience of the display style of the online status is negatively correlated with the status similarity. The status similarity is the similarity between the online status of the candidate account and the online status of the originating account at the same time. For example, for The candidate account 402D, the candidate account 405D in Tokyo, and the originating account in Beijing, at the same time A, the time zone and time information corresponding to the candidate account 402D at time A is 10 o'clock in the evening, the online status of the candidate account 402D is rest, and the candidate account 405D corresponds to The time zone and time information of time A is 10 am, the online status of candidate account 405D is work, the time zone time information corresponding to time A of the initiating account in Beijing is 9 am, and the online status of the initiating account in Beijing at 9 am is It can be seen that the similarity between the online status of the candidate account 402D and the online status of the initiating account is lower than the similarity between the online status of the candidate account 405D and the online status of the initiating account. The degree of significance is greater than that of the display style of the online status 407D of the candidate account 405D. For example, the font of the online status 404D is darker and has thicker strokes than the font of the online status 407D.

In some embodiments, the communication reference information further includes at least one of the following: the location information of the candidate account, the weather information of the location of the candidate account, and the schedule information of the candidate account; when the communication reference information includes the location information of the candidate account, The prominence of the display style of the communication reference information is positively correlated with the distance, which is the distance between the geographic location corresponding to the candidate account and the geographic location corresponding to the originating account of the multimedia communication; when the communication reference information includes the weather information of the location of the candidate account , the prominence of the display style of the communication reference information is positively correlated with the bad weather represented by the weather information; when the communication reference information includes the schedule information of the candidate account, the prominence of the display style of the communication reference information is positively correlated with the number of schedules represented by the schedule information relevant. In addition to the time zone time information and online status, it can also display the weather information, schedule information and location information of the location of the candidate account, so as to break through the time and space constraints brought by different regions and provide diversified communication reference information to the originating account. Improve the display efficiency of communication reference information, thereby improving the efficiency of human-computer interaction.

It can be understood that, in the embodiment of the present application, data related to the user's location information, weather information, schedule information, etc. are involved. When the embodiment of the present application is applied to a specific product or technology, the user's permission or consent is required. And the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

As an example, at least one of the location information of the location of the candidate account, the weather information of the location of the candidate account, and the schedule information of the candidate account may also be displayed on the human-computer interaction interface. For example, if the login location of the candidate account is in New York, the location information is New York, the location information of candidate account A is New York, the location information of candidate account B is Tokyo, and the geographical location of the initiating account is Beijing. The significance of the display style of communication reference information is positively correlated with the distance. The degree of significance of the display style of the candidate account B is greater than that of the display style of the communication reference information of the candidate account B; the weather information of the candidate account includes at least one of the following: snowstorm, sunny, cloudy, rainstorm, etc., and the weather information of the candidate account A is snowstorm , the weather information of candidate account B is cloudy, the significance of the display style of communication reference information is positively correlated with the severity of weather represented by the weather information, the significance of the display style of candidate account A’s communication reference information is greater than that of candidate account B’s communication reference The significance of the display style of the information; the schedule information of the candidate account includes at least one schedule or the schedule information represents no schedule, the schedule information of candidate account A represents no schedule, the schedule information of candidate account B represents a schedule, communication reference The prominence of the display style of the information is positively correlated with the number of schedules represented by the schedule information, and the prominence of the display style of the communication reference information of the candidate account A is less than that of the communication reference information of the candidate account B.

In some embodiments, referring to FIG. 3B, FIG. 3B is a schematic flowchart of a multimedia communication processing method provided in an embodiment of the present application. In step 102, the communication reference information of each candidate account can be displayed through step 1021 shown in FIG. 3B or Step 1022 is implemented.

In step 1021, when the multimedia communication is real-time multimedia communication, display the real-time time zone time of each candidate account and the real-time online status corresponding to the real-time time zone time of the candidate account.

In step 1022, when the multimedia communication is scheduled multimedia communication, the time zone time and online status corresponding to the scheduled time of each candidate account are displayed.

As an example, the reservation time includes at least one of the following: a reservation time point; a reservation time period, when the reservation time is the reservation time period, the time zone time and online status corresponding to the communication start time of each candidate account in the reservation time period are displayed.

As an example, see FIG. 4E. FIG. 4E is a schematic diagram of the display interface of the multimedia communication processing method provided by the embodiment of the present application. The human-computer interaction interface 401E displays the candidate account 402E, the real-time time zone time 403E of the candidate account 402E, and the real-time time of the candidate account 401E. Online status 404E, the human-computer interaction interface 401E also displays that the type of multimedia communication is real-time multimedia communication, and the human-computer interaction interface 401E displays the current time 405E in the time zone where the originating account is located. For example, the current time is 8:00 am Beijing time. If the login area of the account is New York, the real-time time zone time 403E is based on the local time in New York converted from 8:00 am Beijing time. The conversion result is 9:00 pm, and the real-time online status corresponds to the state at 9:00 pm. Referring to FIG. 4F, FIG. 4F is a schematic diagram of the display interface of the multimedia communication processing method provided by the embodiment of the present application. The human-computer interaction interface 401F displays the candidate account 402F, the time zone time 403F corresponding to the candidate account 402F at the reservation time, and the candidate account at the time of the reservation. The online status 404F corresponding to the time, the type of multimedia communication is also displayed in the human-computer interaction interface 401F as reservation multimedia communication and the reservation time 405F of reservation multimedia communication, the reservation time 405F is the time zone time of the location where the account is initiated, for example, the current time is Beijing time is 9:00 a.m., the scheduled communication time is 10:00 a.m. Beijing time, and the login area of the candidate account is New York, then the time zone time 403F corresponding to the candidate account 402F at the appointment time is the New York time zone time converted based on 10:00 a.m. Beijing time. The conversion result is 11 o'clock in the evening, and the online status corresponding to the candidate account 402F at the reservation time is the status corresponding to 11 o'clock in the evening.

In some embodiments, before displaying the communication reference information of each candidate account, in response to the setting operation of the appointment time for multimedia communication, the time zone time and online status corresponding to the appointment time of the candidate account are obtained; After the communication reference information of each candidate account is updated, the communication reference information of each candidate account is updated according to the modified reservation time in response to the modification operation of the multimedia communication originating account for the multimedia communication reservation time. The updated communication reference information is for each candidate The communication reference information of the account at the modified appointment time. Different types of communication reference information are provided for different types of multimedia communication, so that the communication reference information is adapted to the multimedia communication, thereby improving the invitation success rate of the multimedia communication.

As an example, refer to FIG. 4G, which is a schematic diagram of the display interface of the multimedia communication processing method provided by the embodiment of the present application. The human-computer interaction interface 401G displays the candidate account 402G, the time zone time 403G corresponding to the reservation time of the candidate account 402G, and the candidate account 402G. The online status 404G corresponding to the account at the scheduled time, the man-machine interaction interface 401G also displays the type of multimedia communication as scheduled multimedia communication and scheduled multimedia communication scheduled time 405G, the scheduled communication time 405G is the time zone time of the location where the account is initiated, for example, The current time is 9:00 am Beijing time, the scheduled communication time is 10:00 am Beijing time, and the login area of the candidate account is New York, then the time zone time 403G corresponding to the candidate account 402G at the appointment time is New York based on the conversion at 10:00 am Beijing time The local time, the conversion result is 11:00 p.m., and the online status of the candidate account corresponding to the reservation time is the state "entertainment" corresponding to 11:00 p.m. in New York. The revised appointment time 406G is 11 am Beijing time. According to the revised appointment time, update the communication reference information of each candidate account. The updated communication reference information is the communication reference of each candidate account at the revised appointment time. Information, specifically, update the time zone time corresponding to the appointment time of the candidate account 402G from 11:00 p.m. New York to 12:00 p.m. The online status "entertainment" corresponding to the appointment time of the account is updated to the online status "sleep" corresponding to the modified appointment time.

In some embodiments, before displaying the communication reference information of each candidate account, the online status of each candidate account is acquired; wherein, the online status of each candidate account is determined in response to a setting operation of the candidate account. When the multimedia communication is real-time multimedia communication, the online status of the candidate account is the real-time online status; when the multimedia communication is scheduled multimedia communication, the online status of the candidate account is the online status corresponding to the scheduled time, which is determined by manual setting The online status of the candidate account can improve the accuracy of the status, thereby increasing the success rate of the invitation.

As an example, when receiving the online status of each candidate account sent by the server, time zone time information of each candidate account sent by the server is also received when receiving the online status of each candidate account sent by the server. In the complete process, the function configuration process is first performed. After the instant messaging client of user A (candidate account) is started, in the configuration update stage, the global configuration used to represent whether the display function of the communication reference information is supported is obtained. When the global configuration When supporting the display function of communication reference information, user A's terminal requests the server to obtain the set or initial user configuration status; then performs configuration and time reporting and updating, and when the global and personal status supports, user A's terminal will trigger the acquisition The latest GMT information and online status, and then report the latest GMT information and online status to the server, or, user A’s terminal receives the setting operation for setting and opening its own time zone status display switch, and the user A's terminal reports the new switch information and the latest current GMT to the server. After receiving the information, the server will convert the reported Greenwich Mean Time into time zone time information through the interface, and store the time zone time information in the database. During the process of creating multimedia communication on user B's terminal, when the candidate account list is displayed, the Request the server to pull communication reference information, the server judges whether the candidate accounts in the candidate account list support displaying their respective communication reference information, and when the candidate accounts in the candidate account list support displaying their respective communication reference information, the server returns to user B's terminal The communication reference information of the candidate account in the candidate account list.

In some embodiments, before displaying the communication reference information of each candidate account, the online status of each candidate account is automatically determined in the following manner. When the multimedia communication is real-time multimedia communication, the time zone time information of the candidate account is the real-time information of the candidate account Time zone time, the online status of the candidate account is the real-time online status corresponding to the real-time time zone time. When the multimedia communication is scheduled for multimedia communication, the time zone time information of the candidate account is the time zone time corresponding to the candidate account at the reservation time, and the online status of the candidate account It is the online status corresponding to the appointment time: obtain the historical schedule information corresponding to multiple sample communication accounts; perform the following processing for each sample communication account: extract the historical online status of each historical period from the historical schedule information of the sample communication account Status; perform statistical processing on the historical online status of multiple communication accounts in each historical period, and obtain the statistical status corresponding to each historical period; determine the statistical status corresponding to the historical period corresponding to the time zone time information as the candidate account Online status, for example, determining the historical time period of the time zone corresponding to the candidate account at the reservation time as the target time period, and determining the statistical status corresponding to the target time period as the online status corresponding to the candidate account at the reservation time, or , determining the statistical status corresponding to the historical period in which the real-time time zone is located as the real-time online status of the candidate account. By automatically determining the online status of the candidate account, the user's setting operation can be saved, the degree of intelligence can be improved, and the efficiency of human-computer interaction can be improved.

It can be understood that in the embodiment of this application, related data such as historical schedule information of sample communication accounts are involved. When the embodiment of this application is applied to a specific product or technology, it is necessary to obtain the user's permission or consent, and the relevant data The collection, use and processing of the data need to comply with the relevant laws, regulations and standards of the relevant countries and regions.

As an example, the historical schedule information of the sample communication account A-C is obtained. The historical schedule information of the sample communication account A includes the historical online status of each historical period, and the historical period can be described in units of hours, that is, 9:00 to 10:00 is a historical period , count the historical online status of the three sample communication accounts in the historical period from 9:00 to 10:00, and obtain the statistical status in the historical period from 9:00 to 10:00. The statistical processing here can be to use the historical online status with the most occurrences as Statistical state, which represents the state of most people in the historical period from 9:00 to 10:00 is a statistical state. When the time zone and time information of the candidate account is 9:30, the statistical state corresponding to the historical period from 9:00 to 10:00 is Determine the online status of the candidate account.

In some embodiments, before displaying the communication reference information of each candidate account, the online status of each candidate account is automatically determined in the following manner. When the multimedia communication is real-time multimedia communication, the time zone time information of the candidate account is the real-time information of the candidate account Time zone time, the online status of the candidate account is the real-time online status corresponding to the real-time time zone time. When the multimedia communication is scheduled for multimedia communication, the time zone time information of the candidate account is the time zone time corresponding to the candidate account at the reservation time, and the online status of the candidate account It is the online status corresponding to the appointment time: obtain the historical schedule information of the candidate account and the historical schedule information of multiple sample communication accounts; call the first neural network model to perform the following processing: extract the candidate account from the historical schedule information of the candidate account Historical status features, and extract the historical status features of multiple communication accounts from the historical schedule information of multiple sample communication accounts; perform fusion processing on the historical status features of candidate accounts and the historical status features of multiple communication accounts to obtain the fusion status features ; Perform mapping processing on the fusion status feature to obtain the online status of the candidate account. The online status of candidate accounts is automatically determined by means of artificial intelligence, which can save the user's setting operations, improve the degree of intelligence, and thus improve the efficiency of human-computer interaction.

As an example, the first neural network model includes a first convolutional layer, a first pooling layer, and a first fully connected layer. Keywords are extracted from the historical schedule information of candidate accounts through the first convolutional layer, and the keywords corresponding to The word vector is convolved to obtain the historical state characteristics of candidate accounts, and the historical state characteristics of multiple communication accounts are extracted from the historical schedule information of multiple sample communication accounts, and the historical state characteristics of candidate accounts are analyzed by the first pooling layer and the historical state characteristics of multiple communication accounts are stimulated, and the results of the incentive processing are pooled to obtain the fusion state characteristics, and the fusion state characteristics are mapped to the probabilities corresponding to different historical online states through the first fully connected layer, and the maximum The historical online status corresponding to the probability is used as the online status corresponding to the time zone time information. The training samples of the first neural network model include sample historical schedule information, the label data of the first neural network model is the online status label of the sample candidate account corresponding to different time zone time information, and the training sample is used as the input of the first neural network to obtain the sample candidate account For the predicted probability of being in a certain online state (corresponding to time information in a certain time zone), the predicted probability and the online state label of the sample candidate account are substituted into the loss function to obtain the first neural network model with the minimum loss.

In some embodiments, before responding to the multimedia communication invitation operation for at least one target account in step 103, when the real-time time zone time of the candidate account is in the communicable period, and the real-time online status of the candidate account is a communicable state, the The candidate account is determined as at least one target account, and the selected target account is displayed.

It can be understood that, in the embodiment of the present application, data related to the communicable period, communicable state, etc. are involved. When the embodiment of the present application is applied to a specific product or technology, it is necessary to obtain the user's permission or consent, and the relevant data The collection, use and processing of the data need to comply with the relevant laws, regulations and standards of the relevant countries and regions.

In some embodiments, before responding to the multimedia communication invitation operation for at least one target account in the at least one candidate account in step 103, when the candidate account is in the communicable period at the time zone corresponding to the reservation time, and the candidate account is in When the online state corresponding to the reservation time is a communicable state, the candidate account is determined as at least one target account, and the target account in the selected state is displayed.

In some embodiments, referring to FIG. 3C, FIG. 3C is a schematic flowchart of a multimedia communication processing method provided in an embodiment of the present application. Before responding to the multimedia communication invitation operation for at least one target account in step 103, FIG. 3C may be implemented. Any one of step 104 and step 105 shown.

In step 104, in response to a selection operation on at least one candidate account, the candidate account selected by the selection operation is determined as at least one target account, and the selected target account is displayed.

In step 105, a candidate account satisfying the automatic selection condition is determined as at least one target account, and the selected target account is displayed.

In some embodiments, the automatic selection condition includes at least one of the following: the social distance between the candidate account and the initiating account is smaller than the social distance threshold; the activity of the candidate account is greater than the activity threshold; the latest interaction between the candidate account and the initiating account The time is greater than the interaction time threshold. The target account is screened out through automatic selection conditions, so that the efficiency of obtaining the target account can be improved, and the efficiency of human-computer interaction can be improved.

As an example, the communication time period includes all the time periods of the candidate account A that can respond to multimedia communication, that is, the time period that excludes the non-communication time period, and the non-communication time period includes at least one of the following: rest time period, entertainment time period, sleep time period, scheduled schedule time period, etc. etc., the communicable state includes all the states of the candidate account A that can respond to multimedia communication, that is, excludes the state of the non-communication state, and the non-communication state includes at least one of the following: rest state, entertainment state, sleep state, scheduled state, etc. . Take candidate account A and real-time multimedia communication as an example. The real-time time zone of candidate account A is 10:00 am New York time, and the communication time is from 9:00 am to 11:00 am in New York and from 15:00 pm to 17:00 pm in New York. Therefore, the real-time time zone time of the candidate account is in the communicable period, and the real-time online status of the candidate account A is working status and no schedule is scheduled, then the real-time online status of the candidate account A is the communicable status, based on the two dimensions of time zone time information and online status It can be determined that the candidate account A satisfies the automatic selection condition. Continue to take candidate account A and reservation of multimedia communication as an example. The time zone time corresponding to the appointment time of candidate account A is 10:00 am New York time, and the communication time is from 9:00 am to 11:00 am in New York and from 15:00 pm to pm in New York 17:00, so the appointment time of the candidate account is in the communicable period, and the online status corresponding to the candidate account A at the appointment time is working status and no schedule is arranged, then the online status corresponding to the candidate account A at the appointment time is the communication status, based on the time zone The two dimensions of time information and online status can determine that the candidate account A satisfies the automatic selection condition.

In some embodiments, before step 105 is performed, the following technical solutions may be implemented to acquire candidate accounts that meet the automatic selection conditions, and the following processing is performed for each candidate account: acquiring decision-making reference data, wherein the decision-making reference data includes at least one of the following One: the historical schedule information of the candidate account, the setting information of multimedia communication, the historical communication information of the candidate account, and the communication reference information of the candidate account; call the second neural network model to perform the following processing: extract the decision-making reference features from the decision-making reference data, and The probability that the candidate account can respond to multimedia communication is predicted based on the decision-making reference feature; when the probability is greater than the probability threshold, it is determined that the candidate account satisfies the automatic selection condition. The target account is automatically determined by means of artificial intelligence, which can save the user's operation of selecting the target account, improve the degree of intelligence, and thereby improve the efficiency of human-computer interaction.

As an example, the second neural network model includes a second convolutional layer, a second pooling layer, and a second fully connected layer. Through the second convolutional layer, the historical schedule information of the candidate account, the setting information of multimedia communication, and the candidate account's Key words are extracted from the historical communication information, and the word vectors corresponding to the keywords are convoluted to obtain the decision-making reference features of the candidate accounts, and the decision-making reference features of the candidate accounts are stimulated through the second pooling layer, and the incentive processing results Perform pooling processing to obtain fusion decision-making features, and map the fusion decision-making features to the probability that the candidate account can respond to multimedia communication through the second fully connected layer. When the probability is greater than the probability threshold, it is determined that the candidate account meets the automatic selection condition. The training samples of the second neural network model include sample historical schedule information, sample multimedia communication setting information, and historical communication information of sample candidate accounts. The label data of the second neural network model is whether each sample candidate account meets the automatic satisfaction condition. label, the training sample is used as the input of the second neural network to obtain the predicted probability of the sample candidate account, and the predicted probability and the label of the sample candidate account are substituted into the loss function to obtain the second neural network model with the minimum loss.

In some embodiments, referring to FIG. 3D , FIG. 3D is a schematic flowchart of a multimedia communication processing method provided in an embodiment of the present application. Before sending a multimedia communication invitation message to at least one target account in step 103, the method shown in FIG. 3D may be implemented. Step 106 and Step 107.

In step 106, when there is a target account meeting the prompting condition in at least one target account, first prompting information is displayed, the first prompting information indicates that the communication start time of the multimedia communication conflicts with the communication reference information of the target account.

In step 107, in response to the confirmation operation for the first prompt information, it is determined to transfer to the process of sending a multimedia communication invitation message to at least one target account.

In some embodiments, the time zone time information includes the time zone time of the target account at the communication start time, and the prompt condition includes at least one of the following: at the communication start time, the time zone time of the target account is in the non-communication period of the target account; at the communication start time , the time zone time of the target account is in the communication period of the target account, and the time interval between the time zone time of the target account and the non-communication period of the target account is less than the time interval threshold; at the communication start time, the online state of the target account is a non-communication state. The scene that needs to be prompted can be effectively characterized by the limitation of the prompt condition, for example, the scene that is not suitable for initiating multimedia communication, for example, the time zone time converted based on the communication start time is in the lunch period (non-communication period), or although multimedia communication can be initiated currently , but after starting the communication and after a period of time (for example, a period of time corresponding to the time interval threshold), it will turn into a scene that is not suitable for initiating multimedia communication, so as to improve the success rate of invitation and the ability of multimedia communication to hold the call.

It can be understood that, in the embodiment of the present application, related data such as non-communication period and non-communication state are involved, when the embodiment of the present application is applied to a specific product or technology, it is necessary to obtain the user's permission or consent, and the relevant data The collection, use and processing of the data need to comply with the relevant laws, regulations and standards of the relevant countries and regions.

As an example, take the target account A as an example. The login location of the target account A is New York, and the time zone corresponding to the communication start time is 12:00 noon. 12:00 noon is in the non-communication period of the target account A, thus satisfying the prompt condition. The first prompt message needs to be displayed. Continue to take the target account A as an example. The login location of the target account A is New York, and the time zone time corresponding to the communication start time is 11:45 a.m., and 11:45 is the communication period of the target account A, but the time zone time is far from The minimum time interval of the non-communication period is 15 minutes, which is less than the time interval threshold of 30 minutes, thus satisfying the prompting condition, and the first prompting information needs to be displayed. The non-communication time period includes at least one of: a break time period, a meal time period, an entertainment time period, a scheduled time period, and the like.

As an example, see FIG. 4H. FIG. 4H is a schematic diagram of a display interface of a multimedia communication processing method provided in an embodiment of the present application. In the human-computer interaction interface 401H, at least one candidate account 402H, the time zone time 403H of the candidate account, and the time zone of the candidate account are displayed. The online status 404H corresponding to the time zone, the target account is a candidate account with a checkmark 405H, in response to the trigger operation for the invitation control 406H, when there is a target account that meets the prompting conditions in at least one target account, the first prompt message 407H is displayed The first prompt information indicates that the communication start time of the multimedia communication invitation conflicts with the communication reference information of the target account, that is, the time zone time converted based on the communication start time is in a non-communication period or the online status corresponding to the time zone time converted based on the communication start time If it is a non-communication state, for example, the time zone time converted based on the communication start time is in the lunch period (non-communication period), in response to the confirmation operation for the first prompt information 407H, send a multimedia communication invitation message 408H to the target account, and the invitation message can be sent 408H is sent to the instant messaging interface of the target account.

In some embodiments, during the multimedia communication, the account identifier of each target account and the real-time communication reference information of each target account are displayed, and the real-time communication reference information of the target account includes at least one of the following: the real-time communication information of the target account Time zone time and the real-time online status corresponding to the real-time time zone time of the target account; when the real-time online status is a non-communication state, a second prompt message is displayed, and the second prompt message is used to prompt the initiator account of the multimedia communication to end the multimedia communication. By displaying at least one of the communication reference information during the communication process, the initiating account can be effectively prompted to flexibly control the communication time, so as to avoid inconvenience to the communication partner and reduce user experience.

As an example, refer to FIG. 4I. FIG. 4I is a schematic diagram of the display interface of the multimedia communication processing method provided by the embodiment of the present application. The human-computer interaction interface 401I displays the account identifier 402I of each target account in the multimedia communication process, and each target account The real-time online status of the account 403I.

As an example, see FIG. 4J. FIG. 4J is a schematic diagram of the display interface of the multimedia communication processing method provided by the embodiment of the present application. The human-computer interaction interface 401J displays the account identification 402J of each target account in the multimedia communication process, and each target account The real-time online state of the account 403J. When the real-time online state indicates that the target account is in a non-communication state, it means that the user corresponding to the candidate account plans to quit multimedia communication. The non-communication state includes all states that are not suitable for continuing communication, such as a rest state and a meal state . Schedule occupancy state, for example, the real-time online state 403J is a meal state, and the second prompt message 404J is displayed to remind the originating account of the multimedia communication to end the multimedia communication.

Next, an exemplary application of the embodiment of the present application in an actual application scenario will be described.

In some embodiments, terminal A of user A receives the online status set by candidate account A, terminal A sends the online status and time zone time information to the server, and the server sends user A's online status and time zone time information to the corresponding initiating account B Terminal B, terminal B receives the trigger operation of the initiating account B for the multimedia communication invitation entry, displays at least one candidate account (including candidate account A) on the human-computer interaction interface of terminal B, and displays the time zone time of each candidate account Information and online status, terminal B receives a multimedia communication invitation operation for candidate account A, and sends a multimedia communication invitation message to terminal A corresponding to candidate account A through the server.

In the multimedia communication processing method provided by the embodiment of the present application, the communication reference information is combined with the multimedia communication invitation. When the initiating account is preparing to initiate or reserve a cross-time zone (for example, cross-border) audio and video call, it can pass through the time zones of multiple candidate accounts. Time information and online status to determine whether the other party is in a communicable state, so as to avoid disturbing foreign colleagues who are resting late at night. Moreover, displaying the real-time time zone time information during the multimedia communication can avoid delaying the multimedia communication and causing the colleagues participating in the multimedia communication to miss the rest time. The multimedia communication processing method provided in the embodiment of the present application can provide accurate time zone time information and online status, thereby improving the success rate of multimedia communication invitations.

In some embodiments, the time zone time information of the time zone where the communication object is located at the start time of the communication is prompted before the multimedia communication invitation. When the user authorizes the client to obtain the current location through the communication account, the client will obtain the user's geographic location to calculate the time zone time information. Referring to Fig. 4B, the human-computer interaction interface 401B is the instant messaging interface of the target group, and the multimedia communication invitation entry 402B is displayed on the human-computer interaction interface 401B. The time zone time information of the time zone where the participant is located, in response to the trigger operation for the multimedia communication invitation portal 401B, display at least one candidate account 402B, the time zone time information 403B of the candidate account and the time zone time information of the candidate account in the human-computer interaction interface 401B Corresponding online status 404B, if there is a participant corresponding to the time zone time information of the multimedia communication is a break time or a meal time, then a warning prompt is displayed to the initiating account, see Figure 4H, and at least one candidate account is displayed in the human-computer interaction interface 401H 402H, the time zone time information 403H of the candidate account and the online status 404H corresponding to the time zone time information of the candidate account. When the target account that meets the prompt condition is displayed, the first prompt information 407H is displayed. The first prompt information indicates that the communication start time of the multimedia communication invitation conflicts with the communication reference information of the target account. In response to the confirmation operation for the first prompt information 407H, the target The account sends a multimedia communication invitation message 408H, and the invitation message 408H can be sent to the terminal of the target account.

In some embodiments, the online status of the time zone where the communication object is located is displayed in real time during the multimedia communication, see FIG. 4J, which is a schematic diagram of the display interface of the multimedia communication processing method provided by the embodiment of the present application. In the human-computer interaction interface 401J Display the account identification 402J of each target account in the multimedia communication process, and the local real-time status 403J of each target account. When the local real-time status indicates that the target account is planned to be in a non-communication state, the non-communication state includes all unsuitable for continuing communication. State, such as rest state, meal state, schedule occupied state, the communicable state can be a working state or a working state without a schedule, when the multimedia communication time reaches other participants’ meal or rest time, a second prompt message is given, such as , the local real-time status 403J is the dining status, and the second prompt message 404J is displayed to remind the originating account of the multimedia communication to end the multimedia, so as to avoid unintentionally prolonging the multimedia communication and causing colleagues in the meeting to miss lunch time or rest time.

In some embodiments, referring to FIG. 5, FIG. 5 is a schematic diagram of an interaction flow of a multimedia communication processing method provided by an embodiment of the present application. In step 201, the terminal of user A performs client login processing, and step 202 is executed, and user A The terminal sends a global configuration request to the server whether it supports the display time zone. The global configuration request is used to inquire whether the server supports the display time zone function. In step 203, the server returns the global configuration result. In step 204, the terminal of user A is in the cache In step 205, the terminal of user A sends a privacy configuration request to the server. The privacy configuration request is used to inquire whether other clients can display the communication reference information of user A. In step 206, the server returns As a result of the private configuration, in step 207, the terminal of user A updates the local private configuration in the cache, obtains the set or initial user configuration status, and then updates the configuration and time zone report, and triggers the time zone report in both cases , in step 208, when both global and private configurations are supported, the terminal of user A will obtain the latest GMT information, and then report the communication reference information corresponding to the time zone to the server. In step 209, user A's The terminal receives the setting operation of user A through the privacy setting portal, and sets the switch to turn on its own time zone status display. In step 210, the terminal of user A reports the new switch information and the latest Greenwich Mean Time to the server, and the server receives the information After that, the reported Greenwich Mean Time will be converted into time zone time information through the interface, and stored in the database. In step 211, the server returns the setting result to the terminal of user A. In step 212, the terminal of user A updates Set the cache by itself, and finally obtain the online status of the time zone and display it. In step 213, when the terminal of user B selects the target account, it requests the server to pull a new message status. In step 214, the server judges whether the candidate account supports display Communication reference information. In step 215, when the candidate account supports the display of communication reference information, the server returns the communication reference information of the supported candidate account to the terminal of user B. In step 216, the communication reference information of the terminal of user B to the candidate account The information is cached, and it is judged whether the current time node is a built-in meal/rest period. When the current time node is in the meal/rest period, a pop-up window prompt is performed. In step 217, the terminal of user A sends the new switch information and the latest After the GMT is reported to the server, the server will push the latest communication reference information to the logged-in initiating account. In step 218, the terminal of user B updates the status icon information on the interface according to the new online status.

The multimedia communication processing method provided by the embodiment of the present application takes into account the necessity of protecting the privacy of the user, and provides a configuration switch to support the user to decide whether to enable the function. Only after enabling the function can the region, time zone, time information and online status of the user be displayed For friends, taking into account the accuracy and timeliness of the displayed time zone and time information, and minimizing the impact on the performance of the user's mobile phone, the server and client multiple caches and update pushes are used to achieve this.

The embodiment of this application is mainly aimed at audio and video call scenarios that are highly dependent on time, and proposes to support displaying the time zone time information and online status of the other party's region in the audio and video call scenario, so that the user can initiate an audio and video call at an appropriate time point. And accurately control the audio and video call time. The embodiment of the present application can enrich the auxiliary information for initiating an audio and video call, and accurately synchronize the time zone and time information of the other party to the audio and video call invitation page, so that the user can know whether the time zone and time information of the other party's location is appropriate to participate in the audio at the start time of the communication. Video calls, and for some time-sensitive activities, it is also easy to communicate and reach consensus based on time information in multiple time zones. The embodiment of the present application can also know the local real-time time in the time zone where multiple communication parties are located, and it is also convenient for the initiator of the audio and video call to accurately grasp the time of the audio and video call, so as to prevent the other party from missing lunch time or rest time due to the extended time during the audio and video call.

The embodiment of this application proposes a technical idea of combining the communication reference information of the participants of the multimedia communication with the time of the multimedia communication. In the related art, the time zone and time information of all participants cannot be fully and timely understood during the process of initiating a multimedia communication invitation and conducting multimedia communication. Relying on the initiating account to confirm the country and city where other people are located, and then manually querying and calculating, the accuracy is low and the user is time-consuming. Through the auxiliary information of the participant’s communication reference information, the user can quickly understand the time zone and time information of all participants and Online status, so as to quickly make a decision on the multimedia communication time, know whether the time zone time information of the participant conflicts with the multimedia communication time when the invitation is initiated, and display the local real-time status of the participant in real time during the communication process, which greatly facilitates the alignment of the two parties communication time.

It can be understood that, in the embodiment of this application, data related to user information, operation behavior, etc. are involved. When the embodiment of this application is applied to a specific product or technology, it is necessary to obtain the user's permission or consent, and the collection of relevant data , use and processing need to comply with relevant laws, regulations and standards of relevant countries and regions.

Continue to illustrate the implementation of the multimedia communication processing device 455 provided by the embodiment of the present application as an exemplary structure of a software module. In some embodiments, as shown in FIG. 2 , the multimedia communication processing device 455 stored in the memory 450 The software modules may include: an embodiment of the present application provides a processing device for multimedia communication, including: a first display module 4551 for displaying a human-computer interaction interface; wherein, the human-computer interaction interface includes a multimedia communication invitation entry; the second display module 4551 4552. Display at least one candidate account and display the communication reference information of each candidate account in response to the trigger operation on the multimedia communication invitation portal; where the communication reference information includes the time zone time information of the candidate account and the time zone information corresponding to the time zone time information. online status; an invitation module 4553, configured to send a multimedia communication invitation message to at least one target account in response to a multimedia communication invitation operation for at least one target account in at least one candidate account; wherein, the target account is from at least one candidate account selected in .

In some embodiments, the second display module 4552 is further configured to: when at least one candidate account number is multiple, display multiple candidate accounts in sequence; wherein, the sequence is one of the following: multiple candidate accounts and multimedia The ascending order of the social distance between the initiating accounts of the communication, the descending order of the activity of multiple candidate accounts, and the descending order of the latest interaction time between the multiple candidate accounts and the initiating account.

In some embodiments, before displaying at least one candidate account, the second display module 4552 is further configured to: obtain a candidate account that meets at least one of the following conditions: the candidate account is online; The social distance between them is less than the social distance threshold; the activity of the candidate account is greater than the activity threshold; the latest interaction time between the candidate account and the initiating account is greater than the interaction time threshold; the candidate account and the initiating account are in the same communication connection.

In some embodiments, when the candidate account and the initiating account are in the same communication connection, the second display module 4552 is further configured to: use at least one communication account other than the initiating account in the target group corresponding to the communication connection as At least one candidate account, and displaying at least one candidate account, wherein the initiating account belongs to the target group; or using the target communication account in the communication connection as a candidate account, and displaying the candidate account.

In some embodiments, the second display module 4552 is further configured to: when the multimedia communication is real-time multimedia communication, display the communication reference information of each candidate account, the communication reference information includes the real-time time zone of the candidate account, and the time of the candidate account The real-time online status corresponding to the real-time time zone.

In some embodiments, when displaying the communication reference information of each candidate account, the second display module 4552 is also used to: when the number of at least one candidate account is multiple, the communication reference information corresponding to the multiple candidate accounts respectively Information application differentiated display styles; among them, the significant degree of the display style of the real-time time zone time of the candidate account is positively related to the time zone difference, and the time zone difference is used to represent the time difference between the candidate account and the initiating account of the multimedia communication; the real-time online status The salience of the displayed style is positively correlated with the status difference, which is the difference between the online status of the candidate account and the online status of the originating account.

In some embodiments, before displaying the communication reference information of each candidate account, the second display module 4552 is further configured to: obtain the real-time online status of each candidate account; wherein, the real-time online status of each candidate account is in response to It is determined by the setting operation of the candidate account.

In some embodiments, before displaying the communication reference information of each candidate account, the second display module 4552 is further configured to: determine the real-time online status of each candidate account in the following manner: obtain the histories corresponding to multiple sample communication accounts respectively schedule information; perform the following processing for each sample communication account: extract the historical online status of each historical period from the historical schedule information of the sample communication account; perform statistical processing on the historical online status of multiple communication accounts in each historical period, The statistical status corresponding to each historical period is obtained; the statistical status corresponding to the historical period in which the real-time time zone is located is determined as the real-time online status of the candidate account.

In some embodiments, before displaying the communication reference information of each candidate account, the second display module 4552 is further configured to: determine the real-time online status of each candidate account in the following manner: obtain the historical schedule information of the candidate account and multiple The historical schedule information of the sample communication account; extract the historical state characteristics of the candidate account from the historical schedule information of the candidate account, and extract the historical state characteristics of multiple sample communication accounts from the historical schedule information of multiple sample communication accounts; The historical status features of the sample communication account and the historical status features of multiple sample communication accounts are fused to obtain the fused status features; the fused status features are mapped to obtain the real-time online status of the candidate accounts.

In some embodiments, before responding to the multimedia communication invitation operation for at least one target account in the at least one candidate account, the invitation module 4553 is further configured to: when the real-time time zone of the candidate account is in the communicable period, and the candidate account When the real-time online status is a communicable state, the candidate account is determined as at least one target account, and the target account in the selected state is displayed.

In some embodiments, the second display module 4552 is further configured to: when the multimedia communication is scheduled multimedia communication, display the time zone time and online status corresponding to each candidate account at the scheduled time, wherein the scheduled time includes at least one of the following 1: Appointment time point; appointment time period.

In some embodiments, when displaying the communication reference information of each candidate account, the second display module 4552 is also used to: when the number of at least one candidate account is multiple, the communication reference information corresponding to the multiple candidate accounts respectively Information application differentiated display style; wherein, the significant degree of the display style of the candidate account in the time zone corresponding to the reservation time is positively correlated with the time zone difference, and the time zone difference is used to represent the time difference between the candidate account and the initiating account of the multimedia communication; The significance of the display style of the online status of the candidate account at the appointment time is positively correlated with the status difference, which is the difference between the online status of the candidate account at the appointment time and the online status of the originating account.

In some embodiments, before displaying the communication reference information of each candidate account, the second display module 4552 is further configured to: obtain the online status corresponding to each candidate account at the appointment time; wherein, each candidate account at the appointment time The corresponding online status is determined in response to the setting operation of the candidate account.

In some embodiments, before displaying the communication reference information of each candidate account, the second display module 4552 is further configured to: determine the online status corresponding to each candidate account at the appointment time by acquiring multiple sample communication accounts Respectively corresponding historical schedule information; perform the following processing for each sample communication account: extract the historical online status of each historical period from the historical schedule information of the sample communication account; historical online status of multiple communication accounts in each historical period Perform statistical processing to obtain the statistical status corresponding to each historical period; determine the statistical status corresponding to the historical period corresponding to the time zone corresponding to the candidate account at the reservation time as the online status corresponding to the candidate account at the reservation time.

In some embodiments, before displaying the communication reference information of each candidate account, the second display module 4552 is further configured to: determine the online status corresponding to each candidate account at the appointment time in the following manner: obtain the historical schedule of the candidate account information and the historical schedule information of multiple sample communication accounts; extract the historical status features of candidate accounts from the historical schedule information of candidate accounts, and extract the historical status features of multiple sample communication accounts from the historical schedule information of multiple sample communication accounts ; Perform fusion processing on the historical status features of the candidate account and the historical status features of multiple sample communication accounts to obtain the fusion status feature; perform mapping processing on the fusion status feature to obtain the online status corresponding to the candidate account at the appointment time.

In some embodiments, before displaying the communication reference information of each candidate account, the second display module 4552 is further configured to: respond to the setting operation of the reservation time for multimedia communication, obtain the time zone time corresponding to the reservation time of the candidate account and online status; after displaying the communication reference information of each candidate account, the method also includes: in response to the modification operation of the multimedia communication initiation account for the reservation time of multimedia communication, update the reservation time of each candidate account according to the modified reservation time The communication reference information, the updated communication reference information is the communication reference information of each candidate account at the modified reservation time.

In some embodiments, before responding to the multimedia communication invitation operation for at least one target account in the at least one candidate account, the invitation module 4553 is further configured to: when the candidate account is in the communicable period in the time zone corresponding to the appointment time , and when the online state corresponding to the reservation time of the candidate account is a communicable state, the candidate account is determined as at least one target account, and the target account in the selected state is displayed.

In some embodiments, the communication reference information further includes at least one of the following: the location information of the candidate account, the weather information of the location of the candidate account, and the schedule information of the candidate account; when the communication reference information includes the location information of the candidate account, The prominence of the display style of the communication reference information is positively correlated with the distance, which is the distance between the geographic location corresponding to the candidate account and the geographic location corresponding to the originating account; when the communication reference information includes the weather information of the location of the candidate account, the communication reference The salience of the display style of the information is positively correlated with the bad weather represented by the weather information; when the communication reference information includes the schedule information of the candidate account, the salience of the display style of the communication reference information is positively correlated with the number of schedules represented by the schedule information.

In some embodiments, before responding to the multimedia communication invitation operation for at least one target account, the invitation module 4553 is further configured to: in response to a selection operation for at least one candidate account, determine the candidate account selected by the selection operation at least one target account, and display the target account in the selected state; or determine the candidate account satisfying the automatic selection condition as at least one target account, and display the target account in the selected state.

In some embodiments, the automatic selection condition includes at least one of the following: the social distance between the candidate account and the initiating account is smaller than the social distance threshold; the activity of the candidate account is greater than the activity threshold; the latest interaction between the candidate account and the initiating account The time is greater than the interaction time threshold.

In some embodiments, the invitation module 4553 is further configured to: perform the following processing for each candidate account: obtain decision reference data, wherein the decision reference data includes at least one of the following: historical schedule information of the candidate account, multimedia communication settings Information, historical communication information of candidate accounts, and communication reference information of candidate accounts; extract decision-making reference features from decision-making reference data, and predict the probability that candidate accounts can respond to multimedia communications based on decision-making reference features; when the probability is greater than the probability threshold, determine the candidate The account meets the automatic selection criteria.

In some embodiments, before sending the multimedia communication invitation message to at least one target account, the invitation module 4553 is further configured to: when there is a target account in at least one target account that meets the prompt condition, display the first prompt message, the first The prompt information indicates that the communication start time of the multimedia communication conflicts with the communication reference information of the target account; in response to the confirmation operation for the first prompt information, it is determined to transfer to the process of sending a multimedia communication invitation message to at least one target account.

In some embodiments, the prompting condition includes at least one of the following: at the communication start time, the time zone time of the target account is in the non-communication period of the target account; at the communication start time, the time zone time of the target account is in the communication period of the target account, And the time interval between the time zone time of the target account and the non-communication period of the target account is less than the time interval threshold; at the communication start time, the online state of the target account is a non-communication state.

In some embodiments, the invitation module 4553 is also used to: display the account identifier of each target account and the real-time communication reference information of each target account during the multimedia communication process. The real-time communication reference information of the target account includes the following At least one of: the real-time time zone time of the target account and the real-time online status corresponding to the real-time time zone time of the target account; when the real-time online status is a non-communication state, a second prompt message is displayed, and the second prompt message is used to prompt the multimedia communication Initiate the account to end the multimedia communication.

An embodiment of the present application provides a computer program product or computer program, where the computer program product or computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the above-mentioned multimedia communication processing method in the embodiment of the present application.

An embodiment of the present application provides a computer-readable storage medium storing executable instructions, wherein executable instructions are stored, and when the executable instructions are executed by a processor, the processor will be caused to perform the multimedia communication provided by the embodiment of the present application. The processing method, for example, the processing method of multimedia communication as shown in FIGS. 3A-3D .

In some embodiments, the computer-readable storage medium can be memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; Various equipment.

In some embodiments, executable instructions may take the form of programs, software, software modules, scripts, or code written in any form of programming language, including compiled or interpreted languages, or declarative or procedural languages, and its Can be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment.

As an example, executable instructions may be deployed to be executed on one computing device, or on multiple computing devices located at one site, or alternatively, on multiple computing devices distributed across multiple sites and interconnected by a communication network. to execute.

To sum up, according to the embodiment of the present application, before the invitation for multimedia communication, the time zone time and online status of each candidate account are displayed to the originating account of the multimedia communication, so that the originating account of the multimedia communication is the target of the invitation from the candidate account. When an account performs multimedia communication, the time zone time and online status of each candidate account can be referred to, so as to improve the success rate of the invitation operation, thereby improving the efficiency of human-computer interaction.

The above descriptions are merely examples of the present application, and are not intended to limit the protection scope of the present application. Any modifications, equivalent replacements and improvements made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims (25)

1. A method of processing multimedia communications, the method comprising:

displaying a human-computer interaction interface; the man-machine interaction interface comprises a multimedia communication invitation inlet;

Responding to triggering operation for the multimedia communication invitation inlet, displaying at least one candidate account, and displaying communication reference information of each candidate account; the communication reference information comprises time zone time information of the candidate account and an online state corresponding to the time zone time information;

in response to a multimedia communication invitation operation for at least one target account of the at least one candidate account, sending a multimedia communication invitation message to the at least one target account.

2. The method of claim 1, wherein the displaying at least one candidate account comprises:

when the number of the at least one candidate account is a plurality of, displaying the plurality of candidate accounts in sequence;

wherein the order is one of: and the social distance between the candidate accounts and the initiating account of the multimedia communication is increased, the liveness of the candidate accounts is reduced, and the latest interaction time between the candidate accounts and the initiating account is reduced.

3. The method of claim 1, wherein prior to displaying the at least one candidate account, the method further comprises:

Obtaining the candidate account number meeting at least one of the following conditions:

the candidate account is in an online state;

the social distance between the candidate account and the initiating account of the multimedia communication is smaller than a social distance threshold;

the activity degree of the candidate account number is larger than an activity degree threshold value;

the latest interaction time between the candidate account and the initiating account is greater than an interaction time threshold;

the candidate account is in the same communication connection as the initiating account.

4. A method according to claim 3, wherein the displaying at least one candidate account when the candidate account is in the same communication connection as the initiating account comprises:

when the communication connection is of a target group, taking at least one communication account corresponding to the communication connection except the initiating account as at least one candidate account, and displaying the at least one candidate account, wherein the initiating account belongs to the target group; or (b)

And when the communication connection is the communication connection between the target communication account and the initiating account, taking the target communication account in the communication connection as the candidate account, and displaying the candidate account.

5. The method of claim 1, wherein displaying the communication reference information for each of the candidate account numbers comprises:

and when the multimedia communication is real-time multimedia communication, displaying communication reference information of each candidate account, wherein the communication reference information comprises real-time zone time of the candidate account and real-time online state corresponding to the candidate account in the real-time zone time.

6. The method of claim 5, wherein when displaying the communication reference information for each of the candidate account numbers, the method further comprises:

when the number of the at least one candidate account is a plurality of candidate accounts, applying differentiated display patterns to the communication reference information respectively corresponding to the plurality of candidate accounts;

the significance degree of the display style of the real-time zone time of the candidate account is positively correlated with a time zone difference, and the time zone difference is used for representing the time difference between the candidate account and the initiating account of the multimedia communication; the significance of the display style of the real-time online status is positively correlated with a status difference between the online status of the candidate account and the online status of the initiating account.

7. The method of claim 5, wherein prior to displaying the communication reference information for each of the candidate account numbers, the method further comprises:

acquiring the real-time online state of each candidate account;

wherein the real-time online status of each of the candidate accounts is determined in response to a setting operation of the candidate account.

8. The method of claim 5, wherein prior to displaying the communication reference information for each of the candidate account numbers, the method further comprises:

determining the real-time online state of each candidate account by the following method:

acquiring historical schedule information corresponding to a plurality of sample communication accounts respectively;

the following processing is performed for each sample communication account:

extracting a historical online state of each historical period from the historical schedule information of the sample communication account;

carrying out statistics processing on the historical online states of the plurality of communication accounts in each historical period to obtain a statistical state corresponding to each historical period;

and determining the statistical state corresponding to the historical time period of the real-time zone time as the real-time online state of the candidate account.

9. The method of claim 5, wherein prior to displaying the communication reference information for each of the candidate account numbers, the method further comprises:

determining the real-time online state of each candidate account by the following method:

acquiring historical schedule information of the candidate account and historical schedule information of a plurality of sample communication accounts;

extracting historical state characteristics of the candidate account from the historical schedule information of the candidate account, and extracting the historical state characteristics of the plurality of sample communication accounts from the historical schedule information of the plurality of sample communication accounts;

fusion processing is carried out on the historical state characteristics of the candidate account and the historical state characteristics of the plurality of sample communication accounts, so that fusion state characteristics are obtained;

and mapping the fusion state characteristics to obtain the real-time online state of the candidate account.

10. The method of claim 5, wherein prior to responding to the multimedia communication invitation operation for at least one target account of the at least one candidate account, the method further comprises:

and when the real-time zone time of the candidate account is in a communicable period and the real-time online state of the candidate account is a communicable state, determining the candidate account as the at least one target account and displaying the target account in the selected state.

11. The method of claim 1, wherein displaying the communication reference information for each of the candidate account numbers comprises:

when the multimedia communication is reserved multimedia communication, displaying time zone time and online state corresponding to each candidate account at reserved time, wherein the reserved time comprises at least one of the following: a reservation time point and a reservation time period.

12. The method of claim 11, wherein when displaying the communication reference information for each of the candidate account numbers, the method further comprises:

when the number of the at least one candidate account is a plurality of candidate accounts, applying differentiated display patterns to the communication reference information respectively corresponding to the plurality of candidate accounts;

the significance degree of the display style of the time zone time corresponding to the reserved time of the candidate account is positively correlated with the time zone difference, and the time zone difference is used for representing the time difference between the candidate account and the initiating account of the multimedia communication; the significance degree of the display style of the online state corresponding to the reservation time of the candidate account is positively correlated with the state difference, and the state difference is the difference between the online state corresponding to the reservation time of the candidate account and the online state of the initiating account.

13. The method of claim 11, wherein prior to displaying the communication reference information for each of the candidate account numbers, the method further comprises:

acquiring the online state corresponding to each candidate account at the reservation time;

the online state corresponding to each candidate account at the reservation time is determined in response to the setting operation of the candidate account.

14. The method of claim 11, wherein prior to displaying the communication reference information for each of the candidate account numbers, the method further comprises:

the online state corresponding to each candidate account at the reserved time is determined by the following method:

acquiring historical schedule information corresponding to a plurality of sample communication accounts respectively;

the following processing is performed for each sample communication account:

extracting a historical online state of each historical period from the historical schedule information of the sample communication account;

carrying out statistics processing on the historical online states of the plurality of communication accounts in each historical period to obtain a statistical state corresponding to each historical period;

determining a historical time period of the time zone time corresponding to the reservation time of the candidate account as a target time period

And determining the statistical state corresponding to the target time period as the online state corresponding to the candidate account number at the reserved time.

15. The method of claim 11, wherein prior to displaying the communication reference information for each of the candidate account numbers, the method further comprises:

the online state corresponding to each candidate account at the reserved time is determined by the following method:

acquiring historical schedule information of the candidate account and historical schedule information of a plurality of sample communication accounts;

extracting historical state characteristics of the candidate account from the historical schedule information of the candidate account, and extracting the historical state characteristics of the plurality of sample communication accounts from the historical schedule information of the plurality of sample communication accounts;

fusion processing is carried out on the historical state characteristics of the candidate account and the historical state characteristics of the plurality of sample communication accounts, so that fusion state characteristics are obtained;

and mapping the fusion state characteristics to obtain the online state corresponding to the reservation time of the candidate account.

16. The method of claim 11, wherein the step of determining the position of the probe is performed,

before displaying the communication reference information of each candidate account, the method further comprises:

Responding to the setting operation of the reservation time of the multimedia communication, and acquiring the time zone time and the online state corresponding to the reservation time of the candidate account;

after displaying the communication reference information of each candidate account, the method further comprises:

and responding to the modification operation of the initiation account of the multimedia communication for the reservation time of the multimedia communication, and updating the communication reference information of each candidate account according to the modified reservation time, wherein the updated communication reference information is the communication reference information of each candidate account at the modified reservation time.

17. The method of claim 11, wherein prior to responding to the multimedia communication invitation operation for at least one target account of the at least one candidate account, the method further comprises:

and when the time zone time corresponding to the reservation time is in a communicable time period and the online state corresponding to the reservation time of the candidate account is a communicable state, determining the candidate account as the at least one target account, and displaying the target account in the selected state.

18. The method according to any of claims 5-17, wherein the communication reference information further comprises at least one of: the method comprises the steps of positioning information of a candidate account, weather information of the position of the candidate account and schedule information of the candidate account;

when the communication reference information comprises the position information of the candidate account, the significance degree of the display style of the communication reference information is positively correlated with a distance between the geographic position corresponding to the candidate account and the geographic position corresponding to the initiating account;

when the communication reference information comprises weather information of the position of the candidate account, the significance degree of the display style of the communication reference information is positively correlated with the weather severity represented by the weather information;

when the communication reference information comprises schedule information of the candidate account, the significance degree of the display style of the communication reference information is positively correlated with the schedule quantity characterized by the schedule information.

19. The method of claim 1, wherein prior to operating in response to the multimedia communication invitation for at least one target account, the method further comprises:

In response to a selection operation for the at least one candidate account, determining the candidate account selected by the selection operation as the at least one target account, and displaying the target account in a selected state; or (b)

And determining the candidate account meeting the automatic selection condition as the at least one target account, and displaying the target account in the selected state.

20. The method of claim 19, wherein the automatic selection condition comprises at least one of:

the social distance between the candidate account number and the initiating account number is smaller than a social distance threshold;

the activity degree of the candidate account number is larger than an activity degree threshold value;

the most recent interaction time between the candidate account and the initiating account is greater than an interaction time threshold.

21. The method of claim 19, wherein the method further comprises:

the following processing is executed for each candidate account:

obtaining decision reference data, wherein the decision reference data comprises at least one of the following: the method comprises the steps of setting historical schedule information of candidate accounts, setting information of multimedia communication, historical communication information of the candidate accounts and communication reference information of the candidate accounts;

Extracting decision reference features from the decision reference data, and predicting the probability that the candidate account can respond to the multimedia communication based on the decision reference features;

and when the probability is greater than a probability threshold, determining that the candidate account meets the automatic selection condition.

22. The method of claim 1, wherein prior to sending the multimedia communication invite message to the at least one target account, the method further comprises:

when a target account number meeting the prompt conditions exists in the at least one target account number, displaying first prompt information, wherein the first prompt information characterizes that the communication starting time of the multimedia communication conflicts with the communication reference information of the target account number;

and in response to the confirmation operation for the first prompt information, determining to switch to a process of sending the multimedia communication invitation message to the at least one target account.

23. The method of claim 22, wherein the step of determining the position of the probe is performed,

the prompting conditions comprise at least one of the following:

at the communication start time, the time zone time of the target account is in a non-communication period of the target account;

at the communication start time, the time zone time of the target account is in a communicable period of the target account, and a time interval between the time zone time of the target account and a non-communication period of the target account is less than a time interval threshold;

At the communication start time, the online state of the target account is a non-communication state.

24. The method according to claim 1, wherein the method further comprises:

displaying an account number identification of each target account number and real-time communication reference information of each target account number in the process of multimedia communication, wherein the real-time communication reference information of each target account number comprises at least one of the following: the real-time zone time of the target account number and the real-time online state of the target account number corresponding to the real-time zone time;

and when the real-time online state is a non-communication state, displaying second prompt information, wherein the second prompt information is used for prompting the initiating account of the multimedia communication to end the multimedia communication.

25. A processing apparatus for multimedia communications, the apparatus comprising:

the first display module is used for displaying the man-machine interaction interface; the man-machine interaction interface comprises a multimedia communication invitation inlet;

the second display module is used for responding to the triggering operation of the multimedia communication invitation entrance, displaying at least one candidate account and displaying communication reference information of each candidate account; the communication reference information comprises time zone time information of the candidate account and an online state corresponding to the time zone time information;

And the invitation module is used for responding to the multimedia communication invitation operation aiming at least one target account in the at least one candidate account and sending a multimedia communication invitation message to the at least one target account.