WO2020029690A1 - Method and apparatus for sending message, and electronic device - Google Patents
Method and apparatus for sending message, and electronic device Download PDFInfo
- Publication number
- WO2020029690A1 WO2020029690A1 PCT/CN2019/091864 CN2019091864W WO2020029690A1 WO 2020029690 A1 WO2020029690 A1 WO 2020029690A1 CN 2019091864 W CN2019091864 W CN 2019091864W WO 2020029690 A1 WO2020029690 A1 WO 2020029690A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- augmented reality
- virtual object
- application
- message
- receiver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/52—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail for supporting social networking services
Definitions
- Memory for storing processor-executable instructions
- FIG. 2 is a flowchart of a message sending method according to an embodiment of the present specification
- FIG. 4 is a schematic diagram of multiple virtual objects provided by an embodiment of the present specification.
- FIG. 6 is a hardware structural diagram of a message sending device according to an embodiment of the present specification.
- FIG. 7 is a schematic block diagram of a message sending apparatus according to an embodiment of the present specification.
- first, second, third, etc. may be used in this specification to describe various information, the information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other.
- first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information.
- word “if” as used herein can be interpreted as “at” or "when” or "in response to determination”.
- the system architecture concept map 100 may include an operation server 105 that performs data communication with one or more augmented reality clients 106 via a network 112, and a database 115 that may be integrated with or independent of the operation server 105.
- the operation server 105 may correspond to a service platform of a social network or a service platform of a payment network. In some cases, such as a network that completes payment through the integration of a social network, such a social network platform and a payment network platform may be integrated.
- the network device on which each augmented reality client 106 is based may include a device having a communication module capable of sending and receiving data via the network 112.
- the network device on which each augmented reality client 106 is based may include a server, desktop computer, laptop computer, tablet computer, smartphone, handheld computer, personal digital assistant ("PDA"), or any other Wired or wireless processor drive.
- PDA personal digital assistant
- the network device on which the augmented reality client 106 is based may be operated by an end user or consumer, a potential counterparty user, a publisher of a social networking system, and an operation waiting for payment, respectively. Person to operate.
- the network 112 may include a local area network ("LAN”), a wide area network ("WAN”), an intranet, the Internet, a storage area network (SAN), a personal area network (PAN), a metropolitan area network (MAN), and a wireless local area network (WLAN) ), A virtual private network (VPN), a cellular or other mobile communication network, Bluetooth, NFC, or any combination thereof, or any other suitable architecture or system that facilitates the communication of signals, data and / or messages.
- LAN local area network
- WAN wide area network
- intranet the Internet
- SAN storage area network
- PAN personal area network
- MAN metropolitan area network
- WLAN wireless local area network
- VPN virtual private network
- a cellular or other mobile communication network Bluetooth, NFC, or any combination thereof, or any other suitable architecture or system that facilitates the communication of signals, data and / or messages.
- data and “information” are used interchangeably herein to refer to text, images, audio, video, or any other form that may exist in a computer-based environment
- the network device on which each augmented reality client 106 is based may be incorporated into the digital wallet application program module through software or hardware or even a combination of software and hardware.
- the digital wallet may encompass any application, hardware, software, or process that the augmented reality client 106 uses to assist the augmented reality client in completing a purchase transaction.
- Digital wallets can be separated from web browser applications, can interact with them, or can be specifically implemented as supporting applications.
- As a companion application digital wallets execute within a web browser application. That is, a digital wallet can be an application embedded in a web browser application. If the digital wallet is separate from the web browser application, the digital wallet can access the network 112 via any available communication technology.
- the augmented reality client 106 may provide or obtain one or more contact applications based on the carried user information.
- the contacts application may be any program or application on the augmented reality client 106 that maintains social network accessibility of the user's contact list. Examples of contacts applications may include, but are not limited to, email applications, text messaging applications, instant messaging, calendar invitation lists, or contact databases such as OUTLOOK or ACT, or friends of social software (or rating friends, strangers, Black people, etc.) provide programs / interfaces / lists / lists, which can include online, offline, invisible, busy, and even hosted status.
- the contacts in the contacts application can be prioritized by various factors, such as the frequency of communication with the user carried by the augmented reality client 106, the social relationship, the appearance of the contact application with the specific contact Number, or any other prioritization factor that can be extracted from the application.
- Different augmented reality clients can be counterparties to each other. Any one of the counterparties may represent an individual or an organization.
- the transaction / payment process involves the data / relationships to be read or the processing performed may need to be obtained from the connected database 115, and the transaction / payment process involves the data / relationships to be written or the processing results connected to the database 115 in.
- the computing device 103 with the operation server 105 may be an integrated relationship or a discrete relationship.
- the computing device 103 may be connected through an internal network or a private network, or may be connected through an encrypted public network.
- a more efficient and faster connection in the form of an internal bus may be used.
- the computing device 103 can access the database 115 directly (not shown in the figure) or through the operation server 105.
- Figure 1b shows the system architecture in a separate social network and payment network.
- System architecture concept diagram 101 may include operational servers 107 and 109 that perform data communication with one or more augmented reality clients 106 via network 112, and a computing environment 108 that may be integrated with or independent of operational server 107, and may A computing environment 110 that is integrated into the operations server 109 or is independent of the operations server 109.
- the operation server 107 may correspond to a service platform of a social network
- the operation server 109 may correspond to a service platform of a payment network.
- the corresponding database 117 can provide or store the required social network data and operation data; the corresponding database 118 can provide or store the required payment network data and operation data.
- Other attributes are similar to the descriptions corresponding to FIG. 1a, and are not repeated here.
- FIG. 2 is a message sending method provided in this specification.
- the method can be applied to an augmented reality client.
- the method may include the following steps:
- Step 220 Obtain at least one receiver determined by the sender.
- Step 230 Send the virtual object to the receiver in the form of an augmented reality message; wherein the sender and the receiver are users in a social platform.
- the above-mentioned augmented reality technology is a technology of calculating a position and an angle of a real scene image and adding a corresponding virtual image.
- the virtual image may include an image, a video, a 3D model, and the like.
- the above augmented reality client refers to client software developed based on augmented reality technology or integrated with augmented reality functions; for example, the above augmented reality client may be a social APP integrated with augmented reality service functions; the above augmented reality client
- the terminal is used to scan the image of the real scene in the offline environment and transmit the scanned image data to the augmented reality server in real time; and, through the above-mentioned augmented reality engine at the front desk of the augmented reality client, the back-end augmented reality service
- the virtual data pushed by the terminal is visually rendered, and it is superimposed and fused with the scanned image data of the real scene (such as real-world images).
- the step 210 specifically includes:
- a controller that sends an augmented reality message under the current application is triggered, based on the augmented reality technology, a preset virtual object corresponding to the current application is displayed in a real-world image.
- a button is taken as an example for illustration, and a schematic diagram of sending an augmented reality message shown in FIG. 3 is taken as an example, and a user may click an “AR message” button to trigger the process of sending an augmented reality message.
- the process may include: an augmented reality client activating a camera device (such as a camera) to display a real-view image captured by the camera device; and displaying a preset virtual object in the real-view image.
- the above-mentioned augmented reality server includes a server, a server cluster, or a cloud platform built on the server cluster for the above-mentioned augmented reality client; for example, the above-mentioned augmented reality server may be provided for a social APP that integrates augmented reality service functions. Social platform for docking services.
- the above-mentioned augmented reality server is used for a background-based augmented reality engine, and responds to the above-mentioned augmented reality client sending a virtual object acquisition request, and returns a virtual object that conforms to the current application of the augmented reality client to the augmented reality client.
- the augmented reality client can simultaneously display these virtual objects for users to select.
- the user can select at least one desired virtual object from it.
- the user selects the virtual object 4 as the virtual object to be finally displayed; in this way, the augmented reality client can finally display the virtual object 4 in the real scene image.
- the augmented reality technology is an augmented reality technology native to a terminal operating system.
- the augmented reality functions native to the operating system are richer than those provided by third parties.
- WebAR Web Augmented Reality
- Native AR Native AR
- the experience of WebAR is not as good as Native AR (NativeAR), including WebAR does not have a native AR recognition tracking mode.
- the form of the virtual object is adjusted according to a dynamic model corresponding to the interactive operation.
- the user can swipe left, right, up and down to rotate the virtual object.
- Virtual objects can be dynamically rotated 360 degrees.
- the embodiments of the present specification can be applied in different applications. Take Alipay's ant forest as an example. As shown in Figure 5, users can invite friends to help with watering in the form of AR messages in the ant forest. Interact with friends through such AR messages.
- the augmented reality message further carries an application identification and a status identification; the application identification indicates an application currently opened by the augmented reality client, and the status identification is used to control the recipient to enter the application identification The interface state displayed after the corresponding application.
- parameters that is, an application identifier and a status identifier can be passed through the augmented reality message.
- the receiver can enter the same application as the sender.
- the homepage is displayed by default, and according to the status identifier, the receiver can have different interface states when entering the same application as the sender.
- the sender invites the receiver to water, it can send an AR message.
- the AR message can carry the application identifier indicating the ant forest and the status identifier of the watering; thus, the receiver After clicking the AR message sent by the sender, you can also enter the ant forest application, and the display interface can be the interface of the sender's sapling, which can water the sapling of the sender.
- the embodiment of the present specification provides a message sending scheme.
- social messages can be displayed in the form of AR messages, thereby improving the interest of social messages.
- it also provides a new way to interact with service content, that is, through the AR message, the receiver can quickly enter the corresponding service content based on the AR message, thereby participating in the interaction of the service content.
- this specification also provides an embodiment of a message sending apparatus.
- the device embodiments may be implemented by software, or may be implemented by hardware or a combination of software and hardware.
- software implementation as an example, as a device in a logical sense, it is formed by reading the corresponding computer business program instructions in the non-volatile memory into the memory through the processor of the device in which it is located.
- hardware as shown in FIG. 6, it is a hardware structure diagram of the device where the message sending device of this specification is located.
- the device where the device is located in the example usually sends the actual function according to the message, and may also include other hardware, which will not be described again.
- FIG. 7 is a block diagram of a message sending device according to an embodiment of the present specification.
- the device corresponds to the embodiment shown in FIG. 2.
- the device includes:
- the display unit 410 displays a preset virtual object in a real-world image based on the augmented reality technology
- the sending unit 430 sends the virtual object to the receiver in the form of an augmented reality message; wherein the sender and the receiver are users on a social platform.
- the display unit 410 specifically includes:
- a controller that sends an augmented reality message under the current application is triggered, based on the augmented reality technology, a preset virtual object corresponding to the current application is displayed in a real-world image.
- the display unit 410 specifically includes:
- An acquisition subunit which sends a virtual object acquisition request to the augmented reality server;
- the display subunit displays the virtual object returned by the augmented reality server in a real-world image.
- the displaying the preset virtual objects in the real scene image specifically includes:
- At least one preset virtual object confirmed by the user is displayed in the real scene image.
- the augmented reality technology is an augmented reality function native to the terminal operating system.
- the device includes:
- the interaction subunit based on the identification and tracking technology provided by the native enhanced display technology, adjusts the shape of the virtual object according to the dynamic model corresponding to the interaction operation when the user's interaction operation is obtained.
- the augmented reality message also carries an application identifier and a status identifier; the application identifier indicates an application currently opened by the augmented reality client, and the status identifier is used to control the receiver to enter a corresponding application identifier. Interface status displayed after application.
- the system, device, module, or unit described in the foregoing embodiments may be specifically implemented by a computer chip or entity, or a product with a certain function.
- a typical implementation device is a computer, and the specific form of the computer may be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email sending and receiving device, and a game control Desk, tablet computer, wearable device, or a combination of any of these devices.
- the relevant part may refer to the description of the method embodiment.
- the device embodiments described above are only schematic, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, may be located One place, or it can be distributed across multiple network elements. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution in this specification. Those of ordinary skill in the art can understand and implement without creative efforts.
- Memory for storing processor-executable instructions
- the processor is configured to:
- displaying preset virtual objects under the current application includes:
- a controller that sends an augmented reality message under the current application is triggered, based on the augmented reality technology, a preset virtual object corresponding to the current application is displayed in a real-world image.
- the displaying a preset virtual object in a real-world image based on the augmented reality technology includes:
- At least one preset virtual object confirmed by the user is displayed in the real scene image.
- the augmented reality technology is an augmented reality function native to the terminal operating system.
- Optional also includes:
- the form of the virtual object is adjusted according to a dynamic model corresponding to the interactive operation.
- the augmented reality message also carries an application identifier and a status identifier; the application identifier indicates an application currently opened by the augmented reality client, and the status identifier is used to control the receiver to enter a corresponding application identifier. Interface status displayed after application.
- the processor may be a central processing unit (English: Central Processing Unit, CPU for short), or other general-purpose processors, digital signal processors (English: Digital Signal Processor) , Referred to as DSP), application specific integrated circuit (English: Application Specific Integrated Circuit, referred to as ASIC), etc.
- a general-purpose processor may be a microprocessor, or the processor may be any conventional processor, and the foregoing memory may be a read-only memory (English: read-only memory (abbreviation: ROM)), a random access memory (English : Random access memory (abbreviation: RAM), flash memory, hard disk or solid state hard disk.
- the steps of the method disclosed in combination with the embodiments of the present invention may be directly implemented by a hardware processor, or may be performed by a combination of hardware and software modules in the processor.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- Information Transfer Between Computers (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
本说明书实施例涉及互联网技术领域,尤其涉及一种消息发送方法及装置和电子设备。The embodiments of the present specification relate to the field of Internet technologies, and in particular, to a method and an apparatus for sending a message, and an electronic device.
随着社交网络的不断发展,通过社交网络进行网络活动越来越频繁。然而,现有社交网络中消息展示形式较为单一,如何提升社交消息的交互性和趣味性,对于提升用户体验具有十分重要的意义。With the continuous development of social networks, network activities through social networks are becoming more frequent. However, the current form of message display in the existing social networks is relatively single. How to improve the interactivity and interest of social messages is of great significance for improving the user experience.
发明内容Summary of the invention
本说明书实施例提供的一种消息发送方法及装置和电子设备:A method and device for sending a message, and an electronic device provided in the embodiments of the present specification:
根据本说明书实施例的第一方面,提供一种消息发送方法,应用于增强现实客户端,所述方法包括:According to a first aspect of the embodiments of the present specification, a message sending method is provided, which is applied to an augmented reality client. The method includes:
基于增强现实技术,在实景图像中显示预设的虚拟对象;Based on augmented reality technology, display preset virtual objects in real-world images;
获取发送方确定的至少一个接收方;Acquiring at least one receiver determined by the sender;
将所述虚拟对象以增强现实消息的形式发送所述接收方;其中,所述发送方和接收方为社交平台中的用户。Sending the virtual object to the receiver in the form of an augmented reality message; wherein the sender and the receiver are users in a social platform.
根据本说明书实施例的第二方面,提供一种消息发送装置,应用于增强现实客户端,所述装置包括:According to a second aspect of the embodiments of the present specification, a message sending apparatus is provided, which is applied to an augmented reality client, and the apparatus includes:
显示单元,基于增强现实技术,在实景图像中显示预设的虚拟对象;A display unit, based on the augmented reality technology, displaying a preset virtual object in a real-world image;
获取单元,获取发送方确定的至少一个接收方;An acquisition unit, which acquires at least one receiver determined by the sender;
发送单元,将所述虚拟对象以增强现实消息的形式发送所述接收方;其中,所述发送方和接收方为社交平台中的用户。The sending unit sends the virtual object to the receiver in the form of an augmented reality message; wherein the sender and the receiver are users in a social platform.
根据本说明书实施例的第五方面,提供一种电子设备,包括:According to a fifth aspect of the embodiments of the present specification, an electronic device is provided, including:
处理器;processor;
用于存储处理器可执行指令的存储器;Memory for storing processor-executable instructions;
其中,所述处理器被配置为上述任一项消息发送方法。The processor is configured as any one of the foregoing message sending methods.
本说明书实施例,提供了一种消息发送方案,通过将AR技术和社交消息相结合,使得社交消息可以以AR消息的形式展示,从而可以提升社交消息的趣味性。另一方面,也提供了业务内容新的互动方式,即通过AR消息的触达,使得接收方可以快速基于该AR消息进入相应的业务内容,从而参与业务内容的互动。The embodiment of the present specification provides a message sending scheme. By combining AR technology and social messages, social messages can be displayed in the form of AR messages, thereby improving the interest of social messages. On the other hand, it also provides a new way to interact with service content, that is, through the AR message, the receiver can quickly enter the corresponding service content based on the AR message, thereby participating in the interaction of the service content.
图1a为本说明书一实施例可以适用的示例性的系统架构概念图;FIG. 1a is an exemplary system architecture conceptual diagram to which an embodiment of the present specification can be applied; FIG.
图1b为本说明书一实施例可以适用的示例性的系统架构概念图;FIG. 1b is a conceptual diagram of an exemplary system architecture to which an embodiment of the present specification can be applied; FIG.
图2是本说明书一实施例提供的消息发送方法的流程图;2 is a flowchart of a message sending method according to an embodiment of the present specification;
图3是本说明书一实施例提供的发送增强现实消息的示意图;3 is a schematic diagram of sending an augmented reality message according to an embodiment of the present specification;
图4是本说明书一实施例提供的多种虚拟对象的示意图;4 is a schematic diagram of multiple virtual objects provided by an embodiment of the present specification;
图5是本说明书一实施例提供的业务应用的示意图;FIG. 5 is a schematic diagram of a service application provided by an embodiment of the present specification; FIG.
图6是本说明书一实施例提供的消息发送装置的硬件结构图;FIG. 6 is a hardware structural diagram of a message sending device according to an embodiment of the present specification; FIG.
图7是本说明书一实施例提供的消息发送装置的模块示意图。FIG. 7 is a schematic block diagram of a message sending apparatus according to an embodiment of the present specification.
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本说明书相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本说明书的一些方面相一致的装置和方法的例子。Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this specification. Rather, they are merely examples of devices and methods consistent with certain aspects of the specification, as detailed in the appended claims.
在本说明书使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本说明书。在本说明书和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。还应当理解,本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。The terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the specification. As used in this specification and the appended claims, the singular forms "a", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and includes any or all possible combinations of one or more of the associated listed items.
应当理解,尽管在本说明书可能采用术语第一、第二、第三等来描述各种信息,但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如,在不脱离本说明书范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。取决于语境,如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”。It should be understood that although the terms first, second, third, etc. may be used in this specification to describe various information, the information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this specification, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at" or "when" or "in response to determination".
本说明书旨在提出一种基于AR(Augmented Reality,增强现实技术)的AR消息,将AR消息应用于社交网络中。例如可以应用在IM(Instant Messaging,即时通讯)。通过将增强现实技术和社交消息相结合,使得社交消息可以以增强现实消息的形式展示,从而可以提升社交消息的趣味性。另一方面,也提供了业务内容新的互动方式,即通过增强现实消息的触达,使得接收方可以快速基于该增强现实消息进入相应的业务内容,从而参与业务内容的互动。This specification aims to propose an AR (Augmented Reality, AR) -based AR message, and apply the AR message to a social network. For example, it can be applied to IM (Instant Messaging, instant messaging). By combining augmented reality technology and social messages, social messages can be displayed in the form of augmented reality messages, which can improve the fun of social messages. On the other hand, it also provides a new way to interact with business content, that is, through the arrival of augmented reality messages, the receiver can quickly enter the corresponding business content based on the augmented reality message, thereby participating in the interaction of business content.
以下通过本说明书提供的消息发送方案进行描述。The following describes the message sending scheme provided in this specification.
图1a示出了本文中可以适用的示例性的系统架构概念。FIG. 1a illustrates an exemplary system architecture concept that may be applied herein.
系统架构概念图100中,各种网络节点借助网络可以实现信息的通信,继而完成交互和数据的处理。系统架构概念图100可以包括经由网络112与一个或多个增强现实客户端106进行数据通信的运营服务器105,以及可以集成于运营服务器105或独立于运营服务器105的数据库115。运营服务器105可以对应社交网络的服务平台,也可以对应支付网络的服务平台,在一些情况下,例如完成借助社交网络一体化完成支付的网络中,可以整合这样的社交网络平台和支付网络平台。In the system architecture concept diagram 100, various network nodes can implement information communication through the network, and then complete interaction and data processing. The system
每个网络112都可以包括有线或无线电信装置,增强现实客户端106所基于的网络装置可以通过所述有线或无线电信装置来交换数据。例如,每个网络112都可以包括局域网(“LAN”)、广域网(“WAN”)、内部网、互联网、移动电话网络、虚拟专用网(VPN)、蜂窝式或其它移动通信网络、蓝牙、NFC或其任何组合。在示例性实施方案的讨论中,应理解,术语“数据”和“信息”可在本文中互换使用来指代可存在于基于计算机的环境中的文字、图像、音频、视频或任何其它形式的信息。Each
每个增强现实客户端106所基于的网络装置都可以包括具有能够经由网络112发出并接收数据的通信模块的装置。例如,每个增强现实客户端106所基于的网络装置都可以包括服务器、台式计算机、膝上型计算机、平板计算机、智能手机、手持式计算机、个人数字助理(“PDA”),或者其它任何的有线或无线处理器驱动装置。在图1a所描绘的 示例性实施方案中,增强现实客户端106所基于的网络装置可以分别由最终用户或消费者、可能的交易对手方用户、社交网络系统的发布者,以及等待支付的操作者进行操作。The network device on which each augmented
用户(包括个人或组织)可以使用如网页浏览器应用程序或独立应用程序的应用程序,以便经由网络112查看、下载、上传或以其它方式访问文件或网页。网络包括有线或无线电信系统或装置,网络装置(包括装置105、106)可以通过所述有线或无线电信装置来交换数据。例如,网络112可以包括局域网(“LAN”)、广域网(“WAN”)、内部网、互联网、存储区域网络(SAN)、个人区域网络(PAN)、城域网(MAN)、无线局域网(WLAN)、虚拟专用网(VPN)、蜂窝式或其它移动通信网络、蓝牙、NFC或其任何组合,或者有助于信号、数据和/或消息的通信的任何其它适当的架构或系统。在示例性实施方案的讨论中,应理解,术语“数据”和“信息”可在本文中互换使用来指代可存在于基于计算机的环境中的文字、图像、音频、视频或任何其它形式的信息。Users (including individuals or organizations) can use applications such as web browser applications or stand-alone applications to view, download, upload, or otherwise access files or web pages via the
网页浏览器应用程序或独立应用程序的应用程序,可以与连接到网络112的网页服务器(或其它服务器,诸如社交平台、支付平台等)以完成交互。A web browser application or a stand-alone application may interact with a web server (or other server, such as a social platform, payment platform, etc.) connected to the
每个增强现实客户端106所基于的网络装置,可以通过软件或硬件甚至软硬件结合的方式纳入数字钱包应用程序模块。数字钱包可以涵盖增强现实客户端106以用来帮助增强现实客户端完成购买交易的任何应用程序、硬件、软件或进程。数字钱包可以与网页浏览器应用程序分开、可以与其交互,或者可以具体实现为其配套应用。作为配套应用,数字钱包在网页浏览器应用内执行。也就是说,数字钱包可以是嵌入网页浏览器应用程序中的应用程序。如果数字钱包与网页浏览器应用程序分开,则数字钱包可以经由任何可用的通信技术来访问网络112。The network device on which each
增强现实客户端106可以根据承载的用户信息提供或获取一个或多个联系人应用程序。联系人应用可以是增强现实客户端106上的保持社交网络可访问性的用户联系人列表的任何程序或应用程序。联系人应用的实例可以包括但不限于电子邮件应用程序、短信应用程序、即时消息发送、日历邀请列表,或者如OUTLOOK或ACT的联系人数据库,或者社交软件的好友(或分级好友、陌生人、拉黑人等诸如此类)提供程序/界面/列表/清单,可以包括在线的、不在线的、隐身的、忙碌的甚至托管的状态。联系人应用中的联系人可以通过各种因素来进行优先级排序,所述因素如与增强现实客户端106承载所述用户的通信频率、社交关系、出现有特定联系人的联系人应用程序的数目,或者可从应用程序中提取出的任何其它优先级排序因素。The
系统架构概念图100中,例如完成借助社交网络一体化完成支付的网络中,可以整 合这样的社交网络平台和支付网络平台。则该服务器105可以具有社交网络中服务器的功能。此时的社交网络服务器105可以代表计算机实施的系统,社交网络系统使用所述系统来托管社交网站和使用社交网站的所有配置文件和社区。社交网站可以代表允许用户经由互联网与通常拥有共同兴趣或共同关系的其它用户交互的任何基于网页的社区。增强现实客户端106可以加入或者与其交互的社交网站的实例。In the system architecture concept diagram 100, for example, in a network that completes payment through the integration of social networks, such a social network platform and a payment network platform can be integrated. Then, the
社交网络服务器105可以向增强现实客户端106提供所属用户的在线社区的成员列表。社交网络系统中可以对每位社区成员与增强现实客户端106所属用户的关系进行优先级排序。这可以由可应用于每个特定社交网络系统的结构的因素来确定。例如,如FACEBOOK的社交网络系统可以将社区的成员分类为“朋友”或“朋友的朋友”,并且LINKEDIN可以将成员分类为第一级联系人、第二级联系人或第三级联系人。The
社交网络系统服务器105可以经由任何可用技术与增强现实客户端106通信。这些技术可以包括但不限于经由网络112的互联网连接、电子邮件、短信、即时消息发送,或者其它合适的通信技术。社交网络系统可以包括可由社交网络服务器105访问的数据存储单元115。数据存储单元115可以包括一个或多个有形计算机可读存储装置。The social
系统架构概念图100中,例如完成借助社交网络一体化完成支付的网络中,可以整合这样的社交网络平台和支付网络平台。则该服务器105可以具有支付网络中服务器的功能。此时的支付网络服务器105可以代表计算机实施的系统,支付网络系统使用所述系统来托管支付平台和使用支付平台的所有配置文件和关系数据、支付数据的存储。支付网站可以代表允许用户经由互联网与通常拥有支付/购买/关注/收藏中存在共同的用户交互的任何基于网页的社区。In the system architecture concept diagram 100, for example, in a network that completes payment through the integration of a social network, such a social network platform and a payment network platform can be integrated. Then, the
不同的增强现实客户端可以是互为交易对手方。交易对手方中的任一个,可以代表个体或者组织。此时的交易/支付过程涉及的需要读取的数据/关系或执行的处理可能需要从连接的数据库115中获得,交易/支付过程涉及的需要写入的数据/关系或处理结果连接的数据库115中。Different augmented reality clients can be counterparties to each other. Any one of the counterparties may represent an individual or an organization. At this time, the transaction / payment process involves the data / relationships to be read or the processing performed may need to be obtained from the connected
图1a中,与运营服务器105可以是集成关系或分立关系的计算装置103,特别是后者的情况下,一般可以通过内部网络或专用网络连接,或者也可以通过加密的公共网络连接。特别的,当为集成关系时,可能采用更高效、传输速度更快的内部总线形式的连接。该计算装置103,当为集成关系或分立关系时,均可以直接(图中未示出)或通过运营服务器105访问数据库115。In FIG. 1 a, the
对计算机装置103进行适当的编程,可以藉由这种指令控制本申请中方法的实施。特别的,当为集成关系时,计算机装置103处理的事务可以视为运营服务器105的处理而不必特别加以区分。By appropriately programming the
图1b则示出了分立的社交网络与支付网络中的系统架构。系统架构概念图101可以包括经由网络112与一个或多个增强现实客户端106进行数据通信的运营服务器107和109,以及可以集成于运营服务器107或独立于运营服务器107的计算环境108,以及可以集成于运营服务器109或独立于运营服务器109的计算环境110。在一个实例当中,运营服务器107可以对应社交网络的服务平台,运营服务器109可以对应支付网络的服务平台。对应的数据库117,可以提供或存储所需的社交网络数据和操作数据;对应的数据库118,可以提供或存储所需的支付网络数据和操作数据。其它属性类似于上述对应图1a的描述,不再赘述。Figure 1b shows the system architecture in a separate social network and payment network. System architecture concept diagram 101 may include
参考图2所示的例子介绍,图2为本说明书提供的一种消息发送方法,该方法可以应用于增强现实客户端,所述方法可以包括以下步骤:Referring to the example shown in FIG. 2, FIG. 2 is a message sending method provided in this specification. The method can be applied to an augmented reality client. The method may include the following steps:
步骤210:基于增强现实技术,在实景图像中显示预设的虚拟对象。Step 210: Based on the augmented reality technology, displaying a preset virtual object in a real-world image.
步骤220:获取发送方确定的至少一个接收方。Step 220: Obtain at least one receiver determined by the sender.
步骤230:将所述虚拟对象以增强现实消息的形式发送所述接收方;其中,所述发送方和接收方为社交平台中的用户。Step 230: Send the virtual object to the receiver in the form of an augmented reality message; wherein the sender and the receiver are users in a social platform.
上述增强现实技术是一种计算实景图像的位置及角度并加上相应虚拟图像的技术。所述虚拟图像可以包括图像、视频、3D模型等。The above-mentioned augmented reality technology is a technology of calculating a position and an angle of a real scene image and adding a corresponding virtual image. The virtual image may include an image, a video, a 3D model, and the like.
上述增强现实客户端,是指基于增强现实技术开发的,或者集成了增强现实功能的客户端软件;例如,上述增强现实客户端,可以是集成了增强现实服务功能的社交APP;上述增强现实客户端用于对线下环境中的现实场景进行图像扫描,并将扫描到的图像数据实时传输至增强现实服务端;以及,通过上述增强现实客户端前台的增强现实引擎,对后台的增强现实服务端推送的虚拟数据进行可视化渲染,将其与扫描到的现实场景的图像数据(比如实景图像)进行叠加融合。The above augmented reality client refers to client software developed based on augmented reality technology or integrated with augmented reality functions; for example, the above augmented reality client may be a social APP integrated with augmented reality service functions; the above augmented reality client The terminal is used to scan the image of the real scene in the offline environment and transmit the scanned image data to the augmented reality server in real time; and, through the above-mentioned augmented reality engine at the front desk of the augmented reality client, the back-end augmented reality service The virtual data pushed by the terminal is visually rendered, and it is superimposed and fused with the scanned image data of the real scene (such as real-world images).
在一实施例中,所述步骤210,具体包括:In an embodiment, the
在当前应用下发送增强现实消息的控制器被触发时,基于增强现实技术,在实景图像中显示所述当前应用对应预设的虚拟对象。When a controller that sends an augmented reality message under the current application is triggered, based on the augmented reality technology, a preset virtual object corresponding to the current application is displayed in a real-world image.
其中,所述控制器可以包括按钮、特定语音、特定生物识别标识等。The controller may include a button, a specific voice, a specific biometric identifier, and the like.
以按钮为例加以说明,图3所示发送增强现实消息的示意图为例,用户可以点击“AR消息”按钮,从而触发发送增强现实消息的流程。所述流程可以包括:增强现实客户端启动摄像装置(如摄像头),显示所述摄像装置捕捉到的实景图像;并在所述实景图像中显示预设的虚拟对象。A button is taken as an example for illustration, and a schematic diagram of sending an augmented reality message shown in FIG. 3 is taken as an example, and a user may click an “AR message” button to trigger the process of sending an augmented reality message. The process may include: an augmented reality client activating a camera device (such as a camera) to display a real-view image captured by the camera device; and displaying a preset virtual object in the real-view image.
以特定语音加以说明,例如触发发送增强现实消息的语音为“我要发送AR消息”;当用户说出“我要发送AR消息”后,就可以触发发送增强现实消息的流程。Use a specific voice to explain, for example, the voice that triggers the sending of an augmented reality message is "I want to send an AR message"; when the user says "I want to send an AR message", the process of sending an augmented reality message can be triggered.
所述特定生物识别标识可以包括指纹,相应地增强现实客户端所在终端需要有识别指纹的硬件。当用户将指纹按压在指纹模块时,就可以触发发送增强现实消息的流程。The specific biometric identification may include a fingerprint, and accordingly, the terminal where the augmented reality client is located needs to have hardware for identifying the fingerprint. When the user presses the fingerprint on the fingerprint module, the process of sending an augmented reality message can be triggered.
在一实施例中,所述虚拟对象可以是增强现实客户端预先缓存在本地的,也就是说是,可以从本地获取虚拟对象,并在实景图像中显示。In an embodiment, the virtual object may be locally cached in advance by the augmented reality client, that is, the virtual object may be obtained from the local and displayed in the real scene image.
在一实施例中,所述虚拟对象可以是增强现实客户端临时从增强现实服务端获取的。具体可以包括:In an embodiment, the virtual object may be temporarily acquired by the augmented reality client from the augmented reality server. This can include:
向增强现实服务端发送虚拟对象的获取请求;Send a virtual object acquisition request to the augmented reality server;
在实景图像中显示所述增强现实服务端返回的虚拟对象。Displaying the virtual object returned by the augmented reality server in a real-world image.
上述增强现实服务端,包括面向上述增强现实客户端提供服务的服务器、服务器集群或者基于服务器集群构建的云平台;例如,上述增强现实服务端,可以是面向集成了增强现实服务功能的社交APP提供对接服务的社交平台。上述增强现实服务端用于基于后台的增强现实引擎,对上述增强现实客户端发送虚拟对象的获取请求做出响应,将符合增强现实客户端当前应用的虚拟对象返回给增强现实客户端。The above-mentioned augmented reality server includes a server, a server cluster, or a cloud platform built on the server cluster for the above-mentioned augmented reality client; for example, the above-mentioned augmented reality server may be provided for a social APP that integrates augmented reality service functions. Social platform for docking services. The above-mentioned augmented reality server is used for a background-based augmented reality engine, and responds to the above-mentioned augmented reality client sending a virtual object acquisition request, and returns a virtual object that conforms to the current application of the augmented reality client to the augmented reality client.
在一实施例中,当存在多个预设的虚拟对象时,所述在实景图像中显示预设的虚拟对象,具体包括:In an embodiment, when there are a plurality of preset virtual objects, the displaying the preset virtual objects in the real scene image specifically includes:
在实景图像中显示用户确认的至少一个预设的虚拟对象。At least one preset virtual object confirmed by the user is displayed in the real scene image.
请参考图4所示的多种虚拟对象的示意图。当存在多个预设的虚拟对象时,增强现实客户端可以同时将这些虚拟对象展示出来供用户进行选择。用户可以从中选取至少一个需要的虚拟对象。如图4中用户选择了虚拟对象4作为最终需要显示的虚拟对象;如此,增强现实客户端最终可以在实景图像中显示虚拟对象4。Please refer to the schematic diagram of various virtual objects shown in FIG. 4. When there are multiple preset virtual objects, the augmented reality client can simultaneously display these virtual objects for users to select. The user can select at least one desired virtual object from it. As shown in FIG. 4, the user selects the virtual object 4 as the virtual object to be finally displayed; in this way, the augmented reality client can finally display the virtual object 4 in the real scene image.
在一实施例中,所述增强现实技术为终端操作系统原生的增强现实技术。In an embodiment, the augmented reality technology is an augmented reality technology native to a terminal operating system.
所述操作系统(Operating System,简称OS,也可以称为计算机管理控制程序)可以是管理和控制终端硬件和软件资源的计算机程序,是直接运行在终端上的最基本的系统软件,任何其它软件和应用程序都必须在操作系统的支持下才能允许。典型的操作系统例如:安卓手机(如华为手机、小米手机、三星手机等)的安卓系统(Android)、苹果手机的IOS系统、微软手机的Windows Phone系统等。The operating system (OS for short, also referred to as computer management control program) may be a computer program that manages and controls the hardware and software resources of the terminal, and is the most basic system software that runs directly on the terminal. Any other software And applications must be allowed with the support of the operating system. Typical operating systems are, for example, the Android system (Android) of Android phones (such as Huawei phones, Xiaomi phones, Samsung phones, etc.), the IOS system of Apple phones, and the Windows Phone system of Microsoft phones.
通常,操作系统原生的增强现实功能相较于第三方提供的增强现实功能更为丰富。例如,WebAR(Web Augmented Reality)也可以作为消息展示的载体,当WebAR的体验没有原生AR(NativeAR)的好,包括WebAR不具有原生AR的识别跟踪模式。Generally, the augmented reality functions native to the operating system are richer than those provided by third parties. For example, WebAR (Web Augmented Reality) can also be used as a carrier for message display. When the experience of WebAR is not as good as Native AR (NativeAR), including WebAR does not have a native AR recognition tracking mode.
基于原生的增强现实技术,可以实现用户与AR对象的交互。Based on native augmented reality technology, users can interact with AR objects.
具体地,基于所述原生的增强显示技术提供的识别追踪技术,在获取到用户的交互操作时,根据交互操作对应的动态模型,调整所述虚拟对象的形态。Specifically, based on the recognition and tracking technology provided by the native enhanced display technology, when a user's interactive operation is obtained, the form of the virtual object is adjusted according to a dynamic model corresponding to the interactive operation.
用户可以通过触摸左右上下滑动,旋转虚拟对象。虚拟对象可以动态360度旋转。The user can swipe left, right, up and down to rotate the virtual object. Virtual objects can be dynamically rotated 360 degrees.
本说明书的实施例可以应用在不同的应用中。以支付宝的蚂蚁森林为例,如图5所示,用户可以在蚂蚁森林中以AR消息的形式邀请好友帮忙浇水。通过这样的AR消息与好友进行互动。The embodiments of the present specification can be applied in different applications. Take Alipay's ant forest as an example. As shown in Figure 5, users can invite friends to help with watering in the form of AR messages in the ant forest. Interact with friends through such AR messages.
在一实施例中,所述增强现实消息还携带有应用标识和状态标识;所述应用标识表示所述增强现实客户端当前开启的应用,所述状态标识用于控制所述接收方进入应用标识对应的应用后显示的界面状态。In an embodiment, the augmented reality message further carries an application identification and a status identification; the application identification indicates an application currently opened by the augmented reality client, and the status identification is used to control the recipient to enter the application identification The interface state displayed after the corresponding application.
本实施例中,通过增强现实消息可以传递参数,即应用标识和状态标识。通过应用标识,接收方可以进入与发送方相同的应用。通常而言,用户进入某个应用后默认是显示首页,而根据状态标识,接收方在进入与发送方相同应用时可以有不同的界面状态。依然以支付宝中蚂蚁森林应用为例,在发送方邀请接收方浇水,即可以发送AR消息,该AR消息中可以携带表示蚂蚁森林的应用标识以及标识浇水的状态标识;如此,接收方在点击了发送方发送的AR消息后,也可以进入蚂蚁森林应用,并且显示界面可以是发送方树苗的界面,可以为发送方的树苗浇水。In this embodiment, parameters, that is, an application identifier and a status identifier can be passed through the augmented reality message. With application identification, the receiver can enter the same application as the sender. Generally speaking, when a user enters an application, the homepage is displayed by default, and according to the status identifier, the receiver can have different interface states when entering the same application as the sender. Still taking the ant forest application in Alipay as an example, when the sender invites the receiver to water, it can send an AR message. The AR message can carry the application identifier indicating the ant forest and the status identifier of the watering; thus, the receiver After clicking the AR message sent by the sender, you can also enter the ant forest application, and the display interface can be the interface of the sender's sapling, which can water the sapling of the sender.
本说明书实施例,提供了一种消息发送方案,通过将AR技术和社交消息相结合,使得社交消息可以以AR消息的形式展示,从而可以提升社交消息的趣味性。另一方面,也提供了业务内容新的互动方式,即通过AR消息的触达,使得接收方可以快速基于该AR消息进入相应的业务内容,从而参与业务内容的互动。The embodiment of the present specification provides a message sending scheme. By combining AR technology and social messages, social messages can be displayed in the form of AR messages, thereby improving the interest of social messages. On the other hand, it also provides a new way to interact with service content, that is, through the AR message, the receiver can quickly enter the corresponding service content based on the AR message, thereby participating in the interaction of the service content.
与前述消息发送方法实施例相对应,本说明书还提供了消息发送装置的实施例。所述装置实施例可以通过软件实现,也可以通过硬件或者软硬件结合的方式实现。以软件实现为例,作为一个逻辑意义上的装置,是通过其所在设备的处理器将非易失性存储器中对应的计算机业务程序指令读取到内存中运行形成的。从硬件层面而言,如图6所示,为本说明书消息发送装置所在设备的一种硬件结构图,除了图6所示的处理器、网络接口、内存以及非易失性存储器之外,实施例中装置所在的设备通常根据消息发送实际功能,还可以包括其他硬件,对此不再赘述。Corresponding to the foregoing embodiment of the message sending method, this specification also provides an embodiment of a message sending apparatus. The device embodiments may be implemented by software, or may be implemented by hardware or a combination of software and hardware. Taking software implementation as an example, as a device in a logical sense, it is formed by reading the corresponding computer business program instructions in the non-volatile memory into the memory through the processor of the device in which it is located. In terms of hardware, as shown in FIG. 6, it is a hardware structure diagram of the device where the message sending device of this specification is located. In addition to the processor, network interface, memory, and non-volatile memory shown in FIG. 6, The device where the device is located in the example usually sends the actual function according to the message, and may also include other hardware, which will not be described again.
请参见图7,为本说明书一实施例提供的消息发送装置的模块图,所述装置对应了图2所示实施例,所述装置包括:Please refer to FIG. 7, which is a block diagram of a message sending device according to an embodiment of the present specification. The device corresponds to the embodiment shown in FIG. 2. The device includes:
显示单元410,基于增强现实技术,在实景图像中显示预设的虚拟对象;The
获取单元420,获取发送方确定的至少一个接收方;The obtaining
发送单元430,将所述虚拟对象以增强现实消息的形式发送所述接收方;其中,所述发送方和接收方为社交平台中的用户。The sending
可选的,所述显示单元410,具体包括:Optionally, the
在当前应用下发送增强现实消息的控制器被触发时,基于增强现实技术,在实景图像中显示所述当前应用对应预设的虚拟对象。When a controller that sends an augmented reality message under the current application is triggered, based on the augmented reality technology, a preset virtual object corresponding to the current application is displayed in a real-world image.
可选的,所述显示单元410,具体包括:Optionally, the
获取子单元,向增强现实服务端发送虚拟对象的获取请求;An acquisition subunit, which sends a virtual object acquisition request to the augmented reality server;
显示子单元,在实景图像中显示所述增强现实服务端返回的虚拟对象。The display subunit displays the virtual object returned by the augmented reality server in a real-world image.
可选的,当存在多个预设的虚拟对象时,所述在实景图像中显示预设的虚拟对象,具体包括:Optionally, when there are multiple preset virtual objects, the displaying the preset virtual objects in the real scene image specifically includes:
在实景图像中显示用户确认的至少一个预设的虚拟对象。At least one preset virtual object confirmed by the user is displayed in the real scene image.
可选的,所述增强现实技术为终端操作系统原生的增强现实功能。Optionally, the augmented reality technology is an augmented reality function native to the terminal operating system.
可选的,所述装置包括:Optionally, the device includes:
交互子单元,基于所述原生的增强显示技术提供的识别追踪技术,在获取到用户的交互操作时,根据交互操作对应的动态模型,调整所述虚拟对象的形态。The interaction subunit, based on the identification and tracking technology provided by the native enhanced display technology, adjusts the shape of the virtual object according to the dynamic model corresponding to the interaction operation when the user's interaction operation is obtained.
可选的,所述增强现实消息还携带有应用标识和状态标识;所述应用标识表示所述 增强现实客户端当前开启的应用,所述状态标识用于控制所述接收方进入应用标识对应的应用后显示的界面状态。Optionally, the augmented reality message also carries an application identifier and a status identifier; the application identifier indicates an application currently opened by the augmented reality client, and the status identifier is used to control the receiver to enter a corresponding application identifier. Interface status displayed after application.
上述实施例阐明的系统、装置、模块或单元,具体可以由计算机芯片或实体实现,或者由具有某种功能的产品来实现。一种典型的实现设备为计算机,计算机的具体形式可以是个人计算机、膝上型计算机、蜂窝电话、相机电话、智能电话、个人数字助理、媒体播放器、导航设备、电子邮件收发设备、游戏控制台、平板计算机、可穿戴设备或者这些设备中的任意几种设备的组合。The system, device, module, or unit described in the foregoing embodiments may be specifically implemented by a computer chip or entity, or a product with a certain function. A typical implementation device is a computer, and the specific form of the computer may be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email sending and receiving device, and a game control Desk, tablet computer, wearable device, or a combination of any of these devices.
上述装置中各个单元的功能和作用的实现过程具体详见上述方法中对应步骤的实现过程,在此不再赘述。For details about the implementation process of the functions and functions of the units in the foregoing device, see the implementation process of the corresponding steps in the foregoing method for details, and details are not described herein again.
对于装置实施例而言,由于其基本对应于方法实施例,所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本说明书方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。As for the device embodiment, since it basically corresponds to the method embodiment, the relevant part may refer to the description of the method embodiment. The device embodiments described above are only schematic, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, may be located One place, or it can be distributed across multiple network elements. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution in this specification. Those of ordinary skill in the art can understand and implement without creative efforts.
以上图7描述了数据汇总装置的内部功能模块和结构示意,其实质上的执行主体可以为一种电子设备,包括:The above Figure 7 describes the internal functional modules and structure of the data aggregation device. The substantial execution body can be an electronic device, including:
处理器;processor;
用于存储处理器可执行指令的存储器;Memory for storing processor-executable instructions;
其中,所述处理器被配置为:The processor is configured to:
基于增强现实技术,在实景图像中显示预设的虚拟对象;Based on augmented reality technology, display preset virtual objects in real-world images;
获取发送方确定的至少一个接收方;Acquiring at least one receiver determined by the sender;
将所述虚拟对象以增强现实消息的形式发送所述接收方;其中,所述发送方和接收方为社交平台中的用户。Sending the virtual object to the receiver in the form of an augmented reality message; wherein the sender and the receiver are users in a social platform.
可选的,基于增强现实技术,显示当前应用下预设的虚拟对象,具体包括:Optionally, based on the augmented reality technology, displaying preset virtual objects under the current application includes:
在当前应用下发送增强现实消息的控制器被触发时,基于增强现实技术,在实景图像中显示所述当前应用对应预设的虚拟对象。When a controller that sends an augmented reality message under the current application is triggered, based on the augmented reality technology, a preset virtual object corresponding to the current application is displayed in a real-world image.
可选的,所述基于增强现实技术,在实景图像中显示预设的虚拟对象,具体包 括:Optionally, the displaying a preset virtual object in a real-world image based on the augmented reality technology includes:
向增强现实服务端发送虚拟对象的获取请求;Send a virtual object acquisition request to the augmented reality server;
在实景图像中显示所述增强现实服务端返回的虚拟对象。Displaying the virtual object returned by the augmented reality server in a real-world image.
可选的,当存在多个预设的虚拟对象时,所述在实景图像中显示预设的虚拟对象,具体包括:Optionally, when there are multiple preset virtual objects, the displaying the preset virtual objects in the real scene image specifically includes:
在实景图像中显示用户确认的至少一个预设的虚拟对象。At least one preset virtual object confirmed by the user is displayed in the real scene image.
可选的,所述增强现实技术为终端操作系统原生的增强现实功能。Optionally, the augmented reality technology is an augmented reality function native to the terminal operating system.
可选的,还包括:Optional, also includes:
基于所述原生的增强显示技术提供的识别追踪技术,在获取到用户的交互操作时,根据交互操作对应的动态模型,调整所述虚拟对象的形态。Based on the identification and tracking technology provided by the native enhanced display technology, when a user's interactive operation is obtained, the form of the virtual object is adjusted according to a dynamic model corresponding to the interactive operation.
可选的,所述增强现实消息还携带有应用标识和状态标识;所述应用标识表示所述增强现实客户端当前开启的应用,所述状态标识用于控制所述接收方进入应用标识对应的应用后显示的界面状态。Optionally, the augmented reality message also carries an application identifier and a status identifier; the application identifier indicates an application currently opened by the augmented reality client, and the status identifier is used to control the receiver to enter a corresponding application identifier. Interface status displayed after application.
在上述电子设备的实施例中,应理解,该处理器可以是中央处理单元(英文:Central Processing Unit,简称:CPU),还可以是其他通用处理器、数字信号处理器(英文:Digital Signal Processor,简称:DSP)、专用集成电路(英文:Application Specific Integrated Circuit,简称:ASIC)等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等,而前述的存储器可以是只读存储器(英文:read-only memory,缩写:ROM)、随机存取存储器(英文:random access memory,简称:RAM)、快闪存储器、硬盘或者固态硬盘。结合本发明实施例所公开的方法的步骤可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。In the above embodiment of the electronic device, it should be understood that the processor may be a central processing unit (English: Central Processing Unit, CPU for short), or other general-purpose processors, digital signal processors (English: Digital Signal Processor) , Referred to as DSP), application specific integrated circuit (English: Application Specific Integrated Circuit, referred to as ASIC), etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, and the foregoing memory may be a read-only memory (English: read-only memory (abbreviation: ROM)), a random access memory (English : Random access memory (abbreviation: RAM), flash memory, hard disk or solid state hard disk. The steps of the method disclosed in combination with the embodiments of the present invention may be directly implemented by a hardware processor, or may be performed by a combination of hardware and software modules in the processor.
本说明书中的各个实施例均采用递进的方式描述,各个实施例之间相同相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。尤其,对于电子设备实施例而言,由于其基本相似于方法实施例,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the embodiment of the electronic device, since it is basically similar to the method embodiment, the description is relatively simple, and for the relevant parts, refer to the description of the method embodiment.
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本说明书的其它实施方案。本说明书旨在涵盖本说明书的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本说明书的一般性原理并包括本说明书未公开的本技术 领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本说明书的真正范围和精神由下面的权利要求指出。Those skilled in the art will readily contemplate other embodiments of the present specification after considering the specification and practicing the invention disclosed herein. This description is intended to cover any variations, uses, or adaptations of this specification. These modifications, uses, or adaptations follow the general principles of this specification and include the common general knowledge or conventional technical means in the technical field not disclosed in this specification. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the specification being indicated by the following claims.
应当理解的是,本说明书并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本说明书的范围仅由所附的权利要求来限制。It should be understood that this description is not limited to the precise structure that has been described above and illustrated in the accompanying drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of this description is limited only by the following claims.
Claims (15)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810898224.7 | 2018-08-08 | ||
| CN201810898224.7A CN109274575B (en) | 2018-08-08 | 2018-08-08 | Message sending method and device and electronic device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020029690A1 true WO2020029690A1 (en) | 2020-02-13 |
Family
ID=65153486
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/091864 Ceased WO2020029690A1 (en) | 2018-08-08 | 2019-06-19 | Method and apparatus for sending message, and electronic device |
Country Status (3)
| Country | Link |
|---|---|
| CN (2) | CN111865771B (en) |
| TW (1) | TWI713327B (en) |
| WO (1) | WO2020029690A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111652637A (en) * | 2020-05-26 | 2020-09-11 | 北京掌中飞天科技股份有限公司 | Cross-platform solutions and electronic devices for AR advertising and marketing activities |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111865771B (en) * | 2018-08-08 | 2023-01-20 | 创新先进技术有限公司 | Message sending method and device and electronic equipment |
| CN110113483B (en) * | 2019-04-19 | 2022-02-25 | 华为技术有限公司 | Method and related apparatus for using enhanced functionality of electronic equipment |
| CN112184277B (en) * | 2019-07-04 | 2023-06-16 | 腾讯科技(深圳)有限公司 | Virtual article package transmitting and receiving method, device, equipment and storage medium |
| CN111258420B (en) * | 2020-01-13 | 2023-02-21 | 维沃移动通信有限公司 | Information interaction method, head-mounted device and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105183477A (en) * | 2015-09-10 | 2015-12-23 | 上海踏风网络科技有限公司 | System and method for acquiring virtual item information of application program |
| CN107111996A (en) * | 2014-11-11 | 2017-08-29 | 本特图像实验室有限责任公司 | The augmented reality experience of Real-Time Sharing |
| CN107924590A (en) * | 2015-10-30 | 2018-04-17 | 斯纳普公司 | The tracking based on image in augmented reality system |
| US9990028B2 (en) * | 2014-10-03 | 2018-06-05 | Verizon Patent And Licensing Inc. | System and method for providing live augmented reality content |
| CN109274575A (en) * | 2018-08-08 | 2019-01-25 | 阿里巴巴集团控股有限公司 | Message sending method and device and electronic device |
Family Cites Families (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8933967B2 (en) * | 2005-07-14 | 2015-01-13 | Charles D. Huston | System and method for creating and sharing an event using a social network |
| CN102054289B (en) * | 2009-11-04 | 2014-06-11 | 沈阳迅景科技有限公司 | 3D virtual community construction method based on panoramic and real image and geographic information |
| KR101569465B1 (en) * | 2013-07-05 | 2015-11-17 | 서용창 | Method for transmitting a message, method for selling a message box and computer readable recording medium storing program for the same |
| GB201406695D0 (en) * | 2014-04-14 | 2014-05-28 | Shopchat Ltd | Threaded messaging |
| CN104835190A (en) * | 2015-04-29 | 2015-08-12 | 华东师范大学 | 3D instant messaging system and messaging method |
| TW201721361A (en) * | 2015-12-03 | 2017-06-16 | 英業達股份有限公司 | Interaction augmented reality enable system |
| CN105488489A (en) * | 2015-12-17 | 2016-04-13 | 掌赢信息科技(上海)有限公司 | Short video message transmitting method, electronic device and system |
| CN105812680A (en) * | 2016-03-31 | 2016-07-27 | 联想(北京)有限公司 | Image processing method and electronic device |
| US20170310927A1 (en) * | 2016-04-26 | 2017-10-26 | Raketu Communications, Inc. | System And Method For Determining And Overlaying Emotion Animation On Calls |
| CN205569711U (en) * | 2016-04-29 | 2016-09-14 | 乐视控股(北京)有限公司 | Virtual outdoor scene image display device and treadmill suitable for treadmill |
| CN106230920A (en) * | 2016-07-27 | 2016-12-14 | 吴东辉 | A kind of method and system of AR |
| CN107633441A (en) * | 2016-08-22 | 2018-01-26 | 大辅科技(北京)有限公司 | Commodity in track identification video image and the method and apparatus for showing merchandise news |
| CN106302132A (en) * | 2016-09-14 | 2017-01-04 | 华南理工大学 | A kind of 3D instant communicating system based on augmented reality and method |
| CN108108012B (en) * | 2016-11-25 | 2019-12-06 | 腾讯科技(深圳)有限公司 | Information interaction method and device |
| KR101838902B1 (en) * | 2016-11-29 | 2018-03-15 | 한국항공우주연구원 | System and Method for Providing Bird’s-eye View based on Mixed Reality |
| US10531220B2 (en) * | 2016-12-05 | 2020-01-07 | Magic Leap, Inc. | Distributed audio capturing techniques for virtual reality (VR), augmented reality (AR), and mixed reality (MR) systems |
| CN111654473B (en) * | 2016-12-13 | 2022-07-19 | 创新先进技术有限公司 | Virtual object distribution method and device based on augmented reality |
| CN106920079B (en) * | 2016-12-13 | 2020-06-30 | 阿里巴巴集团控股有限公司 | Augmented reality-based virtual object assignment method and device |
| CN107016550A (en) * | 2017-02-21 | 2017-08-04 | 阿里巴巴集团控股有限公司 | The distribution method and device of virtual objects under augmented reality scene |
| CN107123013B (en) * | 2017-03-01 | 2020-09-01 | 阿里巴巴集团控股有限公司 | Offline interaction method and device based on augmented reality |
| CN106803921A (en) * | 2017-03-20 | 2017-06-06 | 深圳市丰巨泰科电子有限公司 | Instant audio/video communication means and device based on AR technologies |
| CN107065196B (en) * | 2017-06-16 | 2019-03-15 | 京东方科技集团股份有限公司 | A kind of augmented reality display device and augmented reality display methods |
| CN107741886B (en) * | 2017-10-11 | 2020-12-15 | 江苏电力信息技术有限公司 | A method for multi-person interaction based on augmented reality technology |
| CN107818459A (en) * | 2017-10-30 | 2018-03-20 | 努比亚技术有限公司 | Red packet sending method, terminal and storage medium based on augmented reality |
| CN108229937A (en) * | 2017-12-20 | 2018-06-29 | 阿里巴巴集团控股有限公司 | Virtual objects distribution method and device based on augmented reality |
-
2018
- 2018-08-08 CN CN202010734596.3A patent/CN111865771B/en active Active
- 2018-08-08 CN CN201810898224.7A patent/CN109274575B/en active Active
-
2019
- 2019-06-10 TW TW108119898A patent/TWI713327B/en not_active IP Right Cessation
- 2019-06-19 WO PCT/CN2019/091864 patent/WO2020029690A1/en not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9990028B2 (en) * | 2014-10-03 | 2018-06-05 | Verizon Patent And Licensing Inc. | System and method for providing live augmented reality content |
| CN107111996A (en) * | 2014-11-11 | 2017-08-29 | 本特图像实验室有限责任公司 | The augmented reality experience of Real-Time Sharing |
| CN105183477A (en) * | 2015-09-10 | 2015-12-23 | 上海踏风网络科技有限公司 | System and method for acquiring virtual item information of application program |
| CN107924590A (en) * | 2015-10-30 | 2018-04-17 | 斯纳普公司 | The tracking based on image in augmented reality system |
| CN109274575A (en) * | 2018-08-08 | 2019-01-25 | 阿里巴巴集团控股有限公司 | Message sending method and device and electronic device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111652637A (en) * | 2020-05-26 | 2020-09-11 | 北京掌中飞天科技股份有限公司 | Cross-platform solutions and electronic devices for AR advertising and marketing activities |
Also Published As
| Publication number | Publication date |
|---|---|
| TW202008753A (en) | 2020-02-16 |
| CN109274575B (en) | 2020-07-24 |
| TWI713327B (en) | 2020-12-11 |
| CN111865771A (en) | 2020-10-30 |
| CN111865771B (en) | 2023-01-20 |
| CN109274575A (en) | 2019-01-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11250887B2 (en) | Routing messages by message parameter | |
| KR102871779B1 (en) | Location sharing using friend list versions | |
| EP3713159B1 (en) | Gallery of messages with a shared interest | |
| KR102890223B1 (en) | Message Interface Extension System | |
| US10868789B2 (en) | Social matching | |
| TWI713327B (en) | Message sending method and device and electronic equipment | |
| US12341738B2 (en) | Contextual reply augmentation system | |
| WO2017005097A1 (en) | Methods and devices for carrying out service operation on the basis of a chat group and acquiring group member information | |
| WO2023235399A1 (en) | External messaging function for an interaction system | |
| KR20250033276A (en) | Hide elements based on user input | |
| CN118891859A (en) | Displaying profiles from messaging system contact feeds | |
| KR20240056556A (en) | End-to-end encrypted metadata per participant | |
| US10303972B2 (en) | Social connection via real-time image comparison | |
| US20240073373A1 (en) | Sharing social augmented reality experiences in video calls | |
| US20230308411A1 (en) | Relationship-agnostic messaging system | |
| WO2016197873A1 (en) | Transaction processing method and system | |
| US12489942B2 (en) | Sharing of content collections | |
| KR20250026343A (en) | Messaging application with conversation filtering | |
| WO2022184166A1 (en) | Object account grouping method and apparatus, device, and storage medium | |
| KR102900065B1 (en) | Location sharing using different rate-limited links | |
| KR102898162B1 (en) | Share-to-Chat messaging system | |
| US20250053275A1 (en) | Shortcut to sharing collections of content items | |
| KR102898241B1 (en) | Location sharing using offline and online objects | |
| US20250370617A1 (en) | Auto-advance user interface system | |
| CN112446693B (en) | Information processing method and device thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19848719 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19848719 Country of ref document: EP Kind code of ref document: A1 |