[go: up one dir, main page]

CN108604359A - Method and system for sharing media content among several users - Google Patents

Method and system for sharing media content among several users Download PDF

Info

Publication number
CN108604359A
CN108604359A CN201780007841.7A CN201780007841A CN108604359A CN 108604359 A CN108604359 A CN 108604359A CN 201780007841 A CN201780007841 A CN 201780007841A CN 108604359 A CN108604359 A CN 108604359A
Authority
CN
China
Prior art keywords
media content
user
contribution
data
client application
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201780007841.7A
Other languages
Chinese (zh)
Inventor
M·米安斯
I·米安斯
L·马丁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alkymia
Original Assignee
Alkymia
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from EP16152459.0A external-priority patent/EP3196830A1/en
Priority claimed from US15/004,632 external-priority patent/US10075399B2/en
Application filed by Alkymia filed Critical Alkymia
Publication of CN108604359A publication Critical patent/CN108604359A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/01Social networking
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/101Collaborative creation, e.g. joint development of products or services

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Human Resources & Organizations (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Theoretical Computer Science (AREA)
  • Economics (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Operations Research (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

Media content sharing between users is implemented in the context of media content exchange that is themed with media content. The user may contribute (C215) by adding contributing media content that forms a contribution to the topic relative to a portion of the topic media content. The server application registers (C216) for each contribution association data representing the contribution and sends a message to the users participating in the media content exchange based on the registered association data. The association data may represent an association between the portion of the subject media content and the contributing media content. The user's contribution may be rendered (C218) on another user's device based on contribution rendering data (C217) received from the server application.

Description

若干用户之间共享媒体内容的方法和系统Method and system for sharing media content among several users

技术领域technical field

本公开一般涉及电信和数字数据处理领域,更具体地涉及通过至少一个电信网络在若干用户之间交换和/或共享媒体内容。The present disclosure relates generally to the fields of telecommunications and digital data processing, and more particularly to exchanging and/or sharing media content among several users over at least one telecommunications network.

背景技术Background technique

用于在若干用户之间共享媒体内容的已知解决方案涉及使用电子邮件/消息应用来发送带有一个或多个媒体内容作为附件或者到云媒体服务器的超链接的电子邮件/消息。然后,每个接收用户可以修改接收到的媒体内容之一,并发送包括修改后的媒体内容的响应电子邮件。例如,在专业环境中,不同的用户可能必须针对给定视频内容的不同部分的进行分享信息/讨论/做出评论。或者在家庭环境中,家庭的不同成员可能想要分享(关于他们的上一个假期的)图片内容,以及对于视频内容的不同部分发送一些评论。然后,修改后的媒体内容的每个接收用户可以进一步修改媒体内容,并发送包括进一步修改后的媒体内容的进一步响应电子邮件。Known solutions for sharing media content among several users involve using an email/messaging application to send an email/message with one or more media content as attachments or hyperlinks to cloud media servers. Each receiving user may then modify one of the received media content and send a response email including the modified media content. For example, in a professional environment, different users may have to share information/discuss/make comments on different portions of a given video content. Or in a family environment, different members of the family may want to share pictorial content (about their last vacation) and send some comments on different parts of the video content. Each recipient user of the modified media content can then further modify the media content and send a further response email including the further modified media content.

因此,每次接收用户想要与其他用户共享修改后的媒体内容时,他/她都必须向每个其他用户发送带有修改后的内容的电子邮件,或者将修改后的内容上传到云媒体服务器。因此,必须通过底层电信网络传输的必要带宽和数据量可能急剧增加,特别是当媒体内容包括视频内容时。在这种情况下,每个修改后的媒体内容具有与原始媒体内容相似或甚至更大的尺寸。Therefore, every time the receiving user wants to share the modified media content with other users, he/she has to send an email with the modified content to each other user, or upload the modified content to cloud media server. As a result, the necessary bandwidth and the amount of data that must be transmitted over the underlying telecommunications network can increase dramatically, especially when the media content includes video content. In this case, each modified media content has a similar or even larger size than the original media content.

此外,当接收用户想要发送基于图像的内容(即,图像或视频)作为接收到的基于图像的内容的注释时,这种解决方案是不方便的。具体而言,一方面,用于组合视频内容的软件应用通常是复杂的,并且对于非专业用户来说难以使用,另一方面,在没有这样的软件应用的情况下,可能需要在,例如包含在响应电子邮件中的文本消息中,单独解释原始视频内容和注释视频内容之间的关系。Furthermore, this solution is inconvenient when the receiving user wants to send image-based content (ie, an image or video) as an annotation for the received image-based content. Specifically, on the one hand, software applications for combining video content are often complex and difficult for non-expert users to use, and on the other hand, in the absence of such software applications, it may be necessary to include, for example In the text message in the response email, explain the relationship between the original video content and the annotated video content separately.

此外,当媒体内容是基于图像的媒体内容时(即,包括至少一个图像时),这种解决方案不能追踪每个单独用户对原始媒体内容做出的修改的贡献。追踪是一项特殊的挑战,因为修正后的基于图像的媒体内容通常以单层像素格式(BMP、JPEG、PNG、TIFF格式等)发送,其中图形/图像元素已经与原始媒体内容组合,并且除了使用一些用于图像分析和特征识别的专业功能之外,不能容易地与原始媒体内容分离。Furthermore, when the media content is image-based (ie, includes at least one image), this solution cannot track the contribution of each individual user to the modifications made to the original media content. Tracking is a particular challenge because corrected image-based media content is usually sent in single-layer pixel formats (BMP, JPEG, PNG, TIFF, etc.) where graphic/image elements have been combined with the original media content, and in addition to Apart from using some specialized functions for image analysis and feature recognition, it cannot be easily separated from the original media content.

此外,媒体内容的修改通常在用于编辑媒体内容的专用软件应用中执行,该专用软件应用通常不同于电子邮件/消息应用。取决于媒体内容类型(图像、视频、音频等),这对非专业用户来说可能是一个难题。Furthermore, modification of media content is typically performed in a dedicated software application for editing media content, which is typically different from email/messaging applications. Depending on the type of media content (images, video, audio, etc.), this can be a problem for non-expert users.

发明内容Contents of the invention

一般而言,在一方面,本公开涉及一种用于在若干用户之间共享媒体内容的方法。该方法包括:由在发起用户的第一用户设备上执行的第一客户端应用,向服务器应用发送至少一个请求,该至少一个请求用于将媒体内容注册为若干用户之间的媒体内容交换的主题;由在第二用户设备上执行的第二客户端应用,允许贡献用户相对于主题媒体内容的第一部分,对所述主题做出第一贡献;由所述第二客户端应用,向所述服务器应用发送至少一个请求,所述至少一个请求用于注册表示所述第一贡献的第一关联数据,其中所述第一关联数据表示所述主题媒体内容的第一部分与至少一个第一贡献媒体内容之间的关联,所述至少一个第一贡献媒体内容被选择来形成所述第一贡献;由在接收用户的用户设备上执行的第三客户端应用,从所述服务器应用接收包括第一关联数据的贡献再现数据,并且;由所述第三客户端应用,通过渲染(rendering)第一组合媒体内容,来再现所述第一贡献,所述第一组合媒体内容由所述第一贡献媒体内容的至少一部分与所述主题媒体内容的所述第一部分的组合产生。In general, in one aspect, the present disclosure relates to a method for sharing media content among a number of users. The method comprises: sending, by a first client application executed on a first user device of an initiating user, to a server application at least one request for registering media content as an exchange of media content between several users theme; by a second client application executed on a second user equipment, allowing a contributing user to make a first contribution to said theme with respect to a first portion of the theme media content; by said second client application, contributing to said theme The server application sends at least one request, the at least one request is used to register the first associated data representing the first contribution, wherein the first associated data represents the first part of the subject media content and at least one first contribution an association between media content, said at least one first contributed media content being selected to form said first contribution; by a third client application executed on a user device of a receiving user, receiving from said server application comprising the first a contribution rendering data associated with data, and rendering said first contribution by said third client application by rendering (rendering) first combined media content, said first combined media content being rendered by said first A combination of at least a portion of the contributed media content and the first portion of the subject media content results.

在至少一个实施方式中,该方法还包括由第二或第三客户端应用从服务器应用接收第一访问数据,所述第一访问数据用于经由远程媒体服务器从用户设备访问主题媒体内容。在至少一个实施方式中,主题媒体内容是由在所述第一用户设备上执行的源应用提供的媒体内容,并且第一访问数据包括源应用的标识和用于从源应用获得主题媒体内容的至少一个应用参数。在至少一个实施方式中,主题媒体内容是可经由网络(web)服务器访问的网页,并且第一访问数据包括经由所述网络服务器到所述网页的超文本链接。In at least one embodiment, the method further includes receiving, by the second or third client application, from the server application first access data for accessing the subject media content from the user device via the remote media server. In at least one embodiment, the subject media content is media content provided by a source application executed on the first user equipment, and the first access data includes an identification of the source application and an ID for obtaining the subject media content from the source application. At least one application parameter. In at least one embodiment, the subject media content is a web page accessible via a web server, and the first access data includes a hypertext link to the web page via the web server.

根据另一方面,本公开涉及一种用户设备,包括处理器、可操作地耦合到处理器的存储器,所述存储器包括配置成与服务器应用通信的客户端应用的指令,所述指令包括指令用以向所述服务器应用发送至少一个请求,所述至少一个请求用于将媒体内容注册为若干用户之间的媒体内容交换的主题;允许贡献用户相对于主题媒体内容的第一部分对所述主题做出第一贡献;向所述服务器应用发送至少一个请求,所述至少一个请求用于注册表示所述第一贡献的第一关联数据,其中所述第一关联数据表示所述主题媒体内容的所述第一部分与至少一个第一贡献媒体内容之间的关联,所述至少一个第一贡献媒体内容被选择来形成所述第一贡献;从所述服务器应用接收表示第二贡献的贡献再现数据;通过渲染第一组合媒体内容,来再现所述第二贡献,所述第一组合媒体内容由第二贡献媒体内容的至少一部分与所述主题媒体内容的第二部分的组合产生。According to another aspect, the present disclosure relates to a user device comprising a processor, a memory operatively coupled to the processor, the memory comprising instructions of a client application configured to communicate with a server application, the instructions comprising instructions for To send at least one request to the server application, the at least one request is used to register the media content as a theme of media content exchange between several users; allow the contributing user to make contributions to the theme with respect to the first part of the theme media content making a first contribution; sending at least one request to the server application, the at least one request being used to register first associated data representing the first contribution, wherein the first associated data represents all of the subject media content An association between the first portion and at least one first contributed media content selected to form the first contribution; receiving contribution rendering data representing a second contribution from the server application; The second contribution is rendered by rendering first combined media content resulting from a combination of at least a portion of the second contributed media content and a second portion of the subject media content.

根据另一方面,本公开涉及包括处理器、可操作地耦合到处理器的存储器的系统,所述存储器包括配置成与至少一个客户端应用通信的服务器应用的指令,所述指令包括指令用以:根据在发起用户的用户设备上执行的第一客户端应用的请求将媒体内容注册为若干用户之间的媒体内容交换的主题;经在贡献用户的用户设备上执行的第二客户端应用的请求,注册第一关联数据,所述第一关联数据表示相对于所述主题媒体内容的第一部分、对所述主题的第一贡献,其中所述第一关联数据表示所述主题媒体内容的所述第一部分与至少一个第一贡献媒体内容之间的关联,所述至少一个第一贡献媒体内容被选择以形成所述第一贡献;向在接收用户的用户设备上执行的第三客户端应用,发送贡献再现数据,所述贡献再现数据包括所述第一关联数据,所述贡献再现数据使得能够由所述第三客户端应用再现所述第一贡献,所述再现包括渲染第一组合媒体内容,所述第一组合媒体内容由所述第一贡献媒体内容的至少一部分与所述主题媒体内容的所述第一部分的组合产生。According to another aspect, the present disclosure is directed to a system including a processor, a memory operatively coupled to the processor, the memory including instructions for a server application configured to communicate with at least one client application, the instructions including instructions to : media content is registered as the subject of media content exchange between several users according to the request of the first client application executed on the user equipment of the initiating user; via the second client application executed on the user equipment of the contributing user request, to register first associated data representing a first contribution to said subject with respect to a first portion of said subject media content, wherein said first associated data represents all of said subject media content an association between said first portion and at least one first contributed media content selected to form said first contribution; to a third client application executed on a user device of a receiving user , sending contribution rendering data comprising the first associated data, the contribution rendering data enabling rendering of the first contribution by the third client application, the rendering comprising rendering of the first combined media content, the first combined media content resulting from a combination of at least a portion of the first contributed media content and the first portion of the subject media content.

根据另一方面,本公开涉及存储计算机可执行指令的计算机可读存储介质,所述计算机可执行指令包括被配置成与服务器应用通信的客户端应用的指令,所述指令包括指令用以:向所述服务器应用发送将媒体内容注册为若干用户之间的媒体内容交换的主题的至少一个请求;允许贡献用户相对于主题媒体内容的第一部分对所述主题做出第一贡献;向所述服务器应用发送至少一个请求,所述至少一个请求用于注册表示所述第一贡献的第一关联数据,其中所述第一关联数据表示所述主题媒体内容的所述第一部分与至少一个第一贡献媒体内容之间的关联,所述至少一个第一贡献媒体内容被选择来形成所述第一贡献;从所述服务器应用接收表示第二贡献的贡献再现数据;以及通过渲染第一组合媒体内容,来再现所述第二贡献,所述第一组合媒体内容由第二贡献媒体内容的至少一部分与所述主题媒体内容的第二部分的组合产生。According to another aspect, the present disclosure relates to a computer-readable storage medium storing computer-executable instructions, the computer-executable instructions including instructions of a client application configured to communicate with a server application, the instructions including instructions to: Described server application sends at least one request that media content is registered as the theme of the media content exchange between several users; Allow contributing user to make first contribution to described theme with respect to the first part of theme media content; To described server The application sends at least one request, the at least one request is used to register first association data representing the first contribution, wherein the first association data represents the first part of the subject media content and at least one first contribution an association between media content, the at least one first contributed media content being selected to form the first contribution; receiving contribution rendering data representing a second contribution from the server application; and by rendering the first combined media content, to render the second contribution, the first combined media content resulting from a combination of at least a portion of the second contributed media content and a second portion of the subject media content.

在至少一个实施方式中,媒体内容交换在包括发起用户、贡献用户和接收用户的讨论组环境中实现。在至少一个实施方式中,媒体内容交换是在媒体内容提供商的服务的环境中实现的。In at least one embodiment, media content exchange is implemented in a discussion group environment that includes originating users, contributing users, and receiving users. In at least one embodiment, media content exchange is implemented within the context of a media content provider's services.

在至少一个实施方式中,主题媒体内容和第一贡献媒体内容是视频内容,并且主题媒体内容的第一部分包括主题媒体内容的至少一个图像的组。In at least one embodiment, the subject media content and the first contributed media content are video content, and the first portion of the subject media content includes a set of at least one image of the subject media content.

附图说明Description of drawings

通过参考以下附图并结合所附说明书,本领域技术人员将更好地理解本公开,并且本公开的许多方面和优点将变得更加明显,其中:Those skilled in the art will better understand the present disclosure, and its many aspects and advantages will become more apparent, by referring to the following drawings in conjunction with the accompanying description, in which:

图1A是根据一个实施方式的用于共享媒体内容的系统的示意图;FIG. 1A is a schematic diagram of a system for sharing media content according to one embodiment;

图1B是根据一个实施方式的用户设备和计算服务器的示意图;Figure 1B is a schematic diagram of a user device and a computing server according to one embodiment;

图2A-2G分别示出了根据至少一个实施方式的示例性方法的流程图;2A-2G respectively illustrate a flowchart of an exemplary method according to at least one embodiment;

图3A-3D是根据示例实施方式的不同实体关系图。3A-3D are various entity relationship diagrams according to example embodiments.

图4示意性地表示说明一个实施方式的相关性图的示例;Figure 4 schematically represents an example of a dependency graph illustrating an embodiment;

图5A-5C图示了所公开的实施方式的一些方面;5A-5C illustrate some aspects of the disclosed embodiments;

图6A-6I表示根据至少一个实施方式的用户界面;6A-6I represent user interfaces according to at least one embodiment;

图7A-7E表示根据至少一个实施方式的用户界面。7A-7E represent user interfaces according to at least one embodiment.

具体实施方式Detailed ways

本公开涉及一种用于在若干用户之间共享媒体内容的设备、系统和方法。本文公开了不同的实施方式。The present disclosure relates to an apparatus, system and method for sharing media content among several users. Various embodiments are disclosed herein.

用户之间媒体内容的共享或交换可以在不同的技术生态系统中实现:例如在消息服务、讨论组、媒体内容提供商或社交网络的环境中。The sharing or exchange of media content between users can be realized in different technological ecosystems: for example in the context of messaging services, discussion groups, media content providers or social networks.

当在消息服务的环境中实现讨论组时,参与媒体内容交换的用户可以是第一用户邀请的用户。当在媒体内容提供商的服务的环境中实现媒体内容交换时,可以访问媒体内容提供商的任何用户可以作为媒体内容交换的角色(part)参与。当在社交网络的环境中实现媒体内容交换时,可以例如选择与给定用户连接的一些或所有用户来定义作为媒体内容交换的角色(part)参与的用户组。When the discussion group is implemented in the context of the messaging service, the users participating in the exchange of media content may be the users invited by the first user. When a media content exchange is implemented in the context of a media content provider's services, any user who has access to the media content provider can participate as a part of the media content exchange. When implementing media content exchange in the context of a social network, it is possible, for example, to select some or all of the users connected to a given user to define a group of users participating as part of the media content exchange.

作为媒体内容交换的角色(part)参与的用户在此被称为参与用户。参与用户可以选择用于媒体内容交换的主题:选择主题媒体内容的用户在本文被称为发起用户。参与用户可以对所选主题做出贡献:做出贡献的用户在本文中被称为贡献用户。接收关于由另一用户选择的主题和/或关于由另一用户做出的贡献的信息数据的参与用户在此被称为接收用户。Users participating as part of media content exchange are referred to herein as participating users. Participating users may select topics for media content exchange: users who select topical media content are referred to herein as originating users. Participating users can contribute to selected topics: users who make contributions are referred to as contributing users in this paper. A participating user who receives informational data about a topic selected by another user and/or about a contribution made by another user is referred to herein as a receiving user.

发起用户选择媒体内容以形成用于媒体内容交换的主题。形成主题的媒体内容在本文被称为主题媒体内容。服务器应用通过存储代表主题的主题关联数据来注册主题。主题关联数据可以表示所选择的主题媒体内容和发起用户之间的关联。An initiating user selects media content to form a topic for media content exchange. Media content forming a theme is referred to herein as theme media content. Server applications register topics by storing topic-associated data representing them. The topic association data may represent the association between the selected topic media content and the originating user.

编码主题媒体内容的数据文件存储在媒体服务器上,以便作为交换的角色(Part)参与的用户可以访问。服务器应用存储访问数据,所述访问数据用于经由媒体服务器从用户设备访问主题媒体内容。媒体服务器可以是可通过网络从用户设备访问的远程媒体服务器。Data files encoding the subject media content are stored on the media server so as to be accessible to users participating as part of the exchange. The server application stores access data for accessing the subject media content from the user device via the media server. The media server may be a remote media server accessible from a user device over a network.

基于注册的主题关联数据,主题再现数据可以由服务器应用发送给参与用户,以便能够再现主题。Based on the registered theme association data, theme reproduction data can be sent by the server application to participating users to enable theme reproduction.

一个或多个参与用户可以通过添加一个或多个媒体内容来贡献,所述一个或多个媒体内容相对于主题媒体内容的一部分形成对所选主题的贡献。形成对主题的贡献的媒体内容在本文被称为贡献媒体内容。One or more participating users may contribute by adding one or more media content that form a contribution to the selected topic relative to a portion of the topical media content. Media content that forms a contribution to a topic is referred to herein as contributed media content.

服务器应用为用户的每个贡献注册表示贡献的贡献关联数据。贡献关联数据可以表示主题媒体内容的部分和贡献媒体内容之间的关联。The server application registers, for each contribution of the user, contribution-associated data representing the contribution. Contribution association data may represent associations between portions of subject media content and contributed media content.

贡献媒体内容的数据文件存储在媒体服务器上,以便参与交换的用户可以访问。服务器应用存储访问数据,所述访问数据用于经由媒体服务器从用户设备访问贡献媒体内容。媒体服务器可以是可通过网络从用户设备访问的远程媒体服务器。Data files of contributed media content are stored on media servers so that users participating in the exchange can access them. The server application stores access data for accessing contributed media content from user devices via the media server. The media server may be a remote media server accessible from a user device over a network.

基于贡献关联数据,服务器应用向参与用户的一个或多个用户设备发送贡献再现数据,以便能够再现相应的贡献。然后,可以基于从服务器应用获得的贡献再现数据,在接收用户的设备上再现用户的贡献。贡献再现数据可以包括主题媒体内容中已经做出贡献的部分的标识。该标识可以包括至少一个渲染坐标(rendering coordinate),相对于与主题媒体内容相关联的渲染坐标系的至少一个轴,所述至少一个渲染坐标定义渲染点。组合媒体内容由主题媒体内容的至少一部分和媒体内容的贡献的组合产生,基于所接收的主题媒体内容的部分的标识,可以渲染该组合媒体内容。Based on the contribution association data, the server application sends contribution reproduction data to one or more user devices of participating users in order to be able to reproduce the corresponding contribution. The user's contribution may then be rendered on the receiving user's device based on the contribution rendering data obtained from the server application. Contributed rendering data may include identification of portions of the subject media content that have been contributed. The identification may include at least one rendering coordinate defining a rendering point relative to at least one axis of a rendering coordinate system associated with the subject media content. Composite media content results from a combination of at least a portion of the subject media content and the contribution of the media content, the combined media content being rendered based on the received identification of the portion of the subject media content.

结果,对于每个贡献,不再需要从一个用户设备向其他每个用户设备发送修改后的主题媒体内容/贡献媒体内容,从而减少(或节省)网络带宽。形成讨论组的主题或对主题的贡献的媒体内容可以仅在参与用户的接收用户设备上上传一次,并且用户的贡献的再现可以由该接收用户设备基于接收的贡献再现数据来执行,例如,根据贡献用户指定的主题媒体内容的部分的标识(或渲染坐标)。As a result, for each contribution, it is no longer necessary to send the modified subject media content/contributed media content from one user device to every other user device, thereby reducing (or saving) network bandwidth. The media content that forms the topic of the discussion group or a contribution to the topic may be uploaded only once on the participating user's receiving user equipment, and rendering of the user's contribution may be performed by the receiving user equipment based on the received contribution rendering data, e.g., according to The identification (or rendering coordinates) of the portion contributing to the user-specified theme media content.

在至少一个实施方式中,通过将贡献用户的用户标识符与表示贡献用户的贡献的数据相关联地注册,以及通过将发起用户的用户标识符与表示主题的数据相关联地注册,来实现对不同用户的贡献的追踪。可以在用户设备上渲染用户的贡献的同时显示用户标识符。In at least one embodiment, registration of a contributing user's user identifier in association with data representing a contributing user's contributions, and by registering an initiating user's user identifier in association with data representing a topic Tracking of contributions by different users. The user identifier may be displayed while rendering the user's contribution on the user device.

主题的选择,对主题的贡献,媒体内容的选择、渲染和编辑可以在单个客户端应用的环境中执行。Selection of themes, contribution to themes, selection, rendering and editing of media content can be performed within the context of a single client application.

另外,主题媒体内容可以是3D内容、网页或由源应用提供的任何内容,因此为用户之间交换媒体内容提供了新的可能性。In addition, the subject media content can be 3D content, a web page or any content provided by the source application, thus providing new possibilities for exchanging media content between users.

对于本领域普通技术人员来说,本文公开的组件的其他优点和其他特征将变得更加明显。以下结合附图对某些优选实施方式的详细描述阐述了本主题技术的代表性实施方式,其中相同的附图标记表示相似的结构元件。Other advantages and other features of the assemblies disclosed herein will become more apparent to those of ordinary skill in the art. The following detailed description of certain preferred embodiments sets forth representative embodiments of the subject technology when taken in conjunction with the accompanying drawings, wherein like reference numerals indicate similar structural elements.

此外,应该清楚的是,本文的教导可以以多种形式体现,并且本文公开的任何特定结构和/或功能仅仅是代表性的。特别地,本领域技术人员将理解,本文公开的实施方式可以独立于任何其他实施方式来实现,并且可以以各种方式组合若干实施方式,并且可以以各种方式组合不同实施方式的一个或多个方面。In addition, it should be clear that the teachings herein can be embodied in a variety of forms and that any specific structure and/or function disclosed herein is representative only. In particular, those skilled in the art will appreciate that an embodiment disclosed herein may be implemented independently of any other embodiments, that several embodiments may be combined in various ways, and that one or more of different embodiments may be combined in various ways. aspect.

下面参考根据一个或多个示例性实施方式的方法、系统和计算机程序的功能、引擎、框图和流程图来描述本公开。每个所描述的功能、引擎、框图和流程图的块可以用硬件、软件、固件、中间件、微码或它们的任何适当组合来实现。如果以软件实现,则功能、引擎、框图和/或流程图的块可以通过计算机程序指令或软件代码来实现,所述计算机程序指令或软件代码可以通过计算机可读介质存储或传输,或者加载到通用计算机、专用计算机或其他可编程数据处理设备上以产生机器,使得在计算机或其他可编程数据处理设备上执行的计算机程序指令或软件代码创建用于实现本文描述的功能的装置。The present disclosure is described below with reference to functions, engines, block diagrams and flowcharts of methods, systems and computer programs according to one or more exemplary embodiments. Each of the described functions, engines, blocks of the block diagrams and flowcharts may be implemented in hardware, software, firmware, middleware, microcode, or any suitable combination thereof. If implemented in software, the functions, engines, blocks of the block diagrams and/or flowcharts may be implemented by computer program instructions or software codes, which may be stored or transmitted on a computer-readable medium, or loaded into A general purpose computer, a special purpose computer, or other programmable data processing equipment to create a machine such that computer program instructions or software code executed on the computer or other programmable data processing equipment create means for implementing the functions described herein.

计算机可读介质的实施方式包括但不限于计算机存储介质和通信介质,通信介质包括便于计算机程序从一个地方转移到另一个地方的任何介质。具体而言,执行本文描述的实施方式的软件指令或计算机可读程序代码可以全部或部分地临时或永久地存储在包括一个或多个存储介质的本地或远程存储设备的非暂时性计算机可读介质上。Embodiments of computer-readable media include, but are not limited to, computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. In particular, software instructions or computer-readable program codes that implement the embodiments described herein may be stored in whole or in part temporarily or permanently in a non-transitory computer-readable storage device including one or more storage media, either locally or remotely. on the medium.

如本文所使用的,计算机存储介质可以是可由计算机读取、写入或更一般地访问的任何物理介质。计算机存储介质的示例包括但不限于闪存驱动器或其他闪存设备(例如,存储器密钥、存储棒、密钥驱动器)、CD-ROM或其他光存储器、DVD、磁盘存储器或其他磁存储设备、固态存储器、存储器芯片、RAM、ROM、EEPROM、智能卡、关系数据库管理系统(RDBMS)、传统数据库、或可用于携带或存储计算机处理器可读取的指令或数据结构形式的程序代码的任何其他适当介质。此外,各种形式的计算机可读介质可用于向计算机传输或携带指令,包括路由器、网关、服务器或其他传输设备,其为有线的(同轴电缆、光纤、双绞线、DSL电缆)或无线的(红外、无线电、蜂窝、微波)。指令可以包括来自任何计算机编程语言的代码,包括但不限于汇编、C、C++、Basic、SQL、MySQL、HTML、PHP、Python、Java、Javascript等。As used herein, computer storage media can be any physical media that can be read, written, or more generally accessed by a computer. Examples of computer storage media include, but are not limited to, flash drives or other flash memory devices (e.g., memory keys, memory sticks, key drives), CD-ROMs or other optical storage, DVDs, magnetic disk storage or other magnetic storage devices, solid-state storage , memory chip, RAM, ROM, EEPROM, smart card, relational database management system (RDBMS), conventional database, or any other suitable medium that can be used to carry or store program code in the form of instructions or data structures readable by a computer processor. In addition, various forms of computer-readable media can be used to transmit or carry instructions to the computer, including routers, gateways, servers, or other transmission devices, whether wired (coaxial cable, optical fiber, twisted pair, DSL cable) or wireless (infrared, radio, cellular, microwave). Instructions may include code from any computer programming language, including but not limited to Assembly, C, C++, Basic, SQL, MySQL, HTML, PHP, Python, Java, Javascript, and the like.

现在转到附图,其中在若干视图中,相同的数字表示相同的部分,图1示出了其中可以实现本文描述的各种技术和技巧的示例的内容共享系统100。Turning now to the drawings, wherein like numerals represent like parts throughout the several views, FIG. 1 illustrates an example content sharing system 100 in which various techniques and techniques described herein may be implemented.

内容共享系统100包括一个或多个计算服务器103A-103G和多个用户设备104A-104C,它们通过网络105可操作地和通信地彼此耦合。Content sharing system 100 includes one or more computing servers 103A- 103G and a plurality of user devices 104A- 104C that are operatively and communicatively coupled to each other via network 105 .

网络105可以是任何数据传输网络,例如有线网络(同轴电缆、光纤、双绞线、DSL电缆等)或无线网络(无线电、红外、蜂窝、微波等)、局域网(LAN)、互联网(IAN)、城域网(MAN)或广域网(WAN),例如互联网、公共或专用网、虚拟专用网(VPN)、具有数据传输能力的电信网络、具有单个连接点的单个无线小区,例如Wifi或蓝牙小区等。Network 105 may be any data transmission network, such as a wired network (coaxial cable, fiber optics, twisted pair, DSL cable, etc.) or a wireless network (radio, infrared, cellular, microwave, etc.), local area network (LAN), Internet (IAN) , a Metropolitan Area Network (MAN) or a Wide Area Network (WAN) such as the Internet, a public or private network, a Virtual Private Network (VPN), a telecommunications network with data transmission capabilities, a single wireless cell with a single point of connection, such as a Wifi or Bluetooth cell Wait.

每个用户设备104A-104C可以实施为单个硬件设备,例如以台式个人计算机(PC)、膝上型计算机、个人数字助理(PDA)、智能电话的形式,或者可以被实现在通过(具有有线和/或无线段的)通信链路彼此连接的单独互连硬件设备上。Each user device 104A-104C may be implemented as a single hardware device, for example in the form of a desktop personal computer (PC), laptop computer, personal digital assistant (PDA), smartphone, or may be implemented on a and/or wireless segments) on separate interconnection hardware devices where communication links connect each other.

每个用户设备104A-104C通常在操作系统的控制下操作,并且执行或以其他方式依赖于各种计算机软件应用、组件、程序、对象、模块、数据结构等。Each user device 104A-104C typically operates under the control of an operating system and executes or otherwise relies on various computer software applications, components, programs, objects, modules, data structures, and the like.

如图1B示意性示出的,在一个或多个实施方式中,用户设备104A-104C包括处理单元110、存储器111、一个或多个计算机存储介质112以及诸如输入/输出接口(例如,诸如USB接口等的设备接口,诸如以太网接口等网络接口)的其他相关硬件、和用于读取和写入一个或多个计算机存储介质112的介质驱动器113。As shown schematically in FIG. 1B , in one or more implementations, user devices 104A- 104C include a processing unit 110, a memory 111, one or more computer storage media 112, and input/output interfaces such as, for example, USB interface, etc., other related hardware such as a network interface such as an Ethernet interface), and a media drive 113 for reading and writing to one or more computer storage media 112 .

用户设备104A-104C的存储器111可以是随机存取存储器(RAM)、高速缓冲存储器、非易失性存储器、备份存储器(例如,可编程或快闪存储器)、只读存储器或其任意组合。用户设备104A-104C的处理单元110可以是包括至少一个基于硬件的处理器或处理核心的任何合适的微处理器、集成电路或中央处理单元(CPU)。The memory 111 of the user devices 104A-104C may be random access memory (RAM), cache memory, non-volatile memory, backup memory (eg, programmable or flash memory), read-only memory, or any combination thereof. The processing unit 110 of the user devices 104A-104C may be any suitable microprocessor, integrated circuit or central processing unit (CPU) including at least one hardware-based processor or processing core.

在一个或多个实施方式中,用户设备104A-104C的一个或多个计算机存储介质112可以包含计算机程序指令,该计算机程序指令在由处理单元110执行时,使得用户设备104A-104C执行本文针对用户设备104A-104C描述的一个或多个方法。用户设备104A-104C的处理单元110可以被配置为访问所述一个或多个计算机存储介质112,用于存储、读取和/或加载计算机程序指令或软件代码,当由处理器执行时,所述计算机程序指令或软件代码使得处理器执行本文针对用户设备104A-104C描述的方法的步骤。用户设备104A-104C的处理单元110可以被配置为在执行本文针对用户设备104A-104C描述的方法的步骤时使用用户设备104A-104C的存储器111,例如用于加载计算机程序指令和用于存储在执行计算机程序指令期间生成的数据。In one or more implementations, the one or more computer storage media 112 of the user devices 104A-104C may contain computer program instructions that, when executed by the processing unit 110, cause the user devices 104A-104C to perform the tasks described herein. One or more methods described by user equipment 104A-104C. The processing unit 110 of the user equipment 104A-104C may be configured to access the one or more computer storage media 112 for storing, reading and/or loading computer program instructions or software code which, when executed by the processor, The computer program instructions or software codes described above cause the processor to perform the steps of the methods described herein for the user equipment 104A-104C. The processing unit 110 of the user equipment 104A-104C may be configured to use the memory 111 of the user equipment 104A-104C when performing the steps of the methods described herein for the user equipment 104A-104C, for example for loading computer program instructions and for storing in Data generated during the execution of computer program instructions.

每个用户设备104A-104C通常还接收用于在外部传送信息的若干输入和输出。对于与用户101A-101C或操作员的界面,用户设备104A-104C通常包括用户界面114,用户界面114包括一个或多个用户输入/输出设备,例如键盘、定点设备、显示器、打印机等。另外,可以例如通过耦合到网络105的网络接口从一个或多个外部计算机(例如,一个或多个用户设备104A-104C或其他计算服务器103A-103G)接收用户输入。Each user device 104A-104C typically also receives several inputs and outputs for communicating information externally. For interfacing with users 101A-101C or operators, user devices 104A-104C typically include a user interface 114 that includes one or more user input/output devices, such as keyboards, pointing devices, displays, printers, and the like. Additionally, user input may be received from one or more external computers (eg, one or more user devices 104A- 104C or other computing servers 103A- 103G ), eg, through a network interface coupled to network 105 .

返回图1A,每个计算服务器103A-103G可以实施为单个硬件设备,或者可以实现在通过(具有有线和/或无线段的)通信链路彼此连接的单独互连硬件设备上。每个计算服务器103A-103G可以在云计算环境中实施。Returning to FIG. 1A, each computing server 103A-103G may be implemented as a single hardware device, or may be implemented on separate interconnected hardware devices connected to each other by communication links (with wired and/or wireless segments). Each computing server 103A-103G may be implemented in a cloud computing environment.

在至少一个实施方式中,计算机服务器组103A-103G包括至少三个媒体服务器103A-103C、数据库服务器103D、前端服务器103E、处理服务器103F和消息服务器103G。In at least one embodiment, computer server group 103A-103G includes at least three media servers 103A-103C, database server 103D, front-end server 103E, processing server 103F, and message server 103G.

每个计算服务器103A-103G通常在操作系统的控制下操作,并且执行或以其他方式依赖于各种计算机软件应用、组件、程序、对象、模块、数据结构等。Each computing server 103A-103G typically operates under the control of an operating system and executes or otherwise relies on various computer software applications, components, programs, objects, modules, data structures, and the like.

如图1B示意性所示在一个或多个实施方式中,计算服务器103A-103G包括处理单元120、存储器121、一个或多个计算机存储介质122以及诸如输入/输出接口(例如,诸如USB接口等的设备接口、以太网接口等网络接口)等其他相关联的硬件和用于读取和写入一个或多个计算机存储介质122的介质驱动器123。As shown schematically in FIG. 1B , in one or more implementations, computing servers 103A-103G include a processing unit 120, a memory 121, one or more computer storage media 122, and input/output interfaces such as, for example, USB interfaces, etc. device interface, network interface such as Ethernet interface) and other associated hardware and a media drive 123 for reading and writing one or more computer storage media 122.

计算服务器103A-103G的存储器121可以是随机存取存储器(RAM)、高速缓冲存储器、非易失性存储器、备份存储器(例如,可编程或快闪存储器)、只读存储器或其任意组合。计算服务器103A-103G的处理单元120可以是包括至少一个基于硬件的处理器或处理核心的任何合适的微处理器、集成电路或中央处理单元(CPU)。The memory 121 of the computing servers 103A-103G may be random access memory (RAM), cache memory, non-volatile memory, backup memory (eg, programmable or flash memory), read-only memory, or any combination thereof. The processing unit 120 of the computing servers 103A-103G may be any suitable microprocessor, integrated circuit or central processing unit (CPU) including at least one hardware-based processor or processing core.

在一个或多个实施方式中,计算服务器103A-103G的一个或多个计算机存储介质122可包含计算机指令,当由处理单元120执行时,所述计算机指令使得计算服务器103A-103G执行本文针对计算服务器103A-103G描述的一个或多个方法。计算服务器103A-103G的处理单元120可以被配置为访问所述一个或多个计算机存储介质122的用于存储、读取和/或加载计算机程序指令或软件代码,当由处理器执行时,所述计算机程序指令或软件代码使得处理器执行本文针对计算服务器103A-103G描述的方法的步骤。计算服务器103A-103G的处理单元120可以被配置为在执行本文针对计算服务器103A-103G描述的方法的步骤时,使用计算服务器103A-103G的存储器121,例如用于加载计算机程序指令和用于存储在执行计算机程序指令期间生成的数据。In one or more implementations, one or more computer storage media 122 of computing servers 103A-103G may contain computer instructions that, when executed by processing unit 120, cause computing servers 103A-103G to perform the computing One or more methods described by servers 103A-103G. The processing unit 120 of the computing servers 103A-103G may be configured to access the one or more computer storage media 122 for storing, reading and/or loading computer program instructions or software code which, when executed by the processor, The computer program instructions or software codes cause the processor to perform the steps of the methods described herein for the computing servers 103A-103G. The processing unit 120 of the computing server 103A-103G may be configured to use the memory 121 of the computing server 103A-103G, for example, for loading computer program instructions and for storing Data generated during the execution of computer program instructions.

每个用户设备104A-104C通过网络105可操作地连接到一个或多个计算服务器103A-103G。每个用户设备104A-104C被配置为通过至少一个通信链路与计算服务器103A-103G中的至少一个通信。Each user device 104A- 104C is operatively connected to one or more computing servers 103A- 103G through the network 105 . Each user device 104A-104C is configured to communicate with at least one of the computing servers 103A-103G via at least one communication link.

在一个或多个实施方式中,每个用户设备104A-104C执行客户端软件应用106(也称为“客户端应用106”)的计算机程序指令,当由用户设备的处理器执行时,该计算机程序指令使得处理器执行本文针对任何用户设备104A-104C描述的方法步骤。In one or more implementations, each user device 104A-104C executes computer program instructions of a client software application 106 (also referred to as "client application 106") which, when executed by a processor of the user device, The program instructions cause the processor to perform the method steps described herein for any user device 104A-104C.

在一个或多个实施方式中,在计算机服务器103E-103F中的至少一个上执行服务器软件应用107(也称为“服务器应用107”)的计算机程序指令,当由计算机服务器103E-103F中的一个的处理器执行时,该计算机程序指令使得该处理器执行本文针对计算机服务器103E-103F之一描述的方法步骤。In one or more embodiments, the computer program instructions of the server software application 107 (also referred to as "server application 107") are executed on at least one of the computer servers 103E-103F, when executed by one of the computer servers 103E-103F When executed by a processor of a computer, the computer program instructions cause the processor to perform the method steps described herein for one of the computer servers 103E-103F.

在一个或多个实施方式中,服务器应用107由前端服务器103E执行,前端服务器103E本身可操作地连接到计算机服务器103C、103D、103F和/或103G中的至少一个,用于实施本文针对服务器应用107描述的方法步骤。在至少一个实施方式中,处理服务器103F被用作前端服务器103E的辅助服务器,以根据前端服务器103E的请求,运行一些耗时的处理功能(例如媒体内容处理功能,诸如媒体转码功能、媒体内容格式解码、和/或编码等)。In one or more embodiments, server application 107 is executed by front-end server 103E, which is itself operatively connected to at least one of computer servers 103C, 103D, 103F, and/or 103G for implementing the server application 107 describes the method steps. In at least one embodiment, the processing server 103F is used as an auxiliary server of the front-end server 103E to run some time-consuming processing functions (such as media content processing functions, such as media transcoding functions, media content format decoding, and/or encoding, etc.).

客户端软件应用106和服务器软件应用107的每个实例被配置成可操作地彼此耦合,以通过至少一个通信链路以客户端/服务器模式通信。客户端软件应用106和服务器软件应用107之间的通信链路可以使用任何合适的通信协议。例如,可以使用基于HTTP(超文本传输)的协议,例如像SOAP(简单对象访问协议)这样的web服务通信协议。可以使用任何其他协议,例如专有协议(proprietary protocol)。Each instance of client software application 106 and server software application 107 is configured to be operatively coupled to each other to communicate in a client/server mode via at least one communication link. The communication link between client software application 106 and server software application 107 may use any suitable communication protocol. For example, an HTTP (Hypertext Transfer) based protocol such as a web service communication protocol like SOAP (Simple Object Access Protocol) may be used. Any other protocol, such as a proprietary protocol, may be used.

在一个或多个实施方式中,用户设备104A-104C的客户端应用106可操作地连接到服务器应用107,用于实现本文公开的用于共享媒体内容的方法的实施方式。客户端应用106包括用于通过消息与服务器应用107通信的计算机程序指令。在至少一个实施方式中,客户端应用106包括计算机程序指令,所述计算机程序指令用于生成、发送到服务器应用107以及用于接收和处理从服务器应用107接收到的消息。服务器应用107可以包括计算机程序指令用于与客户端应用106通信,所述计算机程序指令特别用于生成和发送到客户端应用106以及用于接收和处理从客户端应用106接收到的消息。In one or more implementations, the client application 106 of the user devices 104A- 104C is operatively connected to the server application 107 for implementing implementations of the methods for sharing media content disclosed herein. Client application 106 includes computer program instructions for communicating with server application 107 via messages. In at least one implementation, the client application 106 includes computer program instructions for generating, sending to, and receiving and processing messages received from the server application 107 . The server application 107 may include computer program instructions for communicating with the client application 106 , particularly for generating and sending to the client application 106 and for receiving and processing messages received from the client application 106 .

由服务器应用107或分别由客户端应用106发送的消息可以是包括与若干用户101A-101C之间的媒体内容交换相关的数据的消息,例如与用户相关的数据、与媒体内容相关的数据、与媒体内容交换的主题相关的数据、与用户在媒体内容交换的环境中做出的贡献相关的消息。服务器应用107或客户端应用106发送的消息可以是任何类型的消息:消息、请求、信息消息、具有用户生成的内容或计算机生成的内容的消息等。The messages sent by the server application 107 or respectively by the client application 106 may be messages comprising data related to the exchange of media content between the several users 101A-101C, such as user-related data, media content-related data, Data related to the subject of media content exchange, messages related to contributions made by users in the context of media content exchange. The message sent by the server application 107 or the client application 106 may be any type of message: a message, a request, an information message, a message with user-generated content or computer-generated content, etc.

每个媒体服务器103A-103C可操作地耦合到用于存储媒体内容的一个或多个媒体内容数据库102A-102C。每个媒体服务器103A-103C提供用于接收和处理数据请求的接口,所述数据请求用于存储在一个媒体内容数据库102A-102C中的媒体内容,所述数据请求为例如用于将媒体内容存储在一个媒体内容数据库102A-102C中的请求,以及用于检索、搜索、修改存储在一个媒体内容数据库102A-102C中的媒体内容的请求。Each media server 103A-103C is operatively coupled to one or more media content databases 102A-102C for storing media content. Each media server 103A-103C provides an interface for receiving and processing data requests for media content stored in a media content database 102A-102C, such as for storing media content Requests in a media content database 102A-102C, and requests for retrieving, searching, and modifying media content stored in a media content database 102A-102C.

每个媒体服务器103A-103C可以是任何web服务器应用、远程服务器应用、云中的存储服务器,或者更一般地是被配置为存储和检索媒体内容并处理来自远程设备的上载请求(或下载请求)以上载(或下载)一个或多个媒体内容的任何软件应用。例如,媒体服务器103A是可从所有用户设备104A-104C通过因特网访问的web服务器,媒体服务器103B是云计算环境中的媒体服务器,其仅可由用户设备104A-104C之一访问。Each media server 103A-103C may be any web server application, remote server application, storage server in the cloud, or more generally configured to store and retrieve media content and handle upload requests (or download requests) from remote devices Any software application for uploading (or downloading) one or more pieces of media content. For example, media server 103A is a web server accessible from all user devices 104A-104C over the Internet, and media server 103B is a media server in a cloud computing environment that is only accessible by one of user devices 104A-104C.

在至少一个实施方式中,媒体服务器103C可以被实现为内容递送网络(CDN),用于存储不仅必须从前端服务器103E获得的内容,而且存储从任何用户设备104A-104C获得的内容。当该媒体内容必须能够从每个用户设备104A-104C访问时,媒体服务器103C用于存储媒体内容,该媒体内容存储在用户设备104A-104C之一或媒体服务器103A-103B之一上。In at least one embodiment, media server 103C may be implemented as a content delivery network (CDN) for storing content that must be obtained not only from front-end server 103E, but from any user device 104A-104C. When the media content must be accessible from each user device 104A-104C, the media server 103C is used to store the media content, either on one of the user devices 104A-104C or on one of the media servers 103A-103B.

在本公开的上下文中,媒体内容可以包括视频内容、音频内容、文本内容、图像内容、图形内容或其任意组合,例如网页或多媒体内容。视频内容可以是3D内容、立体3D视频内容、2D视频内容、独立编码图像的列表等。音频内容可以包括单声道音频内容、立体声音频内容、3D音频内容等。媒体内容可以以任何格式编码,包括例如JPEG、TIFF、MPEG、WAV、DOC、HTM、OBJ、DAE、FBX、DXF、X3D、MOV()等。In the context of the present disclosure, media content may include video content, audio content, text content, image content, graphic content or any combination thereof, such as web pages or multimedia content. The video content may be 3D content, stereoscopic 3D video content, 2D video content, a list of independently encoded images, and the like. Audio content may include monaural audio content, stereo audio content, 3D audio content, and the like. Media content can be encoded in any format including, for example, JPEG, TIFF, MPEG, WAV, DOC, HTM, OBJ, DAE, FBX, DXF, X3D, MOV ( )Wait.

媒体内容数据可以被编码在一个或多个数据文件中。例如,视频内容可以被编码为图像组,每个图像被编码在单独的数据文件中。Media content data may be encoded in one or more data files. For example, video content may be encoded as groups of pictures, with each picture encoded in a separate data file.

在一个或多个实施方式中,使用媒体内容上的一个或多个渲染点(renderingpoints)。媒体内容上的渲染点可以由相对于与该媒体内容关联的渲染坐标系的至少一个渲染坐标的集合来定义。在一个或多个实施方式中,渲染点定义媒体内容的该部分(片段、摘录或媒体子集)上的用户视图。在一个或多个实施方式中,渲染点标识媒体内容的该特定部分。媒体内容的该特定部分可以例如从要为用户渲染的媒体内容中提取。In one or more implementations, one or more rendering points on the media content are used. A rendering point on media content may be defined by a set of at least one rendering coordinate relative to a rendering coordinate system associated with the media content. In one or more implementations, the rendering point defines the user's view on the portion (segment, excerpt, or media subset) of the media content. In one or more implementations, the rendering point identifies the particular portion of the media content. This particular portion of media content may, for example, be extracted from the media content to be rendered for the user.

在一个或多个实施方式中,渲染点定义该媒体内容的渲染可以开始的开始位置。在一个或多个实施方式中,渲染点标识从该开始位置开始的媒体内容的一部分。该渲染点可以由用户选择,并且媒体内容的相应部分可以被渲染。In one or more implementations, a rendering point defines a starting location at which rendering of the media content can begin. In one or more implementations, a rendering point identifies a portion of the media content that begins at the start location. This rendering point can be selected by the user, and the corresponding portion of the media content can be rendered.

在至少一个实施方式中,开始位置是相对于渲染坐标系的时间轴的时间坐标,并且媒体内容的部分是从该时间坐标开始的媒体内容的至少一个用户视图的集合。In at least one embodiment, the start position is a time coordinate relative to the time axis of the rendering coordinate system, and the portion of the media content is a collection of at least one user view of the media content starting at this time coordinate.

在至少一个实施方式中,开始位置是相对于渲染坐标系的一维、二维或三维坐标系的空间坐标,并且媒体内容的部分是从该空间坐标开始的媒体内容页面的区域。In at least one embodiment, the starting position is a spatial coordinate of a one-dimensional, two-dimensional or three-dimensional coordinate system relative to the rendering coordinate system, and the portion of the media content is the region of the media content page starting from the spatial coordinate.

当媒体内容是“视觉内容”(例如,视频内容、图像内容、图形内容、文本内容等)时,且可以定义视觉内容上特定视图。因此,渲染点在本公开中也将被称为包括视频和音频内容的所有类型内容的“视点”(view point或point of view)或POV。When the media content is "visual content" (eg, video content, image content, graphic content, text content, etc.), and specific views on the visual content may be defined. Therefore, a rendering point will also be referred to as a "view point" (or point of view) or POV in this disclosure for all types of content including video and audio content.

渲染点的不同示例在下面给出。Different examples of rendering points are given below.

例如,作为视频内容的媒体内容上的渲染点可以由图像标识符(图像编号、时间码或任何其他标识符)来定义,因此媒体内容的部分是由该图像标识符标识的图像。在这样的示例中,相关联的渲染坐标系是三维(3D)坐标系,包括定义图像编号或时间码的时间轴。因此,图像标识符定义了相对于该时间轴的开始位置。For example, a rendering point on media content that is video content may be defined by an image identifier (image number, timecode, or any other identifier), so that a portion of the media content is an image identified by the image identifier. In such examples, the associated rendering coordinate system is a three-dimensional (3D) coordinate system, including a time axis defining image numbers or timecodes. Thus, the image identifier defines the starting position relative to this time axis.

例如,作为视频内容的媒体内容上的渲染点可以由两个图像标识符定义,该媒体内容的部分是由第一图像标识符标识的第一图像和由第二图像标识符标识的第二图像之间的图像序列。在这样的示例中,相关联的渲染坐标系是3D坐标系,该3D坐标系包括定义图像编号或时间码的时间轴。For example, a rendering point on media content that is video content may be defined by two image identifiers, a portion of the media content being a first image identified by a first image identifier and a second image identified by a second image identifier sequence of images between. In such examples, the associated rendering coordinate system is a 3D coordinate system that includes a time axis defining image numbers or timecodes.

例如,作为场景3D内容的媒体内容上的渲染点可以由时间坐标(开始位置、时间码或任何其他标识符)和至少一个相机位置(例如,相机在对应于相机获取的场景的三维空间中的坐标)来定义,因此,该媒体内容的部分是由该时间坐标和该相机位置标识的视图。在这样的示例中,相关联的渲染坐标系是四维(4D)渲染坐标系,该四维(4D)渲染坐标系包括定义图像编号(即视频内容中的时间位置)的时间轴和用于定义相机位置的3D坐标系。For example, a rendering point on media content that is 3D content of a scene can be defined by a time coordinate (start position, timecode, or any other identifier) and at least one camera position (e.g., the position of the camera in the three-dimensional space corresponding to the scene captured by the camera). coordinates), so the portion of the media content is the view identified by the time coordinates and the camera position. In such an example, the associated rendering coordinate system is a four-dimensional (4D) rendering coordinate system that includes a time axis defining image numbers (ie temporal positions in the video content) and a The 3D coordinate system of the position.

例如,作为文本内容的媒体内容上的渲染点可以由一个或两个字符标识符(编码文本的字母数字序列中的字符编号或位置)来定义,该媒体内容的部分因此是包括在由第一字符标识符标识的第一字符和由第二字符标识符标识的第二字符之间的文本。在这样的示例中,相关联的渲染坐标系是标识字母数字序列中的字符的一维(1D)坐标系。字符标识符因此定义了相对于1D坐标系的起始位置。For example, a rendering point on media content that is text content may be defined by a one or two character identifier (character number or position in an alphanumeric sequence of coded text), the portion of the media content thus included in the first The text between the first character identified by the character identifier and the second character identified by the second character identifier. In such examples, the associated rendering coordinate system is a one-dimensional (1D) coordinate system that identifies characters in an alphanumeric sequence. The character identifier thus defines the starting position relative to the 1D coordinate system.

例如,作为音频内容的媒体内容上的渲染点可以由时间位置(时间码或时间)定义,该媒体内容的部分因此是从该时间位置开始的音频内容的一部分。在这样的示例中,相关联的渲染坐标系是与音频媒体内容的时间轴相对应的1D坐标系。For example, a rendering point on media content that is audio content may be defined by a time position (timecode or time), and a portion of the media content is thus a portion of the audio content starting from that time position. In such examples, the associated rendering coordinate system is a ID coordinate system corresponding to the time axis of the audio media content.

例如,作为图像的媒体内容上的渲染点可以由图像中的两个点来定义,该媒体内容的部分因此是子图像,所述子图像具有作为右上角的第一点和作为左下角的第二点。在这样的示例中,相关联的渲染坐标系是与图像的垂直轴和水平轴相对应的2D坐标系。这些点因此定义了相对于2D坐标系的开始位置。或者,可以使用单个点(例如左上角/右下角)和子图像的宽度和高度来定义该子图像。For example, a rendering point on media content that is an image may be defined by two points in the image, the portion of the media content thus being a sub-image with the first point as the upper right corner and the second point as the lower left corner. two points. In such examples, the associated rendering coordinate system is a 2D coordinate system corresponding to the vertical and horizontal axes of the image. These points thus define the starting position relative to the 2D coordinate system. Alternatively, the subimage can be defined using a single point (eg top left/bottom right) and the subimage's width and height.

例如,作为由web服务器提供的网页的媒体内容上的渲染点可以由页面中的两个点或页面区域的左上角/右上角以及该页面区域的宽度和高度来定义,该媒体内容的部分因此是所定义的页面区域。在这样的示例中,相关联的渲染坐标系是与网页的垂直轴和水平轴相对应的2D坐标系。这些点因此定义了相对于2D坐标系的开始位置。或者,可以使用单个点(例如左上角/右下角)和子图像的宽度和高度来定义该子图像。For example, a rendering point on media content that is a web page served by a web server may be defined by two points in the page or the top left/top right corners of the page area and the width and height of the page area, the portion of the media content thus is the defined page area. In such an example, the associated rendering coordinate system is a 2D coordinate system corresponding to the vertical and horizontal axes of the web page. These points thus define the starting position relative to the 2D coordinate system. Alternatively, the subimage can be defined using a single point (eg top left/bottom right) and the subimage's width and height.

例如,媒体内容是由诸如导航应用的源软件应用提供的图像内容,该媒体内容的渲染点可以由地理位置(例如,可以在GPS系统或其他地理定位系统中的一组地理坐标)来定义,该媒体内容的部分因此是由该导航应用为该地理位置生成的围绕该地理位置的地理区域的图像或表示。在这样的示例中,相关联的渲染坐标系是定位系统的2D或3D坐标系。For example, the media content is image content provided by a source software application such as a navigation application, the rendering point of the media content may be defined by a geographic location (e.g., a set of geographic coordinates that may be in a GPS system or other geographic positioning system), Part of the media content is thus an image or representation of a geographic area surrounding the geographic location generated by the navigation application for the geographic location. In such examples, the associated rendering coordinate system is the 2D or 3D coordinate system of the positioning system.

在一个或多个实施方式中,用户设备104A-104C的客户端应用106包括用于处理媒体内容的计算机程序指令。用于处理媒体内容的那些计算机程序指令可以包括用于实现多媒体播放器或渲染器的计算机程序指令,例如用于加载媒体内容的至少一部分到存储器以及渲染。例如,客户端应用106包括音频和/或视频播放器、图像查看器、文本阅读器、网页阅读器、3D阅读器、3D查看器等的至少一些功能。In one or more implementations, the client application 106 of the user devices 104A- 104C includes computer program instructions for processing media content. Those computer program instructions for processing media content may include computer program instructions for implementing a multimedia player or renderer, such as for loading at least a portion of media content into memory and rendering. For example, client application 106 includes at least some functionality of an audio and/or video player, image viewer, text reader, web page reader, 3D reader, 3D viewer, and the like.

在一个或多个实施方式中,用户设备104A-104C的客户端应用106包括用于实现媒体内容编辑器的计算机程序指令,从而使得用户能够创建和/或编辑至少一个媒体内容。例如,客户端应用106包括图像编辑器、视频编辑器、音频内容编辑器、文本编辑器、图形编辑器等的功能。In one or more implementations, the client application 106 of the user devices 104A- 104C includes computer program instructions for implementing a media content editor, thereby enabling a user to create and/or edit at least one media content. For example, client application 106 includes functionality of an image editor, video editor, audio content editor, text editor, graphics editor, and the like.

在至少一个实施方式中,用户设备104A-104C的客户端应用106包括计算机程序指令,用于获得滤波器参数并用于根据至少一个滤波器参数将滤波器应用于媒体内容。In at least one embodiment, the client application 106 of the user device 104A-104C includes computer program instructions for obtaining filter parameters and for applying a filter to media content based on at least one filter parameter.

在一个或多个实施方式中,用户设备104A-104C的客户端应用106包括计算机程序指令,用于获得组合参数和用于根据至少一个组合参数从至少两个媒体内容生成组合媒体内容。In one or more implementations, the client application 106 of the user devices 104A- 104C includes computer program instructions for obtaining combining parameters and for generating combined media content from at least two media contents based on the at least one combining parameter.

在一个或多个实施方式中,用户设备104A-104C的客户端应用106可操作地连接到一个或多个媒体服务器103A-103C,并且包括计算机程序指令,用于从远程媒体服务器103A-103C请求媒体内容、用于将一个或多个媒体内容上载到远程媒体服务器103A-103C以及用于从远程媒体服务器103A-103C下载一个或多个媒体内容。In one or more embodiments, the client application 106 of the user device 104A-104C is operatively connected to one or more media servers 103A-103C and includes computer program instructions for requesting media content, for uploading one or more media content to the remote media server 103A-103C and for downloading one or more media content from the remote media server 103A-103C.

数据库服务器103D可操作地耦合到一个或多个数据库102D,用于存储与媒体内容交换相关的数据。数据库服务器103D实施数据库管理系统(SQL、…)并且提供用于接收和处理对存储在数据库102D之一中的数据的数据请求的接口,例如用于存储、检索、搜索、修改存储在数据库102D之一中的数据的请求。Database server 103D is operatively coupled to one or more databases 102D for storing data related to media content exchange. The database server 103D implements a database management system ( SQL, . . . ) and provide an interface for receiving and processing data requests for data stored in one of the databases 102D, such as requests for storing, retrieving, searching, modifying data stored in one of the databases 102D.

在一个或多个实施方式中,数据库102D用于存储数据集,所述数据集表示与媒体内容交换相关的不同实体以及这些实体之间的关系。数据集可以是软件应用中的数据结构、面向对象软件环境中的对象、表示关系数据库软件实体的数据集等。In one or more implementations, the database 102D is used to store datasets representing different entities related to the exchange of media content and the relationships between these entities. A dataset may be a data structure in a software application, an object in an object-oriented software environment, a dataset representing a relational database software entity, and the like.

在一个或多个实施方式中,数据库102D用于存储关于用户101A-10C及它们的用户设备104A-104C的若干数据集。数据库102D用于存储表示用户101A-101C的用户账户的用户数据集和表示用户101A-101C使用的用户设备104A-104C的设备数据集。虽然图1A表示了一个用户仅用一个用户设备,每个用户101A-101C可以使用配置有客户端软件应用106的一个或多个用户设备来与服务器软件应用107通信。这些数据集用于控制用户对服务器应用107的访问,并用于识别给定用户在访问服务器应用107时所使用的设备。In one or more implementations, database 102D is used to store several data sets about users 101A-10C and their user devices 104A-104C. Database 102D is configured to store user data sets representing user accounts of users 101A-101C and device data sets representing user devices 104A-104C used by users 101A-101C. Although FIG. 1A shows a user with only one user device, each user 101A- 101C may use one or more user devices configured with client software application 106 to communicate with server software application 107 . These data sets are used to control user access to the server application 107 and to identify the device a given user is using to access the server application 107 .

在一个或多个实施方式中,用户数据集可以包括例如用户标识符、用户名、用户密码、创建时间、修改时间、访问时间等。用户标识符可以是用户电子邮件、字母数字串、图片等。用户标识符可用于唯一地标识用户账户。用户标识符可以由服务器应用107分配。用户账户可以是专用于客户端应用106和本文描述的共享内容的方法的用户账户,或者是在其中执行客户端应用106的环境中的另一软件应用的用户账户。在一个或多个实施方式中,设备数据集可以例如包括设备标识符、设备类型、操作系统标识、创建时间、修改时间和访问时间。In one or more implementations, user data sets may include, for example, user identifiers, usernames, user passwords, creation times, modification times, access times, and the like. A user identifier can be a user email, an alphanumeric string, a picture, etc. A user identifier may be used to uniquely identify a user account. The user identifier may be assigned by the server application 107 . The user account may be a user account dedicated to the client application 106 and the methods of sharing content described herein, or a user account of another software application in the environment in which the client application 106 executes. In one or more implementations, a device data set may include, for example, a device identifier, device type, operating system identification, creation time, modification time, and access time.

在一个或多个实施方式中,数据库102D用于存储关于用户之间的媒体内容交换的若干数据集。这些数据集可以以不同的方式组织和存储。这些数据集用于定义用户、媒体内容和用户组之间的关系和/或关联。这些数据集被关联地存储,用于编码和表示在参与一个或多个媒体内容交换的用户之间建立的一个或多个通信会话期间发生的事件。例如,存储用于表示媒体内容交换的主题的主题关联数据。例如,贡献关联数据被存储用于表示对媒体内容交换的贡献。主题关联数据是表示主题的关联数据,而贡献关联数据是表示对主题的贡献的关联数据。在至少一个实施方式中,这些事件至少包括用户组的创建、媒体内容交换的新主题的定义以及用户对媒体内容交换的主题的贡献。In one or more implementations, the database 102D is used to store several data sets regarding the exchange of media content between users. These datasets can be organized and stored in different ways. These datasets are used to define relationships and/or associations between users, media content, and groups of users. These data sets are stored associatively for encoding and representing events occurring during one or more communication sessions established between users participating in one or more exchanges of media content. For example, topic association data representing topics of media content exchange is stored. For example, contribution-associated data is stored to represent contributions to media content exchanges. Subject-linked data is linked data representing a subject, and contribution-linked data is linked data representing a contribution to a subject. In at least one embodiment, these events include at least creation of user groups, definition of new topics for media content exchange, and user contributions to topics for media content exchange.

在一个或多个实施方式中,数据库102D中的数据集包括用户组数据集、主题数据集、渲染点数据集、媒体内容数据集等。In one or more implementations, the data sets in the database 102D include user group data sets, theme data sets, rendering point data sets, media content data sets, and the like.

用户组数据集表示用户组,并且可以包括用户组标识符、创建时间和/或修改时间。创建(或修改)时间可以对应于创建(或修改)用户组数据集的时间,该时间根据通用时钟以时间戳的形式编码。A user group dataset represents a user group and may include a user group identifier, creation time and/or modification time. The creation (or modification) time may correspond to the time at which the user group dataset was created (or modified), encoded in the form of a timestamp according to the universal clock.

媒体内容数据集表示媒体内容,并且可以包括媒体内容标识符、内容类型和/或创建时间。创建时间可以对应于创建媒体内容数据集的时间,该时间根据通用时钟以时间戳的形式编码。另外,媒体内容数据集可以包括指定如何访问媒体内容的访问数据。访问数据可以包括媒体内容标识符、超文本链接( URL、统一资源定位器)、账户标识符、密码或其组合中的至少一个。媒体内容标识符可以是由媒体服务器媒体服务器103A-103C分配给媒体内容的唯一内容标识符,用于从该媒体服务器103A-103C请求媒体内容数据(例如,用于下载媒体内容)。A media content dataset represents media content and may include a media content identifier, content type, and/or creation time. The creation time may correspond to the time at which the media content dataset was created, encoded as a time stamp according to a universal clock. In addition, the media content data set may include access data specifying how to access the media content. Access data may include at least one of a media content identifier, a hypertext link (URL, Uniform Resource Locator), an account identifier, a password, or a combination thereof. The media content identifier may be a unique content identifier assigned to media content by a media server 103A-103C for requesting media content data from the media server 103A-103C (eg, for downloading media content).

渲染点数据集表示贡献(即的媒体内容上的形成主题的部分)的渲染点,并且渲染点数据集可以包括渲染点标识符、至少一个渲染坐标、创建时间和/或修改时间。创建(或修改)时间可以对应于创建(或修改)渲染点数据集的时间,该时间根据通用时钟以时间戳的形式编码。The render point dataset represents the render point of the contribution (ie the part on the media content that forms the theme), and the render point dataset may include a render point identifier, at least one render coordinate, a creation time and/or a modification time. The creation (or modification) time may correspond to the time at which the rendered point dataset was created (or modified), encoded in the form of a timestamp according to the universal clock.

主题数据集表示媒体内容交换的主题,并且可以包括主题标识符、主题类型、创建时间和/或修改时间。创建(或修改)时间可以对应于创建(或修改)主题数据集的时间,改时间根据通用时钟以时间戳的形式编码。A topic data set represents a topic of media content exchange and may include a topic identifier, topic type, creation time and/or modification time. The creation (or modification) time may correspond to the time at which the subject data set was created (or modified), encoded in the form of a timestamp according to the universal clock.

在一个或多个实施方式中,数据库102D用于注册不同数据集之间的关系:这些关系表示由这些数据集表示的实体之间的关系或关联。In one or more implementations, database 102D is used to register relationships between different datasets: these relationships represent relationships or associations between entities represented by those datasets.

在一个或多个实施方式中,本文针对用户设备104A-104C的客户端应用106描述的功能被集成到主机应用(host application)中。主机应用可以是消息应用,如Facebook等。主机应用可以是web应用,例如等社交网络web应用,或者等媒体内容提供商应用。本文描述的客户端应用106的功能可以由主机应用的插件、附加组件或一个或多个软件组件来实施。In one or more implementations, the functionality described herein for the client application 106 of the user device 104A- 104C is integrated into a host application. The host application can be a messaging application such as Facebook Wait. The host application can be a web application such as social networking web applications, or and other media content provider applications. The functionality of the client application 106 described herein may be implemented by a plug-in, add-on component, or one or more software components of the host application.

在至少一个实施方式中,主机应用被配置为与在消息服务器消息服务器103G上执行的消息服务器应用通信。In at least one embodiment, the host application is configured to communicate with a message server application executing on the message server message server 103G.

在一个或多个实施方式中,主机应用包括用于经由消息收发服务器103G实现消息会话(messaging sessions)的计算机程序指令。消息会话可以是即时消息会话、电子邮件消息会话、讨论组或其他形式的消息会话,无论同步还是异步。In one or more implementations, the host application includes computer program instructions for implementing messaging sessions via the messaging server 103G. A messaging session can be an instant messaging session, e-mail messaging session, discussion group, or other form of messaging session, whether synchronous or asynchronous.

在至少一个实施方式中,由消息服务器103G发送或接收的消息用于,从服务器应用107向用户设备104A-104C和/或从用户设备104A-104C向服务器应用107,发送与媒体内容交换有关的命令、数据和/或信息。In at least one embodiment, the messages sent or received by the message server 103G are used to send messages related to the exchange of media content from the server application 107 to the user equipment 104A-104C and/or from the user equipment 104A-104C to the server application 107. commands, data and/or information.

例如,消息服务器103G可以发送文本消息,包括由服务器应用107注册的用户组或主题的用户组标识符。在接收到该文本消息时,客户端应用106被配置为与服务器应用107建立通信会话,以便从服务器应用107接收消息,该消息为关于该用户组或该主题、用户组的用户和/或由服务器应用107与该主题相关联地注册的贡献媒体内容的消息。For example, message server 103G may send a text message including user group identifiers of user groups or topics registered by server application 107 . Upon receipt of the text message, the client application 106 is configured to establish a communication session with the server application 107 to receive a message from the server application 107 about the user group or topic, users of the user group and/or The server application 107 registers a message of contributing media content in association with the topic.

在一个或多个实施方式中,客户端应用106的用户界面被配置为向用户提供关于该用户组的信息,并且实现用于允许用户在保持在主机应用的环境中的同时对与用户组相关联的主题做出贡献的用户界面项。In one or more implementations, the user interface of the client application 106 is configured to provide the user with information about the user group, and is implemented to allow the user to view information related to the user group while remaining within the context of the host application. User interface items contributed to linked topics.

图2A-2G示出了根据用于在若干用户之间共享媒体内容的方法的一个或多个实施方式的流程图。尽管流程图中的各个步骤被顺序地呈现和描述,但是本领域技术人员将理解,一些或所有步骤可以以不同的顺序执行,可以组合或省略,并且一些或所有步骤可以并行执行。2A-2G illustrate flowcharts according to one or more implementations of a method for sharing media content among several users. Although various steps in the flowcharts are presented and described sequentially, those skilled in the art will understand that some or all steps may be performed in a different order, combined or omitted, and some or all steps may be performed in parallel.

图2A-2G说明用于在若干用户之间共享媒体内容的方法的若干方面和实施方式:用户组的注册、主题的注册、贡献的注册、媒体内容的注册和媒体内容的渲染。在至少一个实施方式中,参考图2A-2G描述的方法的步骤由客户端应用106或服务器应用107执行。2A-2G illustrate several aspects and implementations of methods for sharing media content among several users: registration of user groups, registration of topics, registration of contributions, registration of media content, and rendering of media content. In at least one embodiment, the steps of the method described with reference to FIGS. 2A-2G are performed by the client application 106 or the server application 107 .

更具体地,图2A示出了用于注册用户组的方法的一个实施方式。用户组可以例如对应于讨论组或消息应用中定义的任何用户组。More specifically, FIG. 2A illustrates one embodiment of a method for registering groups of users. A user group may eg correspond to a discussion group or any user group defined in a messaging application.

第一用户(或“发起用户”),例如用户101A想要与其他用户共享媒体内容。用户101A使用其配置有软件应用106的用户设备104A来注册讨论组。A first user (or "originating user"), such as user 101A, wants to share media content with other users. User 101A uses his user device 104A configured with software application 106 to register for a discussion group.

在步骤A201中,自动或由发起用户101A选择要被邀请到讨论组的一个或多个用户(本文也称为“受邀用户”)。客户端应用106的用户界面可以例如包括至少一个用户界面项,用于选择用户。例如,用户界面用于显示联系人列表,发起用户101A可以选择其中的一个或多个用户。联系人列表可以是由用户设备104A的操作系统管理的联系人的列表、通过客户端应用106创建的联系人的列表、或者通过另一客户端应用(例如消息服务器103G的客户端应用)创建的联系人的列表、或者由前端服务器103E创建和管理的联系人的列表。In step A201, one or more users (also referred to herein as "invited users") to be invited to the discussion group are selected automatically or by the initiating user 101A. The user interface of the client application 106 may, for example, include at least one user interface item for selecting a user. For example, the user interface is used to display a list of contacts, from which one or more users can be selected by the initiating user 101A. The contact list may be a list of contacts managed by the operating system of the user device 104A, a list of contacts created by the client application 106, or created by another client application, such as a client application of the messaging server 103G A list of contacts, or a list of contacts created and managed by the front-end server 103E.

发起用户101A在显示的联系人列表中选择一个或多个联系人,表示发起用户101A想要邀请到讨论组的用户,并且客户端应用106获得要邀请到讨论组的至少一个用户的列表。例如,用户101B和用户101C被邀请与发起用户101A一起参加讨论组。The initiating user 101A selects one or more contacts in the displayed contact list, indicating users that the initiating user 101A wants to invite to the discussion group, and the client application 106 obtains a list of at least one user to invite to the discussion group. For example, user 101B and user 101C are invited to participate in a discussion group with initiating user 101A.

在步骤A202中,用户设备104A的客户端应用106向服务器应用107发送至少一个请求,用于注册新创建的讨论组GR1。在一个或多个实施方式中,通过向讨论组GR1分配用户组标识符以及通过在数据库102D中创建和记录表示讨论组GR1的用户组数据集,服务器应用107执行讨论组的注册。In step A202, the client application 106 of the user equipment 104A sends at least one request to the server application 107 for registering the newly created discussion group GR1. In one or more implementations, the server application 107 performs the registration of the group GR1 by assigning a user group identifier to the group GR1 and by creating and recording a user group data set representing the group GR1 in the database 102D.

例如,如图3A的实体关系图示意性地表示,对于参与讨论组的每个用户,包括发起用户101A以及受邀用户101B和101C,表示参与用户101A-101C的用户数据集与用户组数据集相关联地存储在数据库102D中。For example, as shown schematically in the entity relationship diagram of Figure 3A, for each user participating in the discussion group, including the initiating user 101A and the invited users 101B and 101C, it represents the user data set and user group data set of the participating users 101A-101C Stored in association in database 102D.

在步骤A203中,用户设备104A的客户端应用106向服务器应用107发送至少一个请求,用于向数据库102D注册与讨论组相关的用户权限。用户权限可以例如基于默认值自动定义,或者由发起用户101A为每个受邀用户定义。例如,被邀请参加讨论组的不同用户可以具有不同级别的权限。In step A203, the client application 106 of the user device 104A sends at least one request to the server application 107 for registering the user rights associated with the discussion group with the database 102D. User permissions may be defined automatically, eg based on default values, or defined for each invited user by the initiating user 101A. For example, different users invited to a discussion group may have different levels of permissions.

在第一权限级别,受邀用户可以参与(例如,在讨论组的环境中查看和渲染用户之间交换的媒体内容),但不可以做出贡献。在第二级别,受邀用户可以做出贡献。在第二级别,受邀用户也可以邀请用户参加讨论组。默认情况下,可以将更完整的一组权限分配给发起用户101A。在第三级权限上,发起用户可以例如做出贡献、邀请用户参与讨论组、向参与用户分配权限级别、撤销权限、拒绝受邀用户等。At a first permission level, invited users can participate (eg, view and render media content exchanged between users in the context of a discussion group), but cannot contribute. At the second level, invited users can contribute. At the second level, invited users can also invite users to a discussion group. By default, a more complete set of permissions may be assigned to originating user 101A. At the third level of permissions, the initiating user can, for example, make contributions, invite users to participate in a discussion group, assign permission levels to participating users, revoke permissions, reject invited users, and the like.

在一个或多个实施方式中,通过为每个用户存储与表示用户组GR1的用户组数据集和表示参与用户的用户数据集相关联的权限级别信息,由服务器应用107执行用户权限的注册。In one or more embodiments, the registration of user permissions is performed by the server application 107 by storing, for each user, permission level information associated with a user group dataset representing user group GR1 and a user dataset representing participating users.

可替代得,使用由集成了客户端应用106的主机应用创建的现有讨论组。在该替代方案中,属于现有讨论组的每个用户的用户标识符由客户端应用106提供给服务器应用107,以便由服务器应用107将表示该讨论组的用户组数据集与表示属于该讨论组GR1的不同用户的用户数据集相关联地注册。Alternatively, an existing discussion group created by the host application integrating the client application 106 is used. In this alternative, the user identifier of each user belonging to an existing discussion group is provided by the client application 106 to the server application 107, so that the server application 107 associates the user group data set representing the discussion group with the user group data set representing the discussion group belonging to the discussion group. The user data sets of the different users of the group GR1 are registered in association.

图2B示出了一个注册用户组的方法的实施方式,所述用户组对应于访问媒体内容提供商的服务的用户。下面描述的步骤B201-B203可以执行多次,例如对于要注册的每个新用户。FIG. 2B shows an embodiment of a method for registering a user group corresponding to users accessing a service of a media content provider. Steps B201-B203 described below may be performed multiple times, eg for each new user to be registered.

第一用户(例如用户101A)想要访问在媒体内容提供商的服务的环境中发布的、或以其他方式可访问的媒体内容。例如,该服务可以是用于经由网站提供媒体内容的服务,其中在有或没有对该服务的订阅的时候,这些媒体内容可以由用户访问和查看。A first user (eg, user 101A) wants to access media content published or otherwise accessible in the context of a media content provider's service. For example, the service may be a service for providing media content via a website that can be accessed and viewed by a user with or without a subscription to the service.

在步骤B201中,服务器应用107从在用户设备104A上执行的客户端应用106接受请求,用于注册关于媒体内容交换的新用户101A。服务器应用107将用户标识符分配给用户101A,并为用户101A注册表示用户账户的用户数据集。可选地,用户101A可以指定用户101A想要接收通知和/或与其他用户共享内容的感兴趣的主题或域。In step B201, the server application 107 accepts a request from the client application 106 executing on the user equipment 104A to register a new user 101A for media content exchange. The server application 107 assigns a user identifier to the user 101A and registers a user data set representing the user account for the user 101A. Optionally, user 101A may specify a topic or domain of interest for which user 101A would like to receive notifications and/or share content with other users.

在步骤B202中,服务器应用107在数据库102D中注册用户101A的用户权限。用户权限可以例如基于默认值自动定义,或者可以依赖于订阅方案。例如,在第一级权限上,用户可以有权访问经由媒体内容提供商可用的媒体内容,但不能对于那些媒体内容做出贡献。在第二级,额外地,受邀请用户可以对经由媒体内容提供商可用的媒体内容做出贡献。在第三级权限,额外地,用户可以通过媒体内容提供商发布新的媒体内容。In step B202, the server application 107 registers the user authority of the user 101A in the database 102D. User permissions can be defined automatically based on default values, for example, or can depend on a subscription scheme. For example, at a first level of authority, a user may have access to media content available via a media content provider, but not be able to contribute to that media content. At a second level, additionally, invited users can contribute to media content available via a media content provider. In the third level of authority, additionally, the user can publish new media content through the media content provider.

在步骤B203中,当若干用户共享相同的感兴趣的域或者必须参与相同的媒体内容交换时,服务器应用107注册包括所有相关用户的用户组。通过向讨论组GR1分配用户组标识符,并且通过在数据库102D中创建和记录表示用户组GR1的用户组数据集,服务器应用107执行用户组的注册。属于用户组的用户的每个用户数据集进一步与用户组数据集相关联地存储。In step B203, when several users share the same domain of interest or must participate in the same media content exchange, the server application 107 registers a user group including all relevant users. The server application 107 performs registration of a user group by assigning a user group identifier to the discussion group GR1, and by creating and recording a user group data set representing the user group GR1 in the database 102D. Each user data set of users belonging to a user group is further stored in association with the user group data set.

根据在步骤B201的下一次执行时可能接收到的进一步注册请求,可以将新用户添加到用户组。According to further registration requests that may be received at the next execution of step B201, new users may be added to the user group.

图2C示出了用于在若干用户之间共享媒体内容的方法的一个实施方式。该方法可以在根据参照图2A和2B描述的用户组注册之前或之后实现。该方法可以例如在没有任何注册用户组的情况下实现。Figure 2C illustrates one embodiment of a method for sharing media content among several users. This method can be implemented before or after the registration of the user group according to that described with reference to Figures 2A and 2B. This method can eg be implemented without any registered user groups.

参照图2C,在步骤C210中,发起用户,例如用户101A,想要与参与媒体内容交换的其他用户共享媒体内容。用户设备104A-104C的客户端应用106使用适当的通信协议建立与服务器应用107的通信会话。Referring to FIG. 2C, in step C210, an initiating user, such as user 101A, wants to share media content with other users participating in media content exchange. The client application 106 of the user devices 104A-104C establishes a communication session with the server application 107 using an appropriate communication protocol.

在一个实施方式中,当用户设备104A-104C的客户端应用106与服务器应用107建立通信会话时,如果在定义主题、或做出贡献、或定义用户组时通信会话已经建立,则客户端应用106接收该客户端应用106应该接收的所有消息和数据。要发送到客户端应用106的消息和数据可以例如基于时间戳来确定,所述时间戳在注册主题、贡献、媒体内容、用户或用户组时,为服务器应用107存储在数据库102D中的不同数据集注册。在下面的详细描述中,为了简化不同实施方式的描述,假设参与用户的用户设备的客户端应用106当前经由网络105可操作地连接到服务器应用107,以便以同步方式接收消息和数据。In one embodiment, when a client application 106 of a user device 104A-104C establishes a communication session with a server application 107, if the communication session has already been established when defining a topic, or making a contribution, or defining a user group, the client application 106 receives all messages and data that the client application 106 should receive. The messages and data to be sent to the client application 106 can be determined, for example, based on the time stamps that are stored in the database 102D for the server application 107 when registering a topic, contribution, media content, user or user group. set registration. In the following detailed description, to simplify the description of the various embodiments, it is assumed that the client application 106 of the user equipment of the participating users is currently operatively connected to the server application 107 via the network 105 to receive messages and data in a synchronous manner.

在步骤C211中,用户设备104A的客户端应用106允许发起用户101A定义主题。用户设备104A的客户端应用106获得一个或多个媒体内容,所述一个或多个媒体内容将被用作媒体内容交换的主题TOP1。要用作主题的一个或多个媒体内容可以由用户101A从现有媒体内容中选择,或者可以由用户101A创建,例如作为现有内容或新生成的内容(图形、照片等)的组合的结果。用作媒体内容交换的主题的媒体内容将被注解为主题媒体内容TMC1。In step C211, the client application 106 of the user device 104A allows the initiating user 101A to define a topic. The client application 106 of the user device 104A obtains one or more media contents to be used as the topic TOP1 of the media content exchange. One or more media content to be used as a theme may be selected by user 101A from existing media content, or may be created by user 101A, for example as a result of a combination of existing content or newly generated content (graphics, photos, etc.) . The media content used as the subject of media content exchange will be annotated as subject media content TMC1.

在步骤C212中,一旦识别出一个或多个媒体内容TMC1,客户端应用106就向服务器应用107发送至少一个请求,以将一个或多个识别出的媒体内容TMC1注册为媒体内容交换的主题。In step C212, upon identifying the one or more media contents TMC1, the client application 106 sends at least one request to the server application 107 to register the one or more identified media contents TMC1 as the subject of media content exchange.

参照图2D进一步描述主题的注册。Registration of a subject is further described with reference to FIG. 2D.

在至少一个实施方式中,在接收到注册请求时,服务器应用107通过存储表示主题TOP1和/或主题媒体内容TMC1的主题关联数据AST1来注册主题TOP1。主题关联数据AST1A可以包括发起用户的用户标识符。可以为主题关联数据AST1存储对应于注册时间的时间戳。In at least one embodiment, upon receiving the registration request, the server application 107 registers the topic TOP1 by storing topic association data AST1 representing the topic TOP1 and/or the topic media content TMC1 . Topic association data AST1A may include a user identifier of the originating user. A time stamp corresponding to the registration time may be stored for the subject association data AST1.

如果用户组已经被服务器应用107注册用于媒体内容交换,则使用例如参考图2A或2B描述的方法的实施方式,主题TOP1与注册的用户组GR1相关联地被注册。If the user group is already registered by the server application 107 for media content exchange, the topic TOP1 is registered in association with the registered user group GR1 , using an implementation of the method such as described with reference to Fig. 2A or 2B.

在至少一个实施方式中,服务器应用107注册一个或多个识别的媒体内容,以使得编码主题媒体内容TMC1的数据文件可从参与用户101A-101C的任何用户设备104A-104C访问。例如,主题媒体内容TMC1被上载并存储在远程媒体服务器上,以便从用户设备访问。In at least one embodiment, the server application 107 registers the one or more identified media content such that the data files encoding the subject media content TMC1 are accessible from any of the user devices 104A-104C of the participating users 101A-101C. For example, topical media content TMC1 is uploaded and stored on a remote media server for access from a user device.

参照图2G进一步描述主题媒体内容TMC1的注册。The registration of the subject media content TMC1 is further described with reference to FIG. 2G.

在步骤C213中,在主题TOP1注册之后,服务器应用107向参与媒体内容交换的用户的用户设备的客户端应用106发送一个或多个消息。例如,参与用户的用户设备的客户端应用106接收一个或多个消息。一个或多个消息包括表示主题和/或主题媒体内容的主题再现数据,使得能够再现主题媒体内容。主题再现数据可以基于在步骤C212中注册的主题关联数据AST1来生成。例如,主题再现数据可以包括这些主题关联数据AST1的子集。主题再现数据可以包括编码主题媒体内容的数据文件和/或用于经由远程媒体服务器从用户设备访问主题媒体内容的访问数据。主题再现数据可以包括发起用户的用户标识符。主题再现数据可以包括由服务器应用107注册的用于媒体内容交换的用户组的组标识符。In step C213, after the topic TOP1 is registered, the server application 107 sends one or more messages to the client application 106 of the user devices of the users participating in the media content exchange. For example, a client application 106 of a user device of a participating user receives one or more messages. The one or more messages include theme rendering data representative of the theme and/or the theme media content, enabling rendering of the theme media content. The theme reproduction data can be generated based on the theme association data AST1 registered in step C212. For example, theme reproduction data may comprise a subset of these theme-associated data AST1. The themed rendering data may include data files encoding the themed media content and/or access data for accessing the themed media content from a user device via a remote media server. Theme reproduction data may include a user identifier of the originating user. The theme rendering data may include group identifiers of user groups registered by the server application 107 for media content exchange.

在步骤C214中,在接收到在步骤C213中发送的一条或多条消息后,参与用户的用户设备的客户端应用106被配置为经由远程媒体服务器访问主题媒体内容TMC1(在步骤C212中,通过该远程媒体服务器,主题媒体内容TMC1变为可访问),例如通过使用在步骤C213中发送的主题再现数据(例如访问数据)下载编码主题媒体内容TMC1的数据文件的至少一部分。参与用户的用户设备的客户端应用106被配置为在参与用户的用户设备的用户界面上渲染主题媒体内容TMC1的部分和/或全部。In step C214, after receiving one or more messages sent in step C213, the client application 106 of the user equipment of the participating user is configured to access the topic media content TMC1 via the remote media server (in step C212, via The remote media server, the subject media content TMC1 becomes accessible), for example downloads at least a part of the data file encoding the subject media content TMC1 by using the subject reproduction data (eg access data) sent in step C213. The client application 106 of the participating user's user equipment is configured to render part and/or all of the topical media content TMC1 on the user interface of the participating user's user equipment.

例如,主题媒体内容的至少一部分由在用户设备104B或104C上执行的客户端应用106渲染。在至少一个实施方式中,主题媒体内容TMC1的部分由用户101B或用户101C选择来渲染。例如,形成主题媒体内容TMC1的视频内容的第一部分将显示在用户设备104B或104C的用户界面上。For example, at least a portion of the subject media content is rendered by the client application 106 executing on the user device 104B or 104C. In at least one embodiment, a portion of the topical media content TMC1 is selected by user 101B or user 101C for rendering. For example, a first portion of the video content forming the subject media content TMC1 will be displayed on the user interface of the user device 104B or 104C.

在至少一个实施方式中,在渲染主题媒体内容TMC1之前、期间或之后,客户端应用106显示发起用户的用户标识符和/或参与媒体内容交换的一个或多个用户的用户标识符。In at least one embodiment, before, during, or after rendering of the topical media content TMC1 , the client application 106 displays the user identifier of the initiating user and/or the user identifiers of one or more users participating in the media content exchange.

步骤C214可以重复几次和/或可以在步骤C213之后或在步骤C218之后执行。Step C214 may be repeated several times and/or may be performed after step C213 or after step C218.

在步骤C215中,参与用户(例如用户101B或用户101A)的用户设备的客户端应用106允许参与用户通过选择主题媒体内容的部分并相对于主题媒体内容的所选部分对媒体内容交换的主题做出贡献,从而对媒体内容交换做出贡献。贡献用户101B或101A的用户设备的客户端应用106获得一个或多个媒体内容,所述一个或多个媒体内容将用作对媒体内容交换的主题的贡献。要用作贡献的一个或多个媒体内容可以从现有媒体内容中选择,或者可以由用户101A创建,例如作为现有内容或新生成的内容(图形、照片等)的组合的结果。用作对主题媒体内容的贡献的媒体内容将被注释为CMC11、CMC12、CMC21等。In step C215, the client application 106 of the user equipment participating in the user (for example, user 101B or user 101A) allows the participating user to make an action on the topic of the media content exchange by selecting a part of the topic media content and relative to the selected part of the topic media content. contribute to the exchange of media content. The client application 106 of the user device of the contributing user 101B or 101A obtains one or more media content to be used as a contribution to the topic of the media content exchange. One or more media content to be used as a contribution may be selected from existing media content, or may be created by user 101A, eg, as a result of a combination of existing content or newly generated content (graphics, photos, etc.). Media content used as a contribution to the subject media content will be annotated as CMC11, CMC12, CMC21, etc.

在至少一个实施方式中,客户端应用106允许贡献用户101B或101A为主题媒体内容TMC1的所选部分和/或贡献媒体内容CMC11、CMC12定义渲染参数。在至少一个实施方式中,客户端应用106允许贡献用户定义两个或多个贡献媒体内容之间的至少一个逻辑相关性。客户端应用106获得表示一个或多个逻辑相关性的渲染参数和/或逻辑相关性数据。In at least one embodiment, the client application 106 allows the contributing user 101B or 101A to define rendering parameters for selected portions of the topical media content TMC1 and/or contributing media content CMC11 , CMC12 . In at least one embodiment, the client application 106 allows a contributing user to define at least one logical dependency between two or more contributed media content. The client application 106 obtains rendering parameters and/or logical dependency data representing one or more logical dependencies.

步骤C215可以重复几次和/或可以在步骤C214之后、或步骤C212、C216或C218之后执行。Step C215 may be repeated several times and/or may be performed after step C214, or after steps C212, C216 or C218.

在步骤C216中,一旦一个或多个贡献媒体内容CMC11、CMC12已经被识别,贡献用户101B或101A的用户设备的客户端应用106向所述服务器应用发送至少一个注册贡献的请求。在至少一个实施方式中,所述请求包括相对于已做出贡献的主题媒体内容TMC1的部分的标识。在至少一个实施方式中,该标识包括渲染坐标POV1,该渲染坐标POV1标识主题媒体内容TMC1的所选部分。In step C216, once one or more contributed media content CMC11, CMC12 has been identified, the client application 106 of the user device of the contributing user 101B or 101A sends at least one request to register a contribution to said server application. In at least one embodiment, the request includes an identification relative to the portion of the contributed subject media content TMC1. In at least one embodiment, the identification includes rendering coordinates POV1 that identify the selected portion of the subject media content TMC1 .

在至少一个实施方式中,该请求包括在步骤C215获得的渲染参数和/或逻辑相关性数据。In at least one embodiment, the request includes the rendering parameters and/or logical dependency data obtained in step C215.

在至少一个实施方式中,在接收到注册请求时,服务器应用107通过存储表示贡献的贡献关联数据ASC1来注册贡献。In at least one embodiment, upon receiving a registration request, the server application 107 registers the contribution by storing contribution association data ASC1 representing the contribution.

在至少一个实施方式中,贡献关联数据ASC1表示主题媒体内容TMC1的所选部分和所选贡献媒体内容CMC11、CMC12之间的关联。贡献关联数据ASC1可以包括贡献用户的用户标识符。贡献关联数据ASC1可以包括在步骤C215获得的渲染参数和/或逻辑相关性数据。In at least one embodiment, the contribution association data ASC1 represents an association between the selected portion of the topical media content TMC1 and the selected contributed media content CMC11, CMC12. Contribution associated data ASC1 may include a user identifier of a contributing user. The contribution association data ASC1 may include the rendering parameters and/or logic association data obtained in step C215.

可以为贡献关联数据ASC1存储对应于注册时间的时间戳。在至少一个实施方式中,贡献关联数据ASC1与在步骤C212注册的主题关联数据AST1相关联地存储。A time stamp corresponding to the registration time may be stored for the contribution association data ASC1. In at least one embodiment, the contribution association data ASC1 is stored in association with the subject association data AST1 registered in step C212.

通过参考图2E进一步描述贡献的注册。Registration of contributions is further described by referring to FIG. 2E.

在至少一个实施方式中,服务器应用107注册一个或多个贡献媒体内容CMC11、CMC12,以使得可从参与用户101A-101C的任何用户设备104A-104C可以访问编码贡献媒体内容CMC11、CMC12的数据文件。例如,贡献媒体内容CMC 11、CMC12被上传并被存储在远程媒体服务器上,以便从用户设备访问。In at least one embodiment, the server application 107 registers one or more contributed media content CMC11, CMC12 so that the data files encoding the contributed media content CMC11, CMC12 can be accessed from any user device 104A-104C of the participating users 101A-101C. . For example, the contributed media content CMC 11, CMC 12 is uploaded and stored on a remote media server for access from a user device.

参考图2G进一步描述贡献媒体内容的注册。Registration of contributed media content is further described with reference to FIG. 2G.

在步骤C217中,服务器应用107向参与媒体内容交换的用户的用户设备的客户端应用106发送与步骤C215中做出的贡献有关的一个或多个消息。一个或多个消息包括贡献再现数据,所述贡献再现数据表示贡献和/或使得能够在目标用户设备上再现贡献。主题再现数据是用于再现主题的再现数据,而贡献再现数据是用于再现对主题的贡献的再现数据。In step C217, the server application 107 sends one or more messages related to the contribution made in step C215 to the client application 106 of the user equipment of the users participating in the media content exchange. The one or more messages include contribution rendering data representing the contribution and/or enabling rendering of the contribution on the target user device. The theme reproduction data is reproduction data for reproducing a theme, and the contribution reproduction data is reproduction data for reproducing a contribution to a theme.

贡献再现数据可以包括在步骤C215中选择的主题媒体内容TMC1的部分的标识,例如渲染坐标POV1。贡献再现数据可以基于或可以包括在步骤C216中注册的贡献关联数据ASC1的子集或全部。贡献再现数据可以包括编码贡献媒体内容CMC11、CMC12的数据文件和/或用于经由远程媒体服务器从用户设备访问贡献媒体内容CMC11、CMC12的访问数据。贡献再现数据可以包括贡献用户的用户标识符。贡献再现数据可以包括在步骤C212由服务器应用107注册的主题TOP1的主题标识符。贡献再现数据可以包括在步骤C215获得的渲染参数和/或逻辑相关性数据。The contributed rendering data may include an identification of the portion of the topical media content TMC1 selected in step C215, eg rendering coordinates POV1. The contribution reproduction data may be based on or may include a subset or all of the contribution association data ASC1 registered in step C216. The contributed rendering data may comprise data files encoding the contributed media content CMC11, CMC12 and/or access data for accessing the contributed media content CMC11, CMC12 from a user device via a remote media server. Contributing rendering data may include a user identifier of a contributing user. The contributed reproduction data may include the topic identifier of the topic TOP1 registered by the server application 107 at step C212. The contributed rendering data may include rendering parameters and/or logical dependency data obtained in step C215.

步骤C217可以重复几次和/或可以在步骤C214之后或步骤C216之后执行。Step C217 may be repeated several times and/or may be performed after step C214 or after step C216.

在步骤C218中,参与用户的用户设备的客户端应用106被配置为经由远程媒体服务器访问贡献媒体内容CMC11、CMC12,通过该远程媒体服务器,贡献媒体内容CMC11、CMC12在步骤C216变成可访问,例如,通过下载编码贡献媒体内容CMC11、CMC12的数据文件。客户端应用106被配置为再现在步骤215中做出的一个或多个贡献。在一个或多个实施方式中,如在步骤C217接收的贡献再现数据所指定,执行再现。In step C218, the client application 106 of the user equipment of the participating user is configured to access the contributed media content CMC11, CMC12 via a remote media server through which the contributed media content CMC11, CMC12 becomes accessible in step C216, For example, by downloading coded contribution media content CMC11, CMC12 data files. The client application 106 is configured to reproduce the one or more contributions made in step 215 . In one or more embodiments, the rendering is performed as specified by the contributed rendering data received at step C217.

在至少一个实施方式中,通过渲染组合媒体内容来执行贡献的再现,该组合媒体内容由贡献媒体内容CMC11、CMC12的至少一部分和步骤C215选择的主题媒体内容的部分的组合产生。在至少一个实施方式中,根据由贡献用户在步骤C215定义并在步骤C217接收的渲染参数和/或逻辑相关性来执行一个或多个贡献的再现。在一个或多个实施方式中,根据在步骤C217接收的贡献再现数据,实施客户端应用106,贡献媒体内容CMC11、CMC12的至少一部分与主题媒体内容的部分的组合在接收用户设备上生成。In at least one embodiment, rendering of the contribution is performed by rendering combined media content resulting from a combination of at least a portion of the contributing media content CMC11, CMC12 and a portion of the subject media content selected in step C215. In at least one embodiment, rendering of one or more contributions is performed according to rendering parameters and/or logical dependencies defined by the contributing user at step C215 and received at step C217. In one or more embodiments, according to the contribution rendering data received in step C217, the client application 106 is implemented, and the combination of at least a part of the contribution media content CMC11, CMC12 and a part of the theme media content is generated on the receiving user equipment.

在至少一个实施方式中,由参与用户选择要渲染的主题媒体内容TMC1的部分和/或贡献媒体内容CMC11、CMC12。In at least one embodiment, portions of the topical media content TMC1 and/or contributing media content CMC11 , CMC12 are selected by participating users to be rendered.

在至少一个实施方式中,在渲染贡献媒体内容CMC11、CMC12之前、期间或之后,客户端应用106显示贡献用户的用户标识符和/或参与媒体内容交换的一个或多个用户的用户标识符。In at least one embodiment, before, during, or after rendering the contributing media content CMC11, CMC12, the client application 106 displays the contributing user's user identifier and/or the user identifiers of one or more users participating in the media content exchange.

参考图2F进一步描述一个或多个贡献的再现。Rendering of one or more contributions is further described with reference to FIG. 2F.

步骤C218可以重复几次和/或在步骤C217之后或在步骤C214或C215之后执行。Step C218 may be repeated several times and/or performed after step C217 or after step C214 or C215.

因为贡献媒体内容CMC11、CMC12与主题媒体内容TMC1分开下载在用户设备104A上,组合媒体内容必须在接收用户设备104A上生成,以便以贡献用户已经做出该贡献的形式在该用户设备104A上再现该贡献。Because the contributing media content CMC11, CMC12 is downloaded separately from the subject media content TMC1 on the user device 104A, the combined media content must be generated on the receiving user device 104A to be reproduced on the user device 104A in the form that the contributing user has made the contribution the contribution.

该方法的主要阶段包括主题的定义(步骤C211-212),对主题的贡献(步骤C215-C216)和贡献的再现(步骤C217-C218)。这些不同阶段可以由在相同用户的相同用户设备上执行的客户端应用106的相同实例来执行,或者可以由在相同用户或不同用户的不同用户设备上执行的客户端应用106的不同实例来执行。例如,当在讨论组的环境中实现该方法时,主题的定义由第一用户的第一客户端应用106执行,对主题的贡献由第一用户的第一客户端应用106和/或第二用户的第二客户端应用106执行,贡献的再现由第一(或第二)用户的第一(或第二)客户端应用106或第三用户的第三客户端应用106执行。例如,当在媒体内容提供商的服务的环境中实现该方法时,主题的定义由第一用户的第一客户端应用106执行,对主题的贡献由第一用户的第一客户端应用106执行,贡献的再现由第一用户的第一客户端应用106或第二用户的第二客户端应用106执行。The main stages of the method include the definition of the theme (steps C211-212), the contribution to the theme (steps C215-C216) and the rendering of the contribution (steps C217-C218). These different stages may be performed by the same instance of the client application 106 executing on the same user device of the same user, or may be performed by different instances of the client application 106 executing on different user devices of the same user or different users . For example, when implementing the method in the context of a discussion group, the definition of the topic is performed by the first client application 106 of the first user, and the contribution to the topic is performed by the first client application 106 of the first user and/or the second client application 106 of the first user. The user's second client application 106 executes, and the contributed rendering is executed by the first (or second) user's first (or second) client application 106 or the third user's third client application 106 . For example, when implementing the method in the context of the service of a media content provider, the definition of the theme is performed by the first client application 106 of the first user, and the contribution to the theme is performed by the first client application 106 of the first user , the rendering of the contribution is performed by the first client application 106 of the first user or the second client application 106 of the second user.

取决于实现媒体内容的环境(讨论组,社交网络、媒体内容提供商的服务,等),上述的实施阶段的顺序可以不同。Depending on the environment in which the media content is implemented (discussion group, social network, media content provider's service, etc.), the order of the implementation phases described above may be different.

图2D示出了用于注册主题的方法的实施方式。这种用于注册主题的方法可以在参考图2C描述的用于在多个用户之间共享媒体内容的方法的环境中实现。Figure 2D illustrates an embodiment of a method for registering a subject. This method for registering a topic can be implemented in the context of the method for sharing media content among multiple users described with reference to FIG. 2C.

在步骤D224中,发起用户101A的用户设备104A的客户端应用106获得要用作媒体内容交换的主题的一个或多个媒体内容。这些媒体内容可以由客户端应用106自动识别或者由发起用户101A选择。客户端应用106的用户界面可以例如包括用于选择媒体内容的至少一个用户界面项。例如,用户界面包括用户界面项(按钮、菜单等),用于触发用于搜索、浏览和/或选择一个或多个媒体内容的用户界面的显示。In step D224, the client application 106 of the user device 104A of the initiating user 101A obtains one or more media content to be used as the subject of the media content exchange. Such media content may be automatically identified by the client application 106 or selected by the originating user 101A. The user interface of the client application 106 may, for example, include at least one user interface item for selecting media content. For example, the user interface includes user interface items (buttons, menus, etc.) for triggering display of a user interface for searching, browsing, and/or selecting one or more media content.

每个所选媒体内容可以是本地存储在用户设备104A上的媒体内容,存储在远程媒体服务器103B上的媒体内容(例如在私有云、内容递送网络、专用网络中的媒体服务器,等)(该媒体内容不能被参与用户的其他用户设备访问),由web应用经由web服务器103A提供的媒体内容,由在用户设备104A上本地执行的源应用提供的媒体内容(该媒体内容只能经由所述源应用访问)。Each selected media content may be media content stored locally on the user device 104A, media content stored on a remote media server 103B (such as a media server in a private cloud, a content delivery network, a dedicated network, etc.) (the media content cannot be accessed by other user devices of participating users), media content provided by a web application via web server 103A, media content provided by a source application locally executing on user device 104A (the media content can only be accessed via the source application access).

例如,客户端应用106可以包括web浏览器、浏览用户界面、和/或使用户能够进入超文本链接(例如URL或URI)的打字区域,该web浏览器、浏览用户界面用于搜索和选择文件,该超文本链接指向与所选媒体内容相对应的一个或多个文件。For example, client application 106 may include a web browser, browse user interface, and/or a typing area that enables a user to enter a hypertext link (e.g., URL or URI) for searching and selecting files , the hypertext link to one or more files corresponding to the selected media content.

客户端应用106获得至少一个媒体内容以用作媒体内容交换的主题。The client application 106 obtains at least one media content for use as the subject of a media content exchange.

在至少一个实施方式中,主题的注册包括相应主题媒体内容的注册。In at least one embodiment, registration of a theme includes registration of corresponding theme media content.

在步骤D225中,用户设备104A的客户端应用106向服务器应用107发送至少一个注册所选主题媒体内容TMC1的请求。在一个或多个实施方式中,主题媒体内容TMC1的注册包括在数据库102D中记录表示主题媒体内容TMC1的媒体内容数据集。所记录的媒体内容数据集包括由服务器应用107分配给主题媒体内容TMC1的媒体内容标识符和/或用于经由远程媒体服务器103A-103C从用户设备访问主题媒体内容TMC1的访问数据。In step D225, the client application 106 of the user equipment 104A sends to the server application 107 at least one request to register the selected topical media content TMC1. In one or more embodiments, the registration of the subject media content TMC1 includes recording a media content data set representing the subject media content TMC1 in the database 102D. The recorded media content data set comprises a media content identifier assigned to the subject media content TMC1 by the server application 107 and/or access data for accessing the subject media content TMC1 from a user device via the remote media servers 103A-103C.

图2G示出了适用于主题媒体内容TMC1的用于注册媒体内容的方法的示例性实施方式。Fig. 2G shows an exemplary embodiment of a method for registering media content applicable to topical media content TMC1.

在注册主题媒体内容TMC1之后,主题媒体内容TMC1可由参与用户的用户设备104A-104C访问,并且可由这些用户设备从远程媒体服务器103A或103C下载或访问。After the subject media content TMC1 is registered, the subject media content TMC1 is accessible by the user devices 104A-104C of the participating users, and can be downloaded or accessed by these user devices from the remote media server 103A or 103C.

在步骤D226中,用户设备104A的客户端应用106向服务器应用107发送至少一个请求,用于将在步骤D224中选择的主题媒体内容TMC1注册为用于媒体内容交换的新主题TOP1。主题TOP1由服务器侧的服务器应用107在数据库102D中注册。在一个或多个实施方式中,主题TOP1的注册包括向主题TOP1分配主题标识符,以及在数据库102D中记录表示主题TOP1的主题数据集。对应于注册时间的时间戳被存储为主题数据集的创建时间。In step D226, the client application 106 of the user equipment 104A sends at least one request to the server application 107 for registering the topic media content TMC1 selected in step D224 as a new topic TOP1 for media content exchange. The topic TOP1 is registered in the database 102D by the server application 107 on the server side. In one or more implementations, registration of topic TOP1 includes assigning a topic identifier to topic TOP1 and recording a topic data set representing topic TOP1 in database 102D. A timestamp corresponding to the time of registration is stored as the creation time of the subject dataset.

在一个或多个实施方式中,主题的注册包括在数据库102D中记录主题关联数据AST1,主题关联数据AST1表示主题媒体内容TMC1、发起用户101A、用户组GR1和主题TOP1之间的关联。或者,不使用主题数据集,并且主题TOP1的注册包括在数据库102D中记录主题关联数据AST1,主题关联数据AST1表示主题媒体内容TMC1、发起用户101A和用户组GR1之间的关联。In one or more implementations, the topic registration includes recording topic association data AST1 in the database 102D, and the topic association data AST1 represents the association between the topic media content TMC1, the originating user 101A, the user group GR1 and the topic TOP1. Alternatively, no topic data set is used, and the registration of topic TOP1 includes recording topic association data AST1 in database 102D, which represents the association between topic media content TMC1, originating user 101A and user group GR1.

在一个或多个实施方式中,当没有用户组被注册用于媒体内容交换时,主题的注册包括在数据库102D中记录主题关联数据AST1,主题关联数据AST1表示主题媒体内容TMC1、发起用户101A和主题TOP1之间的关联。或者,不使用主题数据集,并且主题TOP1的注册包括在数据库102D中记录表示主题媒体内容TMC1和发起用户101A之间的关联的主题关联数据AST1。In one or more embodiments, when no user group is registered for media content exchange, the registration of the topic includes recording topic association data AST1 in the database 102D, and the topic association data AST1 represents the topic media content TMC1, the originating user 101A and Associations between topics TOP1. Alternatively, no topic data set is used, and registration of topic TOP1 includes recording in database 102D topic association data AST1 representing an association between topic media content TMC1 and originating user 101A.

例如,由图3B中的实体关系图示意性地表示,表示主题TOP1的主题数据集与表示用户组GR1的用户组数据集、与表示主题媒体内容TMC1的内容数据集、以及与表示发起用户101A的用户数据集相关联地存储。或者,不使用主题数据集,并且表示用户组GR1的用户组数据集与表示主题媒体内容TMC1的内容数据集和表示发起用户101A的用户数据集相关联地存储。或者,不使用主题数据集和用户组数据集,并且表示主题媒体内容TMC1的内容数据集与表示发起用户101A的用户数据集相关联地存储。For example, it is schematically represented by the entity relationship diagram in FIG. 3B , the topic data set representing the topic TOP1 and the user group data set representing the user group GR1, the content data set representing the topic media content TMC1, and the content data set representing the originating user 101A The user data set is stored associatively. Alternatively, no topic data set is used and a user group data set representing user group GR1 is stored in association with a content data set representing topical media content TMC1 and a user data set representing originating user 101A. Alternatively, the topic data set and user group data set are not used, and the content data set representing the topical media content TMC1 is stored in association with the user data set representing the originating user 101A.

图2E示出了用于注册用户对主题的贡献的方法的一个实施方式。用于注册贡献的方法可以在参考图2C描述的用于在多个用户之间共享媒体内容的方法的情况下实现。Figure 2E illustrates one embodiment of a method for registering user contributions to a topic. The method for registering contributions may be implemented in the context of the method for sharing media content among multiple users described with reference to FIG. 2C.

在步骤E221中,选择主题媒体内容TMC1的部分。所选择的部分可以是与现有贡献相关联的部分,该部分因此已经由贡献用户选择或者可以是新选择的部分。In step E221, a part of the topical media content TMC1 is selected. The selected portion may be a portion associated with an existing contribution which has thus been selected by the contributing user or may be a newly selected portion.

用户设备104B的客户端应用106的用户界面可以包括至少一个用户界面项,用于导航到主题媒体内容TMC1,用于选择用于主题媒体内容TMC1的渲染点POV1(或视点),或者用于输入渲染坐标,该渲染坐标标识相对于与主题媒体内容TMC1相关联的渲染坐标系的渲染点POV1。在一个或多个实施方式中,相对于与主题媒体内容TMC1相关联的渲染坐标系的至少一个轴,为主题媒体内容TMC1计算对应的渲染点POV1。The user interface of the client application 106 of the user device 104B may include at least one user interface item for navigating to the subject media content TMC1, for selecting a rendering point POV1 (or point of view) for the subject media content TMC1, or for entering Rendering coordinates identifying a rendering point POV1 relative to a rendering coordinate system associated with the topical media content TMC1 . In one or more embodiments, a corresponding rendering point POV1 is calculated for the subject media content TMC1 with respect to at least one axis of the rendering coordinate system associated with the subject media content TMC1 .

在步骤E222中,用户设备104B的客户端应用106获得一个或多个媒体内容CMC11、CMC12,形成贡献用户101B对主题TOP1的贡献。In step E222, the client application 106 of the user equipment 104B obtains one or more media contents CMC11, CMC12 to form the contribution of the contributing user 101B to the topic TOP1.

用户设备104B的客户端应用106的用户界面可以,例如,包括用于生成和/或选择一个或多个媒体内容CMC11、CMC12的至少一个用户界面项。例如,用户界面可以包括用户界面项(按钮,菜单等),用于触发用于搜索和/或选择一个或多个媒体内容的用户界面的显示。例如,用户界面包括用于生成或导入贡献媒体内容的工具栏。例如,用户界面可以配置有媒体内容编辑器,以使用户能够:The user interface of the client application 106 of the user device 104B may, for example, comprise at least one user interface item for generating and/or selecting one or more media content CMC11, CMC12. For example, a user interface may include user interface items (buttons, menus, etc.) for triggering display of a user interface for searching and/or selecting one or more media content. For example, the user interface includes a toolbar for generating or importing contributed media content. For example, a user interface may be configured with a media content editor to enable a user to:

-绘制包括矩形、圆形、或其它预定几何形状或自由形状,- drawing including rectangles, circles, or other predetermined geometric shapes or freeform shapes,

-写一段文字,- write a text,

-插入动态链接,例如URL或散列标签,- Insert dynamic links, such as URLs or hashtags,

-导入图像/视频/音频/文本内容,- import image/video/audio/text content,

-对图像或音频内容应用滤波器,- apply filters to image or audio content,

-通过照相机和/或麦克风生成图像/视频/音频/文本内容,和/或- generate image/video/audio/text content via camera and/or microphone, and/or

-编辑现有媒体内容。- Edit existing media content.

在至少一个实施方式中,贡献的注册包括贡献媒体内容CMC11、CMC12的注册。In at least one embodiment, the registration of contributions includes the registration of contributed media content CMC11, CMC12.

在步骤E223中,用户设备104B的客户端应用106向服务器应用107发送至少一个请求,用于注册所选择/生成的贡献媒体内容CMC11、CMC12。在一个或多个实施方式中,贡献媒体内容CMC11、CMC12的注册包括在数据库102D中记录表示贡献媒体内容CMC11、CMC12的一个或多个媒体内容数据集。每个记录的媒体内容数据集包括由服务器应用107分配给相应贡献媒体内容CMC11、CMC12的媒体内容标识符、和/或访问数据,所述访问数据用于通过远程媒体服务器103A-103C从用户设备访问相应主题媒体内容CMC11、CMC12。图2D示出了适用于贡献媒体内容的用于注册媒体内容的方法的示例性实施方式。In step E223, the client application 106 of the user equipment 104B sends at least one request to the server application 107 for registering the selected/generated contributed media content CMC11, CMC12. In one or more embodiments, the registration of the contributed media content CMC11, CMC12 includes recording one or more media content data sets representing the contributed media content CMC11, CMC12 in the database 102D. The media content data set of each recording comprises the media content identifier assigned to corresponding contribution media content CMC11, CMC12 by server application 107, and/or access data, and described access data is used for from user equipment by remote media server 103A-103C. Access the corresponding theme media content CMC11, CMC12. Figure 2D illustrates an exemplary embodiment of a method for registering media content suitable for contributing media content.

在注册贡献媒体内容CMC11、CMC12之后,贡献媒体内容CMC11、CMC12可由参与媒体内容交换的用户的用户设备104A-104C访问,并且可由用户设备104A-104C从远程媒体服务器103A或103C下载或访问。After registering the contributed media content CMC11, CMC12, the contributed media content CMC11, CMC12 is accessible by the user devices 104A-104C of the users participating in the media content exchange, and can be downloaded or accessed by the user devices 104A-104C from the remote media server 103A or 103C.

在步骤E224中,客户端应用106允许用户设备104B为贡献媒体内容CMC11、CMC12定义至少一个渲染参数RP11、RP12,和/或为主题媒体内容TMC1定义至少一个渲染参数RP1。渲染参数RP1、RP11、RP12定义如何在另一用户(即,参与相同的媒体内容交换的接受用户)的用户设备上渲染贡献媒体内容和/或主题媒体内容。渲染参数可以是组合参数CP11、CP12,滤波参数FP1、FP11、FP12,渲染顺序参数RO1。In step E224 the client application 106 allows the user equipment 104B to define at least one rendering parameter RP11 , RP12 for the contributed media content CMC11 , CMC12 and/or at least one rendering parameter RP1 for the topical media content TMC1 . The rendering parameters RP1 , RP11 , RP12 define how the contributing media content and/or the topical media content are rendered on the user equipment of another user, ie a recipient user participating in the same media content exchange. The rendering parameters may be combination parameters CP11, CP12, filter parameters FP1, FP11, FP12, and rendering sequence parameters RO1.

根据一个或多个实施方式,组合参数CP11、CP12可以定义贡献媒体内容CMC11、CMC12如何与主题媒体内容组合以便形成该主题媒体内容的注释。According to one or more embodiments, the combination parameters CP11, CP12 may define how the contributed media content CMC11, CMC12 is combined with the subject media content in order to form an annotation of the subject media content.

组合参数CP11、CP12可以是定义与主题媒体内容TMC1相关联的2D坐标系中的位置的空间组合参数,其中必须显示贡献媒体内容CMC11、CMC12。例如,作为图片或徽标的贡献媒体内容CMC11、CMC12可以位于作为视频或图像内容的主题媒体内容TMC1的图像中的不同位置。在这个示例中,空间组合参数是对应于在主题媒体内容TMC1的图像中的贡献媒体内容CMC11、CMC12的水平和垂直位置的一对(x,y)坐标。The composition parameters CP11, CP12 may be spatial composition parameters defining a position in a 2D coordinate system associated with the subject media content TMC1 in which the contributing media content CMC11, CMC12 has to be displayed. For example, the contributed media content CMC11 , CMC12 as pictures or logos may be located at different positions in the image of the subject media content TMC1 as video or image content. In this example, the spatial combination parameter is a pair of (x, y) coordinates corresponding to the horizontal and vertical positions of the contributing media content CMC11, CMC12 in the image of the subject media content TMC1.

组合参数CP11、CP12可以是透明度参数(transparency parameter),该透明度参数定义基于图像的贡献媒体内容相对于基于图像的主题媒体内容的透明度。在此示例中,透明度参数是在最小透明度值(无透明度)和最大透明度值坐标(完全透明的贡献媒体内容)之间编码的值。The combination parameters CP11, CP12 may be transparency parameters defining the transparency of the image-based contributed media content relative to the image-based themed media content. In this example, the transparency parameter is a value encoded between a minimum transparency value (no transparency) and a maximum transparency value coordinate (fully transparent contributed media content).

组合参数CP11、CP12可以是权重,其定义基于图像(或基于音频)的贡献媒体内容相对于基于图像(或基于音频)的主题媒体内容的权重,组合媒体内容是(对于基于图像的内容逐个像素的、或对基于音频的内容逐个样本的)加权和。Combination parameters CP11, CP12 may be weights that define the weight of the image-based (or audio-based) contributing media content relative to the image-based (or audio-based) subject media content, the combined media content being (pixel by pixel for image-based content) , or sample-by-sample for audio-based content) weighted sums.

组合参数CP11、CP12可以是定义主题媒体内容TMC1和贡献媒体内容CMC11、CMC12之间的同步模式的时间组合参数,这两个内容必须根据该同步模式被组合和渲染。The composition parameters CP11, CP12 may be temporal composition parameters defining a synchronization pattern between the topical media content TMC1 and the contributing media content CMC11, CMC12 according to which the two contents have to be composed and rendered.

例如,贡献用户101B可以预定义和选择不同的同步模式:冻结模式和流动模式。For example, the contributing user 101B can predefine and select different synchronization modes: frozen mode and streaming mode.

当选择冻结模式时,当到达由贡献用户在步骤E221中定义的渲染点POV1时,主题媒体内容的渲染将被中断,并且在渲染贡献媒体内容时,主题媒体内容TMC1的渲染将与主题媒体内容的相应部分冻结。冻结模式例如在有人想要在主题视频媒体内容的特定图像上添加视频贡献时是有用的:在显示贡献媒体内容的同时,可以显示与渲染点POV1相对应的冻结图像。When freezing mode is selected, when reaching the rendering point POV1 defined by the contributing user in step E221, the rendering of the theme media content will be interrupted, and when rendering the contribution media content, the rendering of the theme media content TMC1 will be consistent with the theme media content The corresponding part freezes. Freeze mode is useful, for example, when one wants to add a video contribution to a particular image of the subject video media content: while the contributed media content is displayed, a frozen image corresponding to the rendering point POV1 can be displayed.

当选择流动模式时,当到达由贡献用户在步骤E221中定义的渲染点POV1时,主题媒体内容的渲染将继续并且不会中断。例如当主题媒体内容是视频并且贡献媒体内容也是视频时,两个视频将同时显示。When the streaming mode is selected, the rendering of the subject media content will continue without interruption when the rendering point POV1 defined by the contributing user in step E221 is reached. For example, when the subject media content is a video and the contributing media content is also a video, the two videos will be displayed simultaneously.

滤波参数FP1、FP11、FP12可以定义滤波器(或效果),该滤波器(效果)要应用于贡献媒体内容(例如,分别应用于贡献媒体内容CMC11或CMC12的滤波参数FP11或FP12)、和/或主题媒体内容(例如,应用于主题媒体内容TMC1的过滤参数FP1)。例如,应用于作为图像或视频的主题媒体内容的滤波器可以是颜色增强滤波器、对比度增强滤波器、色度修正滤波器,锐化滤波器、平滑滤波器、变形滤波器,等。The filter parameters FP1, FP11, FP12 may define a filter (or effect) to be applied to the contributed media content (e.g. filter parameters FP11 or FP12 respectively applied to the contributed media content CMC11 or CMC12), and/or or topical media content (eg, filter parameter FP1 applied to topical media content TMC1 ). For example, a filter applied to the subject media content as an image or video may be a color enhancement filter, a contrast enhancement filter, a chroma correction filter, a sharpening filter, a smoothing filter, an anamorphic filter, and the like.

滤波参数FP1,由对主题做出贡献的贡献用户定义,用于定义要应用于主题媒体内容中已做出贡献的部分的滤波器。根据贡献用户定义的滤波参数,在接收用户的用户设备上执行贡献的再现。The filter parameter FP1, defined by the contributing user who contributed to the topic, is used to define the filter to be applied to the contributed part of the topic media content. The rendering of the contribution is performed on the user equipment of the receiving user according to the filtering parameters defined by the contributing user.

渲染顺序参数RO1用于定义在接收用户的用户设备上相对于主题媒体内容的渲染贡献媒体内容的顺序。例如,贡献用户101B可以预定义和选择不同的渲染顺序RO1:时间顺序、基于渲染坐标的顺序、基于用户的顺序和基于相关性的顺序。The rendering order parameter RO1 is used to define the order of contributing media content with respect to the rendering of the subject media content on the receiving user's user equipment. For example, the contributing user 101B can predefine and select different rendering orders RO1: time order, order based on rendering coordinates, order based on users and order based on relevance.

根据为相关联的渲染点数据集存储的记录时间戳,时间顺序允许按照贡献媒体内容的创建顺序来渲染贡献媒体内容。时间戳可以由通用时钟生成,因此与真实世界的时间轴有关。这个时间轴可以说是媒体内容交换的时间轴(例如,讨论组环境中的讨论线程)。Time ordering allows rendering of the contributed media content in the order in which they were created according to the record timestamps stored for the associated rendering point dataset. Timestamps can be generated by universal clocks and thus relate to real-world timelines. This timeline can be said to be the timeline of media content exchange (eg, discussion threads in a discussion group environment).

根据存储在渲染点数据集中的记录的渲染坐标,基于渲染坐标的顺序允许以它们的渲染点的顺序渲染贡献媒体内容。例如,当渲染点是相对于作为视频内容的主题媒体内容的图像编号时,不同贡献媒体内容可以按图像编号顺序进行渲染。换句话说,视频内容的时间轴用于确定贡献媒体内容顺序,而不是讨论线程的时间轴。例如,可以从头到尾渲染视频内容,并且当达到与渲染坐标相对应的图像编号时,通过渲染贡献媒体内容来渲染视频内容。The order based rendering coordinates allows rendering of the contributed media content in the order of their rendering points, according to the recorded rendering coordinates stored in the rendering point dataset. For example, when the rendering point is relative to the image number of the subject media content as the video content, the different contributing media contents may be rendered in order of image numbers. In other words, the timeline of video content is used to determine the order of contributed media content, not the timeline of discussion threads. For example, the video content may be rendered from beginning to end, and when the image number corresponding to the rendering coordinates is reached, the video content is rendered by rendering the contributing media content.

基于用户的顺序允许根据贡献用户渲染贡献媒体内容。例如,在一个实施方式中,当选择基于用户时,允许首先渲染第一用户的所有贡献媒体内容,然后是第二用户的所有贡献媒体内容,依次类推。在一个实施方式中,当选择基于用户的顺序时,给定用户的所有贡献媒体内容按时间顺序(即例如根据它们的时间戳)或以基于坐标的顺序(即根据渲染坐标的值)渲染。User-based ordering allows rendering of contributed media content according to contributing users. For example, in one embodiment, when the selection is user-based, all contributed media content of a first user is allowed to be rendered first, followed by all contributed media content of a second user, and so on. In one embodiment, when a user-based order is selected, all contributed media content for a given user is rendered in chronological order (ie, eg, according to their timestamps) or in a coordinate-based order (ie, according to the value of the rendering coordinates).

基于相关性的顺序允许根据贡献媒体内容之间定义的逻辑相关性,来渲染贡献媒体内容。例如,通过遵循贡献媒体内容之间的相关性链,基于相关性的顺序允许渲染第一注册贡献媒体内容,然后渲染与第一注册贡献媒体内容具有逻辑相关性的第二注册贡献媒体内容,然后渲染与第二注册贡献媒体内容具有逻辑相关性的第三注册贡献媒体内容,依此类推。在一个实施方式中,当选择基于相关性的顺序时,给定相关性链的所有贡献媒体内容按时间顺序(即,根据它们的时间戳)或以基于坐标的顺序(即,根据渲染坐标的值)进行渲染。The dependency-based ordering allows rendering of contributed media content according to defined logical dependencies between the contributed media content. For example, by following a chain of dependencies between contributed media content, a dependency-based order allows rendering of a first registered contributed media content, then rendering of a second registered contributed media content that has a logical dependency on the first registered contributed media content, and then A third registered contributed media content having a logical dependency on the second registered contributed media content is rendered, and so on. In one embodiment, when a dependency-based order is selected, all contributing media content for a given dependency chain are ordered chronologically (i.e., according to their timestamps) or in a coordinate-based order (i.e., according to rendering coordinates). value) for rendering.

在步骤E225中,当用户设备104B的用户101B不是对媒体内容交换做出贡献的第一用户并且服务器应用107已经为该媒体内容交换注册了至少一个先前贡献时,客户端应用106允许用户设备104B的用户101B选择两个注册的贡献媒体内容,并且在两个贡献媒体内容CMC11、CMC12之间建立逻辑相关性。逻辑相关性用于定义贡献媒体内容之间的相关性。这允许贡献用户101B指出他的贡献涉及哪些媒体内容。这也允许定义具有逻辑相关性的贡献媒体内容的子集。贡献媒体内容的该子集可以例如,对应于媒体内容交换的主题TOP1的子主题。In step E225, when the user 101B of the user equipment 104B is not the first user who contributes to the media content exchange and the server application 107 has registered at least one previous contribution for this media content exchange, the client application 106 allows the user equipment 104B The user 101B of selects two registered contributed media contents, and establishes a logical correlation between the two contributed media contents CMC11, CMC12. Logical dependencies are used to define dependencies between contributed media content. This allows the contributing user 101B to indicate which media content his contribution relates to. This also allows defining logically related subsets of contributed media content. This subset of contributed media content may, for example, correspond to a subtopic of the topic TOP1 of the media content exchange.

步骤E224和E225都是可选步骤。因此,步骤E226例如可以在步骤E223之后执行。Both steps E224 and E225 are optional steps. Therefore, step E226 may be performed after step E223, for example.

在步骤E226中,用户设备104B的客户端应用106向服务器应用107发送至少一个请求,用于注册表示对媒体内容交换的贡献的贡献关联数据ASC1。在一个或多个实施方式中,贡献关联数据ASC1包括主题媒体内容TMC1的与贡献相关的部分的标识。在至少一个实施方式中,主题媒体内容TMC1的部分的标识包括定义渲染点POV1的渲染坐标。In step E226, the client application 106 of the user equipment 104B sends at least one request to the server application 107 for registering contribution association data ASC1 representing a contribution to the media content exchange. In one or more embodiments, the contribution association data ASC1 includes an identification of a contribution-related portion of the topical media content TMC1 . In at least one embodiment, the identification of the portion of the topical media content TMC1 includes rendering coordinates defining the rendering point POV1.

可选地,贡献关联数据ASC1还包括一个或多个渲染参数RP1、RP11、RP12,该一个或多个渲染参数由贡献用户101B指定并由用户设备104B的客户端应用106在步骤E224获得。可选地,当在步骤E225定义了至少一个逻辑相关性时,贡献关联数据ASC1还包括表示逻辑相关性的逻辑相关性数据LD1。例如,逻辑相关性数据LD1包括应用逻辑相关性的先前注册的贡献媒体内容的内容标识符。Optionally, the contribution associated data ASC1 further includes one or more rendering parameters RP1, RP11, RP12 specified by the contributing user 101B and obtained by the client application 106 of the user equipment 104B in step E224. Optionally, when at least one logical dependency is defined in step E225, the contribution association data ASC1 further includes logical dependency data LD1 representing the logical dependency. For example, the logical dependency data LD1 includes content identifiers of previously registered contributed media content to which the logical dependency applies.

服务器应用107在服务器侧注册用户101B的贡献,例如在数据库102D中。在一个或多个实施方式中,贡献用户101B的注册包括在数据库102D中记录渲染点数据集,该渲染点数据集表示渲染点POV1并包括步骤E224中获得的渲染坐标。对应于注册时间的时间戳被存储为渲染点数据集的创建时间。该时间戳是用户101B的贡献的时间戳。The server application 107 registers the contribution of the user 101B on the server side, eg in the database 102D. In one or more embodiments, the registration of the contributing user 101B includes recording a rendering point dataset in the database 102D, which represents the rendering point POV1 and includes the rendering coordinates obtained in step E224. A timestamp corresponding to the registration time is stored as the creation time of the rendered point dataset. This timestamp is that of user 101B's contribution.

可选地,当在步骤E224中定义了一个或多个组合参数CP11、CP12时,那些组合参数CP11、CP12也与内容数据集相关联地存储,该内容数据集表示必须分别应用组合参数CP11、CP12的贡献媒体内容CMC11、CMC12。Optionally, when one or more combination parameters CP11, CP12 are defined in step E224, those combination parameters CP11, CP12 are also stored in association with the content data set indicating that the combination parameters CP11, CP12, respectively, must be applied. Contributed media content CMC11, CMC12 of CP12.

可选地,当在步骤E224中定义了一个或多个滤波参数FP1、FP11、FP12时,那些滤波参数FP1、FP11、FP12也与渲染点数据集相关联地存储,该渲染点数据集表示必须分别应用滤波参数FP1、FP11、FP12的主题媒体内容的部分。Optionally, when one or more filter parameters FP1, FP11, FP12 are defined in step E224, those filter parameters FP1, FP11, FP12 are also stored in association with the rendering point dataset representing the necessary Portions of the subject media content to which filter parameters FP1, FP11, FP12 are applied respectively.

可选地,当在步骤E225中定义了一个或多个逻辑相关性时,存储逻辑相关性数据LD1。例如,先前注册的贡献媒体内容的内容标识符与内容数据集相关联地存储,该内容数据集表示与先前注册的贡献媒体内容具有逻辑相关性的贡献媒体内容。Optionally, when one or more logical dependencies are defined in step E225, the logical dependency data LD1 is stored. For example, content identifiers for previously registered contributed media content are stored in association with a content dataset representing contributed media content having a logical relationship to the previously registered contributed media content.

可选地,当参与媒体内容交换的不同用户已经做出若干贡献时,客户端应用106被配置为允许贡献用户选择渲染顺序RO1参数,以确定不同贡献在接收用户的用户设备上渲染的顺序。接收用户可以使用该渲染顺序参数来渲染不同的贡献。Optionally, when several contributions have been made by different users participating in the exchange of media content, the client application 106 is configured to allow the contributing user to select a rendering order RO1 parameter to determine the order in which the different contributions are rendered on the receiving user's user device. The receiving user can use this render order parameter to render different contributions.

在一个或多个实施方式中,用户101B的贡献的注册包括在数据库102D中记录贡献关联数据ASC1,贡献关联数据ASC1表示贡献媒体内容CMC11、CMC12和主题媒体内容TMC1中由渲染点POV1标识的的部分之间的关联。在一个或多个实施方式中,贡献关联数据ASC1还包括至少一些在步骤E224中定义的渲染参数RP1、RP11(组合参数CP11、CP12和/或滤波参数FP1、FP11、FP12和/或渲染顺序RO1)和/或在步骤E225中定义的表示逻辑相关性的逻辑相关性数据LD1。In one or more embodiments, the registration of the contribution of the user 101B includes recording the contribution association data ASC1 in the database 102D, and the contribution association data ASC1 represents the contribution media content CMC11, CMC12 and theme media content TMC1 identified by the rendering point POV1. Associations between parts. In one or more embodiments, the contribution association data ASC1 also includes at least some rendering parameters RP1, RP11 (combination parameters CP11, CP12 and/or filtering parameters FP1, FP11, FP12 and/or rendering order RO1 defined in step E224 ) and/or logical dependency data LD1 representing logical dependencies defined in step E225.

在至少一个实施方式中,贡献关联数据ASC1表示贡献媒体内容CMC11、CMC12、渲染点POV1、贡献用户101B和主题TOP1之间的关联。或者,当主题数据集被创建后,贡献关联数据ASC1表示贡献媒体内容CMC11、CMC12、渲染点POV1、贡献用户101B和主题媒体内容TMC1之间的关联。In at least one embodiment, the contribution association data ASC1 represents the association among the contribution media content CMC11 , CMC12 , rendering point POV1 , contribution user 101B and topic TOP1 . Or, after the theme data set is created, the contribution association data ASC1 represents the association among the contribution media content CMC11 , CMC12 , rendering point POV1 , contribution user 101B and theme media content TMC1 .

例如,如图3C的实体关系图示意性地表示的,表示渲染点POV1的渲染点数据集与不同内容数据集、主题数据集、用户数据集相关联地存储,该不同内容数据集表示贡献媒体内容CMC11、CMC12(在本示例中包括两个贡献媒体内容CMC11、CMC121和CMC11、CMC122),该主题数据集表示主题TOP1,该用户数据集表示贡献用户101B。在该示意图中,贡献关联数据ASC1包括渲染参数RP1、RP11、RP12(即组合参数CP11、CP12,滤波参数FP1、FP11、FP12和渲染顺序RO1)。For example, as schematically represented in the entity relationship diagram of FIG. 3C , the rendering point data set representing the rendering point POV1 is stored in association with different content data sets, topic data sets, and user data sets, and the different content data sets represent contributed media. The content CMC11, CMC12 (including two contributed media contents CMC11, CMC121 and CMC11, CMC122 in this example), the topic data set represents the topic TOP1, and the user data set represents the contributing user 101B. In this schematic diagram, the contribution associated data ASC1 includes rendering parameters RP1, RP11, RP12 (ie combination parameters CP11, CP12, filter parameters FP1, FP11, FP12 and rendering order RO1).

或者,当不使用主题数据集时,表示渲染点POV1的渲染点数据集与不同的内容数据集、媒体内容数据集、用户数据集相关联地存储,该不同的内容数据集表示贡献媒体内容CMC11、CMC12,媒体内容数据集表示主题媒体内容TMC1,用户数据集表示贡献用户101B。Or, when the theme data set is not used, the rendering point data set representing the rendering point POV1 is stored in association with a different content data set, media content data set, user data set, and the different content data set represents the contributed media content CMC11 , CMC12, the media content data set represents the topic media content TMC1, and the user data set represents the contributing user 101B.

可选地,当在步骤E224定义了一个或多个滤波参数FP1、FP11、FP12,表示渲染点POV1的渲染点数据集与步骤E224中定义的滤波参数FP1、FP11、FP12相关联地存储。Optionally, when one or more filter parameters FP1, FP11, FP12 are defined in step E224, the rendering point data set representing the rendering point POV1 is stored in association with the filtering parameters FP1, FP11, FP12 defined in step E224.

可选地,当在步骤E224中定义了一个或多个组合参数CP11、CP12,表示贡献媒体内容CMC11、CMC121或CMC11、CMC122的内容数据集,与在步骤E224中定义的组合参数CP11或CP12相关联地存储,CP11或CP12分别应用到贡献媒体内容CMC11、CMC121或CMC11、CMC122。Optionally, when one or more combination parameters CP11, CP12 are defined in step E224, it means that the content data set of contributed media content CMC11, CMC121 or CMC11, CMC122 is related to the combination parameters CP11 or CP12 defined in step E224 For joint storage, CP11 or CP12 are respectively applied to contributed media content CMC11, CMC121 or CMC11, CMC122.

贡献关联数据ASC1可以以各种方式生成和存储。贡献关联数据ASC1的功能是编码贡献和主题之间的关系,以便能够基于该贡献关联数据ASC1、贡献媒体内容CMC11、CMC12的访问数据、和主题媒体内容TMC1的访问数据再现用户所作的贡献,特别是不需要服务器应用107向参与媒体内容交换的用户的每个用户设备发送由贡献媒体内容CMC11、CMC12和主题媒体内容TMC1的组合产生的组合媒体内容。因此,可以节省网络带宽,因为不同的媒体内容可以在每个用户设备下载一次,然后根据需要在接收用户设备上与主题媒体内容TMC1组合,用于再现一个或若干贡献。例如,当主题媒体内容TMC1包括视频内容时,该视频内容将仅在参与用户的不同用户设备中下载一次,且不用为相对于该视频内容做出的每个贡献进行下载。Contribution associated data ASC1 can be generated and stored in various ways. The function of the contribution association data ASC1 is to encode the relationship between the contribution and the topic, so that the contribution made by the user can be reproduced based on the contribution association data ASC1, the access data of the contribution media content CMC11, CMC12, and the access data of the topic media content TMC1, in particular It is not necessary for the server application 107 to send the combined media content resulting from the combination of the contributing media content CMC11, CMC12 and the topical media content TMC1 to each user equipment of the users participating in the media content exchange. Thus, network bandwidth can be saved since the different media content can be downloaded once per user device and then combined with the topical media content TMC1 on the receiving user device as required for rendering one or several contributions. For example, when the subject media content TMC1 includes video content, the video content will only be downloaded once in different user devices of participating users, and will not be downloaded for every contribution made with respect to the video content.

图2F示出了用于再现与媒体内容交换的主题相关的贡献的方法的一个实施方式。该方法可以在注册贡献之后执行,例如在步骤C215-C216之后和/或在步骤E221-E226之后。Figure 2F illustrates one embodiment of a method for rendering contributions related to a topic of media content exchange. The method may be performed after registering the contribution, for example after steps C215-C216 and/or after steps E221-E226.

在步骤F230中,在参与媒体内容交换的用户的用户设备上执行的客户端应用106被配置为接收贡献再现数据,该贡献再现数据涉及相对于媒体内容交换的主题媒体内容做出的贡献。如参照图2C的步骤C217所描述的,贡献再现数据包括对主题媒体内容TMC1的已做出贡献的选定部分的标识。In step F230, the client application 106 executing on the user equipment of the users participating in the media content exchange is configured to receive contributed rendering data relating to contributions made with respect to the subject media content of the media content exchange. As described with reference to step C217 of FIG. 2C , the contributed rendering data includes an identification of the selected portion of the subject media content TMC1 that has contributed.

客户端应用106被配置为针对每个贡献,渲染组合媒体内容,该组合媒体内容由贡献媒体内容CMC11、CMC12的至少一部分和主题媒体内容TMC1的组合产生。The client application 106 is configured to render, for each contribution, combined media content resulting from a combination of at least a portion of the contribution media content CMC11 , CMC12 and the topic media content TMC1 .

当渲染参数(组合参数和/或滤波参数,和/或渲染顺序)和/或步骤E224-E225或C215中定义的逻辑相关性数据,与贡献再现数据一起被发送到接收用户设备104A、104B或104C时,根据一个或多个接收到的渲染参数RP1和/或渲染参数RP11、RP12,该组合由在接收用户设备104A、104B、104C上执行的客户端应用106执行,其中RP1为主题媒体内容TMC1定义,RP11、RP12为贡献媒体内容CMC11、CMC12定义。When the rendering parameters (combining parameters and/or filtering parameters, and/or rendering order) and/or logical dependency data defined in steps E224-E225 or C215 are sent to the receiving user equipment 104A, 104B or 104C, according to one or more received rendering parameters RP1 and/or rendering parameters RP11, RP12, the combination is performed by the client application 106 executed on the receiving user equipment 104A, 104B, 104C, wherein RP1 is the subject media content Defined by TMC1, RP11 and RP12 are defined by contributed media content CMC11 and CMC12.

该组合可以对应于视频和/或音频内容的加权和、图像或图形的叠加、图像或图形的(空间)并置、视频或音频内容的(时间)串联、内容的卷积、将贡献内容的缩略图包含在主题媒体内容的至少一个图像中,等。The combination may correspond to a weighted sum of video and/or audio content, superposition of images or graphics, (spatial) juxtaposition of images or graphics, (temporal) concatenation of video or audio content, convolution of content, A thumbnail image is included in at least one image of the subject media content, etc.

在至少一个实施方式中,通过生成组合媒体内容,执行该组合,所述组合媒体内容由贡献媒体内容CMC11、CMC12的至少一部分和主题媒体内容TMC1的对应接收的渲染坐标POV1的部分的组合产生。在至少一个实施方式中,组合主题媒体内容的生成由接收用户设备104A、104B或104C的客户端应用106“飞速写入(on the fly)”执行,也就是说在用户设备的RAM存储器中执行,仅仅用于通过用户设备的用户界面渲染该组合媒体内容的目的。特别地,因此,不需要将媒体内容数据文件(包括组合媒体内容)以永久的方式存储在用户设备上。In at least one embodiment, the combination is performed by generating combined media content produced by a combination of at least a portion of the contributing media content CMC11, CMC12 and a portion of the corresponding received rendering coordinates POV1 of the theme media content TMC1. In at least one embodiment, the generation of the combined themed media content is performed "on the fly," that is, in the RAM memory of the user device 104A, 104B, or 104C, by the client application 106 of the receiving user device 104A, 104B, or 104C , solely for the purpose of rendering the combined media content through the user interface of the user device. In particular, therefore, there is no need for the media content data files (including the combined media content) to be stored in a permanent manner on the user equipment.

例如,如图6C-6F所示,当主题媒体内容是视频或图像并且贡献媒体内容是图像或图形时,主题媒体内容的一个或多个像素可以是,在生成的组合媒体内容中、由贡献媒体内容的像素或者由主题媒体内容的像素和贡献媒体内容的相应像素的组合替换。像素的组合可以例如被计算为两个像素的加权和,权重使得能够相对于主题媒体内容调整贡献媒体内容的透明度。For example, as shown in Figures 6C-6F, when the subject media content is a video or image and the contributing media content is an image or graphic, one or more pixels of the subject media content may be, in the generated combined media content, contributed Pixels of the Media Content are either replaced by a combination of pixels of the Subject Media Content and corresponding pixels of the Contributing Media Content. The combination of pixels may, for example, be calculated as a weighted sum of two pixels, the weights enabling adjustment of the transparency of the contributing media content relative to the subject media content.

当贡献媒体内容是音频内容并且主题媒体内容也是音频媒体内容时,两个内容的组合可通过将音频样本以预定义或用户定义的相应权重进行混合来计算。When the contributing media content is audio content and the subject media content is also audio media content, the combination of the two contents may be calculated by mixing the audio samples with predefined or user-defined corresponding weights.

在用户设备101A上执行的客户端应用106被配置为渲染由组合产生的组合媒体内容。因此,用户101A可以查看和/或列出参与媒体内容交换的不同用户的贡献。The client application 106 executing on the user device 101A is configured to render the combined media content resulting from the combining. Accordingly, user 101A can view and/or list the contributions of different users participating in the exchange of media content.

修正后的主题媒体内容可以被生成并存储在用户设备104A的动态存储器中,并且永远不会被保存在用户设备104A的永久存储介质上。因此,组合媒体内容由用户设备上的客户端应用106生成,用于在该用户设备上渲染该组合媒体内容,但是该组合媒体内容不需要永久存储在该用户设备上或通过网络105传输。The revised subject media content may be generated and stored in the dynamic memory of the user device 104A, and never saved on the persistent storage medium of the user device 104A. Thus, the combined media content is generated by the client application 106 on the user device for rendering the combined media content on the user device, but the combined media content need not be permanently stored on the user device or transmitted over the network 105 .

结果,仅需要传输(例如下载)未修改的主题媒体内容和未修改的贡献媒体内容到用户设备。未修改的媒体内容的这种传输只需要执行一次,这与每次作出贡献时组合媒体内容将被发送到每个用户设备的情况相比,减少了内容传输所需的网络带宽。As a result, only unmodified subject media content and unmodified contributed media content need be transmitted (eg, downloaded) to the user device. This transmission of unmodified media content only needs to be performed once, which reduces the network bandwidth required for content transmission as compared to the case where the combined media content would be sent to each user device each time a contribution is made.

在步骤F231中,当参与媒体内容交换的不同用户已经做出若干贡献时,在用户101A的用户设备上执行的客户端应用106被配置为允许用户选择渲染顺序参数,以确定不同贡献必须被渲染的顺序。接收用户在步骤F231中选择的渲染顺序参数可以与贡献用户在步骤E224或C215中定义的渲染顺序RO1相同或不同。In step F231, when different users participating in the media content exchange have made several contributions, the client application 106 executed on the user equipment of the user 101A is configured to allow the user to select a rendering order parameter to determine that different contributions must be rendered Order. The rendering order parameter selected by the receiving user in step F231 may be the same as or different from the rendering order RO1 defined by the contributing user in step E224 or C215.

在步骤F232中,在用户101A的用户设备上执行的客户端应用106被配置为根据在步骤F231中选择的渲染顺序生成贡献的有序列表。贡献列表中的第一贡献被选为当前贡献。In step F232, the client application 106 executing on the user device of user 101A is configured to generate an ordered list of contributions according to the rendering order selected in step F231. The first contribution in the list of contributions is selected as the current contribution.

在步骤F233中,在用户设备101A上执行的客户端应用106被配置为渲染组合媒体内容,该组合媒体内容由主题媒体内容TMC1和在步骤F232生成的贡献列表中选择的当前贡献的贡献媒体内容的组合产生。In step F233, the client application 106 executed on the user equipment 101A is configured to render combined media content consisting of the topic media content TMC1 and the currently contributed contribution media content selected in the contribution list generated in step F232 combination produced.

在步骤F234中,在用户设备101A上执行的客户端应用106被配置为在步骤F232中生成的贡献列表中选择下一个贡献。在步骤F234之后,用新选择的贡献执行步骤F233。执行步骤F234,直到渲染完贡献列表的所有贡献,或者直到客户端应用106接收到停止渲染的命令。In step F234, the client application 106 executing on the user device 101A is configured to select the next contribution in the list of contributions generated in step F232. After step F234, step F233 is performed with the newly selected contribution. Step F234 is executed until all contributions in the contribution list are rendered, or until the client application 106 receives a command to stop rendering.

因此,用户101A可以查看和/或列出不同用户对媒体内容交换的贡献。Accordingly, user 101A can view and/or list contributions of different users to the exchange of media content.

图4通过表示与媒体内容交换相关的媒体内容之间的示例性相关性树,来说明不同的渲染顺序可能性。在该示例中,媒体内容交换包括主题媒体内容T1,和贡献媒体内容M1至M7。对于每个贡献媒体内容,定义了时间戳、渲染坐标、贡献用户、以及(可选的)与另一贡献媒体内容的逻辑相关性。在本示例中,以下是对媒体内容交换连续做出的贡献:Figure 4 illustrates different rendering order possibilities by representing an exemplary dependency tree between media content related to media content exchange. In this example, the media content exchange includes topical media content T1, and contributed media content M1 through M7. For each contributed media content, a timestamp, rendering coordinates, contributing user, and (optionally) a logical dependency to another contributed media content are defined. In this example, the following are continuous contributions to media content exchange:

-媒体M1在时间戳TS1形成用户U1的贡献,用于渲染坐标C1,与另一贡献媒体内容没有逻辑相关性,并且被标注为M1(TS1,C1,U1);- media M1 forms a contribution of user U1 at timestamp TS1 for rendering coordinates C1, has no logical correlation with another contributed media content, and is labeled M1(TS1, C1, U1);

-媒体M2在时间戳TS2形成用户U2的贡献,用于渲染坐标C1,与另一贡献媒体内容没有逻辑相关性,并且被标注为M2(TS2,C1,U2);- Media M2 forms a contribution of user U2 at timestamp TS2 for rendering coordinates C1, has no logical correlation with another contributed media content, and is labeled M2(TS2, C1, U2);

-媒体M3在时间戳TS3形成用户U1的贡献,用于渲染坐标C2,而与另一贡献媒体内容没有逻辑相关性,并且被标注为M3(TS3,C2,U1);- Media M3 forms a contribution of user U1 at time stamp TS3 for rendering coordinate C2, without logical correlation to another contributed media content, and is labeled M3(TS3, C2, U1);

-媒体M4在时间戳TS4形成用户U2的贡献,用于渲染坐标C1,具有对媒体M1的逻辑相关性并且被标注为M4(TS4,C1,U2);- Media M4 forms the contribution of user U2 at timestamp TS4 for rendering coordinates C1, has a logical dependency on media M1 and is labeled M4(TS4, C1, U2);

-媒体M5在时间戳TS5形成用户U3的贡献,用于渲染坐标C2,与媒体M2具有逻辑相关性,并被标注为M5(TS5,C2,U3);- Media M5 forms the contribution of user U3 at timestamp TS5 for rendering coordinates C2, logically related to media M2, and labeled M5(TS5, C2, U3);

-媒体M6在时间戳TS6形成用户U2的贡献,用于渲染坐标C3,与媒体M3具有逻辑相关性,并被标注为M6(TS6,C3,U2);- Media M6 forms the contribution of user U2 at timestamp TS6 for rendering coordinate C3, has a logical correlation with media M3 and is labeled M6(TS6, C3, U2);

-媒体M7在时间戳TS7形成用户U3的贡献,用于渲染坐标C3,与媒体M6具有逻辑相关性,并被标注为M7(TS7,C3,U3)。- Media M7 forms the contribution of user U3 at time stamp TS7 for rendering coordinate C3, has a logical correlation with media M6 and is labeled M7(TS7, C3, U3).

当用户选择时间顺序时,贡献媒体内容将按以下顺序渲染:M1,M2,M3,M4,M5,M6,M7。When the user selects a chronological order, the contributed media content will be rendered in the following order: M1, M2, M3, M4, M5, M6, M7.

当用户选择基于渲染坐标的顺序时,通过使用相同渲染坐标的贡献媒体内容的时间顺序,贡献媒体内容将按以下顺序渲染:M1,M2,M4,M3,M5,M6,M7。When the user selects an order based on rendering coordinates, the contributed media content will be rendered in the following order by using the chronological order of the contributed media content using the same rendering coordinates: M1, M2, M4, M3, M5, M6, M7.

当用户选择基于用户的顺序时,通过使用同一用户的贡献媒体内容和对用户进行分类的时间顺序,贡献媒体内容将按照以下顺序渲染:M1,M3,M2,M4,M6,M5,M7。When a user selects a user-based order, by using the same user's contributed media content and the chronological order in which users are categorized, the contributed media content will be rendered in the following order: M1, M3, M2, M4, M6, M5, M7.

当用户选择基于相关性的顺序时,通过使用相同相关性链的贡献媒体内容和用于分类相关性链的时间顺序,贡献媒体内容将按照以下顺序渲染:M1,M4,M2,M5,M3,M6,M7。When the user selects a dependency-based order, by using the contributed media content of the same dependency chain and the chronological order used to sort the dependency chain, the contributed media content will be rendered in the following order: M1, M4, M2, M5, M3, M6, M7.

图2G示出了用于注册媒体内容交换的媒体内容的方法的一个实施方式。该方法适用于主题媒体内容或贡献媒体内容。该方法适用于本地存储在用户设备104A-104C上的媒体内容、存储在远程媒体服务器103A-103B上的媒体内容、由web应用经由web服务器103A提供的媒体内容、由在用户设备104A上本地执行的源应用提供的媒体内容。Figure 2G illustrates one embodiment of a method for registering media content for a media content exchange. This method is suitable for topical media content or contributed media content. The method is applicable to media content stored locally on user equipment 104A-104C, media content stored on remote media servers 103A-103B, media content provided by web applications via web server 103A, performed locally on user equipment 104A The media content provided by the source application of the .

源应用是例如苹果公司开发的软件应用源应用是被配置为提供对应于一组至少一个输入参数(在本示例中,是定位区域中的地理位置)的媒体内容(例如图像、3D图像、视频、地理地图、街景等)的软件应用或软件应用组件。The source application is e.g. Apple Inc. developed software applications A source application is a software application configured to provide media content (e.g., images, 3D images, videos, geographic maps, street views, etc.) corresponding to a set of at least one input parameter (in this example, a geographic location within a location area) or software application components.

在步骤G240G24中,服务器应用107从请求用户设备(例如用户设备104B)接收,用于注册媒体内容(主题媒体内容或贡献媒体内容)的至少一个请求。In step G240G24, the server application 107 receives at least one request for registering media content (themed media content or contributed media content) from the requesting user equipment (eg user equipment 104B).

该请求包括关于要注册的媒体内容的访问信息。例如,该请求包括到媒体内容的链接、相对于请求用户设备的存储介质的本地访问路径、通用资源定位符(URL)、通用资源指示符(URI)、源应用标识、服务器标识,或者可以用于定位和访问媒体内容数据的任何形式的任何其他参数或信息。The request includes access information about the media content to be registered. For example, the request includes a link to the media content, a local access path relative to the storage medium of the requesting user device, a universal resource locator (URL), a universal resource indicator (URI), a source application identifier, a server identifier, or can be Any other parameters or information in any form for locating and accessing media content data.

在步骤G241中,服务器应用107将表示媒体内容的媒体内容数据集存储在数据库102D中。记录的媒体内容数据集包括由服务器应用107分配给媒体内容的媒体内容标识符。In step G241, the server application 107 stores a media content data set representing the media content in the database 102D. The recorded media content data set includes a media content identifier assigned to the media content by the server application 107 .

在步骤G242中,服务器应用107确定是否必须将媒体内容上载到媒体服务器103C,以便使媒体内容可以从任何用户设备104A-104C访问。在至少一个实施方式中,当媒体内容在注册之前,还不能从任何用户设备104A-104C永久访问时,媒体内容必须上载到媒体服务器103C。例如,必须上载本地存储在请求用户设备上的媒体内容。例如,必须上载存储在web服务器上的作为临时web内容的媒体内容,或者必须上载该临时web内容的表示。例如,如果源应用可以在用于访问媒体内容的任何用户设备104A-104C上执行,则不必上载源应用提供的媒体内容。In step G242, the server application 107 determines whether the media content must be uploaded to the media server 103C in order to make the media content accessible from any of the user devices 104A-104C. In at least one embodiment, when the media content is not permanently accessible from any user device 104A-104C prior to registration, the media content must be uploaded to the media server 103C. For example, media content stored locally on the requesting user's device must be uploaded. For example, media content stored on a web server as temporary web content must be uploaded, or a representation of the temporary web content must be uploaded. For example, the media content provided by the source application need not be uploaded if the source application can execute on any of the user devices 104A-104C used to access the media content.

在步骤G243中,当在步骤G242中确定需要上载媒体内容时,服务器应用107向请求用户设备104B发送用于将媒体内容上载到媒体服务器103C的命令。媒体内容被上传并由媒体服务器103C存储。生成与媒体服务器103C上的媒体内容的位置相对应的访问数据,并将其存储在表示媒体内容的媒体内容数据集中。访问数据允许经由远程媒体服务器103C从用户设备访问媒体内容数据。In step G243, when it is determined in step G242 that the media content needs to be uploaded, the server application 107 sends a command for uploading the media content to the media server 103C to the requesting user equipment 104B. Media content is uploaded and stored by the media server 103C. Access data corresponding to the location of the media content on the media server 103C is generated and stored in a media content data set representing the media content. Access data allows access to media content data from user equipment via the remote media server 103C.

在步骤G244中,当在步骤G242C1中确定不需要上载媒体内容时,服务器应用107在表示媒体内容的媒体内容数据集中存储与媒体内容的位置相对应的访问数据。访问数据对应于从请求用户设备104B接收的访问信息。访问数据可以包括内容源的标识和/或用于经由内容源访问媒体内容的参数。例如,这些访问数据包括到网页超文本链接、通用资源定位符(URL)、通用资源指示符(URI)、源应用标识、服务器标识、或经由源应用或替代地经由不同于远程媒体服务器103C的媒体服务器访问媒体内容数据所需的任何其他参数。在源应用提供媒体内容的情况下,访问数据可以包括源应用的标识和标识主题媒体内容的至少一个应用参数,以用于从源应用获取主题媒体内容。在由web服务器提供的网页的情况下,访问数据可以包括经由所述web服务器到所述网页的超文本链接。In step G244, when it is determined in step G242C1 that the media content does not need to be uploaded, the server application 107 stores access data corresponding to the location of the media content in the media content data set representing the media content. The access data corresponds to the access information received from the requesting user device 104B. Access data may include an identification of a content source and/or parameters for accessing media content via the content source. For example, such access data includes hypertext links to web pages, universal resource locators (URLs), universal resource indicators (URIs), source application identifications, server identifications, or via a source application or alternatively via a server other than the remote media server 103C Any other parameters required by the media server to access the media content data. Where the source application provides the media content, the access data may include an identification of the source application and at least one application parameter identifying the subject media content for retrieving the subject media content from the source application. In the case of a web page provided by a web server, the access data may comprise a hypertext link to said web page via said web server.

在注册媒体内容之后,媒体内容可由参与媒体内容交换的用户的用户设备104A-104C访问,并且可由这些用户设备从至少一个媒体服务器或源应用下载或访问。After registering the media content, the media content can be accessed by the user devices 104A-104C of the users participating in the media content exchange, and can be downloaded or accessed by the user devices from at least one media server or source application.

通过在三维(3D)空间中表示,图5A-5C示出了与媒体内容交换相关的媒体内容及它们的相对关系。Represented in three-dimensional (3D) space, Figures 5A-5C illustrate media content and their relative relationships in relation to media content exchange.

该3D空间包括三个轴。This 3D space includes three axes.

第一水平轴PV是表示在主题媒体内容上的视点(或者更一般地是渲染点)的轴。在图5A所示的示例中,PV轴表示主题媒体内容的时间轴,相对于该主题媒体内容,可以定义渲染坐标,即时间码。The first horizontal axis PV is the axis representing the viewpoint (or more generally the rendering point) on the subject media content. In the example shown in FIG. 5A , the PV axis represents the time axis of the theme media content, relative to the theme media content, rendering coordinates, ie time codes, can be defined.

第二水平轴TS是表示讨论的时间轴(即,现实世界中的时间)。TS轴表示例如与主题媒体内容和贡献媒体内容相关联的时间戳值。The second horizontal axis TS is a time axis representing the discussion (ie, time in the real world). The TS axis represents, for example, timestamp values associated with subject media content and contributed media content.

第三轴CT是表示贡献的轴。The third axis CT is an axis representing contribution.

媒体内容交换的主题按照惯例由三轴系统的原点表示。The subject of media content exchange is conventionally represented by the origin of the three-axis system.

图5A对应于包括主题TP1和贡献CT1的媒体内容交换。如图5A所示:Figure 5A corresponds to a media content exchange comprising a topic TP1 and a contribution CT1. As shown in Figure 5A:

-在时间戳00:00,主题TP1已由用户标识符为ID1的用户定义;该主题TP1例如是视频内容;以及- at time stamp 00:00, a topic TP1 has been defined by a user with user identifier ID1; this topic TP1 is eg video content; and

-在时间戳10:18处,贡献CT1已经由用户标识符为ID2的用户定义,该贡献为针对定义主题TP1上的视点的时间码@3:41相对应的主题TP1的部分,例如对应于时间码@3:41的主题TP1的图像。- At time stamp 10:18, a contribution CT1 has been defined by user with user identifier ID2 as part of topic TP1 corresponding to timecode @3:41 defining a viewpoint on topic TP1, for example corresponding to Image of topic TP1 at timecode @3:41.

如图5B所示,时间码@3:41处的贡献可以由不同的媒体内容和滤波器(F1)来定义,该滤波器(F1)应用于主题TP1与为该贡献定义的视点相对应的部分。在图5B的示例中,媒体内容包括:As shown in Figure 5B, the contribution at timecode @3:41 can be defined by different media content and a filter (F1) applied to the subject TP1 corresponding to the viewpoint defined for this contribution part. In the example of Figure 5B, the media content includes:

-第一图形内容(G1),- first graphic content (G1),

-第二图形内容(G2),- second graphic content (G2),

-第一文本内容(T1),- first text content (T1),

-第二文本内容(T2),- the second text content (T2),

-第三文本内容(T3),- third text content (T3),

-第一视频内容(V1),以及- first video content (V1), and

-第二视频内容(V2)。- Second video content (V2).

表示在图5B中的媒体内容的顺序,代表了这些媒体内容用于渲染该组合媒体内容而必须被组合的顺序,该组合媒体内容来自贡献媒体内容和主题媒体内容的对应于视点的部分的组合。例如在图5B中:The order of the media content shown in FIG. 5B represents the order in which the media content must be combined for rendering the combined media content from the combination of the contributing media content and the portion of the subject media content corresponding to the viewpoint. . For example in Figure 5B:

-首先,将滤波器F1应用于与时间码@3:41相对应的主题TP1的图像;- First, apply filter F1 to the image of subject TP1 corresponding to timecode @3:41;

-然后通过将图形内容G1与滤波图像组合(例如叠加)来执行第一组合;- a first combination is then performed by combining (for example superimposing) the graphical content G1 with the filtered image;

-然后通过将由第一组合产生的图像与图形内容G2组合(例如叠加)来执行第二组合;- then perform a second combination by combining (for example superimposing) the image resulting from the first combination with the graphic content G2;

-然后通过将由第二组合产生的图像与文本内容T1组合(例如叠加)来执行第三组合;- then perform a third combination by combining (for example superimposing) the image resulting from the second combination with the text content T1;

-然后通过将由第三组合产生的图像与文本内容T2组合(例如叠加)来执行第四组合;-then perform a fourth combination by combining (for example superimposing) the image resulting from the third combination with the text content T2;

-然后通过将由第四组合得到的图像与文本内容T3组合(例如叠加)来执行第五组合;-then perform a fifth combination by combining (for example superimposing) the image resulting from the fourth combination with the text content T3;

然后通过将由第五组合产生的图像与视频内容V1组合(例如并置)来执行第六组合;A sixth combination is then performed by combining (e.g. juxtaposing) the image resulting from the fifth combination with the video content V1;

-然后通过将由第六组合产生的视频内容与视频内容V2组合(例如并置)来执行第七组合。- A seventh combination is then performed by combining (eg juxtaposing) the video content resulting from the sixth combination with the video content V2.

图5C对应于包括主题TP1和若干贡献CT1至CT7的媒体内容交换。如图5C所示:Figure 5C corresponds to a media content exchange comprising a topic TP1 and several contributions CT1 to CT7. As shown in Figure 5C:

-在时间戳00:00,主题TP1已由用户标识符为ID1的用户定义;该主题TP1例如是视频内容;- At time stamp 00:00, topic TP1 has been defined by the user with user identifier ID1; this topic TP1 is for example video content;

-在时间戳10:18处,贡献CT1已经由用户标识符为ID2的用户定义,该贡献为针对定义主题TP1上的视点的时间码@3:41相对应的主题TP1的部分,例如对应于时间码@3:41的主题TP1的图像;并且相似的,- At time stamp 10:18, a contribution CT1 has been defined by user with user identifier ID2 as part of topic TP1 corresponding to timecode @3:41 defining a viewpoint on topic TP1, for example corresponding to Image of subject TP1 at timecode @3:41; and similarly,

-在时间戳11:05,贡献CT2已经由用户标识符为ID2的用户定义,该贡献为针对与时间码@0:50相对应的主题TP1的图像;- At time stamp 11:05, a contribution CT2 has been defined by a user with user identifier ID2, the contribution being an image for topic TP1 corresponding to timecode @0:50;

-在时间戳11:32,贡献CT3已经由用户标识符为ID2的用户定义,该贡献为针对与时间码@2:34相对应的主题TP1的图像;- At time stamp 11:32, contribution CT3 has been defined by user with user identifier ID2, the contribution being an image for topic TP1 corresponding to timecode @2:34;

-在时间戳11:51处,贡献CT4已经由用户标志服为ID3的用户定义,该贡献为针对与时间码@0:50相对应的主题TP1的图像;- At time stamp 11:51, contribution CT4 has been defined by user ID3, the contribution being an image for topic TP1 corresponding to timecode @0:50;

-在时间戳12:58处,贡献CT5已经由用户标识符为ID3的用户定义,该贡献为针对与时间码@3:41相对应的主题TP1的图像;- At timestamp 12:58, contribution CT5 has been defined by user with user identifier ID3, the contribution being an image for topic TP1 corresponding to timecode @3:41;

-在时间戳13:02,贡献CT6已经由用户标识符为ID1的用户定义,该贡献为针对与时间码@2:34相对应的主题TP1的图像;- At timestamp 13:02, contribution CT6 has been defined by user with user identifier ID1, the contribution being an image for topic TP1 corresponding to timecode @2:34;

-在时间戳13:27,贡献CT7已经由用户标识符为ID1的用户定义,该贡献为针对与时间码@0:50相对应的主题TP1的图像。- At time stamp 13:27, a contribution CT7 has been defined by the user with user identifier ID1, the contribution being an image for topic TP1 corresponding to timecode @0:50.

图6A-6I表示根据至少一个实施方式的用户界面。在图6A-6I所示的示例中,主题媒体内容是图像,并且媒体内容交换是在由主机应用实现的即时消息会话的环境中实现的。主机应用是结合了针对客户端应用106描述的功能的消息应用。6A-6I illustrate user interfaces in accordance with at least one embodiment. In the example shown in Figures 6A-6I, the subject media content is an image, and the exchange of media content is effected within the context of an instant messaging session implemented by a host application. The host application is a messaging application that incorporates the functionality described for client application 106 .

在图6A的示例中,即时消息会话的消息显示在用户101A的用户设备上的用户界面600中。用户101B(“用户1”)的贡献出现在用户界面600的左侧,而用户101A(“用户2”)的贡献出现在用户界面600的右侧。用户101A刚刚向用户101B发送了短信601。在图6B的示例中,用户101A已经接收到图像602,由用户界面600左侧的缩略图602表示。如果用户101A执行一些预定义动作,例如如果用户101A选择图像602的缩略图,则图像602可以用作当前消息传送会话的环境中的媒体内容交换的主题。该动作之后,图6C的用户界面被显示。显示第一用户界面元素603(图标603),用于允许用户101A对主题做出贡献。显示第二用户界面元素604(图标604),用于允许用户101A返回消息会话。假设用户101A选择第一用户界面元素603,则显示图6D的用户界面。显示三个用户界面元素,其分别对应于用于生成贡献的不同工具:用于绘制自由形状的第一图标608,用于记录图像或视频的第二图标609和用于写入文本的第三图标610。可以显示另一个用户界面元素607(图标607)以允许用户101A取消动作并返回到图6C的用户界面。可以显示另一个用户界面元素606(图标606),以允许用户101A验证贡献并注册它。一旦用户101A做出贡献,用户界面包括图像605,图像605通过组合媒体内容表示该贡献,该组合媒体内容由图像602和三个贡献媒体内容605A、605B、605C(分别对应于文本605A,视频605B和自由形状605C)的组合产生。In the example of FIG. 6A, messages of an instant messaging conversation are displayed in user interface 600 on user device of user 101A. Contributions from user 101B (“User 1”) appear on the left side of user interface 600 , while contributions from user 101A (“User 2 ”) appear on the right side of user interface 600 . User 101A has just sent a text message 601 to user 101B. In the example of FIG. 6B , user 101A has received image 602 , represented by thumbnail 602 on the left side of user interface 600 . If the user 101A performs some predefined action, for example if the user 101A selects a thumbnail of the image 602, the image 602 can be used as the subject of media content exchange in the context of the current messaging session. Following this action, the user interface of Figure 6C is displayed. A first user interface element 603 (icon 603 ) is displayed for allowing user 101A to contribute to the topic. A second user interface element 604 (icon 604 ) is displayed for allowing user 101A to return to the messaging conversation. Assuming that the user 101A selects the first user interface element 603, the user interface of FIG. 6D is displayed. Three user interface elements are displayed, corresponding to different tools for generating contributions: a first icon 608 for drawing freeform shapes, a second icon 609 for recording an image or video and a third icon for writing text icon 610 . Another user interface element 607 (icon 607 ) may be displayed to allow user 101A to cancel the action and return to the user interface of FIG. 6C . Another user interface element 606 (icon 606 ) may be displayed to allow user 101A to verify the contribution and register it. Once user 101A has made a contribution, the user interface includes an image 605 that represents the contribution through combined media content consisting of image 602 and three contributed media content 605A, 605B, 605C (corresponding to text 605A, video 605B, respectively). and Freeform 605C) combination results.

假设用户101A使用用户界面元素606验证贡献,用户界面600再次显示(如图6E所示),并且包括表示用户101A的贡献的图像605的缩略图。主题和贡献根据主机应用的请求在用户101A的用户设备上注册。主题关联数据和贡献关联数据由此由服务器应用107注册。服务器应用107向用户101B的用户设备上的主机应用发送相应的主题再现数据和贡献再现数据。Assuming user 101A verifies the contribution using user interface element 606, user interface 600 is displayed again (as shown in FIG. 6E) and includes a thumbnail image 605 representing user 101A's contribution. Topics and contributions are registered on the user device of user 101A at the request of the host application. The subject-associated data and contribution-associated data are thus registered by the server application 107 . The server application 107 sends the corresponding theme rendering data and contribution rendering data to the host application on the user device of the user 101B.

在用户101A的贡献之后,如图6F所示,即时消息会话的消息显示在用户101B的用户设备上的主机应用的用户界面620中。用户101A(“用户2”)的贡献出现在用户界面620的左侧,而用户101B(“用户1”)的贡献出现在用户界面620的右侧。因此,通过渲染组合媒体内容(图像605),用户101A的贡献(图像605)由用户101B的用户设备上的主机应用再现,该组合媒体内容对应于图像602以及三个贡献媒体内容605A、605B、605C的组合。After user 101A's contribution, the messages of the instant messaging conversation are displayed in user interface 620 of the host application on user device of user 101B, as shown in Figure 6F. Contributions from user 101A (“User 2”) appear on the left side of user interface 620 , while contributions from user 101B (“User 1 ”) appear on the right side of user interface 620 . Thus, user 101A's contribution (image 605) is rendered by the host application on user device of user 101B by rendering the combined media content (image 605) corresponding to image 602 and the three contributed media content 605A, 605B, Combination of 605C.

如果用户101B执行一些预定动作,例如如果用户101B选择缩略图605,则用户101B可以对媒体内容交换做出进一步的贡献。该动作之后,显示图6G的用户界面。图6G的用户界面类似于图6C。显示第一用户界面元素603(图标603),用于允许用户101B对主题做出贡献。显示第二用户界面元素604(图标604),用于允许用户101B返回消息会话。If the user 101B performs some predetermined action, for example if the user 101B selects the thumbnail 605, the user 101B may make a further contribution to the media content exchange. After this action, the user interface of Figure 6G is displayed. The user interface of Figure 6G is similar to that of Figure 6C. A first user interface element 603 (icon 603 ) is displayed for allowing user 101B to contribute to the topic. A second user interface element 604 (icon 604 ) is displayed for allowing user 101B to return to the messaging conversation.

假设用户101A选择第一用户界面元素603,显示图6H的用户界面。图6H的用户界面类似于图6D。显示了三个用户界面元素,它们分别对应于用于产生贡献的不同工具:用于绘制自由形状的第一图标608、用于记录图像或视频的第二图标609、和用于写入文本的第三图标610。可以显示另一用户界面元素607(图标607),用于允许用户101A取消动作并返回到图6G的用户界面。可以显示另一用户界面元素606(图标606),用于允许用户101A验证贡献并注册它。用户101A可以选择图像601的矩形部分来做出贡献。默认情况下,选择整个图像。例如,用户101选择整个图像并使用用户界面项608、609、610之一,用于相对于该图像做出贡献。一旦用户101B做出了贡献,用户界面包括图像611的缩略图,该缩略图通组合媒体内容来表示该贡献,该组合媒体内容由图像602以及两个贡献媒体内容611A、611B(分别对应视频611A、文本611B)的组合产生。Assuming that the user 101A selects the first user interface element 603, the user interface of FIG. 6H is displayed. The user interface of Figure 6H is similar to that of Figure 6D. Three user interface elements are shown, corresponding to different tools for generating contributions: a first icon 608 for drawing a freeform shape, a second icon 609 for recording an image or video, and a 609 icon for writing text. The third icon 610 . Another user interface element 607 (icon 607 ) may be displayed for allowing user 101A to cancel the action and return to the user interface of FIG. 6G . Another user interface element 606 (icon 606 ) may be displayed for allowing user 101A to verify the contribution and register it. User 101A may select a rectangular portion of image 601 to contribute. By default, the entire image is selected. For example, user 101 selects the entire image and uses one of user interface items 608, 609, 610 for contributing with respect to that image. Once user 101B has made a contribution, the user interface includes a thumbnail of image 611 representing the contribution with the combined media content consisting of image 602 and two contributed media content 611A, 611B (respectively for video 611A). , text 611B) combination produces.

假设用户101B验证贡献,用户界面620再次显示(如图6I所示),并且包括表示用户101B的贡献的图像611的缩略图。用户101B的贡献根据主机应用的请求在用户101B的用户设备上注册。贡献关联数据由此被服务器应用107注册。服务器应用107向运行在用户101A的用户设备上的主机应用发送相应的贡献再现数据,从而能够在用户101A的用户设备上再现用户101B的贡献。Assuming user 101B verifies the contribution, user interface 620 is again displayed (as shown in FIG. 6I ) and includes a thumbnail of image 611 representing user 101B's contribution. User 101B's contribution is registered on user 101B's user device at the request of the host application. The contribution association data is thus registered by the server application 107 . The server application 107 sends the corresponding contribution reproduction data to the host application running on the user equipment of the user 101A, so that the contribution of the user 101B can be reproduced on the user equipment of the user 101A.

图7A-7E表示根据至少一个实施方式的用户界面。在图7A-7E所示的示例中,主题媒体内容是图像或视频,并且媒体内容交换是在由主机应用实现的媒体内容提供商的服务的环境中实现的。主机应用例如是与媒体内容提供商的服务器通信并结合针对客户端应用106描述的功能的web应用。7A-7E represent user interfaces according to at least one embodiment. In the examples shown in FIGS. 7A-7E , the subject media content is images or videos, and the media content exchange is implemented in the context of a media content provider's service implemented by a host application. The host application is, for example, a web application that communicates with the media content provider's server and incorporates the functionality described for client application 106 .

在图7A的示例中,显示用于管理媒体内容的主机应用的用户界面700。用户界面700包括缩略图,每个缩略图表示基于图像的内容。例如,用户界面700包括表示视频701的缩略图701。如果用户101A执行一些预定动作,例如如果用户101A选择视频701的缩略图,视频701可以用作在主机应用的环境中媒体内容交换的主题。该动作之后,显示图7B的用户界面。In the example of FIG. 7A, a user interface 700 of a host application for managing media content is displayed. User interface 700 includes thumbnail images each representing image-based content. For example, user interface 700 includes thumbnail image 701 representing video 701 . If the user 101A performs some predetermined action, for example if the user 101A selects a thumbnail of the video 701, the video 701 can be used as the subject of media content exchange in the context of the host application. After this action, the user interface of Figure 7B is displayed.

图7B的用户界面类似于图6C。显示第一用户界面元素703(图标703),用于允许用户101A对主题做出贡献。显示第二用户界面元素704(图标704),用于允许用户101A返回到主机应用。The user interface of Figure 7B is similar to that of Figure 6C. A first user interface element 703 (icon 703 ) is displayed for allowing user 101A to contribute to the topic. A second user interface element 704 (icon 704 ) is displayed for allowing user 101A to return to the host application.

假设用户101A选择第一用户界面元素703,显示图7C的用户界面。显示了三个用户界面元素,它们分别对应于用于产生贡献的不同工具:用于绘制自由形状的第一图标708,用于记录图像或视频的第二图标709,和用于写入文本的第三图标710。可以显示另一用户界面元素706(图标706),用于允许用户101A取消动作并返回到图7B的用户界面。可以显示另一用户界面元素705(图标705)以允许用户101A验证贡献,以在媒体内容提供商的服务的环境中注册贡献并发布贡献。用户101A可以选择视频701的任何渲染点和/或任何部分来做出贡献。例如,用户101选择视频701的一个图像并使用用户界面项708、709、710之一,用于相对于该图像做出贡献。一旦用户101A做出了贡献,用户界面包括缩略图707,缩略图707通过组合媒体内容表示该贡献,该组合媒体内容由视频701的图像、以及包括文本707A和自由形状707B的若干贡献媒体内容的组合产生。Assuming that the user 101A selects the first user interface element 703, the user interface of FIG. 7C is displayed. Three user interface elements are shown, corresponding to different tools for generating contributions: a first icon 708 for drawing freeform shapes, a second icon 709 for recording an image or video, and a 709 icon for writing text. The third icon 710 . Another user interface element 706 (icon 706 ) may be displayed for allowing user 101A to cancel the action and return to the user interface of FIG. 7B . Another user interface element 705 (icon 705 ) may be displayed to allow the user 101A to verify the contribution, to register the contribution and to publish the contribution in the context of the media content provider's service. User 101A may select any rendered point and/or any portion of video 701 to contribute. For example, user 101 selects an image of video 701 and uses one of user interface items 708, 709, 710 for contributing with respect to that image. Once user 101A has made a contribution, the user interface includes a thumbnail image 707 representing the contribution through combined media content consisting of an image of video 701, and several pieces of contributed media content including text 707A and freeform shapes 707B. combination produced.

假设用户101A验证他的贡献,用户界面711如图7D所示显示,并且包括表示用户101A的贡献的缩略图707。除图标705和706之外,图7D的用户界面711包括若干用户界面元素,该若干用户界面元素分别对应于不同媒体内容服务(例如,媒体内容提供商或媒体内容应用),用于经由相应的媒体内容服务发布贡献。假设用户101A选择这些图标720-724之一,用户101A的贡献通过相应的服务提供给其他用户。更具体地,用户101A的贡献可以在另一用户(例如用户101B)的用户设备上的实施所选媒体内容服务的主机应用的用户界面再现。如图7E所示,通过渲染组合媒体内容(例如,视频),再现用户101A的贡献,该组合媒体内容由视频701的至少一个图像和贡献媒体内容707A-707B的组合产生。Assuming user 101A validates his contribution, user interface 711 is displayed as shown in Figure 7D and includes thumbnail image 707 representing user 101A's contribution. In addition to the icons 705 and 706, the user interface 711 of FIG. 7D includes several user interface elements, which respectively correspond to different media content services (for example, media content providers or media content applications) for Media content service publishing contribution. Assuming that user 101A selects one of these icons 720-724, the contribution of user 101A is provided to other users through the corresponding service. More specifically, user 101A's contribution may be rendered in a user interface of a host application implementing a selected media content service on another user's (eg, user 101B's) user device. As shown in FIG. 7E , user 101A's contribution is rendered by rendering combined media content (eg, video) resulting from a combination of at least one image of video 701 and contributed media content 707A-707B.

通过记录表示不同用户对媒体内容交换的每个贡献的贡献关联数据ASC1,服务器应用107跟踪那些连续的贡献,并且使得能够在参与媒体内容交换的其他用户的用户设备上再现那些贡献。在一个或多个实施方式中,从客户端应用106发送到服务器应用107的关联数据(例如,贡献关联数据ASC1和/或主题关联数据AST1)仅包括用于访问相关媒体内容(例如例如URL或任何其他标识数据)的访问数据,而不包括表示相关媒体内容的数据文件,从而减少了服务器应用107和客户端应用106之间用于注册对主题的贡献的网络带宽。By recording contribution association data ASC1 representing each contribution of different users to the media content exchange, the server application 107 keeps track of those successive contributions and enables reproduction of those contributions on user equipments of other users participating in the media content exchange. In one or more implementations, the association data sent from the client application 106 to the server application 107 (e.g., contribution association data ASC1 and/or topic association data AST1 ) only includes information for accessing relevant media content (e.g., URL or Any other identification data), rather than data files representing relevant media content, thereby reducing network bandwidth between the server application 107 and the client application 106 for registering contributions to the topic.

基于注册的关联数据(例如贡献关联数据ASC1和/或主题关联数据AST1),可以通知每个客户端应用106,使得客户端应用106可以访问定义主题和/或贡献的媒体内容,并且在用户设备上再现另一用户在另一用户设备上所做的贡献,而不必将组合媒体内容从一个用户设备发送到另一用户设备。在一个或多个实施方式中,从服务器应用107发送到客户端应用106的再现数据仅包括用于访问相关媒体内容(例如URL或任何其他标识数据)的访问数据,而不包括表示相关媒体内容的数据文件,从而减少用于服务器应用107和客户端应用106之间的用于向参与用户通知对主题的贡献的通信的网络带宽。例如,不需要通过电信网络105发送组合媒体内容。此外,编码主题媒体内容和贡献媒体内容的数据文件必须仅从源设备(例如,媒体服务器103A-103C之一)传输一次到用户的目的地设备104A-104C,以便在用户设备104A-104C上再现贡献。Based on registered association data (such as contribution association data ASC1 and/or theme association data AST1), each client application 106 can be notified so that the client application 106 can access the media content defining the theme and/or contribution, and in the user device Contributions made by another user on another user device can be reproduced on the Internet without having to send the combined media content from one user device to another user device. In one or more implementations, the rendering data sent from the server application 107 to the client application 106 includes only access data for accessing the relevant media content (e.g., a URL or any other identifying data) and does not include information indicating the relevant media content. , thereby reducing the network bandwidth used for communications between the server application 107 and the client application 106 for notifying participating users of contributions to the topic. For example, the combined media content need not be sent over the telecommunications network 105 . In addition, the data files encoding the subject media content and contributing media content must only be transmitted once from the source device (e.g., one of the media servers 103A-103C) to the user's destination device 104A-104C for reproduction on the user device 104A-104C. contribute.

由于与贡献相关联的时间戳,贡献的时间顺序可以被再现。由于与贡献相关联的用户标识符,已经做出贡献的用户可以被接收用户知晓。The chronological order of the contributions can be reproduced due to the timestamps associated with the contributions. Users who have made contributions may be known to the recipient user due to the user identifier associated with the contribution.

与贡献相关联的视点或渲染点用于将贡献链接到主题媒体内容的给定部分。如此,不同贡献可以相对于主题媒体内容的不同部分做出。A viewpoint or rendering point associated with a contribution is used to link the contribution to a given portion of the subject media content. As such, different contributions can be made with respect to different portions of the subject media content.

主题和贡献之间的空间和/或时间关系还可以由贡献用户通过时间和/或空间组合参数来指定,并在接收用户的设备上再现。Spatial and/or temporal relationships between topics and contributions may also be specified by the contributing user via temporal and/or spatial combination parameters and reproduced on the receiving user's device.

逻辑相关性可用于链接两个或多个贡献,从而提供渲染连续贡献的改进方式。具有逻辑相关性的贡献链可用于定义媒体内容交换中的子主题。Logical dependencies can be used to link two or more contributions, providing an improved way of rendering consecutive contributions. Contribution chains with logical dependencies can be used to define subtopics in media content exchanges.

若干主题可以用于同一媒体内容交换,并且上面针对媒体内容交换中的单个主题描述的实施方式可以用于管理那些不同的主题。Several topics can be used for the same media content exchange, and the implementations described above for a single topic in the media content exchange can be used to manage those different topics.

本文描述的方法、设备和系统可以应用于不同的环境。例如,在专业环境中,不同用户必须针对给定视频内容的不同部分进行分享信息/讨论/做出评论。例如个人使用,当家庭的不同成员想要共享视频内容(关于他们的上一个假期)并且发送一些关于视频内容的不同部分的评论时。The methods, devices and systems described herein can be applied in different environments. For example, in a professional environment, different users must share information/discuss/make comments on different parts of a given video content. For example personal use, when different members of the family want to share video content (about their last vacation) and send some comments about different parts of the video content.

Claims (15)

1. a kind of method of the sharing media content between several users, the method includes:
By the first client application executed on the first user equipment for initiating user, (C212) is sent extremely to server application A few request, the theme for media content to be registered as to the exchange of the media content between several users,
By the second client application executed in second user equipment, (C215) is allowed to contribute user relative to the theme matchmaker The first part held in vivo makes the first contribution to the theme,
By second client application, (C216) at least one request is sent to the server application, is indicated for registering The first associated data (ASC1) of first contribution, wherein first associated data (ASC1) indicates in the theme media Being associated between the first part held and at least one first contribution media content, at least one first contribution media Content is selected to form first contribution,
By the third client application executed on the user equipment for receiving user, (C217) packet is received from the server application The contribution reproduce data of first associated data is included, and
By the third client application, by rendering the first combination media content, to reproduce (C218) described first contribution, institute State the first combination media content by it is described first contribute media content at least part with described in the theme media content The combination of first part generates.
2. according to the method described in claim 1, further comprising:
By second client application, receives first from the server application and access data, described first, which accesses data, uses In via remote media server from theme media content described in user equipment access,
By the third client application, receives first from the server application and access data, described first, which accesses data, uses In via the remote media server from theme media content described in user equipment access,
By second client application, data are accessed using described first, via the remote media server, described in access Theme media content, and
By the third client application, data are accessed using described first, via the remote media server, described in access Theme media content.
3. method according to claim 1 or 2, further comprising:
By the third client application, receives second from the server application and access data, described second, which accesses data, uses In via remote media server from contributing media content described in user equipment access, and
By the third client application, data are accessed using described second, described in remote media server access Contribute media content.
4. according to the method described in claim 1, wherein
First associated data includes the mark of the first part of the theme media content, and the mark includes at least One first rendering coordinate, described at least one first renders coordinate relative to rendering associated with the theme media content Rendering point of at least one axis identification of coordinate system for the theme media content.
5. according to the method described in claim 4, wherein
The theme media content is three-dimensional content,
The rendering coordinate system be it is four-dimensional render coordinate system, include three-dimensional system of coordinate for defining camera position and in institute The time shaft of time location defined in three-dimensional content is stated,
At least one first rendering coordinate includes camera position and time location, and
Described first part of the theme media content is to watch from the camera position and opened from the time location The group of at least one image to begin.
6. according to the method described in claim 1, wherein
First associated data (ASC1) indicates the first part of the theme media content, the first contribution media Association between content and the second user, and
First associated data (ASC1) includes the user identifier of the second user,
The method further includes being shown (C218) by first client application, the user of the second user marks Know symbol.
7. according to the method described in claim 1, further comprising:
By second client application, at least one combination parameter (CP11, CP12) is obtained,
By second client application, at least one combination parameter is sent to the server application, and
By the third client application, at least one combination parameter is received from the server application,
The wherein described combination is executed by the third client application according at least one combination parameter.
8. according to the method described in claim 1, further comprising:
By second client application, at least one filtering parameter (FP1) is obtained,
By second client application, at least one filtering parameter is sent to the server application, and
By the third client application, at least one filtering parameter is received from the server application,
Wherein, by the third client application, according at least one filtering parameter, by the theme media content The first part rendering is executed using filter.
9. according to the method described in claim 1, further comprising:
By the 4th client application executed on the user equipment of the second contribution user, (C215) described second contribution is allowed to use The second contribution is made in family relative to the second part of the theme media content to the theme,
By the 4th client application, sends (C216) to the server application and be used to register expression second contribution At least one request of second associated data, wherein second associated data indicates described the second of the theme media content Being associated between part and at least one second contribution media content, at least one second contribution media content are chosen so as to Second contribution is formed,
By the 5th client application executed on the user equipment of the second reception user, received from the server application (C217) include second associated data second contribution reproduce data, and
By the 5th client application, by rendering the second combination media content, reproduction (C218) second contribution is described Described the of at least part and the theme media content that second combination media content contributes media content by described second The combination of two parts generates.
10. according to the method described in claim 9, further comprising:
By the 5th client application, the rendering for obtaining the rendering order for defining first contribution and second contribution is suitable Order parameter, and
By the 5th client application, by rendering the first combination media content, reproduction described first is contributed, described first group Close the first part of at least part and the theme media content that media content contributes media content by described first Combination generate,
Wherein, according to the rendering order parameter, the first combination media content and the second combination media content are executed Rendering.
11. according to the method described in claim 10, further comprising:
By the 4th client application, logical interdependency data (LD1), logical interdependency data (LD1) definition are obtained At least one logical interdependency between the first contribution media content and the second contribution media content,
By the 4th client application, the logical interdependency data (LD1) are sent to the server application, and
By the 5th client application, the logical interdependency data (LD1) are received from the server application,
The wherein described rendering order parameter is the sequence based on correlation based on the logical interdependency data (LD1).
12. according to the method described in claim 1, further comprising:
By first client application, the theme media content is uploaded into the first long-range matchmaker from first user equipment Body server, and
By second client application, at least the one of the theme media content is downloaded from first remote media server Part,
By the third client application, at least the one of the theme media content is downloaded from first remote media server Part.
13. a kind of user equipment, including:
Processor,
It is operatively coupled to the memory of the processor, the memory includes the visitor for being configured to communicate with server application Family end application instruction, described instruction include instruction to:
(C212) at least one request is sent to the server application, for being registered as media content between several users The theme that media content exchanges,
Allow (C215) that user is contributed to make the first contribution to the theme relative to the first part of the theme media content,
(C216) at least one request is sent to the server application, for registering the first association for indicating first contribution Data (ASC1), wherein first associated data (ASC1) indicate the first part of the theme media content at least Association between one first contribution media content, at least one first contribution media content are selected to be formed described the One contribution;
From the server application, it includes indicating to the master to receive (C217) and contribute reproduce data, the contribution reproduce data The registration associated data of second contribution of topic, and
By render the first combination media content, come reproduce (C218) it is described second contribution, the first combination media content by At least part of second contribution media content and the combination of the second part of the theme media content generate.
14. a kind of system, including
Processor,
It is operatively coupled to the memory of the processor, the memory includes being configured to and at least one client application The instruction of the server application of communication, described instruction include instruction to
According to the request of the first client application executed on the user equipment for initiating user, media content is registered into (C212) As between several users media content exchange theme,
According to the request of the second client application executed on the user equipment of contribution user, (C216) first incidence number is registered According to (ASC1), first associated data (ASC1) indicates relative to the first part of the theme media content, to the master First contribution of topic, wherein first associated data (ASC1) indicate the first part of the theme media content with extremely Association between few one first contribution media content, at least one first contribution media content are selected to form described First contribution, and
To the third client application executed on the user equipment for receiving user, sends (C217) and contribute reproduce data, it is described It includes first associated data to contribute reproduce data, and the contribution reproduce data makes it possible to by the third client application First contribution is reproduced, the reproduction includes rendering the first combination media content, and the first combination media content is by described At least part of first contribution media content and the combination of the first part of the theme media content generate.
15. a kind of computer readable storage medium of storage computer executable instructions, the computer executable instructions include Be configured to the instruction of the client application communicated with server application, described instruction include instruction to:
(C212) at least one request is sent to the server application, for being registered as media content between several users The theme that media content exchanges,
(C215) user is allowed to make the first contribution to the theme relative to the first part of the theme media content,
(C216) at least one request is sent to the server application, for registering the first association for indicating first contribution Data, wherein first associated data (ASC1) indicates the first part of the theme media content and at least one the Association between one contribution media content, at least one first contribution media content are selected to form first tribute It offers,
From the server application, it includes indicating to the master to receive (C217) and contribute reproduce data, the contribution reproduce data The registration associated data of second contribution of topic, and
By render the first combination media content, come reproduce (C218) it is described second contribution, the first combination media content by At least part of second contribution media content and the combination of the second part of the theme media content generate.
CN201780007841.7A 2016-01-22 2017-01-19 Method and system for sharing media content among several users Pending CN108604359A (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
EP16152459.0A EP3196830A1 (en) 2016-01-22 2016-01-22 Method and system for sharing media content between several users
US15/004,632 2016-01-22
EP16152459.0 2016-01-22
US15/004,632 US10075399B2 (en) 2016-01-22 2016-01-22 Method and system for sharing media content between several users
PCT/EP2017/051111 WO2017125509A1 (en) 2016-01-22 2017-01-19 Method and system for sharing media content between several users

Publications (1)

Publication Number Publication Date
CN108604359A true CN108604359A (en) 2018-09-28

Family

ID=57995176

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780007841.7A Pending CN108604359A (en) 2016-01-22 2017-01-19 Method and system for sharing media content among several users

Country Status (4)

Country Link
KR (1) KR20180104694A (en)
CN (1) CN108604359A (en)
SG (1) SG11201805704UA (en)
WO (1) WO2017125509A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12204667B2 (en) * 2020-07-28 2025-01-21 Elementum Ltd Selectively granting computer system access credentials to external users and non-users
KR102228572B1 (en) 2020-08-03 2021-03-15 마보현 Electronic device for providing a topic oriented intelligent collaboration service based on artificial interlligence and method for operating thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102332174A (en) * 2011-09-06 2012-01-25 中国科学院软件研究所 A collaborative sketch animation generation method and system
US20140344694A1 (en) * 2013-05-15 2014-11-20 Christopher Gomersall Methods, systems, and user interfaces for prompting social video content interaction
CN104980422A (en) * 2014-10-22 2015-10-14 腾讯科技(深圳)有限公司 Information processing method, client, server and system
CN105183759A (en) * 2015-07-23 2015-12-23 无锡天脉聚源传媒科技有限公司 Picture commenting method and apparatus

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120311624A1 (en) * 2011-06-03 2012-12-06 Rawllin International Inc. Generating, editing, and sharing movie quotes
US10255227B2 (en) * 2012-05-21 2019-04-09 Oath Inc. Computerized system and method for authoring, editing, and delivering an interactive social media video

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102332174A (en) * 2011-09-06 2012-01-25 中国科学院软件研究所 A collaborative sketch animation generation method and system
US20140344694A1 (en) * 2013-05-15 2014-11-20 Christopher Gomersall Methods, systems, and user interfaces for prompting social video content interaction
CN104980422A (en) * 2014-10-22 2015-10-14 腾讯科技(深圳)有限公司 Information processing method, client, server and system
CN105183759A (en) * 2015-07-23 2015-12-23 无锡天脉聚源传媒科技有限公司 Picture commenting method and apparatus

Also Published As

Publication number Publication date
KR20180104694A (en) 2018-09-21
SG11201805704UA (en) 2018-08-30
WO2017125509A1 (en) 2017-07-27

Similar Documents

Publication Publication Date Title
US10075399B2 (en) Method and system for sharing media content between several users
US20230412677A1 (en) Direct input from a nearby device
US8701008B2 (en) Systems and methods for sharing multimedia editing projects
US9460752B2 (en) Multi-source journal content integration systems and methods
US8819559B2 (en) Systems and methods for sharing multimedia editing projects
US20210109630A1 (en) Multi-source journal content integration systems and methods and systems and methods for collaborative online content editing
US9495416B2 (en) Method, apparatus, and system to recommend multimedia contents using metadata
US20160093078A1 (en) Virtual world generation engine
KR101673188B1 (en) Method and apparatus for sharing contents
KR102108849B1 (en) Systems and methods for multiple photo feed stories
US9099151B2 (en) Multimedia content editing server, multimedia content editing method, program, and integrated circuit
CN117633257A (en) System and method for conversion between media content items
US20180061457A1 (en) Systems and methods for dynamically providing video content based on declarative instructions
CN105900121B (en) Methods for generating activity streams
US9930427B2 (en) Providing advanced playback and control functionality to video client
US11726965B2 (en) User-directed digital asset vault
CN103685209A (en) A source-tracing processing method of Internet media files, a server, and a communication system
US20160041723A1 (en) Systems and methods for manipulating ordered content items
CN108604359A (en) Method and system for sharing media content among several users
CN103136268A (en) Method and device for processing with special effect and displaying of images in published contents
US20160041722A1 (en) Systems and methods for processing orders of content items
EP3657427A1 (en) Method and system for sharing media content between several users
CN116204092A (en) Digital library reading room realization system and device based on three-dimensional scene
Szeliski et al. Navigating the worldwide community of photos

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20180928

WD01 Invention patent application deemed withdrawn after publication