[go: up one dir, main page]

WO2025081229A1 - Procédé et système d'accès à un modèle 3d numérique d'une scène - Google Patents

Procédé et système d'accès à un modèle 3d numérique d'une scène Download PDF

Info

Publication number
WO2025081229A1
WO2025081229A1 PCT/AU2024/051086 AU2024051086W WO2025081229A1 WO 2025081229 A1 WO2025081229 A1 WO 2025081229A1 AU 2024051086 W AU2024051086 W AU 2024051086W WO 2025081229 A1 WO2025081229 A1 WO 2025081229A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
model
interactive
link
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/AU2024/051086
Other languages
English (en)
Inventor
Gavin Douglas
Kevin KREFTING
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Drawbridge Labs Asset Pty Ltd
Original Assignee
Drawbridge Labs Asset Pty Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU2023903302A external-priority patent/AU2023903302A0/en
Application filed by Drawbridge Labs Asset Pty Ltd filed Critical Drawbridge Labs Asset Pty Ltd
Publication of WO2025081229A1 publication Critical patent/WO2025081229A1/fr
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/47815—Electronic shopping
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0623—Electronic shopping [e-shopping] by investigating goods or services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0631—Recommending goods or services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
    • G06Q30/0643—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping graphically representing goods, e.g. 3D product representation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/812—Monomedia components thereof involving advertisement data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G06Q30/0255—Targeted advertisements based on user history
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Definitions

  • the present application relates to a method and system for accessing digital content in an interactive manner as it is displayed on a device via a user’s personal device.
  • Embodiments of the present invention are particularly adapted for use in accessing a digital 3D model with handheld mobile devices such as a smartphone.
  • handheld mobile devices such as a smartphone.
  • the invention is applicable in broader contexts and other applications.
  • a method for providing access for a user to an interactive digital 3D model of a scene or event relating to a temporally changing digital content comprising the steps of: a) providing the temporally changing digital content for display on a first device, the digital content including one or more scenes or events; b) generating an indicator at times corresponding to the one or more scenes or events, the indicator being associated with a link; c) allowing activation of the link on a second device; d) in response to the activation of the link, rendering on a display of the second device, an interactive 3D model associated with the scene or event, wherein the interactive 3D model includes one or more selectable objects; and e) allowing the user on the second user device to select one or more of the selectable objects to direct the second device to a data portal to interact with the selected object(s).
  • the temporally changing digital content includes a digital billboard.
  • the temporally changing digital content includes video content.
  • the video content includes a television show.
  • the video content includes on-demand video content.
  • the video content includes a live broadcast video event.
  • the video content includes a live broadcast video event.
  • the video content includes online video.
  • the video content includes social media video.
  • the data portal provides updated content of the link independent of the one or more scenes or events including factors such as when the content is viewed or a demographic of the user.
  • the data portal provides updated content of the link based on other factors such as a season.
  • the data portal includes a webpage containing a list of the selected objects.
  • the webpage provides functionality to purchase the selected objects.
  • the webpage is a third party webpage hosted by an owner of the selected objects.
  • the interaction with the selected object(s) includes a purchase.
  • the first and the second devices are the same device.
  • the activation of the link includes capturing a QR code, HTML link, or a soft button on a touchscreen.
  • the one or more selectable objects are indicative of products that can be purchased.
  • the temporally changing digital content is pre-recorded and wherein the indicator is generated by inserting a trigger at timecodes of the pre-recorded content corresponding to a scene or event.
  • the temporally changing digital content is broadcast live and wherein the indicator is inserted into the temporally changing digital content in real-time or near real-time through a push operation by an operator.
  • the indicator is displayed on the first device.
  • the indicator is displayed on the second device.
  • the interactive 3D model is generated from a digital scan of a real environment associated with the scene or event using a 3D scanner.
  • the interactive 3D model is generated from a plurality of images of a real environment and fed to a generative machine learning model.
  • At least a subset of the one or more selectable objects are generated from a digital scan of a real object using a 3D scanner.
  • At least a subset of the one or more selectable objects are generated from a plurality of images of a real object and fed to a generative machine learning model.
  • the interactive 3D model is configurable.
  • a system for providing access for a user to an interactive digital 3D model of a scene or event relating to a temporally changing digital content comprising: a) a first device, adapted to display the temporally changing digital content, the digital content having a narrative including one or more scenes or events; b) at least one processor adapted to: generate an indicator at times corresponding to a display of at least one of the scenes or events on the first device, the indicator being associated with a link; c) a second user device, adapted to receive the link and allowing the user to activate the link; wherein, in response to the activation of the link, the second user device is configured to render on a display of the second user device, an interactive 3D model of the scene or event, wherein the interactive 3D model includes one or more selectable objects and allow the user on the second user device to select one or more of the selectable objects to direct the second device to a data portal to interact with the selected
  • the first device includes a digital billboard.
  • the temporally changing digital content includes video content.
  • the video content includes a television show.
  • the video content includes on-demand video content.
  • the video content includes a live broadcast video event.
  • the video content includes online video.
  • the video content includes social media video.
  • the data portal provides an updated content of the link dependent on the times corresponding to the display of the at least one of the scenes.
  • the data portal updates the content of the link based on other factors such as a season.
  • the data portal includes a webpage containing a list of the selected objects.
  • the webpage provides functionality to purchase the selected objects.
  • the webpage is a third party webpage hosted by an owner of the selected objects.
  • the interaction with the selected object(s) includes a purchase.
  • the first and the second devices are the same device.
  • the activation of the link includes capturing a QR code, HTML link, or a soft button on a touchscreen.
  • the one or more selectable objects are indicative of products that can be purchased.
  • the temporally changing digital content is pre-recorded and wherein the indicator is generated by inserting a trigger at timecodes of the pre-recorded content corresponding to a scene or event.
  • the indicator is inserted into the temporally changing digital content in real-time or near real-time through a push operation by an operator.
  • the indicator is displayed on the first device (e.g. TV).
  • the indicator is displayed on the second device (e.g. smartphone).
  • the interactive 3D model is configurable.
  • the interactive digital 3D model is comprised of one or more configurable modules defining the one or more selectable objects within the interactive digital 3D model.
  • Figure 1 shows a schematic diagram of an embodiment of the invention
  • Figure 2 shows a further schematic diagram of an embodiment of the invention
  • FIG. 3 shows yet a further schematic diagram of an embodiment of the invention
  • Figure 4 shows a flow chart illustrating the primary steps in a method for providing access for a user to an interactive digital 3D model of a scene or event relating to a temporally changing digital content
  • Figure 5 shows a flow chart in accordance with an embodiment of the invention
  • Figure 6 shows a sequence chart in accordance with an embodiment of the invention.
  • Described herein is a system and method for providing access for a user, such as a consumer to an interactive digital 3D model of a scene or event relating to a temporally changing digital content.
  • Embodiments of the invention described herein relate primarily to a scene/event in the form of a digital program such as a television series with the associated temporally changing digital content being the digital audio and video signal recorded for that program and displayable on electronic devices.
  • other forms of digital content may include websites, social media posts, e-books, online articles, podcasts and digital advertisements.
  • the method and system are accessed by the user from conventional household devices such as televisions and mobile devices (e.g. smartphones or tablet computers) having displays and user interfaces.
  • conventional household devices such as televisions and mobile devices (e.g. smartphones or tablet computers) having displays and user interfaces.
  • mobile devices e.g. smartphones or tablet computers
  • FIG. 1 An aspect of the invention is exemplified schematically in Figures 1 to 3.
  • a schematic is provided to exemplify a system 1000 in accordance with an embodiment of the invention.
  • the system 1000 will be described in conjunction with method 4000, which may be implemented on the system.
  • the system 1000 provides access for a user 106 to an interactive digital 3D model 108 of a scene or event relating to a temporally changing digital content.
  • the temporally changing digital content may include video or digital images that change with time as will be discussed below.
  • the temporally changing digital content may also include digital audio data as well as various metadata.
  • the interactive digital 3D model may be generated utilising image processing methods such as generative Al and will be discussed in more detail below.
  • An example of a scenario in which the temporally changing digital content occurs at a variable rate may include a digital billboard.
  • the digital content may update based on the nature of the content being displayed on the billboard or in accordance with an advertiser’s marketing campaign.
  • the temporally changing digital content will be in the context of video and optionally audio also, such as a program accessible through a video streaming service or a terrestrial television broadcast.
  • the scenes or events represent specific scenes or events that occur within the narrative of the program.
  • a kitchen cooking reality program may include one or more scenes associated with a particular kitchen having a set of kitchen products, appliances and/or ingredients laid out therein.
  • Subsequent scenes of that program may include different kitchens and/or different arrangements of kitchen products, appliances and/or ingredients.
  • a different event may represent a different cooking scenario set in the same kitchen as a previous scenario.
  • the model will include objects such as the kitchen products, appliances and/or ingredients.
  • An interactive digital 3D model 108 of that kitchen can be generated as described in more detail below.
  • the present invention may be used in other contexts such as electronic billboards, online content such as social media content, YouTube videos and the like.
  • the scene or event represents a subset of the overall temporally changing digital content (in the example case, a kitchen cooking reality program), which may include a plurality of scenes or events.
  • the system 1000 includes the provision of initially providing the temporally changing digital content for display on a first device 100, such as a television set, with the digital content including one or more scenes or events.
  • This temporally changing digital content may be provided by way of a digital stream over the internet, on-demand video content, a subscription video service or via a free to air television broadcast as a few examples.
  • the temporally changing digital content may include non-video sources such as temporally changing images in the form of a digital advertising, such as that displayed on an electronic billboard.
  • the temporally changing digital content may also include audio data and metadata associated with the video content.
  • the metadata may include timecodes indicating a temporal order of images or other data in the temporally changing digital content. Nonetheless, the temporally changing digital content, when in the form of video, may include a number of digital video formats including MPEG-2, MPEG- 4, 3GPP or FLV as some examples.
  • the digital content is temporally changing such that scenes or events within the content come and go.
  • the scenes or events may be identified by timecode data or one or more timestamps that are inserted into the data stream.
  • the first device 100 may include a visual display device as was discussed previously, such as a user’s 106 television set, or a user’s 106 mobile device, such as a mobile/cell phone, in the form of a smart phone, a laptop or desktop computer or a tablet computer as some examples.
  • a visual display device such as a user’s 106 television set, or a user’s 106 mobile device, such as a mobile/cell phone, in the form of a smart phone, a laptop or desktop computer or a tablet computer as some examples.
  • an indicator 104 may be generated and presented to the user 106 on the first device 100 at times corresponding to one or more of the scenes or events.
  • the indicator may be generated by inserting a trigger at timecodes of the pre-recorded content corresponding to a scene or event and embedding the indicator into frames of the content during those times. More preferably, an indicator is generated to be presented to the user 106 during a period of time defined by a “starttime” and an “end-time”.
  • the period between the start-time and end-time corresponds to a display of one of the scenes/events and is when the indicator is presented to the user 106.
  • This start-time and end-time may be set by a creator of the content or by a third party after creation of the content.
  • the one or more indicators may be inserted into the temporally changing digital content in realtime or near real-time through a push operation by an operator.
  • the operator may include a content broadcaster or a third party.
  • the push operation may be performed from the same system or server as that hosting the content or may be pushed from a separate system or server to the content-hosted system/server to augment the content with the indicator(s).
  • the indicator is embedded into the temporally changing digital content for the duration of the push operation.
  • the indicator 104 takes the form of a visual indicator 104 which is presented on the screen of the first device 100 at a time corresponding to the one or more scenes or events.
  • a common indicator may be used for multiple scenes/events or different indicators may be used for different scenes/events.
  • the indicators may be inserted either at post production, or in the case of a live television broadcast, the indicators may be inserted in near real time or real time as the case may be.
  • the indicator 104 may be overlayed on a screen of the first device 100 at a predetermined location such as in a bottom corner of the screen.
  • the indicator may generate an audio signal for output through an audio output of first device 100.
  • the indicator 104 takes the form of a scannable code such as a QR code.
  • a QR code the generation of the QR code may involve encoding data into a two-dimensional scannable code which may be achieved using a number of different software solutions for generating QR codes such as “qr code” libraries available in Python or JavaScript as some examples.
  • the indicator 104 includes a selectable button, such as a “soft button” presented to the screen and associated with a weblink for the user 106 to activate. These latter embodiments are possible where the first device 100 includes an interactive display such as a smartphone or tablet computer.
  • the weblink indicator is displayed on the screen of the first device 100 and is a selectable link that can be activated by the user 106 by touching the weblink.
  • the indicator may take other forms such as a non-visual indicator in the form of an audio signal as one example. It is envisaged, in some embodiments, that the user may activate the weblink by providing an audible instruction to activate the weblink.
  • step 4002 includes the generation of one or more time stamps which are associated with particular events within the video stream.
  • the time stamps may be pre-generated when the digital content is generated or may be added at a later time.
  • the timestamps may be generated at the time of production or shortly thereafter.
  • the time stamps may be inserted into the digital data in real or near-real time by a number of methods that may include a push operation by an operator or a push operation by a server that is being called by an agreed list of scenes/events based on the timecode.
  • the time stamps are preferably in the form of a sequence of characters or encoded information identifying when the event or scene occurred in the program/content.
  • the time stamps may be associated with a timecode of the digital content.
  • the time stamps may be designated by an absolute measure of time (if referenced to a common reference such as a clock signal) or may include a relative measure of time such as from a starttime of the program/content.
  • the time stamps may include sufficient significant figures so as to be accurate to a fraction of a second.
  • the time stamps conform with one or more standards such as ISO 8601 .
  • time stamps may be associated with key segments of the video stream, allowing the user 106 to interact with a particular scene at a particular time in the video stream. Time stamps may be generated corresponding to a start time and an end time of a scene/event.
  • the generation of the indicator 104 then provides an opportunity for the user 106 to activate a link associated with the indicator 104.
  • the indicator includes a QR code
  • the user 106 is able to scan the QR code on a second device 102, which may include a personal device such as a smart phone or a tablet computer.
  • the user 106 may choose not to scan the indicator if the content associated with the scene is not of interest to the user 106 at that particular time stamp.
  • the first device 100 and second device 102 are one and the same device.
  • the indicator 104 is generated on the device with the content being viewed.
  • the indicator 104 which, in the embodiment shown takes the form of a QR code 104, then provides a link which is then activated on the user’s 106 second device 102 (e.g. smart phone or table computer).
  • the link may include a HTML or hyperlink that is associated with a visible or non-visible URL or address available over the internet or another network.
  • the link then is activated on the second device 102 (or first device 100 if the user 106 is viewing the content on a smart phone) by the user 106.
  • the first device upon activation of the link associated with the indicator 104, the first device is directed to the URL or address associated with the link via a web browser or other executable application.
  • the URL or address is hosted by a server that hosts an interactive 3D model of the scene/event.
  • the interactive 3D model 108 associated with the scene/event is rendered on a display of the second device 102 (or first device 100 where the user 106 is viewing the content on a smart phone or tablet computer).
  • the interactive 3D model 108 is associated with the scene or event which was displayed at the time at which the indicator 104 was presented to the user 106. Therefore, the contents of each link will typically be unique for the scene/event associated with a given indicator.
  • the interactive 3D model 108 is preferably hosted on a server that may accessed by the second device 102 over the internet or another network.
  • the interactive 3D model 108 may emulate the living room that was presented to the user 106 at that time.
  • the interactive 3D model 108 then allows the user to interact with the scene through the second device 102 in response to an indicator 104 being presented on the first device.
  • the generation of the interactive 3D model 108 will be described in more detail below.
  • the interactive 3D model 108 includes one or more selectable objects that preferably correspond to objects that were displayed in the scene/event of the digital content. Furthermore, the interactive 3D model 108 preferably takes the form of a 3D rendering of the scene/event of the digital content. By way of example, where the temporally changing digital content corresponds to a kitchen cooking program, the interactive 3D model may represent a 3D model of the kitchen being displayed at that time.
  • the one or more selectable objects may correspond to cooking items, utensils, appliances or ingredients used in the scene/event.
  • decimating the interactive 3D model 108 involves reducing the number of polygons or vertices comprising the interactive 3D model 108 while preserving the overall shape and appearance of the model.
  • the interactive 3D model 108 is then rebuilt utilizing less polygons or vertices, thus load times for the interactive 3D model 108 may be reduced from ten or more seconds on slower devices to a fraction of that amount.
  • Other methods employed to reduce the load time may include, but are not limited to; lowering the resolution of the images comprising the 3D models, removing post processing and refactoring the product and item representations in the interactive 3D model 108.
  • the user can manipulate the display/device to interact with the objects within the model. This manipulation includes moving a current view or position around the 3D model and/or zooming in or out to view different areas of the rendered scene.
  • the interactive 3D model 108 is comprised of one or more configurable modules which define the one or more selectable objects within the interactive 3D model 108.
  • the one or more configurable modules allow for user editing of aspects of the interactive 3D model 108.
  • the configurable modules in the form of software modules, may include a set of functions which may be used throughout the interactive 3D model 108.
  • the set of functions may also be stored in a library for use on different 3D models.
  • the act of editing the aspects or properties of the interactive 3D model 108 by the operator of, for example, an online store, may create a new version of that online store.
  • the operator of the online store can also generate a new indicator in the form of a QR code representing that new online store that can be placed onto the temporally changing digital content. This results in keeping the new online store synchronised with the temporally changing digital content, so that the products shown in the temporally changing digital content continue to match the products provided in the online store via the interactive 3D model 108.
  • a variety of different software modules may be utilised to edit aesthetic aspects of the interactive 3D model 108 such as rendering modules, texture modules, shader modules and user interface (III) modules as some examples.
  • the functionality of the interactive 3D model may also be adjusted for insofar as the III is concerned.
  • an operator of an online store may wish to adjust the properties of items presented in the online store represented by the interactive 3D model 108 or may wish to edit the appearance of certain items or the manner in which a potential customer may interact with the interactive 3D model 108.
  • These properties may include specific items presented for sale within the interactive 3D model 108, such as a particular line of shoes or clothing as some examples, or the means of purchasing those items.
  • each of the objects within the interactive 3D model 108 may be selectable for editing with user selectable boundaries being defined within the scene of the interactive 3D model 108. This may be achieved by selecting on the item to be edited, where a menu may be presented upon selection (as will be discussed further below) for editing parameters within the configurable modules to alter the properties of the objects within the interactive 3D model 108. In one example, as previously discussed, selecting a given object within the 3D model 108 may invoke a menu allowing for the customization of the given object or the adjustment of items presented for purchase within that object.
  • the objects within the interactive 3D model 108 may be selected by way of a device such as a mouse (in the context of a computer), or remote control when in the context of a television display, or in the context of a handheld device by way of interaction with a touch screen display.
  • a device such as a mouse (in the context of a computer), or remote control when in the context of a television display, or in the context of a handheld device by way of interaction with a touch screen display.
  • the user 106 is able to select one or more of the selectable objects to direct the second device 102 to a data portal to interact with the selected object(s).
  • the selectability may be implemented by defining the objects as ‘soft buttons’ that are defined to have corresponding bounding boxes or borders corresponding approximately to the visual shape of the object. If the position, shape or size of the object changes over time, the corresponding position, shape or size of the soft buttons may change also.
  • the object selection process may be by way of a hidden HTML or hyperlink associated with a corresponding URL or address accessed by the internet or another network.
  • this data portal may include a website associated with and hosted by a merchant selling the products.
  • the selectable objects represent educational items (e.g. animals in a documentary program)
  • the data portal may include a website providing educational information on the items.
  • the selectable objects are associated with one or more weblinks (e.g. HTML links) to direct the second device 102 to the data portal.
  • the data portal may include more than one website or links to multiple websites and may also include a checkout page for purchasing multiple items from different merchants.
  • the user is able to interact with the selectable objects in other ways prior to being directed to the data portal.
  • a user may be able to select the objects to have the interface present more information on the objects, increase their size or rotate them.
  • a user 106 is provided with a headset 200 (such as a VisionPro headset) in which the user 106 can interact with a 3D model.
  • the headset 200 represents both the first device 100 and second device 102.
  • the user 106 is able to select and activate the link associated with the indicator using a physical gesture rather than scanning a code as in previous embodiments.
  • the user views the interactive 3D model 108 through the headset 200 and is able to select the selectable objects and navigate the data portal.
  • a further embodiment of the invention is provided in which a video sharing platform (such as YouTube or TikTok) is viewed by a user 106 on the user’s personal device 102.
  • the first device and the second device are the same device 102 and the user 106 is presented with an indicator 104 on the user’s device 102.
  • the user 106 can then choose to respond to the indicator 104, by either tapping on the indicator or providing a gesture to the device. Based on the interaction with the indicator 104, the user 106 is then able to access the interactive 3D model by way of a link associated with the indicator 104.
  • the link being dependent on the event/scene (and/or optionally an embedded timecode) defining a time at which the indicator 104 was first presented to the user 106.
  • the labels A, B and C represent different periods of time in which the user is presented with the indicator 104.
  • Different 3D models may be presented to the user which are dependent on the time at which the user interacts with the indicator 104 as it is presented to the user 106.
  • FIG. 5 there is illustrated a flow chart exemplifying a method of providing a 3D model to a user 106 in accordance with the present invention.
  • the embodiment of Figure 5 is in the context of a television show which is presented to a user 400.
  • an indicator 104 in the form of a QR code, is presented to the user 106.
  • Data related to the indicator is provided based on a timecode which may be predetermined or provided in real time.
  • Data related to the presentation of the time code include data related to user experience, placement, and the television show time code placement.
  • the user 106 chooses to scan the QR code 402
  • data relating to the user’s device i.e. the second device 102
  • the user’s IP address and any previous interactions are sent upon which the user is presented to the interactive 3D model 404, providing a scene related to the temporally changing digital content at the time that the indicator was presented to the user 106, as defined by a time stamp.
  • the user can then browse the 3D model providing items which the user can either investigate for additional information, or the ability to purchase items may be included.
  • the experiences in the 3D model can alter with time during the progression of the television show 408. If the user wants to purchase a product displayed in the 3D model, the user can then select by way of tapping 410 on the relevant product for purchase displayed in the 3D model. If the user chooses to purchase the selected items, the user can select the “buy now” or similar icon and proceed to the seller’s website, transitioning from the 3D model back to a 2D webpage for purchase 418. The user can then complete the checkout process 420 and return to the 3D model 422.
  • the interactive 3D model 108 allows a user to browse items within the interactive 3D model 108 by selecting items by selecting an item of interest. This then provides the user with a 2D model, allowing the user to select items within the 2D model to either purchase or enquire about. Based on data acquired on the user via search histories or from 1 st party data etc., more relevant content may be presented to the user based on their demographic, gender, location and other factors.
  • Figure 6 provides a flow chart representation from the perspective of a user’s 106 device 102.
  • a user opens their device, which may be a smartphone or other smart device, including a camera capable of scanning codes such as a QR code.
  • the user then scans the QR code 500 presented to the user on a first device 100.
  • the first device then accesses a web address embedded in the QR code providing a 3D model 502 for presentation to the user.
  • One aspect of the present invention involves the generation of an interactive 3D model which provides selectable objects to be selected by a user.
  • the generation of the interactive 3D model may utilize well known 3D modelling software such as Blender, Autodesk, Maya, 3ds or ZBrush as some examples.
  • the interactive 3D model may be generated using generative artificial intelligence (Al) where an image input on the first device may be captured at a given timestamp and provided to a generative Al system.
  • Generative Al essentially works by creating new content such as text, images or sound based on patterns learned from existing data.
  • GANs Generative Adversarial Networks
  • VAEs Variational Autoencoders
  • GTT Generative Pre-trained Transformer
  • An example of a generative Al system is ChatGPT, which can take as an input still or video images and provide an emulation of the still or video images as an output.
  • the term “temporally changing” is used throughout the description to mean content that changes with time. However, unlike video which changes at a precise rate (for example 24 frames per second), the period related to “temporally changing” may be variable or constant and may be measured in seconds, hours, days, weeks or months etc. For instance, an electronic billboard may have temporally changing content that may be updated when a product changes, or the content may change based on a predetermined sequence.
  • controller or “processor” may refer to any device or portion of a device that processes electronic data, e.g., from registers and/or memory to transform that electronic data into other electronic data that, e.g., may be stored in registers and/or memory.
  • a “computer” or a “computing machine” or a “computing platform” may include one or more processors.
  • any one of the terms comprising, comprised of or which comprises is an open term that means including at least the elements/features that follow, but not excluding others.
  • the term comprising, when used in the claims should not be interpreted as being limitative to the means or elements or steps listed thereafter.
  • the scope of the expression a device comprising A and B should not be limited to devices consisting only of elements A and B.
  • Any one of the terms including or which includes or that includes as used herein is also an open term that also means including at least the elements/features that follow the term, but not excluding others. Thus, including is synonymous with and means comprising.
  • Coupled may mean that two or more elements are either in direct physical, electrical or optical contact, or that two or more elements are not in direct contact with each other but yet still co-operate or interact with each other.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Theoretical Computer Science (AREA)
  • Strategic Management (AREA)
  • Marketing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Game Theory and Decision Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Artificial Intelligence (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un procédé et un système pour fournir un accès pour un utilisateur à un modèle 3D numérique interactif d'une scène ou d'un événement relatif à un contenu numérique à changement temporel (4000), le procédé comprenant les étapes consistant à : fournir le contenu numérique à changement temporel pour un affichage sur un premier dispositif (4001), le contenu numérique comprenant une ou plusieurs scènes ou événements ; générer un indicateur à des instants correspondant à la ou aux scènes ou événements, l'indicateur étant associé à une liaison (4002) ; permettre l'activation de la liaison sur un second dispositif (4003) ; en réponse à l'activation de la liaison, effectuer un rendu sur un affichage du second dispositif, d'un modèle 3D interactif associé à la scène ou à l'événement, le modèle 3D interactif comprenant un ou plusieurs objets sélectionnables (4004) ; et permettre à l'utilisateur sur le second dispositif utilisateur de sélectionner un ou plusieurs des objets sélectionnables pour diriger le second dispositif vers un portail de données pour interagir avec le ou les objets sélectionnés (4005).
PCT/AU2024/051086 2023-10-16 2024-10-16 Procédé et système d'accès à un modèle 3d numérique d'une scène Pending WO2025081229A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AU2023903302A AU2023903302A0 (en) 2023-10-16 Method and system for accessing a digital 3D model of a scene
AU2023903302 2023-10-16

Publications (1)

Publication Number Publication Date
WO2025081229A1 true WO2025081229A1 (fr) 2025-04-24

Family

ID=95447484

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2024/051086 Pending WO2025081229A1 (fr) 2023-10-16 2024-10-16 Procédé et système d'accès à un modèle 3d numérique d'une scène

Country Status (1)

Country Link
WO (1) WO2025081229A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160182969A1 (en) * 2010-07-30 2016-06-23 Grab Vision Group LLC Interactive advertising and marketing system
US10360946B1 (en) * 2018-08-24 2019-07-23 GameCommerce, Inc. Augmenting content with interactive elements

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160182969A1 (en) * 2010-07-30 2016-06-23 Grab Vision Group LLC Interactive advertising and marketing system
US10360946B1 (en) * 2018-08-24 2019-07-23 GameCommerce, Inc. Augmenting content with interactive elements

Similar Documents

Publication Publication Date Title
US10547909B2 (en) Electronic commerce functionality in video overlays
US10491958B2 (en) Live video stream with interactive shopping interface
US10872193B2 (en) Method for publishing composite media content and publishing system to perform the method
US9277157B2 (en) Interactive marketing system
US10440436B1 (en) Synchronizing interactive content with a live video stream
US9008491B2 (en) Snapshot feature for tagged video
US9912994B2 (en) Interactive distributed multimedia system
EP2044591B1 (fr) Generation automatique de video a partir d'un contenu structure
US12230041B2 (en) Information playback method and device, computer readable storage medium, and electronic device
KR102114701B1 (ko) 미디어 데이터에 있는 아이템을 인식하고 이와 관련된 정보를 전달하기 위한 시스템 및 방법
US12200306B1 (en) Computer program product for allowing a user to create an interactive object in a content owner's digital media file
US20080163283A1 (en) Broadband video with synchronized highlight signals
US20150289022A1 (en) Liquid overlay for video content
WO2013138370A1 (fr) Couche d'objets de superposition interactive de contenu multimédia en ligne
US9665965B2 (en) Video-associated objects
EP3314559A1 (fr) Outils de diffusion pour interfaces d'achats interactives
US20180249206A1 (en) Systems and methods for providing interactive video presentations
US20190325474A1 (en) Shape-based advertising for electronic visual media
US20170024097A1 (en) Method and Host Server for Creating a Composite Media File
CN115039174A (zh) 用于交互式直播视频流传输的系统和方法
WO2025081229A1 (fr) Procédé et système d'accès à un modèle 3d numérique d'une scène
CN117215442A (zh) 显示处理方法、装置、电子设备、存储介质及程序产品
JP6448046B2 (ja) 複合メディアコンテンツの提示方法およびその方法を実行する提示システム
JP2015176597A5 (fr)
WO2014152422A1 (fr) Système de mercatique interactive

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24878268

Country of ref document: EP

Kind code of ref document: A1