WO2013186544A1

WO2013186544A1 - Electronic content synchronization system

Info

Publication number: WO2013186544A1
Application number: PCT/GB2013/051523
Authority: WO
Inventors: Adrian Michael FOWKES
Original assignee: Individual
Current assignee: Individual
Priority date: 2012-06-11
Filing date: 2013-06-11
Publication date: 2013-12-19
Anticipated expiration: 2014-12-11

Description

ELECTRONIC CONTENT SYNCHRONIZATION SYSTEM

The present invention relates to an electronic system configured to synchronize electronic content accessible by a user's computer with digital television broadcast audio and/or video content and, in particular, second screen application synchronization, which is a mechanism for synchronizing content for display on a second screen application with live video content that is being played out through a transmission network for display on a first screen.

BACKGROUND OF THE INVENTION

A second screen application is an application or website that is designed to run on a computer such as a laptop, tablet or smart phone alongside video and audio content presented on a television (the first screen).

The second screen application is generally intended to involve the viewer in the content presented on the first screen for example by providing additional information, links to further content, ability to interact with the content and opportunities to respond to advertising. A second screen application often has content or cues synchronized with the content on the first screen (the television program).

This synchronization is shown in schematic form 10 in Figure 1 in which as time passes different events on the first screen 12 have different content on the second screen 14 synchronized with them. There are two contexts in which first screen content can be played. Firstly, it may be received live over air/cable. Secondly, it may be being replayed after first being recorded from live. In the first case, all viewers will have the same time frame as the broadcaster and in the second case, all viewers will be watching in a time frame arbitrarily far behind the live broadcast, each with their own time line. The mechanism described herein addresses the live playout case. There are a number of reasons why synchronized second screen content may no longer be relevant for replayed content: voting and polling events are only relevant in the context of a live event, when the votes and polls can be used; for advertising request for information (RFI) responses are often tied to a particular promotional window; and the broadcaster may want to take down the second screen application content for a show after the end of the run. There are a number of known mechanisms that provide second screen application synchronization. Broadly they fall into two categories as set-out below.

AUDIO RECOGNITION

As illustrated in Figure 2, audio recognition approaches 20 are content-driven, and rely on the second screen device 22 "listening" to the audio output of the television (first screen device) 24.

One audio recognition approach is Automatic Content Recognition (ACR). In this arrangement, a second screen device 22 "listens" to the audio content 23 from a first screen device 24 provided, in this example from a broadcaster 26 via a local distributor 28, until a key sound bite is recognised (that is also audible to the person viewing the first screen device), followed by synchronized operation to view particular content on the second screen device. In these arrangements, the second screen application has to be launched and listening for the particular audio clip which synchronizes the application with content on a content server 30. This requires a suitable environment (audio must be loud and background noise must be quiet) to work and can reduce the battery life of a second screen device.

Another audio recognition approach is watermarking. In this arrangement, a second screen device 22 listens to the content until a watermark is recognised, followed by synchronized operation. The watermark may be, for example, a particular low frequency noise inaudible to a person. This arrangement requires the original audio content to be modified to watermark it. The second screen application still has to be launched and listening, and it suffers from the same issues as ACR.

SYNCHRONIZATION THROUGH REMOTE CONTROL

An approach 30 involving synchronization through remote control is illustrated in Figure 3. This approach is also content-driven, and relies on interaction with the first screen device 32, normally a set-top box (STB), to synchronize with a second screen application 34. In this example, audio and video content 46 is provided by a broadcaster 42 via a local distributor to the first screen device 32.

The STB 32 runs a first screen application and the broadcaster 42 sends events to that application, via a local distributor 38, to provide synchronization. The viewer invokes a synchronized second screen application by interacting with the STB application via the remote control 36 of the STB. The STB application sends a message back through the local distributor 38 to the broadcaster 42, which is used to synchronize the second screen application to access content on a content server 44, on a registered second screen device 34. A registration database 40 is required in communication connection with the broadcaster to associate the STBs with the corresponding second screen devices.

This approach requires the STB 32 to download and run an appropriate application to respond to the remote control 36 and also for the messages from STB to be routed back to the broadcaster 42. This requires a network of system configurations and commercial agreements for each local distributor. BRIEF SUMMARY OF THE INVENTION

Embodiments of the invention described herein address the problems of the prior art described above.

The invention in its various aspects is defined in the independent claims below to which reference should now be made. Advantageous features are set forth in the dependent claims.

Arrangements are described in more detail below and take the form of an electronic system configured to synchronize electronic content accessible by a user's computer with digital television broadcast audio and/or video content. The electronic system comprises a digital television broadcaster and a content server. The digital television broadcaster is configured to broadcast digital television comprising audio and video content, and interactive content. The interactive content comprises a synchronization annotation to synchronize electronic content accessible by a user's computer with the audio and/or video content. The content server is configured to store electronic content accessible by a user's computer. The electronic content is synchronised to the audio and/or video content by the synchronization annotation. Embodiments of the electronic system comprise a trigger detector that detects the synchronization annotation and transmits a signal to the content server to update the electronic content accessible by a user's computer dependent on the synchronization annotation.

Embodiments of the synchronization annotation (stream event or trigger) exist specifically to provide synchronization of interactive content to video on a user's computer (first screen). In these arrangements, advantageously, the second screen content is synchronized centrally (as part of or within the digital television broadcast network) rather than on the viewer (the second screen). BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be described in more detail, by way of example, with reference to the accompanying drawings, in which:

Figures 1 to 3 (prior art) are schematic diagrams illustrating known second screen application synchronization arrangements; and Figure 4 is a schematic diagram of an electronic system embodying the present invention.

DETAILED DESCRIPTION OF THE INVENTION

An example electronic system 100 configured to synchronize electronic content accessible by a user's computer 102 (second screen) with digital television broadcast audio and/or video content (first screen) and, in particular, second screen application synchronization or a mechanism for synchronizing second screen content, will now be described with reference to Figure 4.

The electronic system 100 is configured to synchronize electronic content accessible by a user's computer 102 (for example, a desktop computer, laptop computer, smartphone, or tablet computer) with digital television broadcast audio and/or video content broadcast by a broadcaster 110. In the example of Figure 4, the broadcaster broadcasts a digital television broadcast to a local distributor 114 who distributes it to first screen devices 104 (for example, televisions or STBs).

The digital television broadcaster 110 is configured to broadcast digital television comprising audio and video content, and interactive content 112. The interactive content includes a synchronization or trigger annotation to synchronize electronic content stored on a content server accessible by a user's computer 102 with the audio and/or video content. The electronic content may be accessible by a user's computer via a web browser and/or by a dedicated application (an app) running on the user's computer. A trigger detector 106 or trigger detector computer is provided that detects the

synchronization annotation and transmits a signal to the content server 108 to update the electronic content accessible by the user's computer 102 dependent on the synchronization annotation. In this example, the trigger detector receives the broadcast digital television data stream from the broadcaster 110. In this way, the digital television broadcast network or electronic system 100 is configured or operated to detect synchronization annotation in a digital television data stream to synchronize electronic content stored on the content server or computer 108 with the digital television data stream.

An electronic system or annotator 116, a computer program, a computerized method, or a computer-readable medium containing a set of computer implementable instructions is provided to add synchronization annotation to the interactive content portion of a digital television data stream for synchronizing the electronic content stored on the content server 108 with the digital television data stream to form broadcast digital television or annotated content 112. The computer-readable medium may be, for example, a CD-ROM, DVD- ROM, hard disk drive or solid state memory.

In more detail, the mechanism for synchronizing second screen content requires that the video content for the primary screen (first screen) 104 is annotated with additional information. This additional information provides an indication of significant events in the content to allow synchronization between the first screens 104 and second screens 102. As mentioned above, the annotation is in the form of interactive content. Interactive content (for example, Enhanced TV Binary Interchange Format (EBIF)/enhanced TV (ETV)) is carried in the digital data stream of a digital television broadcast alongside the video and audio content and provides applications that run on the first screen device 104 alongside the video and audio, allowing the viewer or user to see the applications overlaid on the video and allowing the viewer to interact with them using a remote control of the first screen device. Standards and mechanisms already exist for inserting interactive content into a digital data stream of a digital television broadcast alongside the video, either by pre- binding the content into a video file, or by injecting the content in real time into the digital data stream alongside the video. The mechanism for synchronizing the second screen content uses trigger detector 106 within the broadcast network. This detects the interactive content annotation in the digital data stream and uses the information from that annotation to update the server or content server 108 containing content for the second screen application with the appropriate new data for the event.

The broadcaster 110 may choose to carry the interactive content through the broadcast chain so that it is available as an overlay to the video on the first screen device 104, or drop the interactive content after it has been read by this mechanism.

The mechanism is content driven, so it matches what is being broadcast, regardless of schedule changes or late advert insertion decisions. The second screen application will have a polling element within it so that it can detect and react to new information on the content server 108. Because the second screen application is synchronized by the content from the content server 108, it does not have to be invoked at any particular time, nor does it have to be running before the associated programs or events. The broadcaster 110 may choose to place an icon on screen (on the first screen 104) to prompt the viewer or user to launch the appropriate second screen application on the second screen device or the user's computer 102. The second screen application can also be used alongside cable, terrestrial and satellite first screen devices 104, as it is not dependent on the delivery technology to achieve synchronization. It is also not dependent on the capability of the first screen (TV or STB).

The second screen application content may be updated in a number of ways. For example, to present new textual or pictorial information on the second screen 102; to start streaming additional video content on the second screen 102; to present new links to additional information on the second screen 102; to present prompts to answer questions for quizzes and polls on the second screen 102; or to present new advertising material on the second screen 102. If a broadcaster 110 provides a national feed that is the same across the whole country, that is that the synchronization annotation is provided by a national digital television broadcaster 110, they may add a listener just before the uplink. This allows them to generate synchronized second screen application content in response to events from all of their annotated TV content, including both editorial content and national adverts. If a local distributor 114 wishes to do the same, they may add listeners in their distribution system, which processes events in both editorial and advertising content. This may be done at either a national or local level. Thus, the synchronization annotation may be provided by a local digital television broadcaster or distributor 114.

If the channel content or timing varies between local distributors 114 or time zones, then the second screen application may need a mechanism to determine which distributor, region or time zone it is synchronized with, to pick up the appropriate localized content. The synchronization or trigger annotation may include an indication of a provider or distributor that provided the synchronization annotation and/or the region and/ or time zone. In this way, the application on the second screen device or computer 102 would display content relevant to the location, distributor or time zone.

Embodiments of the present invention have been described. It will be appreciated that variations and modifications may be made to the described embodiments within the scope of the present invention.

Claims

1. An electronic system configured to synchronize electronic content accessible by a user's computer with digital television broadcast audio and/or video content, the electronic system comprising:

a digital television broadcaster configured to broadcast digital television comprising audio and video content, and interactive content, the interactive content comprising a synchronization annotation to synchronize electronic content accessible by a user's computer with the audio and/or video content; and

a content server configured to store electronic content accessible by a user's computer;

wherein the electronic content is synchronised to the audio and/or video content by the synchronization annotation.

2. An electronic system according to claim 1 , further comprising a trigger detector that detects the synchronization annotation and transmits a signal to the content server to update the electronic content accessible by a user's computer dependent on the synchronization annotation.

3. An electronic system according to claim 1 or 2, wherein the synchronization annotation is provided by a national digital television broadcaster.

4. An electronic system according to claim 1 or 2, wherein the synchronization annotation is provided by a local digital television broadcaster.

5. An electronic system according to any preceding claim, wherein the synchronization annotation comprises an indication of a provider that provided the synchronization annotation.

6. An electronic system according to any preceding claim , wherein the interactive content comprises content in Enhanced TV Binary Interchange Format (EBIF).

7. An electronic system according to any preceding claim, wherein the broadcast digital television comprises enhanced TV (ETV) format content.

8. An electronic system according to any preceding claim, wherein the user's computer comprises a desktop computer, laptop computer, smartphone, or tablet computer.

9. An electronic system according to any preceding claim, wherein the electronic content is accessible by a user's computer via a web browser and/or by a dedicated application running on the user's computer.

10. A method of synchronizing content accessible by a user's computer with digital television broadcast audio and/or video content, the method comprising:

a digital television broadcaster broadcasting digital television comprising audio and video content, and interactive content, the interactive content comprising a synchronization annotation to synchronize electronic content accessible by a user's computer with the audio and/or video content; and

a computer synchronizing, by the synchronization annotation, electronic content accessible by a user's computer stored on a content server to the audio and/or video content.

11. A method according to claim 10, further comprising a trigger detector detecting the synchronization annotation and transmitting a signal to the content server to update the electronic content accessible by a user's computer dependent on the synchronization annotation.

12. A method according to claim 10 or 11 , further comprising a national digital television broadcaster providing the synchronization annotation.

13. A method according to claim 10 or 11 , further comprising a local digital television broadcaster providing the synchronization annotation.

14. A method according to any of claims 10 to 13, wherein the synchronization annotation comprises an indication of a provider that provided the synchronization annotation.

15. A method according to any of claims 10 to 14, wherein the interactive content comprises content in Enhanced TV Binary Interchange Format (EBIF).

16. A method according to any of claims 10 to 15, wherein the broadcast digital television comprises enhanced TV (ETV) format content.

17. A method according to any of claims 10 to 16, wherein the user's computer comprises a desktop computer, laptop computer, smartphone, or tablet computer.

18. A method according to any of claims 10 to 17, comprising accessing the electronic content by a user's computer via a web browser and/or by a dedicated application running on the user's computer.

19. An electronic system for digital television broadcast, the electronic system being configured to add synchronization annotation to an interactive content portion of a digital television data stream for synchronizing electronic content stored on a content server with the digital television data stream.

20. An electronic system according to claim 19, wherein the interactive content comprises content in Enhanced TV Binary Interchange Format (EBIF).

21. A electronic system according to claim 19 or 20, wherein the broadcast digital television comprises enhanced TV (ETV) format content.

22. A computerized method for digital television broadcast, the computerized method comprising:

adding synchronization annotation to an interactive content portion of a digital television data stream for synchronizing electronic content stored on a content server with the digital television data stream.

23. A computerized method according to claim 22, wherein the interactive content comprises content in Enhanced TV Binary Interchange Format (EBIF).

24. A computerized method according to claim 22 or 23, wherein the broadcast digital television comprises enhanced TV (ETV) format content.

25. A computer-readable medium containing a set of instructions that causes a computer to add synchronization annotation to an interactive content portion of a digital television data stream for synchronizing electronic content stored on a content server with the digital television data stream.

26. A computer-readable medium according to claim 25, wherein the interactive content comprises content in Enhanced TV Binary Interchange Format (EBIF).

27. A computer-readable medium according to claim 25 or 26, wherein the broadcast digital television comprises enhanced TV (ETV) format content.

28. A computer program for implementing the computerized method of any of claims 22 to 24.

29. A digital television broadcast network, the network being configured to detect synchronization annotation in a digital television data stream to synchronize electronic content stored on a computer with the digital television data stream.

30. A network according to claim 29, wherein the digital television data stream comprises interactive content, and the interactive content comprises the synchronization annotation.

31. A method of operating a digital television broadcast network, the method comprising the network:

detecting synchronization annotation in a digital television data stream; and synchronizing electronic content stored on a computer with the digital television data stream based on the detected synchronization annotation.

32. A method according to claim 31 , wherein the digital television data stream comprises interactive content, and the interactive content comprises the synchronization annotation.