[go: up one dir, main page]

WO2018152630A1 - Systèmes et procédés de surveillance de lecture de contenu enregistré - Google Patents

Systèmes et procédés de surveillance de lecture de contenu enregistré Download PDF

Info

Publication number
WO2018152630A1
WO2018152630A1 PCT/CA2018/050198 CA2018050198W WO2018152630A1 WO 2018152630 A1 WO2018152630 A1 WO 2018152630A1 CA 2018050198 W CA2018050198 W CA 2018050198W WO 2018152630 A1 WO2018152630 A1 WO 2018152630A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
video
sound
audio
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CA2018/050198
Other languages
English (en)
Inventor
Steven Blumenfeld
Rod Archer
Domingo RELACION
Joseph Chiu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TimePlay Inc
Original Assignee
TimePlay Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TimePlay Inc filed Critical TimePlay Inc
Publication of WO2018152630A1 publication Critical patent/WO2018152630A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/4425—Monitoring of client processing errors or hardware failure
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N2017/006—Diagnosis, testing or measuring for television systems or their details for television sound

Definitions

  • the described embodiments relate to systems and methods for monitoring playback of recorded content, and in particular monitoring presence of light and sound during playback of recorded content.
  • an In Venue Light Sound Meter (IVLSM) system and method for capturing the presence or absence of light and sound.
  • the IVLSM is a device that is placed behind a movie screen and measures the inclusion or absence of sound and light, and transmits that data to a central processor where the data is analyzed and aggregated for monitoring and alerting purposes.
  • the IVLSM device is placed in front of the movie screen, such as in the theater or projection booth.
  • the device may also include a filter to distort the image or prevent a portion or portions of the image so that the light data it captures has no real value for any purpose other than monitoring playback.
  • a playback monitoring system located at a venue, the playback monitoring system being communicably coupled to a content playback device configured to play audio and video associated with a content file at the venue, the video being displayed on a display screen and the audio being provided within the venue, the playback monitoring system comprising: a memory unit; a processing unit coupled to the memory unit; at least one video sensor coupled to the memory unit and the processing unit, the at least one video sensor being configured to detect presence of light corresponding to the video being displayed on the display screen within the venue; and at least one audio sensor coupled to the memory unit and the processing unit, the at least one audio sensor being configured to detect presence of sound corresponding to the audio being provided within the venue, the processing unit being configured to generate a light presence signal based on the detection of presence of light by the at least one video sensor, and a sound presence signal based on the detection of sound by the at least one sound sensor.
  • the at least one video sensor is further configured to detect light intensity associated with the video being displayed on the display screen, and generate a corresponding light intensity signal comprising a plurality of light intensity values.
  • the system comprises a content verification record corresponding to the video associated with the content file being played using the content playback device
  • the processing unit is configured to: receive the content verification record from an external server, the content verification record comprising a plurality of brightness values associated with the video being displayed on the display screen; compare the plurality of brightness values within the content verification record to the plurality of light intensity values within the light intensity signal; and generate a correlation index for the video associated with the content file based on the comparison.
  • the at least one audio sensor is further configured to sample sound associated with the audio being provided within the venue, and generate a corresponding sound signal comprising a plurality of sampled sound values.
  • the system comprises a content verification record corresponding to the audio associated with the content file being played using the content playback device, wherein the processing unit is configured to: receive the content verification record from an external server, the content verification record comprising a plurality of sound levels associated with the audio being played within the venue; compare the plurality of sound levels within the content verification record to the plurality of sampled sound values within the sound signal; and generate a correlation index for the sound associated with the content file based on the comparison.
  • the at least one video sensor is a single cell light intensity sensor.
  • the at least one video sensor is located behind the display screen such that it is on the opposite side of the display screen than the content playback device.
  • the at least one video sensor is located on the same side of the display screen as the content playback device.
  • the content file is stored on film.
  • the content file is a digital file.
  • the venue is a movie theater and the content playback device is a projector.
  • a method of monitoring playback of a content file within a venue including a content playback device configured to play audio and video associated with the content file, the video associated with the content file being displayed on a display screen and the audio associated with the content file being provided within the venue, the method comprising: detecting, by at least one video sensor, presence of light corresponding to the video being displayed on the display screen within the venue; detecting, by at least one audio sensor, presence of sound corresponding to the audio being provided within the venue; and generating, by a processing unit coupled to the at least one video sensor and the at least one audio sensor, a light presence signal based on the detection of presence of light by the at least one video sensor, and a sound presence signal based on the detection of sound by the at least one sound sensor.
  • the method comprises detecting, by the at least one video sensor, light intensity associated with the video being displayed on the display screen; and generating, by the processing unit, a corresponding light intensity signal comprising a plurality of light intensity values.
  • the method comprises receiving a content verification record from an external server, the content verification record corresponding to the video associated with the content file being played using the content playback device, the content verification record comprising a plurality of brightness values associated with the video being displayed on the display screen; comparing the plurality of brightness values within the content verification record to the plurality of light intensity values within the light intensity signal; and generating a correlation index for the video associated with the content file based on the comparison.
  • the method comprises sampling, by the at least one audio sensor, the sound associated with the audio being provided within the venue; and generating a corresponding sound signal comprising a plurality of sampled sound values.
  • the method comprises receiving a content verification record from an external server, the content verification record corresponding to the audio associated with the content file being played using the content playback device, the content verification record comprising a plurality of sound levels associated with the audio being played within the venue; comparing the plurality of sound levels within the content verification record to the plurality of sampled sound values within the sound signal; and generating a correlation index for the sound associated with the content file based on the comparison.
  • a method of monitoring playback of content where a content server initiates playback of a particular item of content.
  • the content server transmits a message to a playback monitor controller identifying the particular content and indicating that the content is about to be played back.
  • the playback monitor controller retrieves a content verification record corresponding to the particular content.
  • the content verification record contains a series of expected brightness values that are temporally correlated with the video content.
  • the playback monitor controller receives a light intensity signal from a sensor, and produces a corresponding series of average light intensity values.
  • the playback monitor controller compares the expected brightness values with the average light intensity values to provide a video correlation index.
  • the playback monitor controller provides the video correlation index to the content server, which makes use of it, for example, to verify that an advertisement or other video content has been played back at a venue.
  • a computer-readable medium storing computer-executable instructions.
  • the instructions cause a processor to perform a method of monitoring playback of a content file within a venue, the venue including a content playback device configured to play audio and video associated with the content file, the video associated with the content file being displayed on a display screen and the audio associated with the content file being provided within the venue, the method comprising: detecting, by at least one video sensor, presence of light corresponding to the video being displayed on the display screen within the venue; detecting, by at least one audio sensor, presence of sound corresponding to the audio being provided within the venue; and generating, by a processing unit coupled to the at least one video sensor and the at least one audio sensor, a light presence signal based on the detection of presence of light by the at least one video sensor, and a sound presence signal based on the detection of sound by the at least one sound sensor.
  • the instructions cause the processor to perform the method comprising: detecting, by the at least one video sensor, light intensity associated with the video being displayed on the display screen; generating, by the processing unit, a corresponding light intensity signal comprising a plurality of light intensity values; receiving a content verification record from an external server, the content verification record corresponding to the video associated with the content file being played using the content playback device, the content verification record comprising a plurality of brightness values associated with the video being displayed on the display screen; comparing the plurality of brightness values within the content verification record to the plurality of light intensity values within the light intensity signal; and generating a correlation index for the video associated with the content file based on the comparison.
  • the instructions cause the processor to perform the method comprising sampling, by the at least one audio sensor, the sound associated with the audio being provided within the venue; generating a corresponding sound signal comprising a plurality of sampled sound values; receiving a content verification record from an external server, the content verification record corresponding to the audio associated with the content file being played using the content playback device, the content verification record comprising a plurality of sound levels associated with the audio being played within the venue; comparing the plurality of sound levels within the content verification record to the plurality of sampled sound values within the sound signal; and generating a correlation index for the sound associated with the content file based on the comparison.
  • the instructions cause the processor to perform the methods as described above or other methods in accordance with the teachings herein.
  • FIG. 1 A is an example of a block diagram of a content playback system
  • FIG. 1 B is another example of a block diagram of a content playback system
  • FIG. 1 C is another example of a block diagram of a content playback system
  • FIG. 2A is an example of a block diagram of a content playback system illustrating the location of various components with respect to each other;
  • FIG. 2B is another example of a block diagram of a content playback system illustrating the location of various components with respect to each other;
  • FIG. 3 is an example of a graph of a content verification record
  • FIG. 4A is an example of a graph of a light intensity signal
  • FIG. 4B is another example of a graph of a light intensity signal
  • FIG. 5 is an example of a block diagram of a playback monitoring system
  • FIG. 6 is an example of a method of monitoring playback of a content file that may be used by the playback monitoring system
  • FIG. 7 is another example of a method of monitoring playback of a content file that may be used by the playback monitoring system.
  • FIG. 8 is another example of a method of monitoring playback of a content file that may be used by the playback monitoring system.
  • Coupled or “coupling” as used herein can have several different meanings depending in the context in which these terms are used.
  • the terms coupled or coupling may be used to indicate that an element or device can electrically, optically, or wirelessly send data to another element or device as well as receive data from another element or device.
  • any recitation of numerical ranges by endpoints herein includes all numbers and fractions subsumed within that range (e.g. 1 to 5 includes 1 , 1 .5, 2, 2.75, 3, 3.90, 4, and 5). It is also to be understood that all numbers and fractions thereof are presumed to be modified by the term "about” which means a variation of up to a certain amount of the number to which reference is being made if the end result is not significantly changed.
  • the example embodiments of the systems and methods described herein may be implemented as a combination of hardware or software.
  • the example embodiments described herein may be implemented, at least in part, by using one or more computer programs, executing on one or more programmable devices comprising at least one processing element, and a data storage element (including volatile memory, non-volatile memory, storage elements, or any combination thereof).
  • These devices may also have at least one input device (e.g. a pushbutton keyboard, mouse, a touchscreen, and the like), and at least one output device (e.g. a display screen, a printer, a wireless radio, and the like) depending on the nature of the device.
  • At least some of these software programs may be stored on a storage media (e.g. a computer readable medium such as, but not limited to, ROM, magnetic disk, optical disc) or a device that is readable by a general or special purpose programmable device.
  • the software program code when read by the programmable device, configures the programmable device to operate in a new, specific and predefined manner in order to perform at least one of the methods described herein.
  • programs associated with the systems and methods of the embodiments described herein may be capable of being distributed in a computer program product comprising a computer readable medium that bears computer usable instructions for one or more processors.
  • the medium may be provided in various forms, including non-transitory forms such as, but not limited to, one or more diskettes, compact disks, tapes, chips, and magnetic and electronic storage.
  • the various embodiments disclosed herein generally relate to systems and methods for monitoring playback of recorded content, and in particular monitoring presence of light and sound during playback of recorded content.
  • content is used herein to describe moving video images or audio. Some content may include both video and audio that are correlated to one another. Content may be stored digitally, on film, or otherwise fixed in any tangible medium of expression.
  • a movie may include video content and audio content (which may include one or more audio tracks) that is temporally correlated to the video content.
  • the video and audio content may be encoded using any appropriate video encoding format such as MP4, WMV, FLV, AVI, QuicktimeTM, 3GP, H.264 or other formats that will be known to a skilled person.
  • the resulting encoded audio data and video data are recorded in one or more data files, according to the selected format, which may be referred to as audio files or video files.
  • Some encoding formats allow audio data to be recorded together with video data in a single data file, which may typically be referred to as a video file.
  • Data files are typically stored in a file system or data store.
  • FIG. 1A illustrates a block diagram of a content playback system 100A in accordance with an example embodiment.
  • the content is digitally stored.
  • System 100A includes a content server 102, a data storage system 104, a video playback system 106, an audio playback system 108 and a playback monitoring system 1 10.
  • Video playback system 106 may also be referred to as a video reproduction system.
  • Audio playback system 108 may also be referred to as an audio reproduction system.
  • Data storage system 104 is a data recording device that is accessible to content server 102.
  • Data storage system 104 may be located locally or remotely to content server 102 and may be accessed through any type of cable or communication system, such as a universal serial bus (USB) cable, a local area network, a wide area network or any combination of such networks, including the Internet.
  • the content server 102 may be able to access more than one data storage systems, each analogous to data storage system 104, using an access cable or a wireless connection appropriate to each data storage system 104.
  • the data storage system 104 is a server system with storage capabilities either stored locally within the venue of system 100A or remote from the venue of system 100A. In some other cases, data storage system 104 is coupled to the playback monitoring system 1 10 via a memory card, such as SD card, micro SD card etc.
  • Data storage system 104 contains a content data store 120, which is used to store a variety of data files 122, including video files 124 and audio files 126.
  • video files 124 include encoded video content and may optionally include encoded audio content that is correlated to the video content, e.g. temporally correlated.
  • data storage system 104 includes a content verification database 128.
  • Content verification database 128 includes one or more content verification records 150 corresponding to particular content stored in the data storage system 104.
  • content verification record 150a corresponds to video file 124a stored in the content data store 120.
  • Content server 102 is coupled to data storage system 104 to retrieve data files 122.
  • Content server 102 transmits the data files to the appropriate content playback system 106 or 108.
  • video files are transmitted to video playback system 106 and audio files are transmitted to audio playback system 108.
  • Video files 124 containing both video and audio data may be transmitted to both video playback system 106 and audio playback system 108.
  • Video playback system 106 includes a video decoder 130, a projector 132 and a display screen 134.
  • Video decoder 130 receives video files from content server 102, extracts and decodes video content from the video files and provides the video content to projector 132.
  • Projector 132 projects the video data onto display screen 134, producing a visible image that can be observed by viewers (not shown) situated between the projector 132 and the display screen 134.
  • system 100A is installed in a video viewing facility such as a movie theatre, television room, a shopping mall, restaurant, bar or other location where viewers may view the displayed video content.
  • video playback system may include display panels such as LCD or LED display panels instead of or in addition to a projector / display screen combination.
  • display screen 134 is a perforated cinema display screen.
  • Display screens are commonly perforated or made from a woven fabric to permit sound from speakers placed behind the display screen (i.e., on the opposite side of the display screen 134 from projector 132) to pass through the display screen.
  • the perforations in the display screen will typically allow a small amount of light projected by projector 132 to pass through the display screen.
  • the audio playback system 108 includes an audio decoder 160 and one or more loudspeakers 162.
  • Audio content (which may be part of a video file 124 or a separate audio file 126) is transmitted by the content server 102 to the audio decoder 160.
  • Audio decoder 160 decodes the audio content and reproduces it through loudspeaker 162.
  • the playback monitoring system 1 10 includes a playback monitor controller 140, a video playback sensor 142 and an audio playback sensor 144.
  • the playback monitor controller 140 is coupled to content server 102 and data storage system 104.
  • Video playback sensor 142 is positioned behind display screen 134.
  • video playback sensor 142 is a single cell light intensity sensor 148.
  • sensor 148 may be a CdS photocell, a light dependent resistor, a pin photo diode, a photo transistor, or any other device capable of providing a signal corresponding to the intensity of light incident on the sensor.
  • the sensor may be a linear or two-dimensional sensor array.
  • Sensor 142 is responsive to the total light energy incident upon it and provides a time varying light intensity signal 146 corresponding to the total light energy. Controller 140 receives the light intensity signal 146.
  • content server 102 initiates the playback of a particular item of content from content data store 120 by the video playback system 106 or the audio playback system 108 or both, the content server transmits a message 158 to playback monitor controller 140 identifying the particular content and indicating that the content is about to be played back.
  • playback monitor controller 140 retrieves a target record, which can be a content verification record 150 corresponding to that particular content, from the data storage system 104.
  • Playback monitor controller 140 compares the light intensity signal 146 received from the sensor 142 to the expected brightness values recorded in the corresponding content verification record 150. Based on the comparison, the playback monitor controller 140 generates a video correlation index 156.
  • the video correlation index corresponds to the extent to which the expected brightness values recorded in the corresponding content verification record 150 and average light intensity values within the light intensity signal 146 received from the sensor 142 correlate for the entire length of the video content being played back.
  • FIG. 1 B illustrates a block diagram of a content playback system 100B in accordance with another example embodiment.
  • the content is stored on film instead of being stored digitally.
  • the video content may be stored in the form of images on film print frames with audio content stored on tracks adjacent to the images on the film print frames.
  • system 100B includes a content server 102, a data storage system 104', a film playback system 106' and a playback monitoring system 1 10.
  • Content server 102 is analogous to content server 102 of FIG. 1A
  • playback monitoring system 1 10 is analogous to playback monitoring system 1 10 of FIG. 1A.
  • the data storage system 104' is analogous to data storage system 104 of FIG. 1A.
  • Data storage system 104' includes a content verification database 128', which includes one or more content verification records 150' corresponding to one or more films.
  • the content server 102 is coupled to the data storage system 104' to coordinate the playback of a film from the data storage system 104'.
  • the content server 102 coordinates the playback of a film by triggering the appropriate content playback system 106' to begin playing the content on the film.
  • the content server 102 is also configured to transmit a message 158 to playback monitor controller 140 as discussed above.
  • the content playback system 106' includes a projector with a built in speaker, where the projector is configured to play a film.
  • the content playback system 106' includes a projector and an external speaker system, where the projector is configured to play the video images provided on a film, and the external speaker system is configured to play the sound associated with the video images on the film in a coordinated manner.
  • the content playback system 106' also includes a display screen 134 analogous to display screen 134 of FIG. 1 A.
  • the playback monitor controller 140 is analogous to the playback monitor system 140 of FIG. 1 A.
  • FIG. 1 C illustrates a block diagram of a content playback system 100C in accordance with another example embodiment.
  • System 100C is generally analogous to systems 100A of FIG. 1 A and 100B of FIG. 1 B.
  • System 100C differs from previously disclosed embodiments in that the playback monitoring system 1 10 is a stand-alone system, which is not coupled to a data storage system (such as the data storage system 104 of FIG. 1A and data storage system 104' of FIG. 1 B), and may be optionally coupled to a content server, such as the content server 102 of FIGS. 1 A and 1 B.
  • a data storage system such as the data storage system 104 of FIG. 1A and data storage system 104' of FIG. 1 B
  • a content server such as the content server 102 of FIGS. 1 A and 1 B.
  • the video sensor 142 is responsive to the total light energy incident upon it and provides a signal 146' that indicates whether or not some light is being generated from the display screen 134.
  • the audio sensor 144 also detects the presence of audio within the venue, and generates another signal 146" that indicates whether or not audio is being generated in the venue. In this embodiment, only the presence of absence of video and/or audio is detected and reported by the playback monitoring system 1 10, without any further step, such as comparison with a content verification record.
  • FIG. 2A illustrates a block diagram of a content playback system 200A in accordance with another example embodiment.
  • sensor 142 is positioned behind display screen 134.
  • the amount of light reaching sensor 142 depends on various factors, such as the light transmission characteristics of display screen 134, the field of view of sensor 142 and the distance of the sensor from the display screen 134.
  • Various display screens may permit greater or lesser amounts of light to pass through them due to number and size of perforations, the opaqueness of the material from which the display screen is made and the extent to which the display screen diffuses the transmitted light.
  • the amount of incident light energy 202 reaching display screen 134 from projector 132 will be substantially greater than the amount of transmitted light 204 that is transmitted through screen 134.
  • the transmitted light is generally diffused.
  • Sensor 142 may be placed at any position behind screen 134.
  • the field of view of a single cell sensor may range from a few degrees to up to about 170-180 degrees, particularly if lenses are provided between a light sensing element in sensor 142 and the display screen 134.
  • the sensitivity of a sensor falls off at higher angles from the center of the field of view.
  • sensor 142 may have a field of view that allows light from circle 206 (as shown on screen 134 of FIGS. 1A - 1 C) to reach sensor 142.
  • Sensor 142 will typically be more sensitive to light energy transmitted near the center of circle 206 (and thus transmitted at a more direct angle) rather than light energy transmitted at the edges of circle 206 (and thus transmitted at a more oblique angle).
  • the radius of circle 206 will depend on the field of view of sensor 142 and the distance between sensor 142 and display screen 134.
  • sensor 142 generates a light intensity signal 146 that is comprised of a series of light intensity values corresponding to all of the light energy that is incident upon it at any point in time. In some other embodiments, sensor 142 generates a light presence signal 146 that is an indication of whether or not any light is reaching the sensor during the playback of the content.
  • FIG. 2B illustrates a block diagram of a content playback system 200B in accordance with another example embodiment.
  • sensor 142 is positioned in front of display screen 134.
  • the amount of light reaching sensor 142 will depend on the light reflection characteristics of display screen 134, the field of view of sensor 142 and the distance of the sensor from the display screen 134.
  • Various display screens may permit greater or lesser amounts of light to reflect off of them due to number and size of perforations, the opaqueness of the material from which the display screen is made and the extent to which the display screen diffuses the transmitted light.
  • the amount of incident light energy 202 reaching display screen 134 from projector 132 will be substantially greater than the amount of reflected light 204' that is reflected off of screen 134. The reflected light is generally not diffused.
  • sensor 142 generates a light intensity signal 146 that is comprised of a series of light intensity values corresponding to all of the light energy that is incident upon it at any point in time. In some other embodiments, sensor 142 generates a light intensity signal 146 that is an indication of whether or not any light is reaching the sensor during the playback of the content.
  • the display screen 134 may be provided with filters, such as an image blurring filter, a shadow masking filter or a combination filter capable of blurring and shadow masking. If the screen 134 is provided with such filters, then the screen 134 is configured to only obscure the images of the content being played back with respect to the sensor 142, and not the audience viewing the screen.
  • filters such as an image blurring filter, a shadow masking filter or a combination filter capable of blurring and shadow masking.
  • FIG. 3 illustrates a graph 300 of a content verification record 150a according to an example embodiment.
  • the content verification record 150a corresponds to a particular item of video content in a video file 124a in data storage system 120.
  • content verification record 150a contains a series of expected brightness values that are temporally correlated with the video content. For example, if the video content is 150 seconds long, then content verification record 150a contains a series of expected brightness values corresponding to a 150 second time period.
  • the expected brightness values may be expressed in any form such as: a range between any two numbers, such as 0 and 63, where 0 indicates no light and 63 indicates bright light; a range of lux values (e.g. luminance and luminous emittance etc.) or any other values.
  • the expected brightness values may have any temporal resolution. For example, a content verification record with high resolution expected brightness values may have a resolution equal to the frame rate of the video content.
  • a content verification record with relatively low resolution expected brightness values may have a single light intensity value corresponding to series of frames in the video content.
  • the light intensity value may correspond to the average expected brightness of a series of frames extending over a fraction of a second, a second, multiple seconds or any other time period.
  • the content verification record will include an indication of the time period (which may be expressed in frames or any other suitable unit) over which the expected brightness values are averaged.
  • FIG. 3 illustrates a content verification record 150a in which expected brightness values 152 are provided for successive one second time periods, beginning at the start of the video content (in the video file 124a) to which the content verification record 150a corresponds.
  • FIG. 4A illustrates a graph 400A of a light intensity signal 146 generated by the sensor 142 according to an example embodiment.
  • the playback monitor controller 140 compares the light intensity signal 146 received from the sensor 142, and generates a series of light intensity values 148 forming the light intensity signal 146.
  • FIG. 4B illustrates a graph 400B of an average light intensity signal 146B based on light intensity signal 146.
  • the average light intensity signal 146B includes a series of average light intensity values 154 corresponding to the average light intensity value during each successive second of the video content.
  • the playback monitor controller 140 compares the expected brightness values 152 and the average light intensity values 154 and provides a video correlation index 156.
  • the video correlation index corresponds to the extent to which the expected brightness values 152 and average light intensity values correlate for the entire length of the video content.
  • playback monitor controller 140 determines the ratio between the expected brightness value 152 and the corresponding average light intensity value 154 for each segment of the video content.
  • each segment is one second long.
  • One ratio is calculated for each segment.
  • the series of ratios may then be analyzed to determine the degree of correlation between the expected brightness values and the average light intensity values. For example, if the series of ratios exhibits a fairly constant value with a relatively low standard deviation, the correlation of the expected brightness values and the average light intensity values will be considered high. Conversely, if the standard deviation of the series of ratios is relatively high, then the expected brightness values and the average light intensity values will be considered to have a low correlation.
  • the light output of the projector may vary over time and between different locations
  • the light transmission characteristics of a display screen may vary between different locations
  • the placement of the sensor 142 behind display screen 134 may vary between different locations.
  • Each of these variations may tend to have a relatively consistent proportional effect on the amount of light that is incident on the sensor in a particular installation or embodiment, as illustrated in systems 100A - 100C.
  • Such variations may uniformly affect the ratio of the expected brightness values and the average light intensity values, allowing the series of ratios to be analyzed to obtain a useful video correlation index.
  • Playback monitor controller 140 provides the video correlation index 156 to the content server 102.
  • the video correlation index 156 corresponds to the degree of correlation between the expected brightness values and the average light intensity values.
  • the video correlation index may be the standard deviation of the series of ratios. In this case, a low video correlation index will correspond to a high degree of correspondence and vice versa.
  • a high degree of correspondence indicates that the video content played back using the video playback system 106 is in fact the correct video content that corresponds to the content verification record.
  • the video correlation index may be used to verify that a particular item of video content has been successfully played back.
  • the video correlation index may be used for control or audit purposes to verify that an advertisement or other video content has been played back at a venue.
  • the audio playback system includes an audio decoder 160 and one or more loudspeakers 162.
  • Audio content (which may be part of a video file or an audio file) is transmitted by the content server 102 to the audio decoder 160.
  • Audio decoder 160 decodes the audio content and reproduces it through loudspeaker 162.
  • Content server 102 transmits a message 158 to playback monitor controller 140 to indicate that a particular item of audio content is being reproduced.
  • Playback monitor controller 140 retrieves a content verification record 150 corresponding to the particular audio item.
  • the playback monitor controller 140 samples audio using audio sensor 144.
  • Playback monitor controller 140 compares the sampled audio to the content verification record 150 to provide an audio correlation signal.
  • Playback monitor controller 140 can sample audio by taking sound measurement levels from audio sensor 144. Playback monitor controller 140 can perform sound level computations at each of one or more sampling windows. Playback monitor controller 140 can track sound level changes for audience noise rejection. Playback monitor controller 140 can determine if sound levels indicate audio from loudspeaker 162. Audio sensor 144 can operate at a sound sampling interval of 22 kHz, during which playback monitor controller 140 can get pulse density, compute a filtered waveform, and store resulting data.
  • playback monitor controller 140 can detect sound from loudspeaker 162 using a volume-level approach. This approach rejects background noise in order to eliminate false positive reporting or sound playing in a venue that could be triggered by background audience noise in the pre-show environment.
  • Playback monitor controller 140 can look for a slowly ramping noise level to set a noise floor as might happen when an audience enters a venue, creating a steady background chatter. Playback monitor controller 140 identifies when this chatter has a sharp fall-off when the show starts, allowing it to reset the expected noise floor used to reject the background noise.
  • the lighting condition of the venue can be used to adjust or gate sound measurements.
  • both the video correlation signal and the audio correlation signal may be used to verify the successful playback or reproduction of the video and audio content.
  • FIG. 5 illustrates a block diagram of a playback monitoring system 1 10 in accordance with an example embodiment.
  • the playback monitoring system 1 10 may be a stand-alone equipment comprising the various components required to monitor the playback of recorded content as discussed in the various embodiments herein.
  • the system 1 10 comprises a memory unit 518 and a processing unit 504 coupled to the memory unit 518.
  • the processing unit 504 is analogous to playback monitor controller 140 of FIGS. 1A - 1 C.
  • the system 1 10 comprises a video sensor 142 and an audio sensor 144, which communicate with processing unit 504.
  • the structure and functionality of each of the video sensor 142 and the audio sensor 144 is analogous to the various examples of video sensors 142 and audio sensors 144 discussed herein.
  • an input/output interface 524 can be present for receiving and communicating, for example, a content verification record 150 from a data storage system 104 to memory unit 518.
  • the system 1 10 can have an output unit 506 that provides the video correlation index 156 and/or an audio correlation signal, as generated by the processing unit 504.
  • a wireless unit 514 can be optionally connected to processing unit 504 in order to send or receive data or signals wirelessly to any other inputs, outputs, units, interfaces, or sensors.
  • the system 1 10 is provided as an example and there can be other embodiments of the system 1 10 with different components or a different configuration of the components described herein.
  • the system 1 10 further includes several power supplies (not shown) connected to various components of the system 1 10 as is commonly known to those skilled in the art.
  • FIG. 6, illustrating an example embodiment of a method 600 of monitoring playback of a content file in accordance with the teachings herein.
  • Method 600 is carried out by the various modules of the playback monitoring system as discussed herein.
  • the playback monitoring system is located at a venue.
  • a content playback device such as a projector, a loudspeaker, a display screen (e.g. LCD, LED, monitor etc.) that is configured to play audio and video associated with a content file being played back.
  • the video of the content file is displayed on a display screen, such as the display screen 134 of FIGS. 1A - 1 C, in the venue such that it can be viewed by audience at the venue.
  • audio associated with the content file is provided within the venue so that it is accessible to the audience at the venue.
  • One or more video sensors such as video sensors 142 of FIGS. 1A - 1 C, are configured to detect the presence or absence of light being received from the display screen 134.
  • the video sensor or sensors are located behind the display screen 134, as discussed in the embodiment of FIG. 2A. In some other cases, the video sensor or sensors are located in front of the display screen 134, as discussed in the embodiment of FIG. 2B.
  • presence of sound corresponding to the audio associated with the content file is detected.
  • the presence or absence of sound is detected by one or more audio sensors located at the venue.
  • the audio sensor or sensors may be located at the same location as the video sensor.
  • the audio sensor or sensors are located away from the video sensor.
  • multiple audio sensors are located at the venue at difference locations throughout the venue.
  • a light presence signal is generated by a processing unit which is coupled to the one or more video sensors and one or more audio sensors.
  • the light presence signal is based on the detection of presence of light by the one or more video sensors.
  • a sound presence signal is generated by the processing unit.
  • the sound presence signal is based on the detected of sound by the one or more sound sensors within the venue.
  • the one or more video sensors, and the one or more audio sensors transmit the detected presence or absence of light and sound information to a playback monitor controller, such as the playback monitor controller 140 of FIGS. 1A - 1 C.
  • the playback monitor controller 140 is configured to generate the associated light presence signal and the sound presence signal based on the received information.
  • the light presence signal thus generated may be expressed in any form, such as a range between two numbers, such as 0 and 1 , where 0 indicates absence of light and 1 indicates presence of light. In some other cases, the range may be between two numbers, such as 0 and 63, where 0 indicates absence of light and 63 indicates presence of light.
  • the audio presence signal may be similarly represented where a lower value indicates absence of sound and a higher value indicates presence of sound.
  • the light and sound presence signals thus generated may be stored locally, or transmitted to an external server for further analysis and processing. For example, an operator may be able to view the light and sound presence signals and determine if the entire content playback or parts of the content playback is unsuccessful. The operator can accordingly address the problem.
  • the playback monitor controller 140 is configured to provide alerts, such as in the form of alarms, reports etc. to indicate the absence of light and sound at the venue based on the light and sound presence signals. For example, in some cases, the playback monitor controller 140 is configured to compare the light presence signal to a corresponding predetermined threshold value. If the light presence signal is below the predetermined threshold, the playback monitor controller 140 may be configured to trigger an alert.
  • FIG. 7 illustrating an example embodiment of a method 700 of monitoring playback of a content file in accordance with the teachings herein.
  • Method 700 is carried out by the various modules of the playback monitoring system as discussed herein.
  • the embodiment of FIG. 7 relates to a content file that is a video file.
  • One or more video sensors such as video sensors 142 of FIGS. 1A - 1 C, are configured to detect the light intensity associated with the video being displayed on the display screen 134.
  • the video sensor 142 is configured to determine the luminosity or brightness value associated with the video being displayed on the display screen 134.
  • a light intensity signal corresponding to the detected light intensity is generated.
  • the light intensity signal is generated by a playback monitor controller, such as controller 140 of FIGS. 1A - 1 C, and comprises a plurality of light intensity values. Each light intensity value at a given time corresponds to the light intensity associated with the image on the display screen 134 at that time.
  • the playback monitor controller 140 is configured to receive a content verification record.
  • the content verification record is stored locally within the playback monitoring system 1 10.
  • the content verification record is received from a data storage server that may be either located locally within the venue or remotely from the venue.
  • the content verification record corresponds to the content file being played back at the venue.
  • the content verification record includes a plurality of target brightness values associated with the video being displayed on the display screen 134.
  • the target brightness values are generated for a scale that may be based on the frame rate, time, or some other unit.
  • the target brightness values may be generated on a time scale such that each target brightness value corresponds to the time of display of the corresponding video.
  • the target brightness values may be generated on a different scale, such that each target brightness value corresponds to each frame of the corresponding video.
  • the playback monitor controller 140 generates the light intensity signal based on the same scale as the content verification record. In some other cases, where the light intensity signal is generated based on a different scale or unit than the content verification record, one or the other is converted to the scale or unit of the other. In some further cases, where the light intensity signal is generated based on a different scale or unit than the content verification record, the scales or units of both are converted to another common unit.
  • the content verification record is generated ahead of time of the playback.
  • the content verification record may be generated by a supervised playback of the content item at the venue.
  • the supervised playback may be carried out at a different location and adjusted for characteristics of the venue where the subsequent playback is carried out.
  • the content verification record is estimated algorithmically, and adjusted for characteristics of different venues. Such an estimated content verification record may be additionally adjusted based on time of day or other occasions to take into account any unusual yet predictable sound or light imbalances within the venue.
  • the playback monitor controller 140 is configured to compare the plurality of brightness values within the content verification record to the plurality of light intensity values within the light intensity signal, as discussed herein.
  • the playback monitor controller 140 is configured to generate a correlation index for the video associated with the content file based on the comparison.
  • the correlation index is an indicator of how closely the actual brightness values of the video being displayed on the display screen 134 maps to the target brightness values contained in the content verification record.
  • FIG. 8 illustrating an example embodiment of a method 800 of monitoring playback of a content file in accordance with the teachings herein.
  • Method 800 is carried out by the various modules of the playback monitoring system as discussed herein.
  • the embodiment of FIG. 8 relates to a content file that is an audio file.
  • the sound associated with the audio file being played back within the venue is detected.
  • the sound is detected by one or more audio sensors, such as audio sensor 144 of FIGS. 1A - 1 C.
  • the audio sensor or sensors are configured to sample the sound being detected .
  • a sampling rate of 22 KHz is used.
  • a sampling rate matching the frame rate of the corresponding video that is correlated to the audio is used.
  • the sampled sound values reflect the volume or sound level of the audio being played within the venue.
  • a sound signal corresponding to the audio being played within the venue is generated, where the sound signal consists of a plurality of sampled sound values.
  • the sound signal is generated by a playback monitor controller, such as controller 140 of FIGS. 1 A - 1 C.
  • a content verification record corresponding to the audio being played within the venue is received.
  • the content verification record may be stored locally within the playback monitoring system, or may be received from an external server, such as a data storage system 104 of FIGS. 1A - 1 C.
  • the content verification record includes a plurality of sound levels associated with the audio being played within the venue.
  • the plurality of sound levels contained within the content verification record may be based on a time scale or a different scale, and may be converted to the same scale as the sound signal generated by the playback monitor controller 140.
  • the plurality of sound levels within the content verification record is compared to the plurality of sampled sound values within the sound signal generated by the playback monitor controller 140, as discussed herein.
  • the playback monitor controller 140 is configured to generate a correlation index for the sound associated with the audio being played within the venue based on the comparison.
  • the correlation index is an indicator of how closely the actual sound of the audio being displayed in the venue maps to the target sound levels contained in the content verification record.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Les divers modes de réalisation de la présente invention concernent un système et un procédé de surveillance de la lecture d'un contenu enregistré. Le système comprend un dispositif de commande d'appareil de surveillance de lecture qui peut être placé derrière un écran de cinéma ou devant l'écran. Le système peut être configuré pour détecter la présence de lumière et de son ou pour comparer la lumière et le son détectés à un enregistrement de vérification de contenu à des fins d'audit ou de vérification. Le procédé utilise le dispositif de commande d'appareil de surveillance de lecture pour obtenir des données de lumière et de son, traiter ces données, et comparer celles-ci à l'enregistrement de vérification de contenu.
PCT/CA2018/050198 2017-02-21 2018-02-21 Systèmes et procédés de surveillance de lecture de contenu enregistré Ceased WO2018152630A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201762461753P 2017-02-21 2017-02-21
US62/461,753 2017-02-21

Publications (1)

Publication Number Publication Date
WO2018152630A1 true WO2018152630A1 (fr) 2018-08-30

Family

ID=63252319

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2018/050198 Ceased WO2018152630A1 (fr) 2017-02-21 2018-02-21 Systèmes et procédés de surveillance de lecture de contenu enregistré

Country Status (1)

Country Link
WO (1) WO2018152630A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110090482A1 (en) * 2009-10-19 2011-04-21 Capella Microsystems, Corp. Optical position detecting device and method thereof
US8957972B2 (en) * 2013-05-21 2015-02-17 Avaya Inc. Automatic glass-to-glass video and A/V sync test tool
US20170048609A1 (en) * 2015-08-10 2017-02-16 Hearing Lab Technology, LLC Multi-source audio amplification and ear protection devices
US9794641B2 (en) * 2011-09-23 2017-10-17 Google Inc. Video segment presentation tracking

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110090482A1 (en) * 2009-10-19 2011-04-21 Capella Microsystems, Corp. Optical position detecting device and method thereof
US9794641B2 (en) * 2011-09-23 2017-10-17 Google Inc. Video segment presentation tracking
US8957972B2 (en) * 2013-05-21 2015-02-17 Avaya Inc. Automatic glass-to-glass video and A/V sync test tool
US20170048609A1 (en) * 2015-08-10 2017-02-16 Hearing Lab Technology, LLC Multi-source audio amplification and ear protection devices

Similar Documents

Publication Publication Date Title
EP1364351B1 (fr) Procede et dispositif de detection de feux base sur l'analyse d'images
US10043079B2 (en) Method and apparatus for providing multi-video summary
US11258526B2 (en) Real-time audience attention measurement and dashboard display
US9171317B2 (en) Back-channel media delivery system
US8224027B2 (en) Method and apparatus for managing video data
US7751647B2 (en) System and method for detecting an invalid camera in video surveillance
US10453263B2 (en) Methods and systems for displaying augmented reality content associated with a media content instance
JP4941286B2 (ja) 撮像装置及び再生装置
US10261393B2 (en) Method for controlling infrared illuminator and related image-recording device
CN103873825A (zh) 一种atm智能监控系统及方法
KR20040082414A (ko) 비사용자 이벤트에 기초하는 미디어 재생기를 제어하는방법 및 장치
KR101178539B1 (ko) 통합 플랫폼 설계 기법을 이용한 지능형 영상 보안 시스템 및 방법
KR20170019450A (ko) 피플 모니터링용 오디오 워터마킹
US8086088B2 (en) Digital video recording method in an audio detection mode
JP2004201305A (ja) 適応可能なディスプレイシステム
KR20160005552A (ko) 비디오써머리를 제공하는 영상재생장치 및 영상재생장치에서 비디오써머리를 제공하는 방법
CN105592301A (zh) 摄像设备及其控制方法和监视照相机系统
CN101494770B (zh) 用于控制监控照相机的屏蔽的颜色的装置和方法
KR101707382B1 (ko) Cctv 오작동 관리 시스템
WO2018152630A1 (fr) Systèmes et procédés de surveillance de lecture de contenu enregistré
US20160232429A1 (en) Data processing system
KR20190023544A (ko) IoT 센서와 연계된 사운드 기반의 디지털 영상저장 장치 및 방법
US20150048173A1 (en) Method of processing at least one object in image in computing device, and computing device
KR101914252B1 (ko) 내장 적외선 센서를 이용한 영상 재생 장치
CN106101624B (zh) 大数据管理系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18757579

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18757579

Country of ref document: EP

Kind code of ref document: A1