[go: up one dir, main page]

WO2020109087A1 - Dispositif de commande pour fournir des scripts de lumière pour des fragments multimédias et procédé associé - Google Patents

Dispositif de commande pour fournir des scripts de lumière pour des fragments multimédias et procédé associé Download PDF

Info

Publication number
WO2020109087A1
WO2020109087A1 PCT/EP2019/081814 EP2019081814W WO2020109087A1 WO 2020109087 A1 WO2020109087 A1 WO 2020109087A1 EP 2019081814 W EP2019081814 W EP 2019081814W WO 2020109087 A1 WO2020109087 A1 WO 2020109087A1
Authority
WO
WIPO (PCT)
Prior art keywords
media
fragments
fragment
audio
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2019/081814
Other languages
English (en)
Inventor
Dzmitry Viktorovich Aliakseyeu
Muhammad Mohsin SIRAJ
Jérôme Eduard MAES
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Signify Holding BV
Original Assignee
Signify Holding BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Signify Holding BV filed Critical Signify Holding BV
Publication of WO2020109087A1 publication Critical patent/WO2020109087A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63J—DEVICES FOR THEATRES, CIRCUSES, OR THE LIKE; CONJURING APPLIANCES OR THE LIKE
    • A63J17/00—Apparatus for performing colour-music
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4131—Peripherals receiving signals from specially adapted client devices home appliance, e.g. lighting, air conditioning system, metering devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8166—Monomedia components thereof involving executable data, e.g. software
    • H04N21/8186—Monomedia components thereof involving executable data, e.g. software specially adapted to be executed by a peripheral of the client device, e.g. by a reprogrammable remote control
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
    • H05B47/10—Controlling the light source
    • H05B47/105—Controlling the light source in response to determined parameters
    • H05B47/115—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings
    • H05B47/12—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings by detecting audible sound
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
    • H05B47/10—Controlling the light source
    • H05B47/155—Coordinated control of two or more light sources
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
    • Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
    • Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection

Definitions

  • Each of the plurality of second media fragments is associated with respective light scripts.
  • a second media fragment is selected based on a comparison of the at least one audio characteristic of the first media fragment and the audio characteristics of the second media fragments. The comparison may be based, for example, on determining a similarity measure. The selection of the second media fragment is then based on the determined similarity measure.
  • the first media fragment e.g. an audio fragment
  • the first media fragment may have distinct sets or clusters of properties. For example, one cluster of properties may describe the energy and dynamism of the audio fragment. These clusters may then be compared with the audio characteristics of the plurality of second media fragments, wherein for each set of properties, i.e. for each cluster, different media fragments from the plurality of second media fragments can be selected.
  • the light script is then generated from multiple light scripts from the selected subset of the plurality of second media fragments, wherein different features of the script are selected from different scripts based on the comparison with clusters of the first media fragment.
  • the step of comparing may be performed by using similarity learning, wherein the similarity learning uses at least one of: regression similarity learning, classification similarity learning, ranking similarity learning and locality sensitive hashing.
  • the modification of light script may at least comprise: modifying the color palette of the light script, increasing/decreasing the dynamic range of the light script, i.e. limiting or extending a range between the lowest and the highest brightness of the light effects, replacing or excluding some of the light effects in the light script, e.g. brightness, intensity, color etc.
  • the controller 120 may obtain the first and/or the plurality of second media fragments 111-112 from a user (not shown) via a user interface device (not shown).
  • the media fragments may be obtained from a music streaming or video sharing platform such as Spotify, YouTube etc. Any other ways to obtain the first and the plurality of second media fragments 111-112 may also be possible.
  • first media fragment 111 and xf is the i th data point from the second media fragment 112.
  • the goal of these learning algorithms is to leam a similarity function based on the data
  • the goal is to leam a function that approximates for every new labeled triplet example This is typically achieved
  • the method 200 may further comprise the step of providing 250 a light script 161 associated with the selected second media fragment or generating a light script 161 based on the selected second media fragment.
  • the step of providing 250 may further comprise modifying a light script based, e.g. on a difference between the analyzed at least one audio characteristic of the first media fragment 111 and the analyzed at least one audio
  • the method 400 may further comprise the step of analyzing 410 at least one characteristic of the first media fragment 111 and the step of analyzing 420 audio
  • Storage media suitable for storing computer program instructions include all forms of nonvolatile memory, including but not limited to EPROM, EEPROM and flash memory devices, magnetic disks such as the internal and external hard disk drives, removable disks and CD-ROM disks.
  • the computer program product may be distributed on such a storage medium, or may be offered for download through HTTP, FTP, email or through a server connected to a network such as the Internet.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Automation & Control Theory (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

L'invention concerne un procédé de fourniture de scripts de lumière pour des fragments multimédias, le procédé comprenant les étapes consistant à obtenir un premier fragment multimédia et une pluralité de seconds fragments multimédias, le premier fragment multimédia comprenant un premier fragment audio ; et la pluralité de seconds fragments multimédias comprenant des seconds fragments audio et chacun de la pluralité de seconds fragments multimédias étant associé à des scripts lumineux respectifs, analyser au moins une caractéristique audio du premier fragment multimédia, analyser des caractéristiques audios de la pluralité de seconds fragments multimédias, comparer l'analyse d'au moins une caractéristique audio du premier fragment multimédia aux analyses des caractéristiques audios de la pluralité de seconds fragments multimédias, sélectionner un ou plusieurs seconds fragments multimédias parmi la pluralité de seconds fragments multimédias sur la base de la comparaison, fournir un script de lumière sur la base de scripts de lumière associés à un ou plusieurs seconds fragments multimédia sélectionnés, associer le script de lumière (fourni) avec le premier fragment multimédia, de telle sorte que lorsque le premier fragment multimédia est rendu par un dispositif de rendu de fragment multimédia, une ou plusieurs lumières étant commandées selon une ou plusieurs instructions d'éclairage définies par le script de lumière (fourni).
PCT/EP2019/081814 2018-11-29 2019-11-19 Dispositif de commande pour fournir des scripts de lumière pour des fragments multimédias et procédé associé Ceased WO2020109087A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP18209056 2018-11-29
EP18209056.3 2018-11-29

Publications (1)

Publication Number Publication Date
WO2020109087A1 true WO2020109087A1 (fr) 2020-06-04

Family

ID=64572096

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2019/081814 Ceased WO2020109087A1 (fr) 2018-11-29 2019-11-19 Dispositif de commande pour fournir des scripts de lumière pour des fragments multimédias et procédé associé

Country Status (1)

Country Link
WO (1) WO2020109087A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022043041A1 (fr) * 2020-08-26 2022-03-03 Signify Holding B.V. Détermination d'un ordre de reproduction de chansons sur la base de différences entre des scripts de lumière

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120078824A1 (en) * 2002-10-03 2012-03-29 Antonio Trias Bonet Method and System for Music Recommendation Based on Immunology
US20120254363A1 (en) * 2011-03-29 2012-10-04 Bose Corporation Multimedia Analysis and Recommendation Generation
US20140072272A1 (en) 2008-12-09 2014-03-13 Koninklijke Philips N.V. Method and system for generating data for controlling a system for rendering at least one signal
WO2017162469A1 (fr) * 2016-03-22 2017-09-28 Philips Lighting Holding B.V. Enrichissement d'un son avec un éclairage
US20180061438A1 (en) 2016-03-11 2018-03-01 Limbic Media Corporation System and Method for Predictive Generation of Visual Sequences

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120078824A1 (en) * 2002-10-03 2012-03-29 Antonio Trias Bonet Method and System for Music Recommendation Based on Immunology
US20140072272A1 (en) 2008-12-09 2014-03-13 Koninklijke Philips N.V. Method and system for generating data for controlling a system for rendering at least one signal
US20120254363A1 (en) * 2011-03-29 2012-10-04 Bose Corporation Multimedia Analysis and Recommendation Generation
US20180061438A1 (en) 2016-03-11 2018-03-01 Limbic Media Corporation System and Method for Predictive Generation of Visual Sequences
WO2017162469A1 (fr) * 2016-03-22 2017-09-28 Philips Lighting Holding B.V. Enrichissement d'un son avec un éclairage

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022043041A1 (fr) * 2020-08-26 2022-03-03 Signify Holding B.V. Détermination d'un ordre de reproduction de chansons sur la base de différences entre des scripts de lumière

Similar Documents

Publication Publication Date Title
US11769528B2 (en) Systems and methods for automating video editing
JP7271590B2 (ja) 音声を伴うビデオ提示の生成
CN110555126B (zh) 旋律的自动生成
US9875245B2 (en) Content item recommendations based on content attribute sequence
US8542982B2 (en) Image/video data editing apparatus and method for generating image or video soundtracks
US10609794B2 (en) Enriching audio with lighting
Xu et al. Hierarchical affective content analysis in arousal and valence dimensions
US11543729B2 (en) Systems and methods to transform events and/or mood associated with playing media into lighting effects
WO2017070427A1 (fr) Prédiction automatique d'attributs acoustiques à partir d'un signal audio
US11244652B2 (en) Display apparatus and control method thereof
KR20220036956A (ko) 생성적 및 검색-기반 애플리케이션들을 위한 효과적인 음악적 특징들을 학습하는 방법
US20140324965A1 (en) Recommending media items based on purchase history
CN108766451B (zh) 一种音频文件处理方法、装置和存储介质
Schindler et al. Harnessing music-related visual stereotypes for music information retrieval
Bakhshizadeh et al. Automated mood based music playlist generation by clustering the audio features
Ma et al. A computational lens into how music characterizes genre in film
Álvarez et al. RIADA: A Machine-Learning Based Infrastructure for Recognising the Emotions of Spotify Songs.
Kostiuk et al. Multi-label emotion classification in music videos using ensembles of audio and video features
EP3928594B1 (fr) Amélioration de la reconnaissance d'un utilisateur d'une scène lumineuse
WO2020109087A1 (fr) Dispositif de commande pour fournir des scripts de lumière pour des fragments multimédias et procédé associé
WO2023274700A1 (fr) Dispositif de commande pour commander une pluralité de dispositifs d'éclairage sur la base d'un contenu multimédia et son procédé
Chen et al. A dataset for learning stylistic and cultural correlations between music and videos
Altieri et al. An adaptive system to manage playlists and lighting scenarios based on the user’s emotions
Singh et al. Scientific exploration of music recommendation system using facial expressions
CN118301382B (zh) 基于音乐节奏的视频生成方法及系统、电视点播方法

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19801921

Country of ref document: EP

Kind code of ref document: A1