JP2023134110A - Broadcasting system, receiver, receiving method, and program - Google Patents

Abstract

To provide a sound adjustment function in GUI with unified operability and design.SOLUTION: A broadcasting system, which executes broadcasting including MPEG-H audio, comprises a receiving unit for receiving an application for a user to adjust sounds, by data broadcasting.SELECTED DRAWING: Figure 2

Description

The present invention relates to a broadcasting system, a receiver, a receiving method, and a program.

In digital terrestrial broadcasting, it is necessary to adjust the audio transmitted from the broadcasting station using a unique adjustment menu for each receiver. In the next generation of terrestrial digital broadcasting, the use of object-based audio signals such as MPEG-H audio is being considered.
In object-based audio signals such as MPEG-H audio, user-adjustable audio parameters are transmitted from a broadcast station and are used to provide audio adjustment functionality to the user. The audio adjustment function can be adjusted using the GUI.
Patent Document 1 describes providing sounds such as a plurality of songs simultaneously and selectively so that they can be heard.

Japanese Patent Application Publication No. 2013-62652

Patent Document 1 discloses that the sounds of a plurality of songs are synthesized and provided, but object-based audio signals such as MPEG-H audio require sound adjustment on an object-by-object basis.
If a GUI for the audio adjustment function is implemented for each receiver, the intentions of the content creator may not be accurately reflected, or the GUI design and operation method may differ depending on the receiver manufacturer or receiver model. There is a risk that it may be damaged. Therefore, the user's convenience regarding the audio adjustment function may not be sufficient.

The present invention has been made in view of the above points, and provides a broadcasting system, a receiver, a receiving method, and a program that can provide an audio adjustment function on a GUI with unified operability and design.

(1) The present invention has been made to solve the above problems, and one aspect of the present invention is a broadcasting system that performs broadcasting including MPEG-H audio, which allows a user to adjust audio. This is a broadcasting system including a receiving unit that receives an application via data broadcasting.

(2) Further, one aspect of the present invention is a receiver in a broadcasting system that performs broadcasting including MMPEG-H audio, which includes a receiving unit that receives an application for a user to perform audio adjustment via data broadcasting. It is equipped with a receiver.

(3) Further, one aspect of the present invention is a reception method of a receiver in a broadcasting system that performs broadcasting including MPEG-H audio, in which the receiver receives an application for a user to perform audio adjustment for data broadcasting. A receiving method includes a receiving step of receiving at.

(4) Further, one aspect of the present invention is a program used in a receiver in a broadcasting system that performs broadcasting including MPEG-H audio, the receiver having an application that allows a user to adjust audio. This is a program for executing a receiving step for receiving broadcasting.

According to the present invention, it is possible to provide an audio adjustment function using a GUI with unified operability and design.

1 is a diagram showing an example of the configuration of a broadcasting system according to an embodiment of the present invention. FIG. 2 is a block diagram showing an example of the functional configuration of a receiver according to the present embodiment. FIG. 3 is a diagram illustrating an example of a definition of metadata according to the present embodiment. It is a figure showing an example of an acquisition command concerning this embodiment. It is a figure showing an example of an acquisition command concerning this embodiment. It is a figure showing an example of an acquisition command concerning this embodiment. It is a figure showing an example of an acquisition command concerning this embodiment. FIG. 3 is a diagram showing an example of an update command according to the present embodiment. FIG. 3 is a diagram showing an example of an update command according to the present embodiment. FIG. 3 is a diagram showing an example of an update command according to the present embodiment. FIG. 3 is a diagram showing an example of an update command according to the present embodiment. 7 is a flowchart illustrating an example of audio adjustment processing according to the present embodiment.

Embodiments of the present invention will be described in detail below with reference to the drawings.

[System configuration]
FIG. 1 is a diagram showing an example of the configuration of a broadcasting system Sys according to an embodiment of the present invention.
The broadcasting system Sys includes a broadcasting device of a broadcasting station 1, a receiver 2, a broadcasting station server 3, and a provider server 4. The broadcast is a broadcast using terrestrial digital broadcasting. However, the present invention is not limited to these broadcasts, and the broadcast may be broadcast using a broadcast satellite. Broadcasting using broadcasting satellites is, for example, advanced BS (Broadcasting Satellites) digital broadcasting or advanced wideband CS (Communication Satellites) digital broadcasting. Moreover, the broadcast may be a cable broadcast such as cable television.

In the broadcasting system Sys, a broadcasting station 1 transmits digital broadcasting signals, application control information, presentation-related control information, etc. via broadcast waves. The service provider provides metadata, video content, etc. related to the program from the provider server 4.
The application control information informs receivers compatible with this system of applications and the like that are linked with the program, and also sends commands and control information for starting and terminating the program.
The control information regarding presentation is to send control information regarding whether an application and a broadcast program can be superimposed on the same TV screen and whether the application can be presented.
The broadcasting station operates a broadcasting station server 3 in the broadcasting system Sys. The broadcast station server 3 provides metadata such as a program title, program ID, program summary, performers, and broadcast date and time. The information provided by the broadcast station to the service provider is provided through an API (Application Programming Interface) included in the broadcast station server 3.

The service provider is a person who provides services by the broadcasting system Sys, and produces and distributes content and applications for providing services, and operates the broadcasting station server 3 to realize individual services. Here, the service includes a broadcast communication cooperation service that links broadcasting and communication.
The broadcast station server 3 sends applications to the receiver 2 for "application management and distribution". The broadcasting station server 3 serves as a "server for each service" and provides server functions for realizing individual services (MPEG-H service, VOD program recommendation service, multilingual subtitle service, etc.).

MPEG-H is a series of standards under development by the ISO/IEC Moving Picture Experts Group (MPEG) for a digital container standard, a video compression standard, an audio compression standard, and two compliance test standards. MPEG-H audio, for example, allows object-based sound. An "object" in object-based audio is each sound material that makes up a program, such as music or human voices. In object-based audio, audio signals are recorded for each sound material, and audio can be controlled for each material. Furthermore, when playing back the program on the receiver 2, it is also possible to play the program in accordance with the position of the speakers actually placed based on the playback position information of the material.

The broadcasting station server 3 not only realizes the functional aspects of these services, but also sends out the contents (MPEG-H audio data, VOD contents, subtitle data, etc.) that constitute the services. The broadcasting station server 3 registers as a "repository" for distributing applications of the broadcasting system Sys, and provides a list of applications that can be provided or searches in response to an inquiry from the receiver 2.

The receiver 2 includes one having a function for realizing a broadcast communication cooperation service in addition to the function of receiving existing digital broadcasts. In addition to the broadband network connection function, the receiver 2 has the following functions.
・Function to receive applications in response to application control signals from broadcasting ・Function to execute applications in response to application control signals from broadcasting ・Function to perform presentation through cooperation between broadcasting and communication ・Terminal cooperation function Here, terminal Examples include user terminals such as smartphones and smart speakers. The terminal coordination function of the receiver 2 accesses broadcast resources such as program information in response to requests from other terminals, and calls receiver functions for playback control.
Examples of applications include MPEG-H audio digital mixers. The user (also referred to as the "receiver") uses the digital mixer received from the operator server 4 to adjust the strength of the sound, effects, etc., and balance between the sound materials for the audio signal for each sound material. Adjustable. These adjustments can also be made for each speaker.

More specifically, the receiver 2 has the following functions.
The receiver 2 has a "broadcast reception and playback" function that receives broadcast waves, selects a specific broadcast service, and synchronously plays back video, audio, subtitles, and data broadcasts that constitute the service.
As a "communication content reception and playback" function, the receiver 2 accesses video content placed on a server on the communication network (for example, the operator server 4), receives it as VOD streaming, and records the video, audio, and content constituting the content. It has a function to synchronously play subtitles.
As an "application control" function, the receiver 2 mainly controls the application engine regarding managed applications based on application control information obtained from servers on the communication network or broadcast signals, and controls the life cycle and events of each application.・Has a management function.
The receiver 2 has a function of acquiring and executing an application as an "application engine" function. This function is realized by, for example, an HTML5 browser.
As a "presentation synchronization control" function, the receiver 2 has a function of controlling presentation synchronization of a stream of video, audio, etc. obtained by broadcast reception and a stream of video, audio, etc. obtained by streaming reception.
As an "application launcher" function, the receiver 2 has a navigation function mainly for the user to select and launch a non-broadcast managed application.

In addition, in the following description, when the broadcasting station 1, the broadcasting station server 3, and the operator server 4 are not particularly distinguished, the broadcasting station 1 will be described as including the case where they are any of these.

FIG. 2 is a block diagram showing an example of the functional configuration of the receiver according to this embodiment.
The receiver 2 in FIG. 2 is a receiver that supports MPEG-H audio.

Broadcasting station 1 transmits a video signal A11 and an audio signal (also referred to as "MPEG-H audio signal" A12). Broadcasting station 1 uses object-based audio as an audio component (asset), and transmits an MPEG-H audio signal A12 in which this audio component and audio components of each channel-based audio are multiplexed together in a broadcast wave. .
Furthermore, when transmitting the MPEG-H audio signal A12 in a broadcast wave, the broadcasting station 1 simultaneously transmits an audio adjustment application A13, which is an application for a user to perform audio adjustment, as a data broadcast.

The receiver 2 includes a tuner 21, a demux (demultiplexer) 22, a video decoder 23, an audio decoder 24, a video adjustment section 25, an audio adjustment section 26, a browser API section 27, and a data broadcasting browser section 28.

The tuner 21 receives broadcast waves via an antenna, and tunes (selects) a channel selected based on a user's operation. The tuned signal is demodulated and input to the Demux 22 as data.

The Demux 22 separates the input data into a video data string, an audio data string, a character superimposition data string, a subtitle data string, and the like. The separated audio data string is output to the audio decoder 24. The separated video data string is output to the video decoder 23.

The video data string output from the demux 22 is input to the video decoder 23.
The video decoder 23 decodes the input video data string.

Further, the text super data string and the subtitle data string separated into the demux 22 are decoded by a text super decoder and a subtitle decoder (not shown), respectively, and the decoded character strings are superimposed on the video.

The audio data string of each audio component output from the demux 22 is output to the audio decoder 24.
The audio decoder 24 decodes the audio data string of the audio component. Furthermore, the audio decoder 24 extracts metadata from the audio data string input from the Demux 22 . The audio decoder 24 outputs metadata to the browser API section 27 in response to a request from the browser API section 27.

The video adjustment unit 25 performs color space conversion processing on the decoded video data string, and uses it to display the video on the display.

The audio adjustment unit 26 synthesizes audio for each sound material based on the audio data string decoded by the audio decoder 24 and the adjustment information output from the browser API unit 27, and performs downmix processing. The downmixed audio data string is converted to audio and output from the speaker.

The browser API section 27 uses the API to acquire metadata from the audio decoder 24 and/or the main body information storage section 29 based on the instruction signal from the data broadcast browser section 28 . Based on the instruction signal from the data broadcasting browser section 28, the browser API section 27 outputs adjustment information indicating the adjustment value of metadata to the audio adjustment section 26 using the API.

The data broadcast browser unit 28 starts the audio adjustment application sent from the broadcast station 1 via the data broadcast.
The data broadcasting browser section 28 acquires metadata from the audio decoder 24 and/or the main body information storage section 29 via the browser API section 27 . The data broadcast browser unit 28 obtains initial values of parameters that can be adjusted by the user based on the metadata. The data broadcasting browser unit 28 sets initial values of audio adjustable parameters in the audio adjustment application.

For example, the data broadcasting browser unit 28 displays a GUI by executing an audio adjustment application, and acquires audio adjustment parameters through a user operation on the GUI.
The data broadcasting browser unit 28 outputs adjustment information based on the adjustment parameters to the audio adjustment unit 26 via the browser API unit 27.

The main body information storage section 29 stores main body information. The main body information is information that is stored in advance by the receiver 2, and includes, for example, speaker position information and viewing scene installation information such as the direction in which the viewer is facing.

As described above, the receiver 2 according to the present embodiment is a broadcasting system that performs broadcasting including MPEG-H audio, and receives an application for a user to perform audio adjustment as data broadcasting. By running the received application, the user can adjust the audio through a GUI with unified operability and design regardless of the manufacturer or model of the receiver, improving user convenience. .

[Metadata definition]
Next, the definitions of four metadata defined by MPEG-H used in this embodiment will be explained.
FIG. 3 is a diagram showing an example of the definition of metadata used in this embodiment.
As shown in the figure, the metadata used in this embodiment includes four types of data: data related to interactivity, data related to individual settings, data related to the overall MPEG-H configuration, and data on audio scene installation. These metadata are described by API functions like mpegh3daElementInteraction(), mpegh3daLocalSetupInformation(), mpegh3daConfig(), mpegh3daSceneDisplacement(). . Two of these metadata, mpegh3daElementInteraction() and mpegh3daConfig(), are included in the MPEG-H audio data sent from the broadcasting station and can be obtained from the audio decoder 24. Further, two metadata, mpegh3daLocalSetupInformation() and mpegh3daSceneDisplacement(), can be obtained from the main body information of the receiver 2.

[Get metadata]
Next, acquisition of metadata by the browser API section 27 will be explained. 4 to 7 are diagrams showing examples of metadata acquisition commands according to the present embodiment.
In the examples illustrated in FIGS. 4 to 7, the method name is "getMpegh3daElementInteraction()." The type of the return value indicating the execution result is "Mpegh3daElementInteraction object". The method name is "getMpegh3daLocalSetupInformation()". The type of return value indicating the execution result is "Mpegh3daLocalSetupInformation object". The method name is "getMpegh3daConfig()". The type of the return value indicating the execution result is "Mpegh3daConfig() object". The method name is "getMpegh3daSceneDisplacement()". The type of the return value indicating the execution result is "Mpegh3daSceneDisplacement() object".

The browser API section 27 executes the acquisition command defined by each "method name" based on the instruction signal from the data broadcasting browser section 28, and acquires metadata from the audio decoder 24 and/or the main body information storage section 29. .

[Update metadata]
Next, updating of metadata by the browser API section 27 will be explained. 8 to 11 are diagrams showing examples of metadata update commands according to this embodiment.
In the examples illustrated in FIGS. 8 to 11, the method name is "putMpegh3daElementInteraction()." The type of the return value indicating the execution result is "Mpegh3daElementInteraction object". The method name is "putMpegh3daLocalSetupInformation()". The type of return value indicating the execution result is "Mpegh3daLocalSetupInformation object". The method name is "putMpegh3daConfig()". The type of the return value indicating the execution result is "Mpegh3daConfig() object". The method name is "putMpegh3daSceneDisplacement()". The type of the return value indicating the execution result is "Mpegh3daSceneDisplacement() object".

The browser API section 27 executes the update command defined by each "method name" based on the instruction signal from the data broadcast browser section 28, and updates the metadata.

[Processing flow]
Next, an example of the audio adjustment process according to this embodiment will be described.
FIG. 12 is a flowchart illustrating an example of the audio adjustment process according to this embodiment.
(Step S101)
The receiver 2 receives and activates an audio adjustment application from a data broadcast corresponding to the selected content in response to a user's channel selection operation and power supply operation.
(Step S102)
The receiver 2 extracts metadata from the separated audio data.
(Step S103)
The receiver 2 acquires metadata from the audio decoder 24 and/or the main body information storage section 29 in response to the API acquisition command.

(Step S104)
Based on the acquired metadata, the receiver 2 sets initial values of parameters for each voice that can be adjusted in the audio adjustment application.
(Step S105)
The receiver 2 receives user operations for the audio adjustment application. When the receiver 2 receives a user operation for the audio adjustment application, the receiver 2 updates the metadata of parameters for each operated audio using an API update command.
(Step S106)
Receiver 2 performs audio adjustment based on the updated metadata.

As described above, the receiver 2 according to the present embodiment is a receiver in a broadcasting system that performs broadcasting including MPEG-H audio, and receives an application for a user to perform audio adjustment as a data broadcast.

As a result, it is possible to provide an audio adjustment function using a GUI with unified operability and design without implementing a GUI in each receiver. Further, user convenience can be improved by using a unified GUI regardless of the manufacturer or model of the receiver.

Note that some of the broadcasting station 1, receiver 2, broadcasting station server 3, and operator server 4 in the embodiment described above, for example, the Demux 22 of the receiver 2, the audio decoder 24, the audio adjustment unit 26, the video decoder 23, and the video At least a portion of the adjustment section 25, the browser API section 27, and the data broadcasting browser section 28 may be realized by a computer. In that case, a program for realizing this control function may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed. Note that the "computer system" here refers to a computer system built into the broadcast station 1, receiver 2, broadcast station server 3, or operator server 4, and includes hardware such as an OS and peripheral devices. shall be held. Furthermore, the term "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into computer systems. Furthermore, a "computer-readable recording medium" refers to a medium that dynamically stores a program for a short period of time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, it may also include a device that retains a program for a certain period of time, such as a volatile memory inside a computer system that is a server or a client. Further, the above-mentioned program may be one for realizing a part of the above-mentioned functions, or may be one that can realize the above-mentioned functions in combination with a program already recorded in the computer system.
Furthermore, part or all of the broadcast station 1, receiver 2, broadcast station server 3, and operator server 4 in the embodiment described above may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each of the functional blocks of the broadcast station 1, receiver 2, broadcast station server 3, and operator server 4 may be made into a processor individually, or some or all of them may be integrated into a processor. Further, the method of circuit integration is not limited to LSI, but may be implemented using a dedicated circuit or a general-purpose processor. Further, if an integrated circuit technology that replaces LSI emerges due to advances in semiconductor technology, an integrated circuit based on this technology may be used.

Although one embodiment of the present invention has been described above in detail with reference to the drawings, the specific configuration is not limited to that described above, and various design changes etc. may be made without departing from the gist of the present invention. It is possible to

Sys Broadcasting system 1 Broadcasting station 2 Receiver 3 Broadcasting station server 4 Operator server 21 Tuner 22 Demux
23 Video decoder 24 Audio decoder 25 Video adjustment section 26 Audio adjustment section 27 Browser API section 28 Data broadcasting browser section 29 Main body information storage section

Claims (6)

A broadcasting system that performs broadcasting including MPEG-H audio,
a receiving unit that receives an application for audio adjustment by a user via data broadcasting;
Equipped with
broadcast system. an execution unit that executes the application;
The execution unit includes a regulation unit that defines an API for acquiring MPEG-H audio metadata;
Furthermore,
The broadcasting system according to claim 1, wherein the execution unit performs audio adjustment by passing the metadata to a browser. The audio adjustment is performed on an object-by-object basis.
The broadcasting system according to claim 1 or 2. A receiver in a broadcasting system that performs broadcasting including MPEG-H audio,
a receiving unit that receives an application for audio adjustment by a user via data broadcasting;
Equipped with
Receiving machine. A receiving method for a receiver in a broadcasting system that performs broadcasting including MPEG-H audio, the receiver comprising:
a receiving step of receiving an application for a user to perform audio adjustment via data broadcasting;
A reception method having. A program used in a receiver in a broadcasting system that performs broadcasting including MPEG-H audio, the program includes:
a receiving step of receiving an application for a user to perform audio adjustment via data broadcasting;
A program to run.

Images