KR20090015260A - Sound output method and system of a multi-image display device and a mobile communication terminal used therein - Google Patents

Abstract

The present invention relates to a multi-image display technology, and more particularly, when a plurality of images are displayed in a multi-image display device, a method and system for selecting and listening to a sound of a desired image in a separate sound output device and It relates to a mobile communication terminal used. To this end, the present invention provides a process of connecting the sound output device and the multi-image display device to communicate with each other in response to a sound output request, and outputting one of the images displayed on the multi-image display device in the sound output device. Selecting, and outputting a sound corresponding to the selected image to the outside by receiving sound data from the multi-image display device, and using the same. Provided is a mobile communication terminal.

Accordingly, when a plurality of images are displayed in the multi-image display apparatus, the user can easily select and listen to a desired image sound by operating only a separate sound output device (for example, a mobile communication terminal). Provide convenience.

Description

Method and system for outputting audio signal and multi-screen display device, and mobile communication terminal used therein}

The present invention relates to a multi-image display technology, and more particularly, when a plurality of images are displayed in a multi-image display apparatus, a separate image output apparatus capable of selecting and listening to a sound of a desired image. A sound output method and system and a mobile communication terminal used therein.

With the development of video technology, recent video display devices (eg, TVs, DMB receiving terminals, etc.) can display more than one video (hereinafter, multiple videos) simultaneously. Examples of such multiple images include a PIP (Picture In Picture) technology that displays a main screen on a full screen and a subscreen on a main screen in a predetermined size.

In the case of the conventional multi-image display device, the sound output is generally output the sound of the main screen. Therefore, when the user wants to listen to the sound corresponding to the sub-screen, the user directly manipulates the multi-image display device to output the sub-screen sound or connects a separate audio output device (eg, a headset) to the multi-image display device. Therefore, a method of listening to the sound of the sub picture is mainly used.

However, in the conventional multi-image display device, when a user listens to the sound of the sub-screen using a headset and wants to listen to the sound of the main screen in an instant, the user removes the headset and outputs the main screen directly from the multi-image display device. It is inconvenient to listen to the sound. That is, when using a separate sound output device there is a problem that it is difficult to easily listen to the sound according to the image.

Accordingly, an object of the present invention is to solve the problems of the prior art as described above. The present invention provides a sound output method and system of a multi-image display device.

Further, another object of the present invention is to provide a mobile communication terminal capable of easily selecting and listening to a desired sound among a plurality of sounds output from a multi-image display device.

According to another aspect of the present invention, there is provided a sound output method for outputting a sound of a multi-image display device on which at least two images are displayed by using an audio output device. A connection process in which the sound output device and the multi-image display device are connected to each other in response to an output request, and an image selection process of selecting one of the images displayed on the multi-image display device in the sound output device; And a sound output process in which the sound output device receives the sound data from the multi-image display device and outputs a sound corresponding to the selected image to the outside.

In addition, the audio output system of the multi-image display device according to the present invention is a multi-image display device and a multi-image display device to display a plurality of images at the same time and one of the images displayed on the multi-image display device And an audio output device for acquiring and outputting audio data corresponding to the selected image.

In addition, the mobile communication terminal according to the present invention mutually communicates with a multi-image display apparatus displaying a plurality of images at the same time, selects one image among the images displayed on the multi-image display apparatus, and sounds corresponding to the selected image. And acquiring and outputting data.

The sound output method and system of the multi-image display device and the mobile communication terminal used in the present invention, when a plurality of images are displayed in the multi-image display device, the user only a separate sound output device (for example, the mobile communication terminal) By operating, the user can easily select and listen to the sound of the desired image, thereby providing high convenience to the user.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

In describing the embodiments, descriptions of technical contents which are well known in the technical field to which the present invention belongs and are not directly related to the present invention will be omitted. In addition, detailed description of components having substantially the same configuration and function will be omitted.

For the same reason, some components in the accompanying drawings are exaggerated, omitted, or schematically illustrated, and the size of each component does not entirely reflect the actual size.

Meanwhile, the multiple image display apparatus and the audio output apparatus described in this embodiment are already registered as devices that can be connected to each other through a pairing process. In other words, if all are located within the connectable range, it can be easily connected by short-range communication. In addition, in the case where the user is set to be automatically connected in advance, the multi-image display apparatus and the audio output apparatus may be automatically connected according to the adjacent distance.

1 is a view schematically showing a sound output system according to an embodiment of the present invention.

Referring to FIG. 1, the sound output system 10 of the multi-image display apparatus according to the present exemplary embodiment is connected to the multi-image display apparatus 200 and the multi-image display apparatus 200 to perform sound of the multi-image display apparatus 200. It is configured to include a sound output device 100 for outputting.

The multi-image display apparatus 200 includes a receiver 250, a controller 220, a display 230, a short range communication unit 210, and a sound processor 240. The multi-image display apparatus 200 according to the present exemplary embodiment may be a general television receiver, a digital multimedia broadcasting (DMB) receiving terminal, or a mobile communication terminal. Meanwhile, in describing the present embodiment, for convenience of description, a case in which multiple images are displayed as picture in picture (PIP) will be described as an example. However, the multi-image of the present invention is not limited to such a PIP, and may include various display methods such as a method of dividing the screen uniformly and displaying the image with the same size.

 The receiver 250 includes a broadcast antenna and receives over-the-air broadcast.

The sound processor 240 outputs sound signals for the images output to the display unit 230 to the outside through the speaker according to a control signal of the controller 220 to be described later. In this case, the sound processor 240 outputs sound only for one image selected by the user. In addition, the sound processor 240 converts sound signals for the images output to the display unit 230 into sound data and transmits the sound signals to the sound output device 100 to be described later. In this case, the sound processor 240 converts only the sound corresponding to the image requested by the sound output device 100 into sound data and transmits the sound data.

The controller 220 displays an image on the display unit 230 based on the broadcast signal input through the receiver 250. In addition, when a user requests to display multiple images (eg, PIP), two or more images are simultaneously displayed on the display unit 230 and the images are displayed. To this end, the controller 220 according to the present exemplary embodiment includes an image processor (not shown). The image processor processes an image signal corresponding to each image, generates an R, G, B signal, and a luminance signal (−Y) for output, and transmits the image signal to the display unit 230.

On the other hand, the multi-image display technology is already known and practiced, so a detailed description thereof will be omitted.

The local area communication unit 210 is used to transmit and receive data with other local area communication devices within a predetermined range. This is connected to the audio output device 100 according to the present invention to communicate with each other, the multi-image display device 200 receives the requests transmitted from the sound output device 100 through the short-range communication unit 210, The response signal and sound data corresponding thereto are transmitted. The short range communication unit 210 according to the present embodiment performs wireless communication using a Bluetooth module. The short range communication unit 210 may be configured in the same manner as the short range communication unit of the sound output apparatus 100 to be described later, and performs the same role. Therefore, it will be described in more detail in the description of the sound output device 100 to be described later.

Next, the sound output device 100 according to the present invention will be described. In the present embodiment, a case in which the mobile communication terminal is used as the sound output device 100 will be described as an example. However, the present invention is not limited thereto, and any device capable of performing short-range communication with the multi-image display apparatus 200 and outputting sound may be used in various ways.

2 is a block diagram schematically illustrating a mobile communication terminal according to an embodiment of the present invention.

2, the mobile communication terminal 100 according to the present invention includes a short range communication unit 120, a wireless communication unit 130, an audio processing unit 140, a key input unit 160, a display unit 150, and a storage unit 170. ), And the controller 190.

The short range communication unit 120 is a module for transmitting and receiving data with another short range communication device within a predetermined range through a short range communication protocol. In the present embodiment, the short range communication unit 120 uses a Bluetooth module (not shown). In this case, the local area communication unit 120 searches for a local area communication device (eg, a multi-image display device, another mobile communication terminal, a headset, etc.) that can be connected under the control of the controller 190, and pairs with the found local area communication device ( pairing) to perform the overall operation of the near field communication. In addition, when the near field communication unit 120 uses the Bluetooth module, a range in which the near field communication device is searched by the near field communication unit 120 is within 10 m. Specifically, when the near field communication unit 120 is activated, a near field communication device within 10m is searched for. In this case, when at least one local area communication device is found, the local area communication unit 120 obtains additional information of the found local area communication device. The additional information obtained may include the type of the device, the level of the short-range communication connection signal, and whether the device is registered.

In addition, the short-range communication unit 120 according to the present invention includes an automatic connection function that automatically connects communication with the short-range communication device when it finds a short-range communication device that can be automatically connected. Therefore, when the short range communication connection request signal is received from the short range communication device registered to be automatically connected by the user, the short range communication unit 120 starts communication with the short range communication device under the control of the controller 190.

The wireless communication unit 130 performs a function of transmitting and receiving corresponding data for wireless communication of the mobile communication terminal 100. The wireless communication unit 130 may include an RF transmitter for upconverting and amplifying a frequency of a transmitted signal, and an RF receiver for low noise amplifying and downconverting a received signal. In addition, the wireless communication unit 130 may receive data through a wireless channel, output the data to the controller 190, and transmit data output from the controller 190 through a wireless channel.

The sound output unit 140 includes a coder (Coder / Decoder). The codec may include a data codec for processing packet data and the like and an audio codec for processing an audio signal such as voice. Therefore, the audio output unit 140 converts the digital audio data received by the control unit 190 through the wireless communication unit 130 into an analog audio signal through an audio codec and outputs the speaker to the speaker, and the analog audio input from the microphone. The signal is converted into digital audio data through an audio codec and provided to the controller 190. Also, the sound output unit 140 according to the present exemplary embodiment obtains sound data transmitted from the sound processor 240 of the multi-image display apparatus 200, converts the sound data into an audio signal, and outputs the sound signal to the outside through the speaker.

The key input unit 160 receives a user's operation signal for controlling the mobile communication terminal 100 and transmits it to the controller 190. To this end, the key input unit 160 includes control keys (not shown) for operation control of the mobile communication terminal 100 and a plurality of numeric keys (not shown) for inputting letters and numbers.

The display unit 150 displays data output from the controller 190 on the screen. Herein, the liquid crystal display (LCD) may be applied to the display unit 150. In this case, the display unit 150 may include an LCD controller, a memory capable of storing data, and an LCD display device. When the LCD is implemented using a touch screen method, the screen of the display unit 150 may be operated as an input unit.

The storage unit 170 includes a program memory and data memories. Program memory stores programs for controlling a general operation of the mobile communication terminal 100. Data generated during program execution is stored in the data memory.

The controller 190 performs an overall control operation of the mobile communication terminal 100. In addition, when the mobile communication terminal 100 is connected to the multi-image display apparatus 200 through the short-range communication unit 120, the controller 190 according to an embodiment of the present invention is displayed on the multi-image display apparatus 200. Select an image for outputting sound from the images. The controller acquires sound data corresponding to the corresponding image and transmits the sound data to the sound output unit 140. To this end, the controller 190 according to an embodiment of the present invention includes an image selector 192.

The image selector 192 obtains information of images displayed on the multi-image display apparatus 200 and displays them to the user. Then, one image is selected according to a user's selection, and the multi-image display apparatus 200 requests sound data corresponding to the selected image.

Next, the sound output method of the multi-image display device according to the present invention will be described in detail with reference to the following embodiments. From the following description of the sound output method, the configuration of the above-described sound output system 10 of the multi-image display apparatus will be more apparent.

3 is a flowchart schematically illustrating a sound output method of a multi-image display device according to an exemplary embodiment of the present invention.

1 to 3, in the sound output method of the multi-image display apparatus 200 according to the present embodiment, power is supplied to the mobile communication terminal 100, and the standby state is in an idle state according to normal operation. The process is performed from entering S10. In operation S20, power is supplied to the multi-image display apparatus 200 and a multi-image is displayed on the display unit 230 of the multi-image display apparatus 200 according to a user's request. S10 and S20 may be performed regardless of the execution order. That is, the S20 process may be performed first.

Next, a process of receiving a sound output request to the mobile communication terminal 100 in a standby state is performed. That is, in operation S30, the user requests the sound of the multi-image display apparatus 200 to be output through the mobile communication terminal 100 by manipulating the key input unit 160 of the mobile communication terminal 100. In this case, the sound output request may be performed by the user entering a menu of the mobile communication terminal 100 and selecting a corresponding item.

When the sound output request is received by the user, an S40 process in which the mobile communication terminal 100 and the multi-image display apparatus 200 are interconnected through respective short-range communication units 130 and 210 is performed. In the present embodiment, a case in which the mobile communication terminal 100 and the multi-image display device 200 communicate with each other through a Bluetooth module will be described as an example. However, the present invention is not limited thereto, and various technologies may be used if short-range communication is possible with each other wirelessly such as ZigBee, RFID, and Wi-Fi.

On the other hand, since the connection process between devices via the Bluetooth module is a known technique, a description thereof will be omitted.

When the mobile communication terminal 100 and the multi-image display apparatus 200 are connected to each other and a state in which communication is possible is formed through the S40 process, the image selector 192 of the mobile communication terminal 100 performs the multi-image. In operation S50, the display apparatus 200 requests image information. The image information refers to information of images currently displayed on the display unit 230 of the multi-image display apparatus 200. The image information according to the present embodiment includes information on the total number of images currently being displayed and display position information on which each image is displayed. However, the present invention is not limited thereto. In addition, if detailed information (eg, title of the image, channel information, etc.) of each image can be obtained, it is preferable to include all of them.

When the image information transmission request is received in step S50, the controller 220 of the multi-image display apparatus 200 performs the step S60 of extracting information of the currently displayed images and transmitting the extracted information to the mobile communication terminal 100. For example, when two images are simultaneously displayed on the display unit 230 of the multi-image display apparatus 200 through the PIP technology, the controller 220 of the multi-image display apparatus 200 displays two images at present. The information indicating that the information is displayed and the information indicating the position of the sub-screen are transmitted to the mobile communication terminal 100 together. In the present embodiment, since multiple images are displayed using the PIP technology, location information on the main screen using the full screen may be omitted. However, when displaying the multiple images by dividing the screen evenly on the display unit 230, it is preferable to transmit all the position information for each image.

When the mobile terminal 100 receives the image information transmitted from the multi-image display apparatus 200 through the S60 process, the image selector 192 of the mobile communication terminal 100 selects the image using the transmitted image information. S70 process of displaying the screen is performed.

4 is a diagram schematically illustrating an image selection screen according to an exemplary embodiment of the present invention. As illustrated in FIG. 4, an image selection screen according to the present exemplary embodiment is an image currently displayed on the multi-image display apparatus 200. Likewise, images are displayed and screens are displayed. Accordingly, the user can easily select one image to listen to the sound.

Meanwhile, in the present embodiment, as described above, only the number information of the image and the position information of the image are included in the information of the images. Therefore, as shown in FIG. 4, a simple image selection screen is displayed. However, the present invention is not limited thereto, and if the title information or the channel information of each image is further included in the information of the images, the images may be displayed in more detail.

When the user selects one image (eg, the main screen) through the image selection screen in step S80, the image selecting unit 192 of the mobile communication terminal 100 displays the sound data of the selected image in the multi-image display device in step S90. Ask 200.

 The sound processor 240 of the multi-image display apparatus 200 performs an operation S100 of generating sound data by converting a sound signal of an image displayed on the main screen. Herein, the sound data is digital data, and means data of a method that can be recognized by the mobile communication terminal 100, which is a sound output device.

Subsequently, the sound processor 240 of the multi-image display apparatus 200 performs an S110 process of transmitting the generated sound data to the mobile communication terminal 100.

When sound data is transmitted from the multi-image display apparatus 200, the controller 190 of the mobile communication terminal 100 transmits the corresponding sound data to the sound output unit 140. The sound output unit 140 converts the corresponding sound data into a sound signal, and then performs an S120 process of outputting the sound data to the outside through a speaker (or an earphone).

Meanwhile, since the sound according to the present embodiment is continuously output in correspondence to the image, the sound data generation, transmission, and output processes performed in steps S100 to S120 are not performed once but similarly to the streaming method. It is performed in real time.

Through the above process, the user of the mobile communication terminal 100 hears the sound of the image displayed on the multi-image display apparatus 200 through the mobile communication terminal 100, not the speaker of the multi-image display apparatus 200. It becomes possible.

As such, in step S120 where the user selects one image (eg, an image of the main screen) and listens to the corresponding sound by the mobile communication terminal 100, the user corresponds to another image (eg, an image of the sub-screen). If you want to listen to the sound, the user requests a selection of another image (S130).

When the user requests the selection of another image by operating the key input unit 160 of the mobile communication terminal 100 in step S130, the process returns to step S50 and the image selection unit 192 of the mobile communication terminal 100 is currently multiple The image display apparatus 200 re-requests information on the images displayed.

Thus, the above-described process S50 to S120 is repeatedly performed as follows.

When the user changes the position or number of images displayed on the multi-image display apparatus 200, the controller 220 of the multi-image display apparatus 200 transmits new image information corresponding thereto to the mobile communication terminal 100 in step S60. Will be sent). Accordingly, the image selector 192 of the mobile communication terminal 100 displays the image selection screen corresponding to the new image information to the user in step S70. On the other hand, when the user does not change the position or number of images displayed on the multi-image display apparatus 200, the controller 220 of the multi-image display apparatus 200 transmits the same image information as before, and thus, S70. The process displays the same image selection screen (eg, FIG. 4) as before.

Next, when the user selects another image (eg, a sub-screen image) in step S80, the image selecting unit 192 of the mobile communication terminal 100 displays sound data of the selected image (sub-screen) in the multi-image display apparatus. It performs the S90 process requesting the (200).

Since the following process is performed in the same manner as the above-described process corresponding to the image selected by the user, a description thereof will be omitted.

Although not shown, when the Bluetooth connection termination request or the audio output termination request is received from the user while the above-described processes are performed, the mobile communication terminal 100 disconnects the multiple image display apparatus 200 and outputs the audio output. The process ends.

The audio output method and system of the multi-image display apparatus according to the present invention performed through the above process, and the mobile communication terminal used therein, when a plurality of images are displayed on the multi-image display device, the user has a separate sound output device Since only a mobile communication terminal (eg, a mobile communication terminal) can be operated to easily select and listen to a sound of a desired image, high convenience is provided to the user.

On the other hand, the method and system for sound output of the multi-image display device according to the present invention and the mobile communication terminal used therein are not limited to the embodiments, and various modifications can be made by those skilled in the art within the technical idea of the present invention. Modifications are possible.

For example, in the present embodiment, an example in which an image is selected by the mobile communication terminal and only the audio data corresponding thereto is transmitted to the mobile communication terminal is described. However, it is not limited thereto. That is, the multi-image display apparatus generates complex sound data corresponding to all images and continuously transmits the complex sound data to the mobile communication terminal, and after receiving the mobile communication terminal, extracts only the sound corresponding to the image selected by the user. It is also possible to use a method for outputting.

In addition, although the present embodiment includes a process of displaying an image selection screen, it may be omitted and set to select an image only by a user's key input. For example, various methods may be used, such as setting a specific key of the key input unit as an image selection key and switching and selecting images currently displayed on the multi-image display device in a certain order each time the image selection key is input. .

In addition, the present invention has been described taking the case of displaying only two images (the image of the main screen and the image of the sub-screen) through the PIP technology as an example. However, the same applies to the case where three or more images are displayed at the same time.

In addition, the embodiment of the present invention has been described taking the case where the multiple image display apparatus and one mobile communication terminal are connected as an example. However, when the near-field communication unit of the multi-image display device is configured to be connected to one or more sound output devices simultaneously, it is also possible to connect and use a plurality of volume output devices to one multi-image display device. In this case, each of the volume output devices connected to the multi-image display device individually selects and outputs a desired sound.

1 is a schematic diagram of a sound output system according to an embodiment of the present invention;

2 is a block diagram schematically illustrating a mobile communication terminal according to an embodiment of the present invention;

3 is a flowchart schematically illustrating a sound output method of a multi-image display device according to an exemplary embodiment of the present invention.

4 schematically illustrates an image selection screen according to an embodiment of the present invention.

Claims (20)

A sound output method for outputting a sound of a multi-image display device on which at least two images are displayed by using an audio output device, A connection process of connecting the sound output device and the multi-image display device to each other in response to a sound output request; An image selection process of selecting one of the images displayed on the multi-image display apparatus in the sound output apparatus; and And outputting a sound corresponding to the selected image to the outside by the sound output device receiving sound data from the multi-image display device. The method of claim 1, wherein if an image selection request is input to the sound output device during the sound output process, And repeating the image selection process and the audio output process. The method of claim 2, wherein prior to performing the sound output process, Requesting the multi-image display device for the sound data corresponding to the image selected in the image selection process; and And transmitting, by the multi-image display device, the sound data to the sound output device. The method of claim 2, wherein the connecting process, The audio output method of a multi-image display device, characterized in that the process of being connected by using wireless communication. The method of claim 4, wherein the wireless communication, The audio output method of the multi-image display device, characterized in that any one of Bluetooth, ZigBee, RFID, and Wi-Fi. The method of claim 2, wherein the audio output device is a mobile communication terminal. The method of claim 2, wherein the audio output device is a Bluetooth headset. The method of claim 2, wherein the image selection process comprises: Requesting information of the images displayed on the multi-image display apparatus; Transmitting information of the images from the multi-image display apparatus in response to the request for the information of the images; and And displaying an image selection screen by using the information of the transmitted images in the sound output apparatus. The method of claim 8, And the information of the images includes information on the total number of the images displayed on the multi-image display apparatus and display position information of the images. A multi-image display device displaying a plurality of images at the same time And an audio output device which mutually communicates with the multi-image display device, selects one image among the images displayed on the multi-image display device, and acquires and outputs sound data corresponding to the selected image. Sound output system of multiple image display device. The display apparatus of claim 10, wherein the multi-image display device comprises: A display unit displaying the images, A short range communication unit connected to the sound output device and communicating with each other, and And a sound processing unit which extracts sound data corresponding to the selected image from the sound output device among the images displayed on the display unit and transmits the sound data to the sound output device. The method of claim 11, wherein the sound output device, A local area communication unit connected to the multi-image display device and communicating with each other; An image selector which acquires the image information displayed on the multi-image display device, selects one image, and transmits the information of the selected image to the multi-image display device, and And a sound output unit configured to receive the sound data transmitted from the sound processor of the multi-image display device and output the sound data to the outside. The apparatus of claim 12, wherein the multiple image display apparatus and the audio output apparatus comprise: An audio output system of a multi-image display device, characterized in that they communicate with each other via wireless communication. The method of claim 13, wherein the wireless communication, An audio output system of a multi-image display device, characterized in that any one of Bluetooth, ZigBee, RFID, and Wi-Fi. The sound output system of claim 12, wherein the sound output device is a mobile communication terminal. The sound output system of claim 12, wherein the sound output device is a Bluetooth headset. And simultaneously communicating with a multi-image display apparatus displaying a plurality of images, selecting one image from among the images displayed on the multi-image display apparatus, and acquiring and outputting sound data corresponding to the selected image. Mobile communication terminal. The method of claim 17, A local area communication unit connected to the multi-image display device and communicating with each other; An image selector which acquires information of the images displayed on the multi-image display apparatus, selects one image among the images according to an external input, and transmits information of the selected image to the multi-image display apparatus;  And a sound output unit for receiving sound data corresponding to the transmitted information of the image and outputting the sound data to the outside. The method of claim 18, wherein the short-range communication unit, And a mobile communication terminal communicating with the multiple video display device through wireless communication. The method of claim 19, wherein the wireless communication, Mobile communication terminal, characterized in that any one of Bluetooth, ZigBee, RFID, and Wi-Fi.

Images