KR20160018112A - Multimedia deivice and method for controlling the same - Google Patents

Abstract

A multimedia device and a control method thereof are disclosed.
A multimedia device according to an embodiment of the present invention includes a camera for acquiring an image, a microphone for receiving an external sound signal and converting the external sound signal into electrical audio data, audio data corresponding to the voices of the first and second users, A memory for storing image data corresponding to a face of each of the first and second users; and a control unit including a display unit, a voice recognition unit, and a face recognition unit, wherein the control unit controls the display unit to include at least two The control unit controls the display unit to output the first content to the first area and the second content to the second area of the at least two areas, and to output the second content to at least one of the stored audio data and the image data Based on the image acquired by the camera and the image acquired by the microphone Audio data to identify the first user and the second user, and when a first user command is input from the identified first user, And outputs the result of the function execution corresponding to the second user command to the second area when the second user command is input from the identified second user.

Description

[0001] MULTIMEDIA DEVICE AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to a multimedia device and a control method thereof.

In recent years, TV has been playing a role of a multimedia device that has added Internet functions and smart functions beyond a broadcast receiving function. As a result, the voice recognition function is implemented on the TV so that the user can control each function of the TV by uttering a command by voice, and the face recognition function is implemented on the TV to recognize a specific user, It is also possible to provide.

On the other hand, TVs are used by a plurality of users together because of their characteristics. In recent years, it is possible for a plurality of users to enjoy different contents by virtually dividing a TV screen. However, in such a case, there is a problem such as how to control each content by a plurality of users, and which user to give priority to when controlling the functions of the TV.

The present invention is directed to solving the above-mentioned problems and other problems.

Another object of the present invention is to provide a solution for how various users can control each content when a screen of a display unit of a multimedia device is virtually divided and various users view different contents .

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to an aspect of the present invention, there is provided a multimedia device comprising: a camera for acquiring an image; a microphone for receiving an external acoustic signal and converting the external acoustic signal into electrical audio data; A memory for storing audio data corresponding to each voice and image data corresponding to a face of each of the first and second users; a display unit; and a control unit including a voice recognition unit and a face recognition unit, Controls the display unit to virtually divide the display unit into at least two areas, output the first content to the first one of the at least two areas, and output the second content to the second area, Based on at least one of data and image data, Identifying the first user and the second user using at least one of an image and audio data obtained by the microphone, and if the first user command is input from the identified first user, Outputs the result of the corresponding function execution to the first area and outputs the result of the function execution corresponding to the second user command to the second area when the second user command is input from the identified second user .

According to another aspect of the present invention, there is provided a multimedia device including a camera for acquiring an image, a display unit, and a control unit, wherein the control unit controls the display unit to include at least two areas And controls the display unit to output the first content to the first area located on the left side of the at least two areas and to output the second content to the second area located to the right side of the first area, Wherein when the acquired image includes at least two users, when a first user command is input from a first user located at a relatively left side in the obtained image, a result of the function execution corresponding to the first user command To the first region, and outputs the second region, which is located at the relatively right side in the obtained image, And outputting a result of the function execution corresponding to the second user command to the second area when a second user command is input from the user, Wherein the second user command is a user command received from the remote controller when the remote controller is detached from the remote controller and the second user command detects that the second user is holding the remote controller based on the obtained image, Is a user command received from the remote controller.

Effects of the multimedia device and the control method according to the present invention will be described as follows.

According to at least one embodiment of the present invention, when a screen of the display unit of the multimedia device is virtually divided to allow different users to watch different contents, it is possible to provide a solution for how various users can control each content .

Further scope of applicability of the present invention will become apparent from the following detailed description. It should be understood, however, that the detailed description and specific examples, such as the preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art.

1 is a block diagram illustrating an example of a multimedia device according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a detailed configuration of the controller of FIG. 1 according to an embodiment of the present invention.
3 is a diagram illustrating examples of a remote controller for controlling a multimedia device according to an exemplary embodiment of the present invention.
4 is a block diagram illustrating the configuration modules of a remote controller according to an embodiment of the present invention.
5 is a flowchart illustrating an example of a method of controlling a multimedia device according to an embodiment of the present invention.
6 is a diagram for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.
7 is a view for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention.
8 is a diagram for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention.
9 is a diagram for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.
10 is a diagram for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention.
11 is a view for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.
12 is a diagram for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.
13 is a diagram for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention.
FIG. 14 is a diagram for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.
15 is a view for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention.
16 is a diagram for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.
17 is a diagram for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

1 is a block diagram illustrating an example of a multimedia device according to an embodiment of the present invention.

The multimedia device 100 according to an exemplary embodiment of the present invention is an intelligent network TV that adds a computer support function to a broadcast reception function, for example, and is a device added to an internet function while being faithful to a broadcast reception function. For example, the multimedia device 100 may correspond to a network TV, a smart TV, a Hybrid Brodacast Broadband Television (HBBTV), an Internet TV, a Web TV, an IPTV (Internet Protocol Television)

The multimedia device 100 includes a receiving unit 110, an external device interface unit 120, an input unit 130, a memory 140, a control unit 150, a user interface unit 160, a display unit 170, Unit 180, a power supply unit 190, and the like.

The receiving unit 110 may include at least one tuner 111, a demodulating unit 112, and a network interface unit 113. However, the receiving unit 110 may include the tuner 111 and the demodulating unit 112, but may not include the network interface unit 113, or vice versa. Although not shown, the receiving unit 110 includes a multiplexer and multiplexes the signal demodulated by the demodulator 112 and the signal received through the network interface unit 113 via the tuner 111, You may. In addition, although not shown, the receiving unit 110 may include a demultiplexer to demultiplex the multiplexed signal or demultiplex the demodulated signal or the signal transmitted through the network interface unit 113 .

The tuner 111 tunes a channel selected by a user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through an antenna and receives RF broadcast signals. Also, the tuner 111 converts the received RF broadcast signal into an intermediate frequency (IF) signal or a baseband signal.

For example, if the received RF broadcast signal is a digital broadcast signal, the signal is converted into a digital IF signal (DIF). If the received RF broadcast signal is an analog broadcast signal, the signal is converted into an analog baseband image or a voice signal (CVBS / SIF). That is, the tuner 111 can process both a digital broadcast signal and an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner 111 can be directly input to the controller 150. [

Also, the tuner 111 can receive RF broadcast signals of a single carrier or a multiple carrier. Meanwhile, the tuner 111 sequentially tunes and receives RF broadcast signals of all the broadcast channels stored through the channel memory function among the RF broadcast signals received through the antenna, converts the RF broadcast signals into intermediate frequency signals or baseband signals (DIF: Digital Intermediate Frequency or baseband signal).

The demodulator 112 may receive and demodulate the digital IF signal DIF converted by the tuner 111 and perform channel decoding. For this, the demodulator 112 may include a trellis decoder, a de-interleaver, a Reed-Solomon decoder, or a convolution decoder, a deinterleaver, - Solomon decoder and the like.

The demodulation unit 112 may demodulate and decode the channel, and then output the stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like.

The stream signal output from the demodulation unit 112 may be input to the control unit 150. The control unit 150 controls demultiplexing, video / audio signal processing, and the like, and controls the output of audio through the display unit 170 and the audio output through the audio output unit 180.

The external device interface unit 120 provides an interface environment between the multimedia device 100 and various external devices. To this end, the external device interface unit 120 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 120 may be a digital versatile disk (DVD), a Blu-ray, a game device, a camera, a camcorder, a computer (notebook), a tablet PC, a smart phone, device, an external device such as a cloud, or the like. The external device interface unit 120 transmits a signal including data such as image, image, and voice input through the connected external device to the controller 150 of the multimedia device 100. The control unit 150 may control the processed image, video, audio, and the like to be output to the external device to which the data signal is connected. To this end, the external device interface unit 120 may further include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit includes a USB terminal, a Composite Video Banking Sync (CVBS) terminal, a component terminal, an S-video terminal (analog) terminal, A DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit can perform wireless communication with another digital device. The multimedia device 100 may be, for example, a wireless LAN (WLAN), a wireless fidelity (Wi-Fi), a wireless fidelity , infrared data association (UWB), Ultra Wideband (UWB), ZigBee, and DLNA (Digital Living Network Alliance).

Also, the external device interface unit 120 may be connected to the set-top box (STB) through at least one of the various terminals described above to perform input / output operations with the set-top box (STB).

Meanwhile, the external device interface unit 120 may receive an application or an application list in an adjacent external device, and may transmit the received application or application list to the controller 150 or the memory 140.

The network interface unit 113 provides an interface for connecting the multimedia device 100 to a wired / wireless network including the Internet network. The network interface unit 113 may include an Ethernet terminal or the like for connection with a wired network and may be a WLAN (Wireless LAN) (Wi- Fi, Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access) communication standards.

The network interface unit 113 can transmit or receive data to another user or another digital device via the connected network or another network linked to the connected network. Particularly, it is possible to transmit some content data stored in the multimedia device 100 to another user registered in advance in the multimedia device 100 or a selected one of the other digital devices or a selected digital device.

On the other hand, the network interface unit 113 can access a predetermined web page through the connected network or another network linked to the connected network. That is, it is possible to access a predetermined web page through a network and transmit or receive data with the server. In addition, content or data provided by a content provider or a network operator may be received. That is, it can receive content and related information of a movie, an advertisement, a game, a VOD, a broadcast signal, and the like provided from a content provider or a network provider through a network. In addition, it can receive update information and an update file of firmware provided by the network operator. It may also transmit data to the Internet or a content provider or network operator.

In addition, the network interface unit 113 can select and receive a desired one of the open applications through the network.

The input unit 130 is for inputting video information (or signal), audio information (or signal), data and the like, and includes a camera 131 for inputting a video signal and a microphone 132 for inputting an audio signal .

The camera 131 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 170 or stored in the memory 140. [

The microphone 132 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or an application program being executed) being performed by the mobile terminal 100. Meanwhile, the microphone 132 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The memory 140 may store a program for each signal processing and control in the control unit 150, and may store signal processed video, audio, or data signals.

The memory 140 may also function to temporarily store video, audio, or data signals input from the external device interface unit 120 or the network interface unit 113. The memory 140 may store information on a predetermined broadcast channel through a channel memory function.

The memory 140 may store a list of applications or applications input from the external device interface unit 120 or the network interface unit 113. [

In addition, the memory 140 may store various platforms to be described later.

The memory 140 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, an SD or XD memory Etc.), RAM (RAM), ROM (EEPROM, etc.), and the like. The multimedia device 100 may reproduce and provide a content file (a moving image file, a still image file, a music file, a document file, an application file, etc.) stored in the memory 140 to a user. According to the embodiment, the memory 140 may be included in the control unit 150 and implemented.

The user interface unit 160 transmits a signal input by the user to the control unit 150 or a signal from the control unit 150 to the user.

For example, the user interface unit 160 receives control signals such as power on / off, channel selection, and screen setting from the remote controller 200 according to various communication methods such as an RF communication method and an infrared (IR) Or to transmit the control signal of the control unit 150 to the remote controller 200. [

The user interface unit 160 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 150.

The user interface unit 160 transmits a control signal input from a sensing unit (not shown) that senses a gesture of a user to the control unit 150 or transmits a control signal from the control unit 150 to a sensing unit (Not shown). Here, the sensing unit (not shown) may include a touch sensor, an audio sensor, a position sensor, an operation sensor, and the like.

The control unit 150 generates a signal for video or audio output by demultiplexing or demultiplexing a stream input through the tuner 111, the demodulation unit 112, or the external device interface unit 120 And can output.

The video signal processed by the control unit 150 may be input to the display unit 170 and displayed as an image corresponding to the video signal. In addition, the image signal processed by the controller 150 may be input to the external output device through the external device interface unit 120.

The control unit 150 may include a demultiplexing unit, an image processing unit, and the like.

The control unit 150 may control the overall operation of the multimedia device 100. [ For example, the control unit 150 may control the tuner 111 to control tuning of a RF broadcast corresponding to a channel selected by the user or a previously stored channel.

The control unit 150 may control the multimedia device 100 by a user command or an internal program input through the user interface unit 160. [ In particular, the user can connect to the network and allow a user to download a desired application or application list into the multimedia device 100.

For example, the controller 150 controls the tuner 111 to input a signal of a selected channel according to a predetermined channel selection command received through the user interface unit 160. And processes video, audio or data signals of the selected channel. The control unit 150 allows the display unit 170 or the audio output unit 180 to output the video or audio signal processed by the user through the channel information selected by the user.

For example, the control unit 150 may control the operation of the external device via the external device interface unit 120, for example, a camera or a camcorder, through the external device interface unit 120 in accordance with the external device video playback command received through the user interface unit 160. [ , So that a video signal or a voice signal can be output through the display unit 170 or the audio output unit 180.

Meanwhile, the control unit 150 may control the display unit 170 to display an image. For example, a broadcast image input through the tuner 111, an external input image input through the external device interface unit 120, an image input through the network interface unit 113, It is possible to control the display unit 170 to display the stored image. At this time, the image displayed on the display unit 170 may be a still image or a moving image, and may be a 2D image or a 3D image.

Also, the control unit 150 can control to reproduce the content. The content at this time may be the content stored in the multimedia device 100, or the received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

On the other hand, when entering the application view item, the control unit 150 can control to display a list of applications or applications that can be downloaded from the multimedia device 100 or from an external network.

In addition to various user interfaces, the control unit 150 can control to install and operate an application downloaded from the external network. Further, it is possible to control the display unit 170 to display an image related to the executed application by the user's selection.

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided.

The channel browsing processing unit receives a stream signal TS output from the demodulating unit 112 or a stream signal output from the external device interface unit 120 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image can be directly or encoded and input to the controller 150. In addition, the generated thumbnail image may be encoded in a stream format and input to the controller 150. The control unit 150 may display a thumbnail list having a plurality of thumbnail images on the display unit 170 using the input thumbnail images. On the other hand, the thumbnail images in this thumbnail list can be updated in sequence or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.

According to an embodiment, the controller 150 may include at least one of a voice recognition unit 151 and a face recognition unit 152.

The voice recognition unit 151 can receive an external sound signal from the microphone 132 and analyze the audio data processed as electrical data and convert the audio data into a predetermined command. For example, the speech recognition unit 151 receives audio data corresponding to a command uttered by the user from the microphone 132, and performs a STT (Speech to Text) operation using the speech recognition algorithm stored in the memory 140 Can be performed. The control unit 180 generates a control signal corresponding to a predetermined command converted by the STT operation and controls each function of the multimedia device 100 according to the generated control signal. The memory 140 may store specific instructions and mapping data for each function of the multimedia device 100. Further, the voice recognition unit 151 can recognize and distinguish the voices of the respective users. The memory 140 stores audio data corresponding to each registered user, and may store an algorithm necessary for voice discrimination in advance. The voice recognition unit 151 analyzes the audio data transmitted from the microphone 122 and determines whether or not the audio data includes audio data corresponding to voices of various users and the audio data is stored in the memory 140 Whether or not audio data corresponding to the voice of the registered user is included, and the like.

The face recognizing unit 152 can recognize a face included in the image acquired by the camera 131. [ The memory 140 stores image data corresponding to registered faces of each user, and may store algorithms necessary for face recognition in advance. The face recognizing unit 152 can recognize whether or not the registered user's face stored in the memory 140 is included in the image acquired by the camera 131. [

The display unit 170 converts an image signal, a data signal, an OSD signal processed by the control unit 150 or a video signal and a data signal received from the external device interface unit 120 into R, G, and B signals, respectively Thereby generating a driving signal.

The display unit 170 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

Meanwhile, the display unit 170 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 180 receives a signal processed by the control unit 150, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs the audio signal. The audio output unit 180 may be implemented by various types of speakers.

In order to detect a user's gesture, a sensing unit (not shown) having at least one of a touch sensor, an audio sensor, a position sensor, and an operation sensor may be further included in the multimedia device 100 . A signal sensed by a sensing unit (not shown) may be transmitted to the controller 150 through the user interface unit 160.

On the other hand, a photographing unit (not shown) for photographing a user may be further provided. The image information photographed in the photographing unit (not shown) may be input to the controller 150.

The control unit 150 may detect the gesture of the user by combining the images photographed by the photographing unit (not shown) or sensed signals from the sensing unit (not shown).

The power supply unit 190 supplies corresponding power to the multimedia device 100.

Particularly, it is possible to supply power to a control unit 150 that can be implemented in the form of a system-on-chip (SoC), a display unit 170 for displaying an image, and an audio output unit 180 for audio output .

To this end, the power supply unit 190 may include a converter (not shown) for converting the AC power into DC power. For example, when the display unit 170 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter (not shown) capable of PWM (Pulse Width Modulation) operation for variable luminance or dimming driving and an inverter (not shown).

The remote controller 200 transmits the user input to the user interface unit 160. For this purpose, the remote controller 200 can use Bluetooth, RF (radio frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, or the like.

Also, the remote controller 200 can receive the video, audio, or data signal output from the user interface unit 160, display it on the remote controller 200, or output sound or vibration.

The multimedia device 100 may be a digital broadcasting receiver capable of processing digital broadcasting signals of a fixed or mobile ATSC scheme or DVB scheme.

In addition, the display device according to the present invention may further include a configuration that omits some of the configuration shown in FIG. On the other hand, the display device may not receive the tuner and the demodulator, and may receive and reproduce the content through the network interface unit or the external device interface unit, unlike the above.

FIG. 2 is a block diagram illustrating a detailed configuration of the controller of FIG. 1 according to an embodiment of the present invention.

The control unit 150 of the multimedia device 100 according to an embodiment of the present invention includes a demultiplexing unit 153, an image processing unit 154, an OSD generating unit 155, a mixer 156, A frame rate converter (FRC) 157, and a formatter 158. In addition, although not shown, the control unit 150 may further include a voice processing unit and a data processing unit.

The demultiplexer 153 demultiplexes the input stream. For example, the demultiplexer 153 may demultiplex the received MPEG-2 TS video, audio, and data signals. Here, the stream signal input to the demultiplexer 153 may be a stream signal output from a tuner, a demodulator, or an external device interface.

The image processing unit 154 performs image processing of the demultiplexed video signal. To this end, the image processing unit 154 may include a video decoder 154a and a scaler 154b.

The video decoder 154a decodes the demultiplexed video signal, and the scaler 272b scales the decoded video signal so that the resolution of the decoded video signal can be output from the display unit.

The video decoder 154a may support various standards. For example, the video decoder 154a performs the function of an MPEG-2 decoder when the video signal is encoded in the MPEG-2 standard, and the video decoder 154a encodes the video signal in the DMB (Digital Multimedia Broadcasting) It can perform the function of the H.264 decoder.

On the other hand, the video signal decoded by the video processing unit 154 is input to the mixer 156.

The OSD generating unit 155 generates OSD data according to a user input or by itself. For example, the OSD generating unit 155 generates data for displaying various data in graphic or text form on the screen of the display unit 170 based on the control signal of the user interface unit 160 . The generated OSD data includes various data such as a user interface screen (e.g., a GUI) of the multimedia device 100, various menu screens, a widget, an icon, and viewing rate information do. The OSD generation unit 155 may generate data for displaying broadcast information based on a caption of a broadcast image or an EPG.

The mixer 156 mixes the OSD data generated by the OSD generating unit 155 and the image signal processed by the image processing unit and provides the mixed signal to the formatter 158. Since the decoded video signal and the OSD data are mixed, the OSD is overlaid on the broadcast image or the external input image.

A frame rate conversion unit (FRC) 157 converts the frame rate of an input image. For example, the frame rate conversion unit 157 may convert the frame rate of the input 60 Hz image to have a frame rate of, for example, 120 Hz or 240 Hz according to the output frequency of the display unit. As described above, there are various methods for converting the frame rate. For example, when converting the frame rate from 60 Hz to 120 Hz, the frame rate conversion unit 157 may insert the same first frame between the first frame and the second frame, Three frames can be inserted. As another example, when the frame rate is converted from 60 Hz to 240 Hz, the frame rate conversion unit 157 may insert and convert three or more identical frames or predicted frames between existing frames. On the other hand, when the frame conversion is not performed, the frame rate conversion unit 157 may be bypassed.

The formatter 158 changes the output of the input frame rate conversion unit 157 to match the output format of the display unit. For example, the formatter 158 may output R, G, and B data signals, and the R, G, and B data signals may be output as low voltage differential signals (LVDS) or mini-LVDS . If the output of the frame rate conversion unit 157 is a 3D video signal, the formatter 158 constructs the 3D format according to the output format of the display unit and outputs the 3D service through the display unit 170 It can also support.

Meanwhile, the voice processing unit (not shown) in the control unit 150 can perform the voice processing of the demultiplexed voice signal. Such a voice processing unit (not shown) may support processing various audio formats. For example, even when a voice signal is coded in a format such as MPEG-2, MPEG-4, AAC, HE-AAC, AC-3, or BSAC, a corresponding decoder can be provided.

In addition, the voice processing unit (not shown) in the control unit 150 can process a base, a treble, a volume control, and the like.

A data processing unit (not shown) in the control unit 150 can perform data processing of the demultiplexed data signal. For example, the data processing unit can decode the demultiplexed data signal even when it is coded. Here, the encoded data signal may be EPG information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel.

Meanwhile, the above-described multimedia device 100 is an example according to the present invention, and each component can be integrated, added, or omitted according to specifications of a display device actually implemented. That is, if necessary, two or more components may be combined into one component, or one component may be divided into two or more components. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and devices thereof do not limit the scope of rights of the present invention.

3 is a diagram illustrating examples of a remote controller for controlling a multimedia device according to an exemplary embodiment of the present invention.

In order to control the multimedia device 100, a front panel (not shown) provided on the multimedia device 100 may be used or a remote controller 200 may be used.

The remote controller 200 is a user interface device (UID) capable of wireless and wired communication and mainly includes a remote controller 203, a keyboard 202, a pointing device 201, , A touch pad (touch pad), and the like. In addition, a mobile device such as a smart phone, a tablet PC, and the like capable of controlling the multimedia device 100 through mode switching and the like may be included in the remote controller 200, though it is not a control object of the multimedia device 100.

The remote controller 200 may be any one of Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (UDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA) And can communicate with the multimedia device 100 by employing at least one communication protocol as needed.

The remote controller 203 is a normal input means having various key buttons necessary for controlling the multimedia device 100. [

The pointing device 201 includes a gyro sensor or the like and implements a pointer corresponding to the motion of the user, pressure, and rotation on the screen of the multimedia device 100, The control command is transmitted. Such a pointing device 203 may be named with various names such as a magic remote controller, a magic controller, and the like.

The keyboard 202 provides various services such as a web browser, an application, and a social network service (SNS) as an intelligent integrated digital device beyond that of the multimedia device 100 providing only conventional broadcasting, It is not easy, and it is implemented to complement input and realize input convenience such as text by implementing similar to PC keyboard.

On the other hand, the remote controller 200 such as the remote controller 203, the pointing device 201, and the keyboard 202 is provided with a touch pad as needed, so that it is more convenient to input text, move the pointer, And can be used for various control purposes.

4 is a block diagram illustrating the configuration modules of a remote controller according to an embodiment of the present invention. However, FIG. 4 is an embodiment for convenience of explanation, and a configuration in which a configuration module other than the configuration modules shown in FIG. 4 is included, or a configuration module is omitted is also within the scope of the present invention.

4, the remote controller 200 according to an exemplary embodiment of the present invention includes a power supply unit 211, a memory 212, a control unit 213, a wireless communication unit 214, a user input unit 215, An output unit 216, a sensor unit 217, a microphone 218, and the like.

The wireless communication unit 214 is designed to be capable of communicating with any external device.

The wireless communication unit 214 includes an RF module 214a capable of transmitting and receiving signals with the multimedia device 100 according to the RF communication standard and an IR module 214a capable of transmitting and receiving signals with the multimedia device 100 according to the IR communication standard 214b.

The remote controller 200 can transmit a signal containing information on the movement and the like of the remote controller 200 to the multimedia device 100 through the RF module 211. Also, the remote controller 200 can receive a signal transmitted by the multimedia device 100 through the RF module 211. [

In addition, the remote controller 200 can transmit commands to the multimedia device 100 via the IR module 214b, such as power on / off, channel change, volume change, and the like, if necessary.

The user input unit 215 may include a keypad, a button, a touchpad, or a touch screen. The user can operate the user input unit 215 to input a command related to the multimedia device 100. [

The sensor unit 217 may include a gyro sensor 217a and an acceleration sensor 217b.

For example, the gyro sensor 217a can sense information on the operation of the remote controller 200 on the basis of the x, y, and z axes. The acceleration sensor 217b can sense information about the moving speed of the remote controller 200 and the like. Meanwhile, a distance measuring sensor can be further provided, thereby enabling the distance to the multimedia device 100 to be sensed.

The output unit 216 may output an image or voice signal corresponding to the operation of the user input unit 215 or corresponding to the signal transmitted from the multimedia device 100. The user can recognize whether the user input unit 215 is operated or whether the multimedia device 100 is controlled through the output unit 216.

For example, the output unit 216 may include an LED module 216a that is turned on when the user input unit 215 is operated or a signal is transmitted to or received from the multimedia device 100 through the wireless communication unit 214, a vibration module 216b An audio output module 216c for outputting sound, a display module 216d for outputting an image, and the like.

The power supply unit 211 supplies power to the remote controller 200. The power supply unit 211 can reduce power waste by interrupting power supply when the remote controller 200 has not moved for a predetermined time. The power supply unit 211 can resume power supply when a predetermined key provided in the remote controller 200 is operated.

The memory 212 may store various types of programs, application data, and the like necessary for the control or operation of the remote controller 200. [

The control unit 213 controls various matters related to the control of the remote controller 200. The control unit 213 transmits a signal corresponding to a predetermined key operation of the user input unit 215 or a signal corresponding to the motion of the remote controller 200 sensed by the sensor unit 217 to the multimedia device 100 ).

The remote controller 200 may include a microphone 218. The microphone 218 processes the external acoustic signal into electrical voice data. According to the embodiment, an external sound signal can be received while being activated only when a specific button in the user input unit 215 is selected. The control unit 213 may transmit the audio data received from the microphone 218 to the multimedia device 100 through the wireless communication unit 214. [

5 is a flowchart illustrating an example of a method of controlling a multimedia device according to an embodiment of the present invention.

The control unit 150 of the multimedia device 100 virtually divides the display unit 170 into at least two areas (S304). The control unit 150 may divide the display unit 170 into at least two areas in accordance with the screen division command received from the remote controller 200 or may divide the display unit 170 into at least two areas based on the image obtained by the camera 131. [ The display unit 170 may be virtually divided into at least two regions when faces of two or more users stored in the display unit 140 are detected.

The controller 150 may output the first content to the first area 321 of the at least two areas and output the second content to the second area of the at least two areas at step S302. For example, the control unit 150 may output the video data of the first content to the first area and the audio data of the first content to the audio output unit 180, and the video of the second content And output audio data of the second content to an external device (for example, an earphone, a sound system, an external speaker, etc.) via the external device interface unit 120. [

The control unit 150 controls the display unit 140 to display at least one of the image data obtained by the camera 131 and the audio data obtained by the microphone 132 based on the audio data and the image data for each specific user stored in the memory 140 , The first user and the second user can be identified (S303). The control unit 150 may control the camera 131 to acquire images at predetermined time intervals. The control unit 150 can control the microphone 132 to receive external sound signals and convert them into electrical audio data at predetermined time intervals or at all times. The controller 150 controls the user interface unit 160 to receive the audio data obtained through the microphone 218 built in the remote controller 200 rather than the audio data obtained from the microphone 132. [ And may identify the first user and the second user using at least one of the received audio data and the image data obtained by the camera 131. [

The first user and the second user are users registered in the memory 140 as users of the multimedia device 100 and the memory 140 stores image data necessary for recognizing the face of the first user, At least the audio data necessary for recognizing the user's voice, the image data necessary for recognizing the face of the second user, and the audio data necessary for recognizing the voice of the second user.

In addition, the control unit 150 determines whether or not there is a face of each of the first and second users stored in the obtained image, presence or absence of the mouth of each of the stored first and second users, The direction of the hands of the first and second users, the line of sight of each of the stored first and second users, the holding of the remote controller 200 of each of the stored first and second users, , At least one of the relative positions of the two users can be detected.

When the display section 170 is virtually divided into the first area and the second area, the first user is registered as the user of the first area and the second user is registered as the user of the first area, 2 domain. ≪ / RTI >

The controller 150 outputs the result of the function execution corresponding to the first user command to the first area when the first user command is input from the first user, If it is inputted, the result of the function execution corresponding to the second user command can be output to the second area (S304).

When the audio data including audio data corresponding to a specific instruction word is acquired through the microphone 132 or received from the remote controller 200, the control unit 150 controls the audio data for the specific user stored in the memory 140 It is possible to recognize whether the specific command is a first user's utterance or a second user utterance. The control unit 150 may execute a function corresponding to the specific instruction word and output the result of the function execution to the first area when the specific instruction word is recognized as being uttered by the first user. On the other hand, when the specific instruction is recognized as being uttered by the second user, the control unit 150 may execute a function corresponding to the specific instruction word and output the result of the function execution to the second area.

If the first user holds the remote controller 200 on the basis of the obtained image, the control unit 150 displays the result of executing the function corresponding to the user command received from the remote controller 200 And outputs the result of the function execution corresponding to the user command received from the remote controller 200 to the first area when the second user holds the remote controller 200 based on the obtained image And outputting it to the second area.

According to an embodiment, the first content may also be output by a first user command input from the first user, and the second content may also be output by a second user command entered from the second user. The control unit 150 may virtually divide the display unit 170 into at least two areas and output the first content to the first area according to a first user command from the identified first user, And output the second content to the second area according to a second user command from the identified second user.

6 is a diagram for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.

The control unit 150 of the multimedia device 100 divides the display unit 170 into at least two areas and outputs the first content to the first area 321 and the second area 322 The second content can be output.

The control unit 150 controls the display unit 140 to display at least one of the image data obtained by the camera 131 and the audio data obtained by the microphone 132 based on the audio data and the image data for each specific user stored in the memory 140 Can be used to identify the first user and the second user. It is assumed that the identified first user is registered as a user of the first area 321 and the identified second user is registered as a user of the second area 322. [

The control unit 150 outputs the result of the function execution corresponding to the first user command to the first area 321 when the first user command is input from the first user, When the user command is input, the result of the function execution corresponding to the second user command may be output to the second area 322. In the present embodiment, the first user command includes a user command recognized from audio data corresponding to a specific command word uttered by the first user, and the second user command includes a specific command to be uttered by the second user And may include user commands recognized from corresponding audio data.

The first user command and the second user command may be commands for controlling functions that can be implemented in the multimedia device 100. For example, the first user command and the second user command may include at least one of a channel switching command, a volume control command, an external input switching command, an Internet running command, a specific application execution command, a specific menu selection command, And the like.

For example, when the first user command is a channel switching command, the control unit 150 outputs video data of a specific content transmitted through the channel converted according to the channel switching command to the first area 321 . In another example, when the second user command is an Internet execution command, the control unit 150 executes the web browser according to the Internet execution command and outputs the execution screen of the web browser to the second area 322 . According to another example, when the second user command is a volume up command, the controller 150 outputs a GUI corresponding to the volume control function to the second area 322 according to the volume up command, The volume of the audio data of the content can be increased by a predetermined amount.

7 is a view for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention.

The control unit 150 of the multimedia device 100 divides the display unit 170 into at least two areas and outputs the first content to the first area 321 and the second area 322 The second content can be output.

The control unit 150 controls the display unit 140 to display at least one of the image data obtained by the camera 131 and the audio data obtained by the microphone 132 based on the audio data and the image data for each specific user stored in the memory 140 Can be used to identify the first user and the second user. It is assumed that the identified first user is registered as a user of the first area 321 and the identified second user is registered as a user of the second area 322. [ The control unit 150 may detect whether the remote controller 200 of each of the first and second users is held based on the obtained image. The memory 140 may store image data of the predetermined remote controller 200. [

The control unit 150 outputs the result of the function execution corresponding to the first user command to the first area 321 when the first user command is input from the first user, When the user command is input, the result of the function execution corresponding to the second user command may be output to the second area 322. In the present embodiment, the first user command includes a user command received from the remote controller 200 when the first user holds the predetermined remote controller 200, And may include a user command received from the remote controller 200 if the remote controller 200 is set.

8 is a diagram for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention.

The control unit 150 controls the display unit 140 to display at least one of the image data obtained by the camera 131 and the audio data obtained by the microphone 132 based on the audio data and the image data for each specific user stored in the memory 140 Can be used to identify the first user and the second user. It is assumed that the identified first user is registered as a user of the first area 321 and the identified second user is registered as a user of the second area 322. [ The control unit 150 may detect whether the remote controller 200 of each of the first and second users is held based on the obtained image. According to the embodiment, the controller 150 determines that the first and second users are not simply holding the remote controller 200, but the remote controller 200 on the basis of the acquired image, It may be detected whether or not it is held.

The control unit 150 outputs the result of the function execution corresponding to the first user command to the first area 321 when the first user command is input from the first user, When the user command is input, the result of the function execution corresponding to the second user command may be output to the second area 322. In the present embodiment, the first user command is a command for holding the remote controller 200 in a state where the first user holds the predetermined remote controller 200 or the first user holds the remote controller 200 toward the multimedia device 100 And the second user command includes a user command received from the remote controller 200 when the second user is holding the predetermined remote controller 200 or the second user is not holding the remote controller 200 200 to the multimedia device 100, the user command received from the remote controller 200 may be included.

According to the embodiment, when information for recognizing the face and / or voice of each of the first user and the second user is not stored in the memory 140, So that the user located on the relatively left side in the acquired image is identified as the first user and the user located on the relatively right side is identified as the second user. The first area 321 may be located on the left side of the display unit 170 from the user's viewpoint and the second area 322 may be located on the right side of the display unit 170 from the user's viewpoint. If the identified first user is holding the remote controller 200 or holding the remote controller 200 facing the multimedia device 100 based on the obtained image, It is possible to recognize the user command received from the remote controller 200 as a first user command and the second user to hold the remote controller 200 or to connect the remote controller 200 to the multimedia device 100 The user can recognize the user command received from the remote controller 200 as the second user command.

Alternatively, according to the embodiment, the memory 140 stores the IR code value corresponding to the function of each of the at least two remote controllers 200a and 200b, and the first remote controller 200a among the first remote controller 200a, It is also possible to register the second remote controller 200b as a dedicated remote controller of the second area 322 by registering it as a dedicated remote controller of the area 321 and registering the second remote controller 200b as a dedicated remote controller of the second area 322. [ When a user command is received from the first remote controller 200a, the first remote controller 200b outputs the function execution result corresponding to the user command to the first area 321, When the command is received, the result of the function execution corresponding to the user command may be output to the second area 322. [

9 is a diagram for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.

The control unit 150 of the multimedia device 100 divides the display unit 170 into at least two areas and outputs the first content to the first area 321 and the second area 322 The second content can be output.

The control unit 150 controls the display unit 140 to display at least one of the image data obtained by the camera 131 and the audio data obtained by the microphone 132 based on the audio data and the image data for each specific user stored in the memory 140 Can be used to identify the first user and the second user. It is assumed that the identified first user is registered as a user of the first area 321 and the identified second user is registered as a user of the second area 322. [ The control unit 150 may detect whether the remote controller 200 of each of the first and second users is held based on the obtained image. The memory 140 may store image data of the predetermined remote controller 200. [

The control unit 150 outputs the result of the function execution corresponding to the first user command to the first area 321 when the first user command is input from the first user, When the user command is input, the result of the function execution corresponding to the second user command may be output to the second area 322. In the present embodiment, the first user command includes a user command recognized from audio data corresponding to a specific command word uttered by the first user, and a user command recognized when the first user holds the predetermined remote controller 200 Wherein the second user command comprises at least one of a user command received from the remote controller 200 and the second user command comprises a user command recognized from the audio data corresponding to a specific command uttered by the second user, And may include at least one of the user commands received from the remote controller 200 when holding the set remote controller 200.

If the predetermined condition is satisfied based on the obtained image, the control unit 150 outputs the result of the function execution corresponding to the first user command inputted from the first user to the first region 321, And outputs the result of the function execution corresponding to the second user command inputted from the second user to the first area 321 rather than the second area 322 can do. In the present embodiment, the preset condition is a condition that the first user's hand points to the second user based on the obtained image in the former case, and in the latter case, And the hand of the second user may be a condition indicating the first user. When the predetermined condition is satisfied, the first user is authorized to control the second area 322 and the second user is also allowed to control the first area 321. [

For example, when the first user command is a channel switching command, if the first user's hand is pointing to the second user based on the obtained image, The video data of the specific content transmitted through the channel switched according to the command may be output to the second area 321. [ Alternatively, when the second user command is an Internet execution command, the control unit 150 determines whether the second user's hand is pointing to the first user based on the obtained image, It is possible to execute the web browser according to the execution command and output the execution screen of the web browser to the first area 321. [

10 is a diagram for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention. The contents overlapping with those described above with reference to FIG. 9 will not be described again, and the differences will be mainly described below.

The control unit 150 of the multimedia device 100 divides the display unit 170 into at least two areas and outputs the first content to the first area 321 and the second area 322 The second content can be output.

The control unit 150 outputs the result of the function execution corresponding to the first user command to the first area 321 when the first user command is input from the first user, When the user command is input, the result of the function execution corresponding to the second user command may be output to the second area 322.

If the predetermined condition is satisfied based on the obtained image, the control unit 150 outputs the result of the function execution corresponding to the first user command inputted from the first user to the first region 321, And outputs the result of the function execution corresponding to the second user command inputted from the second user to the first area 321 rather than the second area 322 can do. In the present embodiment, the predetermined condition is a condition in which the gaze of the first user is directed to the second region 322 for a predetermined time based on the obtained image in the former case, and in the latter case, And the gaze of the second user may be directed to the first region 321 for a preset time based on the obtained image. When the predetermined condition is satisfied, the first user is authorized to control the second area 322 and the second user is also allowed to control the first area 321. [

11 is a view for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.

The control unit 150 of the multimedia device 100 divides the display unit 170 into at least two areas and outputs the first content to the first area 321 and the second area 322 The second content can be output.

The control unit 150 outputs the result of the function execution corresponding to the first user command to the first area 321 when the first user command is input from the first user, When the user command is input, the result of the function execution corresponding to the second user command may be output to the second area 322.

The control unit 150 may control the second area 322 and the second area 322 so that when the first user's gaze and the second user's gaze are directed to the second area 322 for a predetermined time, To the entire area of the display unit 170. [0064] Likewise, when the gaze of the first user and the gaze of the second user are directed to the first region 321 for a preset time, based on the obtained image, Can be output to the entire area of the display unit 170.

According to an embodiment of the present invention, when the first content is output to the entire area of the display unit 170, the controller 150 controls each function of the multimedia device 100 according to a first user command input from the first user And may control each function of the multimedia device 100 according to a user command input from a user registered as a master user in the memory 140 among the first user and the second user. When the second content is output to the entire area of the display unit 170, the controller 150 may control each function of the multimedia device 100 according to a second user command input from the second user, A multimedia device (e.g., a personal computer) in response to a user command input from a user registered as a master user in the memory 140 among the first user and the second user 100 may be controlled,

12 is a diagram for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.

The control unit 150 of the multimedia device 100 divides the display unit 170 into at least two areas and outputs the first content to the first area 321 and the second area 322 The second content can be output.

The control unit 150 controls the display unit 140 to display at least one of the image data obtained by the camera 131 and the audio data obtained by the microphone 132 based on the audio data and the image data for each specific user stored in the memory 140 Can be used to identify the first user and the second user. It is assumed that the identified first user is registered as a user of the first area 321 and the identified second user is registered as a user of the second area 322. [ The control unit 150 may detect whether the remote controller 200 of each of the first and second users is held based on the obtained image. The memory 140 may store image data of the predetermined remote controller 200. [

The control unit 150 outputs the result of the function execution corresponding to the first user command to the first area 321 when the first user command is input from the first user, When the user command is input, the result of the function execution corresponding to the second user command may be output to the second area 322. In the present embodiment, the first user command includes a user command recognized from audio data corresponding to a specific command word uttered by the first user, and a user command recognized when the first user holds the predetermined remote controller 200 Wherein the second user command comprises at least one of a user command received from the remote controller 200 and the second user command further comprises a user command recognized from audio data corresponding to a specific command uttered by the second user, And may include at least one of the user commands received from the remote controller 200 when holding the set remote controller 200.

If the predetermined condition is satisfied based on the obtained image, the controller 150 outputs the function corresponding to the first user command input from the first user through the second area 322 And outputs the result of the function execution to the first area 321. The function corresponding to the second user command inputted from the second user is called the first area 321 And outputting the result of the function execution to the second area 322. The second area 322 includes a first area 322 and a second area 322, In the present embodiment, the preset condition is a condition that the first user's hand points to the second user based on the obtained image in the former case, and in the latter case, And the hand of the second user may be a condition indicating the first user.

The first content output through the first area 321 is video data of a program transmitted through the channel 11 and the second content output through the second area 321 is transmitted through the channel 100 Hereinafter, the video data of the program will be described as an example. If the first user command is a channel up command, the control unit 150 determines whether the first user's hand is pointing to the second user based on the obtained image, (Switching from channel 100 to channel 101), and a program that is transmitted through channel 101, which is a result of the function execution, on the basis of the second content output through the second area 322 And output the video data to the first area 321. Alternatively, if the first user command is an EPG information output command, the control unit 150 determines whether the first user's hand is pointing to the second user based on the obtained image, It is possible to extract the EPG data included in the broadcast signal of the second content according to the EPG information output command and output the GUI including the extracted EPG data to the first area 321. [

13 is a diagram for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention. The contents overlapping with those described above with reference to FIG. 12 will not be described again, and the differences will be mainly described below.

The control unit 150 of the multimedia device 100 divides the display unit 170 into at least two areas and outputs the first content to the first area 321 and the second area 322 The second content can be output.

The control unit 150 outputs the result of the function execution corresponding to the first user command to the first area 321 when the first user command is input from the first user, When the user command is input, the result of the function execution corresponding to the second user command may be output to the second area 322.

If the predetermined condition is satisfied based on the obtained image, the controller 150 outputs the function corresponding to the first user command input from the first user through the second area 322 And outputs the result of the function execution to the first area 321. The function corresponding to the second user command inputted from the second user is called the first area 321 And outputting the result of the function execution to the second area 322. The second area 322 includes a first area 322 and a second area 322, In the present embodiment, the predetermined condition is a condition in which the gaze of the first user is directed to the second region 322 for a predetermined time based on the obtained image in the former case, and in the latter case, And the gaze of the second user may be directed to the first region 321 for a preset time based on the obtained image.

FIG. 14 is a diagram for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.

The control unit 150 of the multimedia device 100 divides the display unit 170 into at least two areas and outputs the first content to the first area 321 and the second area 322 The second content can be output.

The control unit 150 controls the display unit 140 to display at least one of the image data obtained by the camera 131 and the audio data obtained by the microphone 132 based on the audio data and the image data for each specific user stored in the memory 140 Can be used to identify the first user and the second user. It is assumed that the identified first user is registered as a user of the first area 321 and the identified second user is registered as a user of the second area 322. [ The control unit 150 may detect whether the remote controller 200 of each of the first and second users is held based on the obtained image. The memory 140 may store image data of the predetermined remote controller 200. [

The control unit 150 outputs the result of the function execution corresponding to the first user command to the first area 321 when the first user command is input from the first user, When the user command is input, the result of the function execution corresponding to the second user command may be output to the second area 322. In the present embodiment, the first user command includes a user command recognized from audio data corresponding to a specific command word uttered by the first user, and a user command recognized when the first user holds the predetermined remote controller 200 Wherein the second user command comprises at least one of a user command received from the remote controller 200 and the second user command comprises a user command recognized from the audio data corresponding to a specific command uttered by the second user, And may include at least one of the user commands received from the remote controller 200 when holding the set remote controller 200.

If the predetermined condition is satisfied on the basis of the obtained image, the controller 150 transmits information related to the second content output through the second area 322 to the first area 321 Or output information related to the first content output through the first area 321 to the second area 322. [ In the present embodiment, the preset condition is a condition that the first user's hand points to the second user based on the obtained image in the former case, and in the latter case, And the hand of the second user may be a condition indicating the first user. When the predetermined condition is satisfied, the first user is allowed to control the second area 322 and the second user is also allowed to control the first area 321. [ Here, the information related to the content may be a concept including EPG data included in the broadcast signal of the content, information about the content related to the content retrieved based on the service data included in the broadcast signal of the content, have. The content relevant to the content may include content having the same title as the content, a series of the content, an episode of the content, and other episode contents. The control unit 150 determines whether content related to the content is broadcast or scheduled to be broadcast on a channel different from the channel on which the content is broadcast based on the service data included in the broadcast signal of the content, Whether or not there is a device that can use the content related to the content among the external devices connected through the unit 120, and the like.

For example, when the hand of the first user is detected as indicating the second user based on the obtained image, the control unit 150 controls the second content 322 output through the second area 322, To the first area 321, a GUI 330 including information related to the first area 321. [ According to an embodiment, when the hand of the first user indicates that the second user is pointing at the predetermined time based on the obtained image, the controller 150 controls the second area 322 And outputs the second content to the entire screen of the display unit 170 after outputting the GUI 330 including information related to the second content output through the first area 321 to the first area 321 for a predetermined time.

15 is a view for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention. The contents overlapping with those described above with reference to Fig. 14 will not be described again, and the differences will be mainly described below.

The control unit 150 of the multimedia device 100 divides the display unit 170 into at least two areas and outputs the first content to the first area 321 and the second area 322 The second content can be output.

The control unit 150 outputs the result of the function execution corresponding to the first user command to the first area 321 when the first user command is input from the first user, When the user command is input, the result of the function execution corresponding to the second user command may be output to the second area 322.

If the predetermined condition is satisfied on the basis of the obtained image, the controller 150 transmits information related to the second content output through the second area 322 to the first area 321 Or output information related to the first content output through the first area 321 to the second area 322. [ In the present embodiment, the predetermined condition is a condition in which the gaze of the first user is directed to the second region 322 for a predetermined time based on the obtained image in the former case, and in the latter case, And the gaze of the second user may be directed to the first region 321 for a preset time based on the obtained image.

16 is a diagram for explaining an example of a method of controlling a multimedia device according to an embodiment of the present invention.

The control unit 150 of the multimedia device 100 divides the display unit 170 into at least two areas and outputs the first content to the first area 411 and the second area 412 The second content can be output. For example, the first region 411 and the second region 412 may be disposed along the first direction. Here, the first direction may be a horizontal direction of the display unit 170. That is, the first area 411 may be located on the left side of the display unit 170 from the user's point of view, and the second area 412 may be located on the right side of the display unit 170 from the user's point of view.

The control unit 150 outputs the first content through the second area 412 and outputs the second content to the first area 411 through the first area 411 when a third user command is received from the remote controller 200 Can be output. That is, the image output through the first area 411 and the image output through the second area 412 can be swapped with each other. The third user command is a command for dragging a pointer P corresponding to the movement of the remote controller 200 from one point in the second area 412 toward a point in the first area 411 Or a user input that is dragged from one point in the second area 411 toward a point in the first area 412. [ The user presses the selection button provided on the remote controller 200 or touches the selection menu and moves the pointer P from one point in the second area 412 to a point in the first area 411 Or from one point in the second region 411 toward a point in the first region 412. [ In one example, the pointer P may move in a direction substantially perpendicular to the first direction on the display unit 170 according to the third user command.

According to an exemplary embodiment, when the screen output through the first area 411 and the screen output through the second area 412 are swapped with each other, the first user and the second user may select the first May be maintained as a user of each of the region 411 and the second region 412 and newly set as a user of the second region 412 and the first region 411, respectively.

17 is a diagram for explaining another example of a method of controlling a multimedia device according to an embodiment of the present invention.

The control unit 150 of the multimedia device 100 divides the display unit 170 into at least two areas and outputs the first content to the first area 411 and the second area 412 The second content can be output. For example, the first region 411 and the second region 412 may be positioned along the second direction. Here, the first direction may be a vertical direction of the display unit 170. That is, the first area 411 may be located on the upper side of the display unit 170, and the second area 412 may be located on the lower side of the display unit 170.

The controller 150 outputs the first content through the second area 412 and outputs the second content to the first area 411 through the first area 411 when a fourth user command is received from the remote controller 200 Can be output. That is, the image output through the first area 411 and the image output through the second area 412 can be swapped with each other. The fourth user command is a command for dragging a pointer P corresponding to the movement of the remote controller 200 from one point in the second area 412 toward a point in the first area 411 Or a user input that is dragged from one point in the second area 411 toward a point in the first area 412. [ The user presses the selection button provided on the remote controller 200 or touches the selection menu and moves the pointer P from one point in the second area 412 to a point in the first area 411 Or from one point in the second region 411 toward a point in the first region 412. [ In one example, the pointer P may move in a direction substantially perpendicular to the second direction on the display unit 170 according to the fourth user command.

According to an exemplary embodiment, when the screen output through the first area 411 and the screen output through the second area 412 are swapped with each other, the first user and the second user may select the first May be maintained as a user of each of the region 411 and the second region 412 and newly set as a user of the second region 412 and the first region 411, respectively.

According to the embodiments of the present invention described above, when a screen of a display unit of a multimedia device is virtually divided to allow different users to watch different contents, it is possible to provide a solution for how various users can control each content.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). In addition, the computer may include a control unit 150 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: Multimedia device
200: remote controller

Claims (10)

A camera for acquiring an image;
A microphone for receiving an external acoustic signal and converting it into electrical audio data;
A memory for storing audio data corresponding to the voices of the first and second users, respectively, and image data corresponding to the faces of the first and second users;
A display unit; And
And a control unit including a voice recognition unit and a face recognition unit,
Wherein,
The display unit is virtually divided into at least two regions,
Controls the display unit to output the first content to the first area and the second content to the second area of the at least two areas,
Identifying the first user and the second user based on at least one of the stored audio data and image data using at least one of audio data obtained by the microphone and images obtained by the camera,
Outputting a result of executing a function corresponding to the first user command to the first area when a first user command is input from the identified first user, And outputs the result of the function execution corresponding to the second user command to the second area. The method according to claim 1,
Wherein the control unit determines whether or not the face of each of the first and second users stored in the obtained image, the presence or absence of the mouth of each of the stored first and second users, A direction of a user's hand, a gaze of each of the stored first and second users, a hold of a remote controller of each of the stored first and second users, and a relative position of each of the first and second users Gt; a < / RTI > multimedia device. The method according to claim 1,
Wherein the first user command is a command to be transmitted from the remote controller when the first user holds the remote controller based on the user command recognized from the audio data corresponding to the specific command word uttered by the first user and the obtained image Comprising any one of the received user commands,
Wherein the second user command is a command to be transmitted from the remote controller when the second user holds the remote controller based on the user command recognized from the audio data corresponding to the specific command word uttered by the second user and the obtained image Wherein the multimedia device comprises any one of the received user commands. 3. The method of claim 2,
Wherein,
Outputting a result of executing the function corresponding to the user command received from the remote controller to the first area when the first user holds the remote controller based on the acquired image,
And outputs a result of executing the function corresponding to the user command received from the remote controller to the second area when the second user holds the remote controller based on the acquired image. 3. The method of claim 2,
Wherein the control unit outputs the result of the function execution corresponding to the first user command inputted from the first user to the second area when a predetermined condition is satisfied based on the obtained image. 3. The method of claim 2,
Wherein the control unit controls the function corresponding to the first user command inputted from the first user based on the second content outputted through the second area when the preset condition is satisfied based on the obtained image And outputs the result of the execution of the function to the first area. 7. The method according to any one of claims 5 and 6,
The predetermined condition is a condition that the first user's hand points to the second user based on the obtained image and the condition that the gaze of the first user is based on the obtained image, And a condition for directing the multimedia device to the multimedia device. 3. The method of claim 2,
Wherein the control unit displays the second content output through the second area when the gaze of the first user and the gaze of the second user are directed to the second area for a predetermined time based on the obtained image, And outputs it to the entire area of the display unit. 3. The method of claim 2,
Wherein the control unit determines whether the first user's hand points to the second user based on the obtained image or whether the gaze of the first user is directed to the second area for a predetermined time based on the obtained image And outputs information related to a second content output through the second area to the first area. A camera for acquiring an image;
A display unit; And
And a control unit,
Wherein,
The display unit is virtually divided into at least two regions,
Controlling the display unit to output the first content to a first region located on the left side of the at least two regions and to output a second content to a second region located to the right side of the first region,
Wherein when the acquired image includes at least two users, when a first user command is input from a first user located at a relatively left side in the obtained image, a result of the function execution corresponding to the first user command And outputting a result of the function execution corresponding to the second user command to the second region when the second user command is input from the second user located on the relatively right side in the obtained image, Respectively,
Wherein the first user command is a user command received from the remote controller when it is detected that the first user is holding the remote controller based on the obtained image, Wherein the second instruction is a user instruction received from the remote controller when it is detected that the second user is holding the remote controller based on the image.

Images