KR20180010955A - Electric device and method for controlling thereof - Google Patents

Abstract

An electronic device is disclosed. The electronic device includes a communication unit that communicates with a server that stores information on a plurality of short clips and a plurality of keywords per short clip, a keyword included in the received speech voice when a user speech voice is received through the input unit, And a processor for transmitting a short clip request signal to the server based on the information about the content output from the output unit and outputting a short clip through the output unit based on the information about the short clip received from the server according to the request signal do.

Description

ELECTRIC DEVICE AND METHOD FOR CONTROLLING THEREOF BACKGROUND OF THE INVENTION [0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic apparatus and a control method thereof, and more particularly to an electronic apparatus for providing a short clip and a control method thereof.

Recently, various types of multimedia devices have been developed due to the development of electronic technology. In particular, multimedia devices such as TVs, PCs, laptop computers, tablet PCs, smart phones and the like are widely used in most households.

In addition, in order to meet the needs of users who want various functions, an effort is being made to develop a new type of personal assistant service (Smart Assistant) that combines voice recognition with a multimedia device.

However, according to the related art, a text-based search result for a user's query is provided only as an unnatural voice using a TTS.

Further, when the video or audio content is included in the search result, the content is provided as it is. In this case, since the original content includes a plurality of parts irrelevant to the user's question, there is a problem that the search result that is meaningless to the user is accepted.

Therefore, it is necessary to provide only the section related to the user's question in the original content as the search result.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and an object of the present invention is to provide an electronic device and a control method thereof for providing a short clip for original content based on a keyword.

According to an aspect of the present invention, there is provided an electronic device including a communication unit for communicating with a server for storing information on a plurality of short clips and keywords for the plurality of short clips, an output unit, A short clip request signal is transmitted to the server based on a keyword included in the received speech voice and information about a content output from the output unit, And outputs a short clip through the output unit based on the information about the short clip received from the output unit.

Here, the information on the plurality of short clips may include at least one of a position where the plurality of short clips are stored and information on a time period including the keyword, and the processor may receive, from the server, When the information on the short clip is received, the short clip can be output based on the received information.

Further, each of the plurality of short clips may be video content or audio content generated by editing a portion including a specific keyword in a specific content.

Further, the processor provides additional information on the short clip when additional information on the short clip is received, and the additional information on the short clip includes a title, a genre, a broadcast time of the original content A generation time of the short clip, broadcasting station information of the original content, and the keyword.

Meanwhile, the output unit may include at least one of a display and a speaker.

In the electronic device according to another embodiment of the present invention, the output unit is implemented to include only a speaker, and the processor can provide additional information about the short clip through the speaker as audio.

Further, the output unit may include at least one of a display and a speaker, and the processor may cause the server to search for a short key associated with the keyword based on a keyword repeated a predetermined number of times or more for a predetermined time in audio output through the speaker, A clip request signal may be additionally transmitted to the server.

In addition, the processor may provide additional response information about the uttered voice together with the short clip based on a keyword included in the received utterance voice.

Meanwhile, the processor may transmit the request signal including the keyword and user information to the server, and receive a short clip related to the keyword and the user information from the server.

In addition, the processor, when receiving the uttered voice, transmits the received utterance voice to the voice recognition server or the server, and based on the keyword and information on the content received from the voice recognition server or the server, A clip request signal may be transmitted to the server.

Meanwhile, a method of controlling an electronic device communicating with a server that stores information on a plurality of short clips and keywords of the plurality of short clips according to an embodiment of the present invention includes: outputting a content; Transmitting a short clip request signal to the server based on a keyword included in the received speech voice and information on the content when the speech voice is received; And outputting the short clip based on the information about the short clip.

Here, the information on the plurality of short clips includes at least one of a position where the plurality of short clips are stored and information on a time period including the keyword, and the transmitting step may include: When the information on the short clip is received from the server, the short clip can be output based on the received information.

Further, each of the plurality of short clips may be video content or audio content generated by editing a portion including a specific keyword in a specific content.

Further, the step of outputting the short clip may provide additional information on the short clip when additional information on the short clip is received, and the additional information on the short clip may include at least one of a title, a genre, A broadcast time of the original content, a generation time of the short clip, broadcasting station information of the original content, and the keyword.

Here, in the step of outputting the short clip, additional information on the short clip may be provided as audio through a speaker.

On the other hand, the electronic device includes at least one of a display and a speaker, and the transmitting may include transmitting the keyword to the server based on a keyword repeated a predetermined number of times or more for a predetermined time in audio outputted through the speaker, To the server, a short clip request signal associated with the short clip request signal.

Further, the step of outputting the short clip may provide additional response information for the speech voice together with the short clip, based on the keyword included in the received speech speech.

The sending step may include transmitting the request signal including the keyword and the user information to the server and outputting the short clip may include receiving a short clip related to the keyword and the user information from the server And output it.

On the other hand, the transmitting step may include transmitting the received speech voice to the speech recognition server or the server, and transmitting a short clip request signal based on the keyword and the information on the content received from the server To the server.

On the other hand, a system including an electronic device and a server according to an embodiment of the present invention generates information on a plurality of short clips based on keywords of each of a plurality of original contents, And a short clip request signal based on the keywords included in the received speech voice and the information about the contents output by the electronic device, And outputting a short clip based on the information about the short clip received from the server according to the request signal.

According to various embodiments of the present invention as described above, the short clip for the original content is provided based on the keyword included in the speech voice of the user, so that convenience for the user can be increased.

1 is a view for explaining a system for providing a short clip according to an embodiment of the present invention.
2A and 2B are block diagrams showing the configuration of an electronic device according to an embodiment of the present invention.
3 is a block diagram showing the configuration of a server according to an embodiment of the present invention.
4 is a view for explaining a method of outputting a short clip related to a keyword according to an embodiment of the present invention.
5 is a diagram for explaining a method of outputting a short clip associated with output content according to an embodiment of the present invention.
6 is a diagram for explaining a method of analyzing an audio signal to acquire a keyword according to an embodiment of the present invention.
7 is a view for explaining additional information on a short clip according to an embodiment of the present invention.
8 is a diagram for explaining additional response information provided with a short clip according to an embodiment of the present invention.
9 is a flowchart illustrating a method of providing a short clip according to an embodiment of the present invention.
10 is a flowchart illustrating a system for providing a short clip according to an embodiment of the present invention.
11 is a view for explaining a method of providing an electronic device according to another embodiment of the present invention with a short clip through a speaker.

Hereinafter, the present invention will be described in more detail with reference to the drawings. In the following description, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In addition, the following examples can be modified in various ways, and the scope of the technical idea of the present disclosure is not limited to the following examples. Rather, these embodiments are provided so that this disclosure will be more thorough and complete, and will fully convey the scope of the present disclosure to those skilled in the art.

Also, to "include" an element means that it may include other elements, rather than excluding other elements, unless specifically stated otherwise. Further, various elements and regions in the drawings are schematically drawn. Accordingly, the technical spirit of the present disclosure is not limited by the relative size or spacing depicted in the accompanying drawings.

1 is a view for explaining a system for providing a short clip according to an embodiment of the present invention.

The electronic device 100 may be implemented with various types of devices that output content using at least one of a display and a speaker. Accordingly, the electronic device 100 may be implemented as a digital TV, but the present invention is not limited thereto, and may be implemented as various types of devices having a display function such as a PC, a mobile phone, a tablet PC, a PMP, a PDA, In addition, it is needless to say that the electronic device 100 may be implemented as an audio output device having no display function. In this case, the content can be outputted as an audio signal through the speaker. Hereinafter, for convenience of description, it is assumed that the electronic device 100 is implemented as a digital TV. An embodiment in which the electronic device 100 includes only a speaker without a display function will be described in detail with reference to FIG.

The electronic device 100 according to an embodiment of the present invention can receive a speech voice of a user and acquire a keyword included in the received speech voice. Specifically, the electronic device 100 can transmit the received speech voice to a speech recognition server (not shown), and receive the keyword included in the speech speech from the speech recognition server. However, the present invention is not limited to this, and the electronic device 100 may analyze the user's utterance voice to obtain a keyword.

In addition, the server 200 according to an embodiment of the present invention may be used as a speech recognition server for analyzing a speech sound and providing a keyword included in a speech voice to the electronic device 100, Of course.

The electronic device 100 may transmit a short clip request signal to the server 200 based on the keyword included in the received speech voice and the information about the content output by the electronic device 100. [ In this case, the electronic device 100 receives the information on the short clip corresponding to the request signal from the server 200, and can output the short clip based on the received information. Here, the information on the short clip may be at least one of information on a short clip, a position where the short clip is stored, and information on a time period including the keyword. For example, when a time interval including a keyword is received, the electronic device 100 may reproduce and output only a time interval including a specific keyword in the content based on the received time interval.

The server 200 can store information on a plurality of short clips and keywords for a plurality of short clips. Specifically, the server 200 may receive the content from the content provider 300 and generate a short clip from the received content. For example, the server 200 may receive broadcast content from a broadcaster and generate a plurality of short clips from the received broadcast content. Hereinafter, for convenience of description, the content received from the content provider 300 is referred to as an original content.

The short clip means an image obtained by editing a specific part or a part of the received original content. In some cases, a plurality of contents may be combined. For example, a specific portion or a portion may be obtained from each of a plurality of contents, and the obtained portions may be combined to generate a short clip.

According to an embodiment of the present invention, the server 200 may analyze the audio signal of the original content and edit the original content in units of EPD (Endpoint Detection). Here, the EPD means an algorithm for analyzing an audio signal of an original content and detecting a start point and an end point of the audio in real time.

In addition, the server 200 can acquire keywords by analyzing the voice included in each of the edited images in units of EPD. Therefore, the server 200 can acquire and store keywords matched to each of a plurality of edited videos and a plurality of edited videos edited in units of EPD from one original content. Here, the keyword to be matched to the edited video may be at least one or more.

According to an embodiment of the present invention, when the server 200 analyzes the audio signal included in the edited video to acquire a plurality of keywords, a plurality of keywords may be matched to one edited video and stored in the server. On the other hand, the original content is not necessarily edited in EPD units, and the server 200 may edit the original content based on various speech detection algorithms to generate a plurality of short clips. The method of generating keywords for the short clip and the short clip of the server 200 will be described in detail with reference to FIG. Hereinafter, for convenience of description, an edited image obtained from the original content is named a short clip.

The short clip may be a video image in which a specific portion of the original content, for example, a portion including a specific keyword is edited within a predetermined time (for example, within 3 minutes). However, it is needless to say that the short clip is not limited to the video content but can be generated by editing the audio content. It is needless to say that the reproduction time of the short clip is not limited to 3 minutes or less because it can be changed according to the setting and voice detection algorithm.

On the other hand, the server 200 may generate and store short clip information together with a short clip. Here, the information on the short clip may include at least one of a position where the short clip is stored and information on a time period including the specific keyword. Specifically, the server 200 may acquire a keyword by analyzing the audio signal included in the short clip, and may store a keyword matching the short clip and the short clip. Therefore, the server 200 can store a plurality of short clips and a plurality of short clip-specific keywords. In addition, the server 200 according to an embodiment of the present invention may store the title, the genre, the broadcast time of the original content, the generation time of the short clip, the broadcast station information of the original content, and the like on the basis of the metadata of the original content Can be saved with short clip.

The electronic device 100 according to an embodiment of the present invention analyzes a speech uttered by a user and transmits a short clip request signal related to a keyword included in a speech voice to a server, A short clip for the included keyword can be transmitted to the electronic device 100. In addition, the electronic device 100 may display and provide the received short clip to a user.

Meanwhile, as described above, the electronic device 100 according to an embodiment of the present invention may transmit a user's utterance voice to a voice recognition server and receive a keyword included in the utterance voice from the voice recognition server. It is also possible that the server 200 providing the short clip receives the speech uttered by the user and transmits the keyword included in the uttered speech to the electronic device 100. [ That is, the speech recognition server or server 200 may be implemented to perform speech recognition in the process of converting a received speech into text and acquiring a keyword in the converted text, when the speech of the user is received.

Hereinafter, various embodiments of the present invention will be described with reference to a block diagram showing a specific configuration of the electronic device 100. [

2A and 2B are block diagrams showing a configuration of a display device according to an embodiment of the present invention.

2A, an electronic device 100 includes a communication unit 110, an input unit 120, an output unit 130, and a processor 140.

The communication unit 110 performs communication with external devices according to various types of communication methods.

In particular, the communication unit 110 may perform communication with the server 200 that stores keywords for a plurality of short clips and a plurality of short clips using at least one of a wire / wireless scheme. Also, the communication unit 110 can perform communication with the voice recognition server. Here, the communication unit 110 may include various communication chips such as a Wi-Fi chip, a Bluetooth chip, a wireless communication chip, and an NFC chip.

As will be described later, the communication unit 110 can transmit a speech voice received by the speech recognition server and receive a keyword included in the speech voice when the user's speech voice is received through the input unit 120. [ Meanwhile, when the server 200 is used as a speech recognition server, the communication unit 110 may transmit the received speech voice to the server 200 and receive keywords from the server 200. [ However, the present invention is not limited to this, and it is needless to say that the electronic device 100 may acquire a keyword by performing voice recognition of a user's utterance voice, without performing communication with the voice recognition server or the server 200.

Meanwhile, the communication unit 110 according to an embodiment of the present invention may transmit a signal requesting a short clip to the server 200, and may receive a short clip according to a request signal from the server 200. Here, the request signal is a signal based on information on keywords and contents included in the speech voice of the user. In one example, the request signal may be a signal including a keyword and information about the content that the electronic device 100 is outputting. As another example, the request signal may be sent to the server 200 either sequentially or concurrently with a separate signal comprising the keyword and information about the content being output by the electronic device 100.

The request signal according to an exemplary embodiment of the present invention may be a signal including information on contents displayed on the electronic device 100, keywords repeatedly output from the contents, information on the user of the electronic device 100, . Here, the keyword repeatedly output from the content may be a keyword repeated a predetermined number of times or more within a predetermined period of time in the content output by the electronic device 100. Hereinafter, for convenience of description, the content displayed on the electronic device 100 or the content being output is referred to as output content.

Further, the communication unit 110 can receive a short clip from the server 200 in response to the above-described request signal.

Specifically, when a short clip request signal is received from the electronic device 100, the server 200 may transmit a short clip corresponding to the request signal to the electronic device 100. [ However, the present invention is not limited thereto, and the server 200 may store information on a location where the original content corresponding to the request signal is stored, and time information corresponding to a short clip among the original contents. For example, the server 200 may transmit the Web address for reproducing the original content and the time information corresponding to the short clip among the original content to the electronic device 100. In this case, the electronic device 100 can access the server where the original content is stored based on the received web address, and can reproduce the section corresponding to the time information.

For example, the electronic device 100 can receive the web address from which the specific content is received from the server 200 and the time information on the section including the keyword in the specific content. In this case, the electronic device 100 can access the received web address to receive a specific content, and can reproduce and output only a specific section of a specific content based on the time information.

The input unit 120 is configured to receive a user's uttered voice and convert it into audio data. Specifically, the input unit 120 may be micro-implemented to receive a user's uttered voice. However, the present invention is not limited thereto, and the input unit 120 may be provided in a remote control device (not shown) for controlling the electronic device 100, rather than the electronic device 100, to receive a user's uttered voice.

In addition, when the electronic device 100 is implemented as a touch-based electronic device, the input unit 120 may be implemented as a touch screen having a mutual layer structure with the touch pad. In this case, the input unit 120 may receive the keyword input through the touch screen in addition to the utterance voice.

The output unit 130 may output at least one of various contents and a short clip. Specifically, the output unit 130 may include at least one of a display and a speaker. When the output unit 130 includes a display, the output unit 130 may display various content playback screens such as an image, a moving picture, a text, and a music, an application execution screen including various contents, a web browser screen, ) Screen and the like can be displayed.

In this case, the display may be implemented by an LCD (Liquid Crystal Display Panel), an OLED (Organic Light Emitting Diodes), or the like, but is not limited thereto. Also, the display may be implemented as a flexible display, a transparent display, or the like as the case may be.

In particular, the display may display a short clip received from the server 200.

Meanwhile, if the output unit 130 according to another embodiment of the present invention includes only a speaker, the output unit 130 may provide the received short clip as audio through a speaker. For example, when the electronic device 100 is implemented as an audio output device that does not have a display function, the output 130 may provide additional information about the received short clip to audio, May be provided.

Processor 140 controls the overall operation of electronic device 100.

In particular, when the user's speech voice is received through the input unit 120, the processor 140 transmits a signal requesting a short clip based on the keyword and contents information included in the received speech voice to the communication unit 110 To the server (200). In addition, a short clip received from the server 200 may be output through the output unit 130 according to a request signal.

In particular, the processor 140 may send information about the output content to the server 200. Here, the information on the output content may include the title, genre, broadcast time, broadcasting station information, and the like of the output content. Thus, if the processor 140 sends a short clip request signal to the server 200 based on at least one of the keywords and information about the output content, the processor 140 receives and provides a short clip associated with the keyword and output content can do.

In this case, when the processor 140 transmits the short clip request signal to the server 200, the short clip created in the server 200 can be received. Here, the generated short clip may be a short clip generated from a content different from the output content. For example, the content may be broadcasted and generated before the output content broadcast time.

However, the present invention is not limited to this, and a short clip generated from the output content can also be received. According to an exemplary embodiment, when the output content is broadcast content that is received in real time, the server 200 may also receive the broadcast content. When the processor 140 transmits the request signal, a short clip If it is created, the corresponding short clip can also be targeted. For example, if the output content has a broadcast start time that is earlier than a predetermined time before the user requests a short clip, a short clip may be generated for the output content.

Meanwhile, the processor 140 may receive additional information about the short clip. In particular, the processor 140 may receive and provide additional information about the short clip and the short clip from the server 200. [ Here, the additional information on the short clip may be information including at least one of a title, a genre of the original content of the short clip, a broadcast time of the original content, a generation time of the short clip, a broadcast station of the original content, and a keyword.

In addition, the processor 140 may analyze the audio signal of the output content and transmit a signal requesting a short clip related to the keyword to the server 200 based on a keyword repeated a predetermined number of times or more for a predetermined time. Accordingly, the processor 140 can acquire a repeated word in the output content as a keyword, and transmit the keyword to the server 200 to receive the associated short clip.

Also, the electronic device 100 may include a storage unit (not shown) for storing user information, and the processor 140 may transmit a request signal including user information stored in the storage unit to the server 200 . In this case, the processor 140 may receive and display a short clip associated with the user information. Here, the user information may be information about the user of the electronic device 100, including information such as age group, preferred genre, favorite content, favorite broadcasting station, and the like. Therefore, when the electronic device 100 receives a plurality of short clips from the server 200, it is possible to receive and display a more suitable short clip to the user based on the keyword and the user information.

 2B is a block diagram showing a detailed configuration of the electronic device 100 according to another embodiment of the present invention. 2B, the electronic device 100 includes a communication unit 110, an input unit 120, an output unit 130, a processor 140, a storage unit 150, an audio processing unit 160, and a video processing unit 170 . Details of the components shown in FIG. 2B that overlap with those shown in FIG. 2A will not be described in detail.

The processor 140 controls the overall operation of the electronic device 100 using various programs stored in the storage unit 150. [ Processor 140 may be implemented as one or more of a central processing unit (CPU), a controller, an application processor (AP), a communication processor (CP), an ARM processor , Or may be defined by the term. In addition, the processor 140 may be implemented as a digital signal processor (DSP), a SoC with a content processing algorithm embedded therein, or a Field Programmable Gate Array (FPGA) .

Specifically, the processor 140 includes a RAM 141, a ROM 142, a main CPU 143, a graphics processing unit 144, first to n interfaces 145-1 to 145-n, .

The RAM 141, the ROM 142, the main CPU 143, the graphics processing unit 144, the first to n interfaces 145-1 to 145-n, etc. may be connected to each other via the bus 136. [

The first to n interfaces 145-1 to 145-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device via a network.

The main CPU 143 accesses the storage unit 150 and performs booting using the O / S stored in the storage unit 150. [ Then, various operations are performed using various programs, contents, data stored in the storage unit 150, and the like.

The ROM 142 stores a command set for booting the system and the like. When the turn-on command is input and power is supplied, the main CPU 143 copies the O / S stored in the storage unit 150 to the RAM 141 according to the instruction stored in the ROM 142, executes O / S Boot the system. When the booting is completed, the main CPU 143 copies various application programs stored in the storage unit 150 to the RAM 141, executes the application program copied to the RAM 141, and performs various operations.

The graphic processing unit 144 generates a screen including various objects such as an icon, an image, and a text using an operation unit (not shown) and a rendering unit (not shown). The operation unit (not shown) calculates an attribute value such as a coordinate value, a shape, a size, and a color to be displayed by each object according to the layout of the screen based on the received control command. The rendering unit (not shown) creates screens of various layouts including the objects based on the attribute values calculated by the operation unit (not shown). The screen generated by the rendering unit (not shown) is displayed in the display area of the output unit 130.

The storage unit 150 stores various data such as an O / S (Operating System) software module for driving the electronic device 100, various multimedia contents, various applications, various contents inputted or set during execution of the application, and the like. In particular, the storage unit 150 may store user information, for example, user preference information, age ranges, user profile information, and the like.

The audio processing unit 160 is a component that performs processing on audio data. In the audio processing unit 160, various processes such as decoding and amplification of audio data, noise filtering, and the like may be performed. For example, the audio processor 160 may generate and provide a feedback sound corresponding to a case where the user preference information displayed at the time of channel jumping satisfies predetermined criteria.

The video processing unit 170 is a component that performs processing on video data. The video processing unit 170 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like on the video data.

3 is a block diagram illustrating the configuration of a server 200 according to an embodiment of the present invention.

Referring to FIG. 3, the server 200 includes a communication unit 210, a storage unit 220, and a processor 230.

The communication unit 210 performs communication with an external device according to various types of communication methods.

In particular, the communication unit 210 may perform communication with the content provider 300 using at least one of a wire / wireless scheme. Specifically, the communication unit 210 can receive the content from the content provider 300. [ Here, the communication unit 210 may include various communication chips such as a Wi-Fi chip, a Bluetooth chip, a wireless communication chip, an NFC chip, and a tuner.

In addition, the communication unit 210 according to an embodiment of the present invention can perform communication with the electronic device 100. [ Specifically, the communication unit 210 may receive a short clip request signal transmitted by the electronic device 100, and may transmit a short clip to the electronic device 100 in response thereto.

The storage unit 220 stores various data such as an O / S (Operating System) software module for driving the server 200, various multimedia contents, various applications, various contents inputted or set during execution of the application.

In particular, the storage unit 220 may store the original content, a plurality of short clips generated from the original content, and a plurality of keywords per short clip.

According to an embodiment of the present invention, when the server 200 edits the original content to generate a plurality of short clips, at least one keyword may be acquired according to an audio signal included in a plurality of short clips. In this case, the server 200 may store the short clips and the keywords obtained from the short clips in the storage unit 220. For example, when the audio signal included in the first short clip is analyzed to obtain the first and second keywords, the server 200 may store the first and second keywords together with the first short clip.

According to an embodiment of the present invention, the server 200 may group and store short clips for each keyword. In this case, the short clips including the audio signal corresponding to the first keyword may be grouped and stored in the storage unit 220. Accordingly, if the first keyword is included in the short clip request signal received from the electronic device 100, the server 200 may transmit a plurality of short clips grouped corresponding to the first keyword to the electronic device 100 .

The processor 230 controls the overall operation of the server 200.

First, when the server 200 according to an embodiment of the present invention performs a speech recognition function, the processor 230 analyzes the speech speech received from the electronic device 100, acquires a keyword included in the speech speech can do. The server 200 may transmit the keyword to the electronic device 100.

In addition, when the original content is received through the communication unit 210, the processor 230 may edit the received original content to generate a plurality of short clips. Specifically, the processor 230 may edit only a specific section of the original content based on the speech detection algorithm. Here, the speech detection algorithm means an algorithm for detecting an audio signal including at least one keyword.

For example, the processor 230 may analyze the audio signal of the original content to detect a start point and an end point of a voice, and edit a section (EPD unit) between a start point and an end point to generate a short clip.

However, the present invention is not limited to this, and the server 200 may be configured to transmit the short clip request signal based on a preset time interval, a specific interval set by the content provider, a time interval set by the administrator of the server 200, And edit the original content to create a short clip.

According to an exemplary embodiment, when the processor 230 determines that the voice is terminated after the first detection of the voice in the broadcast content received in real time, the processor 230 may edit the corresponding section in real time to generate a short clip. In this case, the processor 230 can determine that the voice has been terminated if no voice is detected for a predetermined time or when a mechanical noise, noise, or the like is detected for a predetermined time or more. The processor 230 may then store the generated short clip and the obtained keyword in the storage unit 220 together. Thus, the processor 230 may send a short clip to the electronic device 100 in response to a short clip request signal received from the electronic device 100. [

Meanwhile, the server 200 according to an embodiment of the present invention may store the web address that can receive the original content and the time information about the section including the specific keyword in the database, instead of generating the short clip from the original content have. In this case, when a short clip request signal is received from the electronic device 100, the server 200 transmits a web address that can receive the original content corresponding to the short clip request signal, and section information To the electronic device (100). Therefore, the electronic device 100 may not receive the short clip from the server 200, but may provide the short clip in such a manner that only the section including the specific keyword is output from the original content based on the web address and the time information .

Hereinafter, the provision of a short clip according to various embodiments of the present invention will be described. On the other hand, in FIGS. 4 to 8, for convenience of explanation, it is assumed that the electronic device 100 is implemented to include a display, and output contents and a short clip are outputted through the display.

4 is a diagram illustrating a method of displaying a short clip associated with a keyword according to an embodiment of the present invention.

According to Fig. 4, the electronic device 100 may receive a speech voice of the user. In this case, the electronic device 100 can analyze the speech uttered by the user and obtain the keyword included in the uttered speech. For example, if the speech voice of the received user is 'tell current traffic information', the electronic device 100 can acquire 'traffic information' as a keyword. Meanwhile, the electronic device 100 according to another embodiment of the present invention may acquire the keyword included in the uttered voice by performing communication with the speech recognition server or the server 200.

The electronic device 100 may also send a signal to the server 200 requesting a short clip for the acquired keyword. In this case, the server 200 may transmit a short clip for the keyword to the electronic device 100. [ Specifically, the server 200 may transmit a specific short clip to the electronic device 100 based on short clip and short clip specific keywords generated from the original content until the server 200 receives the request signal from the electronic device 100. For example, if the keyword included in the short clip request signal is 'traffic information', the server 200 transmits only a short clip having the keyword 'traffic information' to the electronic device 100. In this case, the electronic device 100 can receive a short clip having a keyword 'traffic information' generated by editing a specific section of a news program transmitted from a content provider, that is, a broadcasting company. Accordingly, the received short clip may be video content including an audio signal corresponding to 'traffic information'.

Meanwhile, according to an exemplary embodiment of the present invention, the electronic device 100 may transmit a short clip request signal including user information to the server 200. In this case, the server 200 can transmit a short clip related to the keyword and the user information to the electronic device 100. [ For example, when the location of the electronic device 100 corresponds to 'Seoul' according to the user information, the server 200 selects 'traffic information' and 'traffic information' among a plurality of short clips having 'traffic information' Can be transmitted to the electronic device 100. The electronic device 100 of FIG. Accordingly, the electronic device 100 can display a short clip optimized for the user among the short clips generated in real time.

Meanwhile, according to an embodiment of the present invention, the electronic device 100 may provide an output mode and a short clip mode. The output mode may be a mode for continuously outputting only the output content regardless of whether or not short clip reception is performed from the server 200. [ In addition, the short clip mode may be a mode for displaying a short clip received from the server 200. [ The electronic device 100 can display a short clip by switching from the output mode to the short clip mode at the end of the output content (for example, during CF broadcast). However, the present invention is not limited thereto, and switching between the output mode and the short clip mode may be performed in response to user input. For example, when a user's uttered voice is received in the output mode, the user can automatically switch to the short clip mode and display the short clip received from the server 200. Further, the output mode and the short clip mode may be simultaneously executed. For example, when a short clip is received from the server 200, the received short clip may overlap with the output content and be displayed in a partial area of the output unit 130. [

Hereinafter, a method of receiving a short clip based on the output content will be described.

5 is a diagram illustrating a method of displaying a short clip associated with an output content according to an embodiment of the present invention.

According to FIG. 5, the electronic device 100 may include information on the output content in addition to the keywords obtained from the user's uttered voice in the short clip request signal to the server 200. In this case, the server 200 may transmit a specific short clip to the electronic device 100 based on the keyword and the short clip request signal.

Specifically, the information on the output content means information on the content being output to the electronic device 100, and can be obtained from the metadata on the output content. For example, the information on the output content may include the title, genre, broadcast time, broadcast station information, and the like of the output content. However, the present invention is not limited to this, and information on the content can be obtained through various methods. For example, it is possible to receive information on the content from an external server, or perform OCR on the screen to acquire additional information.

As shown in FIG. 5, if the user's uttered voice is 'Let's inform the other party of Team A', the electronic device 100 can acquire at least one of 'Team A' and 'batter' as keywords. In addition, if the output content is a baseball game, the electronic device 100 may provide information (e.g., 'sports', 'baseball') and keywords (eg, 'Team A' and 'batter' To the server 200 as a short clip request signal. In this case, the server 200 can transmit, to the electronic device 100, a short clip keyword of 'sports', 'baseball', 'Team A' and 'batter' among a plurality of short clips. Accordingly, the electronic device 100 can receive and display an interview image of a batter of Team A, sports news of Team A, etc. from the server 200. Meanwhile, as described above, the plurality of short clips received by the electronic device 100 may be image contents generated by editing the specific section of the original content received from the broadcasting company and received by the server 200. [

Hereinafter, a method of acquiring a keyword from an audio signal output by the electronic device 100 and receiving a short clip for the acquired keyword will be described.

6 is a diagram for explaining a method of analyzing an audio signal to acquire a keyword according to an embodiment of the present invention.

According to FIG. 6, it can be assumed that the content being output by the electronic device 100 repeatedly outputs a specific word. In this case, in addition to the keyword obtained from the speech uttered by the user, the electronic device 100 may transmit the words repeatedly output from the output contents to the server 200 by including them in the short clip request signal.

Specifically, the electronic device 100 may transmit to the server 200 a keyword that is repeated a predetermined number of times or more for a preset time in the audio output through the speaker provided in the electronic device 100.

For example, if the output content is a travel information program for 'Spain', the electronic device 100 may analyze the audio signal of the output content and obtain 'Spain', 'Barcelona' . In this case, the server 200 can transmit short clips matching 'Spain' and 'Barcelona' among the plurality of short clips to the electronic device 100. Accordingly, the electronic device 100 can receive and display a short clip for 'Spain' and 'Barcelona' from the server 200. Meanwhile, as described above, the electronic device 100 may transmit the short clip request information to the server 200 including the information about the output content. In this case, the electronic device 100 can receive a short clip generated by editing a specific section of the travel information program for 'Spain' and 'Barcelona'.

Meanwhile, the electronic device 100 according to an embodiment of the present invention can display a short clip received from the server 200 as a thumbnail image. In this case, a short clip corresponding to the thumbnail image selected according to the input of the user may be reproduced.

Hereinafter, a specific method of displaying a short clip on the electronic device 100 will be described.

7 is a view for explaining additional information on a short clip according to an embodiment of the present invention.

7, electronic device 100 may additionally receive information about a short clip from server 200 and provide the received information along with a short clip.

More specifically, the additional information about the short clip includes at least one of the title 710 of the original content, the genre, the broadcast time 720 of the original content, the broadcast station information 730 of the original content, the generation time of the short clip, can do. Here, the broadcast time of the original content may mean a time when the server 200 received the content from the content provider 300, a generation time of the original content, a time when the original content was transmitted from the broadcasting station, and the like. Further, the keyword of the short clip may mean a keyword that matches the keyword included in the short clip request signal among at least one keyword matched to the short clip.

On the other hand, as shown in Fig. 7, the additional information about the short clip can be displayed when a short clip selected according to the user's input is reproduced. It goes without saying that the electronic device 100 may display a plurality of short clips received from the server 200 as a thumbnail image and display additional information about the short clip together.

Hereinafter, a method of displaying additional response information for a keyword included in a user uttered voice will be described.

8 is a diagram for explaining additional response information provided with a short clip according to an embodiment of the present invention.

Referring to FIG. 8, the electronic device 100 can receive additional response information about a keyword obtained from a speech uttered by the user, from an external server and display it together with a short clip. Here, the additional response information may include a search result 810 for the keyword, information about the keyword, and the like. However, the present invention is not limited to this, and it is needless to say that additional response information for at least one of the information on the output content, the user information, and the repeated keywords in the output content may be received from the external server and displayed.

For example, it is possible to receive a search result in which a genre of output content is used as a search word from an external server and to display it together with a short clip, and to combine genres of keywords and output contents obtained from a user's uttered voice, May be received and displayed by an external server.

9 is a flowchart illustrating a method of providing a short clip according to an embodiment of the present invention.

According to the control method of the electronic apparatus shown in Fig. 9, the content is output first (S910).

Then, the user's speech voice is received (S920).

Then, when a speech voice is received, a short clip request signal is transmitted to the server based on the keyword and contents information included in the received speech voice (S930).

Then, a short clip is output based on the information about the short clip received from the server according to the request signal (S940).

Herein, the information about the short clip includes at least one of a position where the short clip is stored and a time section including the keyword. In step S940, when the information about the short clip is received from the server according to the request signal, It is possible to output a short clip based on the information.

Further, each of the plurality of short clips may be video content or audio content generated by editing a portion including a specific keyword in a specific content

Further, in step S940, when additional information on the short clip is received, additional information on the short clip is provided, wherein the information on the short clip includes the title of the original content, the genre, the broadcast time of the original content, A broadcasting station information of an original content, and a keyword.

Further, in step S940, additional information on the short clip can be provided as audio through the speaker.

In addition, the electronic device may include at least one of a display and a speaker. In step S930, a short clip related to the keyword is transmitted to the server based on the keyword repeated a predetermined number of times or more for a predetermined time in the audio output through the speaker The requesting signal can be additionally transmitted to the server.

Further, in step S940, based on the keyword included in the received speech voice, it is possible to provide additional response information about the speech voice together with the short clip.

In step S930, a request signal including a keyword and user information is transmitted to the server. In step S940, a shortcut clip associated with the keyword and the regular user information may be received from the server and output.

In step S930, the received speech voice may be transmitted to the speech recognition server or the server, and a short clip request signal may be transmitted to the server based on the keyword and contents information received from the speech recognition server or server.

10 is a flowchart illustrating a system for providing a short clip according to an embodiment of the present invention.

10, the server 200 first receives the content from the content provider 300 (S1010). Hereinafter, the content received from the content provider 300 is referred to as an original content. On the other hand, the server 200 can receive the content from the content provider 300 in real time. If the contents provider 300 is a broadcasting station, the server 200 can receive the broadcasting program transmitted in real time from the broadcasting station as original contents.

Subsequently, the server 200 generates a plurality of short clips based on the keyword of each of the received original contents (S1020).

Subsequently, the server 200 stores a plurality of generated short clips and a plurality of short clip-related keywords (S1030).

Meanwhile, the electronic device 100 receives the user uttered voice (S1040).

Subsequently, a short clip request signal related to the keyword included in the received speech is transmitted to the server 200 (S1050).

Subsequently, the electronic device 100 receives a short clip from the server (S1060).

Subsequently, the electronic device 100 outputs the received short clip (S1070).

Hereinafter, a description will be given of a method of providing a short clip through a speaker when the electronic device 100 does not have a display function.

11 is a view for explaining a method of providing an electronic device according to another embodiment of the present invention with a short clip through a speaker.

According to Fig. 11, the electronic device 100 may have only an output unit, a speaker, and no display. In this case, the electronic device 100 can output a short clip audio signal from the server 200 and provide it. In one example, if the short clip contains both video and audio signals as video content, the electronic device 100 may provide only audio signals in the received short clip.

As shown in FIG. 11, when 'inform current weather' is received as a speech voice, a short clip having 'current weather' as a keyword can be provided. In this case, a short clip may be provided for the current weather in the specific area (e.g., current weather in New York) by additionally receiving the location information of the electronic device 100 as described above. Further, since the electronic device 100 may not have a display, only the audio signal of the received short clip can be output.

Further, when additional information on the short clip is received as described above, additional information on the short clip can be converted into an audio signal and provided. For example, when additional information about the short clip and the short clip is received from the server 200, the additional information on the short clip may be output first, and the audio signal included in the short clip may be sequentially output.

The electronic device 100 according to an embodiment of the present invention may output only some of the additional information about the received short clip as audio. For example, when a title, a genre, a broadcast time, or the like of an original content is received as additional information about a short clip, the electronic device 100 provides only the title of the original content as an audio signal, Output.

In addition, the electronic device 100 according to an embodiment of the present invention can sequentially provide a plurality of short clips based on a predetermined priority when a plurality of short clips are received from the server 200. [ For example, the electronic device 100 can output audio signals included in a plurality of short clips through a speaker in accordance with a sequence of generating a short clip.

Therefore, even if the electronic device 100 does not have a display function, the user can be provided with additional information on the short clip and the short clip as an audio signal.

Meanwhile, the methods according to various embodiments of the present invention described above can be implemented in the form of software, programs, or applications that can be installed in existing electronic devices, servers, and the like.

Further, the methods according to various embodiments of the present invention described above can be implemented by software upgrading, or hardware upgrading, for existing electronic devices or servers, and the like.

Meanwhile, the method of controlling an electronic device according to various embodiments of the present invention described above may be embodied in computer-executable program code to be executed by a processor in a state stored in various non-transitory computer readable media. And may be provided to each server or devices.

In addition, the method of controlling an electronic device according to various embodiments of the invention described above may be implemented in a computer program product comprising a computer readable medium including a computer readable program executed by a computer device, Lt; / RTI > The computer-readable program may be stored in a computer-readable storage medium at a server, and the program may be implemented in a form that can be downloaded to a computer device via a network.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

100: electronic device 110: communication unit
120: input unit 130: output unit
140: Processor 200: Server
300: content provider

Claims (20)

In an electronic device,
A communication unit that communicates with a server that stores information on a plurality of short clips and keywords of the plurality of short clips;
An output section;
An input unit; And
A short clip request signal is transmitted to the server on the basis of a keyword included in the received speech voice and information on a content output from the output unit when the user speech voice is received through the input unit, And outputting a short clip through the output unit based on information on a short clip received from the server. The method according to claim 1,
The information on the plurality of short clips may be,
A position where the plurality of short clips are stored, and information on a time period including the keyword,
The processor comprising:
And outputs the short clip based on the received information when information on the short clip is received from the server according to the request signal. The method according to claim 1,
Wherein each of the plurality of short clips comprises:
Wherein the electronic content is video content or sound content generated by editing a portion including a specific keyword in a specific content. The method according to claim 1,
The processor comprising:
When additional information on the short clip is received, provides additional information on the short clip,
Additional information about the short clip may include,
A title of the original content, a genre, a broadcast time of the original content, a generation time of the short clip, broadcasting station information of the original content, and the keyword. The method according to claim 1,
The output unit includes:
A display, and a speaker. 5. The method of claim 4,
The output unit is implemented to include only a speaker,
The processor comprising:
And provides additional information about the short clip as audio through the speaker. The method according to claim 1,
The output unit includes:
A display and at least one of a speaker,
The processor comprising:
Further transmitting to the server a short clip request signal associated with the keyword to the server based on a keyword that is repeated a predetermined number of times over a predetermined time in audio output through the speaker. The method according to claim 1,
The processor comprising:
And provides additional response information about the speech voice together with the short clip based on a keyword included in the received speech speech. The method according to claim 1,
The processor comprising:
And transmits the request signal including the keyword and user information to the server and receives a shortcut clip associated with the keyword and the user information from the server. The method according to claim 1,
The processor comprising:
And transmits a short clip request signal to the server based on the keyword and information on the content received from the speech recognition server or the server when the utterance voice is received, ≪ / RTI > A control method of an electronic device communicating with a server that stores information on a plurality of short clips and keywords of the plurality of short clips,
Outputting a content;
Receiving a speech voice of a user;
Transmitting a short clip request signal to the server based on a keyword included in the received speech voice and information on the content when the speech voice is received; And
And outputting a short clip based on the information about the short clip received from the server according to the request signal. 12. The method of claim 11,
The information on the plurality of short clips may be,
A position where the plurality of short clips are stored, and information on a time period including the keyword,
Wherein the outputting step comprises:
And if the short clip information is received from the server according to the request signal, outputs the short clip based on the received information. 12. The method of claim 11,
Wherein each of the plurality of short clips comprises:
Wherein the video content or the audio content is generated by editing a portion including a specific keyword in a specific content. 12. The method of claim 11,
Wherein the outputting of the short clip comprises:
When additional information on the short clip is received, provides additional information on the short clip,
Additional information about the short clip may include,
A title of the original content, a genre, a broadcast time of the original content, a generation time of the short clip, broadcasting station information of the original content, and the keyword. 15. The method of claim 14,
Wherein the outputting of the short clip comprises:
And provides additional information about the short clip as audio through a speaker. 12. The method of claim 11,
The electronic device includes:
A display and at least one of a speaker,
Wherein the transmitting comprises:
Wherein the server further transmits a short clip request signal related to the keyword to the server based on a keyword repeated a predetermined number of times or more for a predetermined time in audio output through the speaker. 12. The method of claim 11,
Wherein the outputting of the short clip comprises:
And provides additional response information about the speech voice together with the short clip based on the keyword included in the received speech speech. 12. The method of claim 11,
Wherein the transmitting comprises:
Transmitting the request signal including the keyword and user information to the server,
Wherein the outputting of the short clip comprises:
And receiving a short clip associated with the keyword and the user information from the server and outputting the short clip. 12. The method of claim 11,
Wherein the transmitting comprises:
And transmits a short clip request signal to the server based on the keyword and information on the content received from the speech recognition server or the server, / RTI > A system comprising an electronic device and a server,
A server for generating information on a plurality of short clips based on each keyword of the plurality of original contents, and storing information on the generated plurality of short clips and keywords for the plurality of short clips; And
A short clip request signal is transmitted to the server based on a keyword included in the received speech voice and information about a content output by the electronic device, and when the short clip request signal is received from the server And an electronic device for outputting a short clip based on information on the received short clip.

Images