WO2016186440A1 - Set top box using multimodal information to acquire user information, managing server using same, and computer-readable recording medium - Google Patents

Abstract

With respect to a method for acquiring user information through a set top box linked to a primary terminal, a method is disclosed which includes the steps: (a) acquiring sensing data through a built-in sensor installed in a set top box or an external IoT terminal; (b) (i) implementing a process of generating identifying information data on a user detected through the built-in sensor or the external IoT terminal, with reference to the sensing data, and (ii) implementing a process of acquiring specific circumstantial information data representing the state inside the interior space in which the set top box is disposed, and acquiring action information data representing information on an action item of the primary terminal or an action item of the external IoT terminal, corresponding to the specific circumstantial information data; and (c) mapping the specific circumstantial information data and the action information data with identifying information data, and recording same.

Description

Set-top box for acquiring user's information using multi-modal information, management server and computer readable recording medium using same

The present invention relates to a set top box for acquiring user information using multi-modal information, a management server for managing user information acquired from the set top box, and a method and a computer readable recording medium using the same.

With the development of IPTV technology, set-top box technology that provides various services such as providing contents based on a network has been commercialized. For example, a user may be provided with content such as video on demand (VOD) or a network game through a set top box, and may use services such as home shopping and internet surfing.

However, until now, the set-top box has only performed a monotonous function of receiving content or service provided by a service provider and delivering a user's response or request to the service provider.

Meanwhile, a conventional method of providing an advertisement to a user by using a set-top box is to provide an advertisement by playing an advertisement image first when the user 'reviews' a TV program or plays a movie or animation. The problem is that it makes people think they are seeing unwanted advertisements.

Accordingly, the present inventors have developed a set-top box that provides a customized service for each user by using a built-in sensor of the set-top box and an external IoT terminal connected to the set-top box and collecting user information by using EPG information.

The object of the present invention is to solve all the above-mentioned problems.

In addition, another object of the present invention is to learn the user's pattern using the user's information collected by the set-top box and to provide a service accordingly.

In addition, another object of the present invention is to collect pattern information of a user who has been learned more precisely by using EPG information, and provide a customized management service for each user.

Representative configuration of the present invention for achieving the above object is as follows.

According to an aspect of the present invention, in a method in which a set-top box interlocked with a basic terminal acquires user information, (a) the set-top box is a built-in sensor or an external device built in the set-top box; Acquiring at least one sensing data through an IoT terminal of the user; (b) the set-top box is provided to (i) a user sensed through the internal sensor or the external IoT terminal with reference to the at least one sensing data. (Ii) analyzing the at least one sensing data to obtain specific context information data representing a state of at least a part of a person, an object, and an environment in an indoor space to which the set-top box belongs; The action item of the basic terminal or the action item of the external IoT terminal performed by the user and corresponding to the specific context information data. Performing a process of acquiring action information data representing information; and (c) the set-top box maps the specific situation information data and the action information data to the identification information data and records the information as the user information. It suggests how to include.

According to another aspect of the present invention, in a method in which a management server obtains and manages user information from a set-top box, (a) the management server comprises: (i) the set-top box; Obtaining at least one sensing data through a built-in sensor or an external IoT terminal embedded therein; (ii) for a user sensed through the built-in sensor or the external IoT terminal with reference to the at least one sensing data. A process of generating identification information data, (iii) analyzing the at least one sensing data to obtain specific context information data indicative of the state of at least a portion of a person, an object and an environment in the indoor space to which the set-top box belongs; The action item of the basic terminal or the amount of the external IoT terminal performed by the user and corresponding to the specific context information data. Acquiring action information data indicating information of an item; and (iv) acquiring information of the user generated from the set top box through a process of mapping the specific context information data and the action information data with the identification information data. Step and (b) the management server presents a method comprising recording and managing the obtained information of the user.

According to another aspect of the present invention, in a set-top box interlocked with a basic terminal and obtaining user information, a broadcast signal processor and a built-in sensor for receiving and processing a broadcast signal and providing the same to the basic terminal When at least one sensing data is obtained through a communication unit for communicating with an external IoT terminal and the internal sensor or the external IoT terminal, (i) the internal sensor or the external device with reference to the at least one sensing data. A process of generating identification information data for the user sensed through the IoT terminal, (ii) analyzing the at least one sensing data to determine the state of at least some of the people, objects and environments in the indoor space to which the set-top box belongs. Acquire specific contextual information data, which is performed by the user, and corresponds to the specific contextual information data. A process of obtaining action information data representing information of an action item of a basic basic terminal or an action item of the external IoT terminal; and (iii) mapping the specific situation information data and the action information data to the identification information data. A set top box is provided that includes a processor that performs a process of recording as information.

According to still another aspect of the present invention, in a management server that obtains and manages user information from a set-top box, the communication unit and the set-top box are (i) a built-in sensor or an external device built in the set-top box. Acquiring at least one sensing data through an IoT terminal, and (ii) generating identification information data for a user sensed through the internal sensor or the external IoT terminal with reference to the at least one sensing data. (iii) analyzing the at least one sensing data to obtain specific context information data representing a state of at least a part of a person, an object, and an environment in an indoor space to which the set-top box belongs, and being performed by the user. Determination of an action item of the basic terminal or an action item of the external IoT terminal corresponding to context information data Obtaining, recording, and managing the user's information generated from the set-top box through a process of acquiring action information data indicating the information; and (iv) a process of mapping the specific situation information data and the action information data with the identification information data. A management server including a processor is provided.

According to the present invention, there is an effect of learning the user's pattern using the user's information collected by the set-top box and providing a service accordingly.

In addition, according to the present invention, the EPG information is used to collect pattern information of a user who has been learned more precisely, and provide a customized management service for each user.

1 is a view showing a schematic configuration of an entire system for recording and managing related information of a user according to an embodiment of the present invention.

2 is a view showing in detail the internal configuration of the set-top box according to an embodiment of the present invention.

3 is a diagram showing in detail the internal configuration of the management server according to an embodiment of the present invention.

4 is a diagram illustrating obtaining specific context information data by obtaining sensing data according to an embodiment of the present invention.

DETAILED DESCRIPTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein may be embodied in other embodiments without departing from the spirit and scope of the invention with respect to one embodiment. In addition, it is to be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the invention. The following detailed description, therefore, is not to be taken in a limiting sense, and the scope of the present invention, if properly described, is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled. Like reference numerals in the drawings refer to the same or similar functions throughout the several aspects.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present invention.

1 is a view showing a schematic configuration of an entire system for recording and managing related information of a user according to an embodiment of the present invention.

As shown in FIG. 1, the entire system according to an embodiment of the present invention may include a set top box, a basic terminal, an external IoT terminal, a management server, and a communication network.

First, the set top box 100 according to an embodiment of the present invention may communicate with other devices through a wired or wireless network. First, the set top box 100 may communicate with the basic terminal 200. The basic terminal 200 may include a display device. In this case, the basic terminal 200 may be, for example, a UHD TV (Ultra High Definition Television) or a mobile terminal. In detail, when the basic terminal 200 includes a display device, the set top box 100 may receive a broadcast signal and provide an image signal to the basic terminal 200 as described below. However, the basic terminal 200 is not limited to the display device.

Also, the set top box 100 may communicate with at least one external IoT terminal 300. The external IoT terminal 300 may be any device that can communicate with the set-top box 100. Here, the external IoT terminal 300 is located in a predetermined indoor space (that is, the indoor space in which the set-top box 100 exists) while acquiring sensing data for the indoor space and providing the sensing data to the set-top box 100 or set-top box ( It may refer to a device that can receive and respond to the control signal from 100). For example, the device may be a camera, a speaker, a microphone, a mobile terminal, a temperature sensor, a humidity sensor, an illuminance sensor, a refrigerator, a washing machine, a gas range, or the like. The external IoT terminal 300 provides sensing data to the set top box 100 continuously or at the request of the set top box 100. Here, the sensing data refers to multi-modal information indicating a measurable physical quantity that can determine the situation of the indoor space in which the set-top box 100 exists.

Set-top box 100 may obtain the sensing data using the built-in sensor built in the set-top box 100, the detailed configuration and functions of the set-top box 100 to find out through Figure 2 below do.

Next, the management server 400 according to an embodiment of the present invention may perform a function of receiving and managing user information from the set-top box 100 through the communication network 500. Here, the information of the user refers to information data generated by referring to the sensing data acquired by the set-top box 100 as information about the user in the indoor space where the set-top box 100 exists, which will be described in detail below. do. The management server 400 may also perform a function of providing advertisement information to the set-top box 100, the server of the carrier providing the IPTV broadcast signal or the server providing the set-top box 100 management server 400 ), But is not limited thereto. The configuration and function of the management server 400 according to the present invention will be described in detail with reference to FIG. 3 below.

Finally, the communication network 500 according to an embodiment of the present invention may be configured in the form of wired or wireless communication, and various communication networks such as wide area network (LAN), local area network (LAN), mobile communication network, and satellite communication network. It may be configured as. However, the communication network 500 may include, at least in part, a known wired / wireless data communication network, a known telephone network, or a known wired / wireless television communication network without being limited thereto.

2 is a view showing in detail the internal configuration of the set-top box according to an embodiment of the present invention.

As shown in FIG. 2, the set top box 100 according to an exemplary embodiment of the present invention may include a broadcast signal processor 110, a built-in sensor 120, a communicator 130, and a processor 140. have. Here, the broadcast signal processing unit 110, the built-in sensor 120, the communication unit 130 and the processor 140 are not all physically included in the set-top box 100, but external to interlock with the set-top box 100 It may be located at

First, the broadcast signal processor 110 according to an embodiment of the present invention may receive and process a broadcast signal and provide the same to the basic terminal 200. In detail, the broadcast signal processor 110 may receive a broadcast signal through a tuner, but when the set-top box 100 provides an IPTV service, the broadcast signal processor 110 may receive broadcast content from a web server through the Internet. The broadcast signal processor 110 may properly process the received broadcast signal and provide it to the basic terminal 200 through a wired / wireless interface or a network.

In addition, the broadcast signal processing unit 110 may perform a function of directly acquiring Electronic Program Guide (EPG) information on a broadcast signal or through the communication unit 130. The acquired EPG information may be used to obtain information of a user to be described later, which will be described below.

Next, the built-in sensor 120 according to an embodiment of the present invention may be an audio sensor, an image sensor, a temperature sensor, a humidity sensor, an infrared sensor, or the like embedded in the set top box 100. The set top box 100 may determine the situation of the indoor space by analyzing the sensing data acquired as big data by sensing the indoor space to which the set top box 100 belongs with the built-in sensor 120. In addition, the set-top box 100 detects a remote control signal for the external IoT terminal 300 connected to the set-top box 100 through the built-in sensor 120, the base terminal 200 or the external IoT terminal by the remote control signal Information on the action item performed at 300 may be obtained. For reference, the action item may mean a process performed by the basic terminal 200 or an external IoT terminal 300 or a mechanical or electronic operation of the external IoT terminal 300.

In one embodiment, the built-in sensor 120 may include an infrared camera or a near infrared camera as a built-in image sensor. The set-top box 100 may analyze an indoor situation even when the room is dark by using image data acquired through an infrared camera or a near infrared camera, or may detect and identify a person present in the indoor space by using the image data. There will be.

In another embodiment, the built-in sensor 120 may include a microphone as a built-in audio sensor. The microphone may collect a user's voice, an animal's sound, or ambient noise. The set-top box 100 may determine a human's voice or an animal's sound by using the collected audio data, or may detect a situation through noise of the surrounding environment. You might be able to identify it.

In addition, the set-top box 100 may receive the sensing data acquired by the basic terminal 200 or the external IoT terminal 300 to the communication unit 130 through a wired or wireless network, and analyze the received sensing data to analyze the indoor space. You will be able to judge the situation.

On the other hand, the communication unit 130 may communicate with the mobile terminal held by the user. The set-top box 100 may identify the user existing in the indoor space by receiving address information from the mobile terminal of the user through the communication unit 130, and provide channel recommendation information or customized advertisement information to the mobile terminal of the user. Could be Here, the channel recommendation information refers to information about channels that the user may be interested in by referring to the channel information, program information, and watch time information that the user likes, and the customized advertisement information is set differently for each user according to the user's taste. Refers to advertising information.

Next, the processor 140 according to an embodiment of the present invention, if at least one sensing data is obtained through the built-in sensor 120 or the communication unit 130 connected to the external IoT terminal 300, at least one sensing By referring to the data, a process of generating identification information data for a user detected in the indoor space through a built-in sensor or an external IoT terminal may be performed.At least one sensing data is analyzed to analyze the indoor space to which the set-top box belongs. Acquiring specific contextual information data representing a state of at least a part of a person, an object, and an environment within the device, and is performed by a user, and represents information of an action item of a basic terminal or an action item of an external IoT terminal corresponding to the specific context information data. A process of obtaining action information data may be performed. In addition, after performing the process, the specific situation information data and the action information data may be mapped with the identification information data and recorded as the user information.

In detail, the processor 140 may detect and identify a user by using the sensing data, and generate identification information data for each identified user. For example, the user may be identified from the image data of the indoor space obtained through the image sensor using a personal identification algorithm, and if the user has a mobile terminal, address information of the user terminal may be received through the communication unit 130. It may also identify the user. Here, the identification information data may include identification information about an individual such as identification ID information, gender information, age information, height information, and information about a household to which the identified user belongs, and the information about the furniture may include an address of the set-top box. It may be created by reference to a value.

In addition, the processor 140 may determine the situation of the indoor space by analyzing the sensing data. At this time, the situation of the indoor space may be grasped by referring to a database in which the situation of the indoor space is predefined. The processor 140 may generate specific context information data for the identified indoor space situation and record it in a database, and the action information of the action item of the basic terminal or the action item of the external IoT terminal corresponding to the specific context information data. After acquiring the data, it may be recorded by mapping it with specific context information data in the database. If the generated specific contextual information already exists in the database, the generated specific contextual information data may not be recorded in the database but may be mapped to the action information data by referring to the specific contextual information data existing in the database. For example, when two people are watching TV in an indoor space, the specific situation information data may be information data indicating a situation where the user watches TV, and the action information data is based on a TV program of channel 11 at 7 o'clock. It may be information data indicating viewing through the terminal 200, and the processor 140 records the specific situation information data in the database if the specific situation information data corresponding to the situation of watching TV does not exist in the database. The information data and the action information data may be mapped and recorded.

Here, the processor 140 may additionally obtain EPG information about the TV program that the user is watching in a specific situation through the broadcast signal processor 110 or the communication unit 130, and precisely with reference to the EPG information. Action information data may be obtained. In the above example, when the action information data is acquired with reference to the EPG information, the action information data is detailed information indicating that the "Infinite Challenge" program of the MBC channel 11 on Saturday is watched through the base terminal 200 at 7 o'clock on Saturday. It could be data. Of course, even if there is a national soccer game at 7:00 on Saturday due to the change of program organization, learn that the user is showing a favorite pattern of the soccer game by referring to the EPG information, and later refer to the EPG information. It may also automatically take action on the TV terminal at the time it is relayed (i.e., automatically turn on the TV terminal). In addition, the processor 140 may use the EPG information to recommend a program of interest (entertainment program, cooking program, etc.) that may be of interest to the user.

The processor 140 may map the specific contextual information data and the action information data obtained by referring to the sensing data with the identification information data and record the information as the user information. This allows the set-top box 100 to provide a user with each user. You will be able to obtain information. For example, in the above example, the processor 140 acquires two pieces of identification information data about two people watching TV, maps specific context information data and action information data to each of the two pieces of identification information data, and then uses the user for each user. You will be able to record the information.

For example, EPG recognizes action information data to be mapped to situation information data for each member while identification information for each of A, B, C, and D members of the household is recognized by the set-top box. The information can be more accurately referred to, and accordingly, each member will be able to record and manage the situation information data and the action information data.

Meanwhile, the sensing data, identification information data, specific context information data, and action information data acquired by the processor 140 may include information that may infringe the privacy of the user. For example, an image of an indoor space Data or voice data recording the user's voice may correspond to information that violates the user's privacy. The processor 140 may analyze and delete all identification information data or convert all information data into binary code data in consideration of a user's privacy problem.

Meanwhile, the processor 140 may support the user's information to be collected by transmitting to the management server through a wired or wireless network. At this time, the processor 140 may confirm to each identified user whether or not to transmit the user's information to the management server 400 may transmit only the information of the user who agreed to the information transmission to the management server 400, Regardless of whether the user agrees or not, the user's information may be encrypted and transmitted to the management server 400. Here, the information of the user transmitted to the management server 400 may be classified and recorded by the management server 400 according to a predetermined criterion, which will be described with reference to FIG. 3.

In addition, when the management server 400 obtains the advertisement information data corresponding to the information of the user from a predetermined advertising server, the processor 140 receives the advertisement information data from the management server 400, the basic terminal 200 It may be provided through any one of the external IoT terminal 300 and the user mobile terminal. For example, when the processor 140 recognizes that the user whose information is recorded in the database is watching TV through the basic terminal 200, the processor 140 transmits the user's information to the management server through the communication unit 130 to the user. The advertisement information data corresponding to the information may be received, and the advertisement information data may be transmitted to the basic terminal 200 so that the advertisement may be provided to the user. Here, the advertisement information data may be information such as personalized product recommendation (PPR) information, specific TV program recommendation information, channel recommendation information, movie recommendation information, banner advertisement information, home shopping information, and the like. For example, if the set-top box 100 recognizes that a man in their mid 30s is watching a fishing program, the set-top box 100 transmits information to a management server that a man in their mid 30s is watching a fishing program. After receiving the advertisement data related to fishing from the management server, the fishing advertisement data may be transmitted to the TV so that the advertisement related to fishing may be displayed on a predetermined area of the TV screen, thereby providing customized advertisement information.

On the other hand, the processor 140 of the action item of the base terminal or the action item of the external IoT terminal corresponding to the obtained specific context information data is performed by the user more than a predetermined number of times or the action item of the external IoT terminal of the base IoT terminal When the action item is modified, the action information data for the modified action item may be obtained and mapped to specific situation information data to be recorded.

3 is a diagram showing in detail the internal configuration of the management server according to an embodiment of the present invention.

The communication unit 410 according to an embodiment of the present invention performs a function of communicating through a wired or wireless network and may communicate with a set-top box or an advertisement server.

 Processor 420 according to an embodiment of the present invention, the set-top box, (i) a process of obtaining at least one sensing data through a built-in sensor or an external IoT terminal embedded in the set-top box, (ii) at least one A process of generating identification information data about a user detected through a built-in sensor or an external IoT terminal with reference to sensing data of the user, (iii) analyzing at least one sensing data, and a person or object in an indoor space to which the set-top box belongs And acquire specific context information data representing a state of at least some of the environment, and obtain action information data representing information of an action item of a basic terminal or an action item of an external IoT terminal performed by a user and corresponding to the specific context information data. And (iv) mapping specific contextual information data and action information data to identification information data. The user's information generated through the process can be obtained from the set-top box through the communication unit 410 and recorded and managed.

In detail, the processor 420 may classify and record the information of the user obtained from the set-top box 100 according to a predetermined criterion, and the predetermined criterion may be at least one of a user's age, gender, occupation, taste, and household. It may be a standard corresponding to Here, the information of the user obtained from the set top box 100 may be encrypted, and the decryption key for the encrypted user information may be obtained through the set top box 100.

In addition, the processor 420 transmits the user's information to a predetermined advertising server to obtain the advertisement information data corresponding to the user's information from the predetermined advertising server and then transmits to the set-top box 100, the set-top box 100 It may be able to assist the user in providing the advertisement information data. At this time, the management server 400 provides an information fee for providing the user information to a predetermined advertising server and an advertising fee for providing the set top box 100 with the advertisement information data provided from the predetermined advertising server. You will be able to receive from the ad server of, the amount of information paid and advertising fees paid directly to the user who provided the user information, or any one of the points, goods, coupons, services in the user's set-top box 100 It may be possible to induce the user to continue providing the user's information by paying the user for providing the user's information.

Here, the processor 410 receives the interest data indicating the user's interest in the advertisement information data transmitted to the set-top box from the set-top box 100 and the user is interested in the advertisement information data when the interest data is below a certain threshold. It may be determined that the number is small, new advertisement information data may be obtained from a predetermined advertisement server, and new advertisement information data may be transmitted to the set-top box 100.

4 is a diagram illustrating obtaining specific context information data by obtaining sensing data according to an embodiment of the present invention.

Set-top box 100 according to an embodiment of the present invention is a specific result as a result of receiving and analyzing the sensing data obtained through the communication unit 130 connected to the built-in sensor 120 or the external IoT terminal 300 as described above The situation information data can be obtained. 4 shows the remote control signal information as a result of analyzing the infrared or near infrared image captured by the infrared camera or the near infrared camera, or the audio acquired by the microphone, as to whether the set-top box 100 is watching TV. FIG. 3 is a diagram illustrating a concept of acquiring specific context information data such as context information, dog information, and person recognition information. The set-top box 100 continuously acquires sensing data of an indoor space to obtain specific context information data. And be able to record.

Here, the specific context information refers to specific context information of the indoor space in which the set-top box is placed, and the set-top box 100 uses various sensors and devices other than a microphone, an infrared camera, or a near infrared camera. Will be able to obtain. For example, the specific situation information includes the viewing channel information of the set-top box, the number of viewers, the situation information of the person going out, the information of the person's room, the weather information of the person, and the situation information of the person in the living room. , Situational information where a person listens to music, situational information where a person sleeps, situational information that a person cooks, situational information that a person exercises, situational information that a person eats, situational information that a person takes a break, Situational information about people playing games, situational information about people studying, situational information about people surfing the Internet, situational information about people shopping on TV, situational information about people partying, The situation information that a person approaches the set-top box 100, the situation information that a person is far from the set-top box 100, the situation information that a person is stationary, the person is a specific room Looking at the situation information, the situation information that people pass or go back and forth in front of the set-top box 100, washing machine, air conditioners, such as the status information of each operation, the door information is opened or closed, the light is turned on or off It may mean each of the status information, the status information that the gas range is turned on or off, the situation information of the fire occurred, the viewing date / time information, or the like, or may mean a combined state of at least some of them.

In addition, the embodiments according to the present invention described above may be implemented in the form of program instructions that may be executed by various computer components, and may be recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the computer-readable recording medium may be those specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs, DVDs, and magneto-optical media such as floptical disks. media), and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the process according to the invention, and vice versa.

Although the present invention has been described by specific embodiments such as specific components and the like, but the embodiments and the drawings are provided to assist in a more general understanding of the present invention, the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations can be made from these descriptions.

Accordingly, the spirit of the present invention should not be limited to the above-described embodiments, and all of the equivalents or equivalents of the claims, as well as the appended claims, fall within the scope of the spirit of the present invention. I will say.

Claims (25)

In a method of obtaining a user's information by a set-top box linked to the basic terminal, (a) acquiring, by the set top box, at least one sensing data through an internal sensor built into the set top box or an external IoT terminal; (b) the set-top box, (i) generating identification information data for the user sensed through the internal sensor or the external IoT terminal with reference to the at least one sensing data; and (ii) the at least one. Analyzes the sensing data of the to obtain specific context information data representing the state of at least some of the person, object and environment in the indoor space to which the set-top box belongs, and is performed by the user, corresponding to the specific context information data Performing a process of acquiring action information data indicating information of an action item of the basic terminal or an action item of the external IoT terminal; and (c) the set-top box mapping the specific context information data and the action information data with the identification information data and recording the information as the user information; How to include. The method of claim 1, The set-top box, the method characterized in that to obtain the action information data by further referring to the EPG (Electronic Program Guide) information on the broadcast signal output through the basic terminal or the external IoT terminal. The method of claim 1, (d) the set-top box, supporting the user's information to be collected by transmitting to the management server through a wired or wireless network How to include more. The method of claim 3, The set-top box, characterized in that whether to transmit the information of the user to the management server to each of the identified users to transmit only the information of the user agreed to the information transmission to the management server. The method of claim 3, And the set-top box performs an encryption process on the user's information and transmits it to the management server, and stores a decryption key for the encrypted user's information in a predetermined storage device. The method of claim 3, The set top box, characterized in that for transmitting the information of the user to the management server to support the management server to classify and record the information of the user according to a predetermined criterion. The method of claim 3, (e) when the management server obtains advertisement information data corresponding to the user information from a predetermined advertisement server, the set-top box receives and provides the advertisement information data from the management server. How to include more. The method of claim 1, The set top box, After the action item of the basic terminal or the action item of the external IoT terminal corresponding to the acquired specific context information data has been performed by the user a predetermined number of times or more, the action item of the basic terminal or the action of the external IoT terminal And when the modification is made to the item, acquiring the action information data of the modified action item, mapping the specific information to the specific situation information, and recording the same. In the management server obtains and manages the user's information from the set-top box, (a) the management server, wherein the set-top box (i) a process of obtaining at least one sensing data through a built-in sensor or an external IoT terminal embedded in the set-top box, (ii) the at least one sensing data A process of generating identification information data for a user sensed through the built-in sensor or the external IoT terminal as a reference; (iii) a person or object in an indoor space to which the set-top box belongs by analyzing the at least one sensing data; And acquiring specific context information data representing a state of at least a part of an environment, and performing information performed by the user and representing information of an action item of the basic terminal or an action item of the external IoT terminal corresponding to the specific context information data. A process of obtaining information data and (iv) the specific contextual information data and the action information Obtaining information of the user generated from the set top box through a process of mapping data to the identification information data, and (b) the management server, recording and managing the obtained information of the user; How to include. The method of claim 9, The management server may obtain action information data obtained by further referring to electronic program guide (EPG) information on a broadcast signal output through the basic terminal or the external IoT terminal from the set top box. . The method of claim 9, And the management server classifies and records the information of the user obtained from the set top box according to a predetermined criterion. The method of claim 9, (c) the management server acquiring advertisement information data corresponding to the user information from a predetermined advertisement server and transmitting the advertisement information data to the set top box to support the set top box to provide the advertisement information data. How to include more. In the set-top box that is linked with the base terminal and acquires the user's information, A broadcast signal processor for receiving and processing a broadcast signal and providing the same to the basic terminal; Built-in sensor, Communication unit for performing communication with the external IoT terminal, and When at least one sensing data is acquired through the built-in sensor or the external IoT terminal, (i) identification information of a user sensed through the built-in sensor or the external IoT terminal with reference to the at least one sensing data. A process of generating data, (ii) analyzing the at least one sensing data to obtain specific contextual information data indicative of the state of at least a portion of a person, an object and an environment in the indoor space to which the set-top box belongs, Obtaining action information data indicating information of an action item of the basic terminal or action item of the external IoT terminal corresponding to the specific context information data; and (iii) the specific context information data and the action information. Information of the user by mapping data with the identification information data Processor that performs a process to record document Set top box comprising a. The method of claim 13, Set top box, characterized in that to obtain the action information data by further referring to the EPG (Electronic Program Guide) information for the broadcast signal output through the basic terminal or the external IoT terminal. The method of claim 13, The processor is set-top box, characterized in that for supporting the user's information collected by transmitting to the management server via a wired or wireless network. The method of claim 15, The set-top box, characterized in that whether to transmit the information of the user to the management server to each of the identified users to transmit only the information of the user agreed to the information transmission to the management server. The method of claim 15, And performing an encryption process on the user's information and transmitting the encrypted information to the management server, and storing a decryption key for the encrypted user's information in a predetermined storage device. The method of claim 15, And transmitting the user's information to the management server so that the management server can classify and record the user's information according to a predetermined criterion. The method of claim 15, And when the management server obtains advertisement information data corresponding to the user's information from a predetermined advertisement server, the processor receives the advertisement information data from the management server and provides the advertisement information data. The method of claim 13, After the action item of the basic terminal or the action item of the external IoT terminal corresponding to the acquired specific context information data has been performed by the user a predetermined number of times or more, the action item of the basic terminal or the action of the external IoT terminal When the modification is made to an item, the set top box, wherein the action information data for the modified action item is obtained, mapped to the specific context information data, and recorded. In the management server to obtain and manage the user information from the set-top box, Communication unit, and (I) a process in which the set top box obtains at least one sensing data through an internal sensor embedded in the set top box or an external IoT terminal, and (ii) the internal sensor or the external reference with reference to the at least one sensing data. A process of generating identification information data for the user sensed through the IoT terminal of the IoT terminal; and (iii) analyzing the at least one sensing data to determine a state of at least some of people, objects, and environments in the indoor space to which the set-top box belongs. Acquiring the specific contextual information data indicating, and acquiring the action information data indicating the action item of the basic terminal or the action item of the external IoT terminal performed by the user and corresponding to the specific contextual information data; iv) identifying said specific contextual information data and said action information data; Correction data and mapping of the user information generated through the process of recording and managing processor to obtain from the set-top box Management server comprising a. The method of claim 21, And the action information data obtained by further referring to electronic program guide (EPG) information on a broadcast signal output through the basic terminal or the external IoT terminal from the set top box. The method of claim 21, And classifying and recording the user information obtained from the set top box according to a predetermined criterion. The method of claim 21, The processor may obtain advertisement information data corresponding to the user information from a predetermined advertisement server and transmit the advertisement information data to the set top box to support the set top box to provide the advertisement information data. . A computer-readable medium for recording a computer program for executing the method according to any one of claims 1 to 12.

Images