KR101744674B1 - Apparatus and method for contents creation using synchronization between virtual avatar and real avatar - Google Patents

Abstract

The present invention relates to an apparatus and method for generating a content using a virtual avatar and a real avatar synchronizing a virtual avatar and a motion synchronized with each other, The portable terminal receiving execution data from a service providing server; (B) activating communication with the avatar unit by the portable terminal; (C) activating the camera unit and driving the motion skin to output a virtual avatar on the screen; (D) transferring the motion data included in the execution data to the avatar unit, and driving the avatar unit according to the motion data; And (E) driving the motion of the virtual avatar on the motion skin according to the motion data. According to the present invention, contents including synchronized virtual avatars and real-life avatars can be generated, and the generated contents can be shared, thereby widening the usability of the avatar in which synchronization is implemented.

Description

[0001] APPARATUS AND METHOD FOR CONTENTS CREATION USING SYNCHRONIZATION BETWEEN VIRTUAL AVATAR AND REAL AVATAR [0002]

The present invention relates to a virtual avatar that synchronizes an actual avatar robot with a virtual avatar displayed in a two-dimensional or three-dimensional image on a screen of a mobile terminal and generates motions of the virtual avatar and the real avatar (2012.05.01 ~ 2015.03.31) of the Ministry of Culture, Sports and Tourism's support for cultural technology research and development in 2012, It is an invention of the result produced in performing.

Generally, an avatar is a broad term used to refer to a false or incarnation, and may be classified into, for example, a virtual avatar and a reality avatar.

The virtual avatar can be used as an animation character in place of a human role in cyberspace. For example, a two-dimensional or three-dimensional image moving in various motions on a screen of a portable terminal such as a smart phone or a tablet PC.

A realistic avatar may be a robot moving in various motions such as a movement or an operation by a remote control signal for remote control or an application program for robot control or the like and may be a modular robot composed of a plurality of actuator modules.

In recent years, there has been provided a technique for providing an interest to a user by interacting with a virtual avatar and a realistic avatar, and allowing the gamer to enjoy the game by applying it to the game. For example, a technology for controlling the appearance of a user in the real world so as to reflect the feature of the avatar in the virtual world has been proposed. There is also provided an apparatus for receiving and displaying robot status information transmitted from a remote presence robot and controlling the remote presence robot according to user input.

However, in this conventional technique, the user's operation is sensed through the sensor, and control information of the corresponding virtual avatar is generated, and the motion of the virtual avatar is controlled according to the control information, so that a plurality of sensors Therefore, there is a problem in that such sensor information needs to be analyzed and processed individually.

In recent years, due to the development of social networks and the like, a content including both a virtual avatar implemented as an image on a mobile terminal and a realistic avatar linked to the virtual avatar in combination with the real avatar is provided, There is a growing need.

Korea Patent Publication No. 2010-0121420 Korea Patent Publication No. 2011-0071220

SUMMARY OF THE INVENTION The present invention has been made in order to solve the above-mentioned problems, and it is an object of the present invention to provide a virtual avatar realized by an image on a mobile terminal and a real- And an apparatus and method for generating a content using synchronization of a real avatar and a virtual avatar for implementing the present invention.

Further, in order to expand the utility of the implemented avatar, the present invention can also be applied to a content creation system that creates content including a synchronized virtual avatar and a realistic avatar, and uses a virtual avatar and a real- And to provide a method and apparatus for generating the same.

According to an aspect of the present invention, there is provided a mobile terminal comprising: (A) a mobile terminal receiving execution data from a service providing server; (B) activating communication with the avatar unit by the portable terminal; (C) activating the camera unit and driving the motion skin to output a virtual avatar on the screen; (D) transferring the motion data included in the execution data to the avatar unit, and driving the avatar unit according to the motion data; And (E) driving the motion of the virtual avatar on the motion skin according to the motion data.

And outputting the sound source data included in the execution data.

(A) the avatar unit is driven according to a control signal; (b) detecting a driving history of the avatar unit from a sensor installed at a driving site of the avatar unit; (c) generating motion information according to the detection result; (d) the portable terminal receiving the motion information from the avatar unit; (e) activating the camera unit and driving a motion skin to output a virtual avatar on the screen; And (f) driving a virtual avatar on the motion skin in accordance with the motion information. The method includes generating a content using synchronization between a virtual avatar and a realistic avatar.

In this case, the portable terminal may output the sound source designated by the user.

(G) receiving a synchronization adjustment command from a user; (H) adjusting the motion driving sink of the virtual avatar according to the synchronization adjustment command when the synchronization adjustment command is motion synchronization; And (I) adjusting the sound source output sink according to the synchronization adjustment command when the synchronization adjustment command is sound source synchronization.

(J) receiving a photographing command from a user; (K) capturing an image including the motion skin to generate content data; And (L) storing the content data. The content data may be still image data or moving image data.

The avatar unit is a modular robot composed of a plurality of operation modules, and the plurality of operation modules may include information of a unique ID, an initial state, a movement width, and a movement axis.

The motion information may further include angular velocity and acceleration information according to an operation of each operation module of the avatar unit.

Wherein the avatar unit allocates an index for each predetermined motion to each operation module and transmits the index to the portable terminal in the avatar unit; The portable terminal may extract motion information corresponding to the index and control the motion of the virtual avatar to operate by applying the extracted motion to the virtual avatar.

The following effects can be expected in the contents creation system and method using the synchronization between the virtual avatar and the real feeler avatar according to the present invention.

That is, according to the present invention, there is an advantage that synchronized operation of a virtual avatar realized with an image on a mobile terminal and a realistic avatar driven by a real robot can be realized.

In addition, the present invention has an advantage that the contents including the synchronized virtual avatar and the real feeling avatar can be generated, and the generated content can be shared, thereby widening the usability of the avatar realized synchronization.

Brief Description of the Drawings Fig. 1 is a configuration diagram showing a configuration of a content creation system using synchronization between a virtual avatar and a real feeling avatar according to the present invention; Fig.
2 is a block diagram showing a configuration of a portable terminal and an avatar unit constituting a specific embodiment of the present invention;
3 is a block diagram showing an operation module configuration of an avatar unit constituting a specific embodiment of the present invention.
FIG. 4 is a flowchart illustrating a content generation method using synchronization between a virtual avatar and a real feeling avatar according to a specific embodiment of the present invention. FIG.
FIG. 5 is an exemplary diagram showing an example of motion data according to a specific embodiment of the present invention. FIG.
FIG. 6 is an exemplary view showing an example of execution of a photographing mode according to a specific embodiment of the present invention; FIG.
FIG. 7 is an exemplary diagram illustrating an example of a synchronization adjustment mode according to a specific embodiment of the present invention; FIG.

Hereinafter, a system and method for generating a content using synchronization between a virtual avatar and a real sense avatar according to a specific embodiment of the present invention will be described with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. , Which may vary depending on the intention or custom of the user, the operator, and the like. Therefore, the definition should be based on the contents throughout this specification.

Each block of the accompanying block diagrams and combinations of steps of the flowcharts may be performed by computer program instructions (execution engines), which may be stored in a general-purpose computer, special purpose computer, or other processor of a programmable data processing apparatus The instructions that are executed through the processor of the computer or other programmable data processing equipment will generate means for performing the functions described in each block or flowchart of the block diagram.

These computer program instructions may also be stored in a computer usable or computer readable memory capable of directing a computer or other programmable data processing apparatus to implement the functionality in a particular manner so that the computer usable or computer readable memory It is also possible for the instructions stored in the block diagram to produce an article of manufacture containing instruction means for performing the functions described in each block or flowchart of the flowchart.

Computer program instructions may also be loaded onto a computer or other programmable data processing equipment so that a series of operating steps may be performed on a computer or other programmable data processing equipment to create a computer- It is also possible that the instructions that perform the data processing equipment are capable of providing the steps for executing the functions described in each block of the block diagram and at each step of the flowchart.

Also, each block or step may represent a portion of a module, segment, or code that includes one or more executable instructions for executing the specified logical functions, and in some alternative embodiments, It is also possible for functions to occur out of order.

That is, it is also possible that the two blocks or steps shown are actually concurrently performed, and that the blocks or steps are performed in the reverse order of the function as required.

First, a content generation system using synchronization between a virtual avatar and a real feeling avatar according to a specific embodiment of the present invention will be described.

FIG. 1 is a configuration diagram showing a configuration of a content generation system using synchronization between a virtual avatar and a real feeling avatar according to the present invention, FIG. 2 shows a configuration of a portable terminal and an avatar unit constituting a specific embodiment of the present invention 3 is a block diagram showing an operation module configuration of an avatar unit constituting a specific embodiment of the present invention.

1, a content generation system using synchronization between a virtual avatar and a real feeler avatar according to a specific embodiment of the present invention includes a service providing server 100, a portable terminal 200, an avatar unit 300, And a network server 400.

The service providing server 100 stores an application program (hereinafter referred to as 'app') and execution data for driving the present invention and provides them to the portable terminal 200 as needed.

The portable terminal 200 receives the app and execution data from the service providing server 100 and communicates with an avatar unit 300 to be described later to drive the avatar unit 300, So that the virtual avatar can be synchronized with the virtual avatar. The configuration and function of the portable terminal 200 will be described in detail later.

At this time, the portable terminal 200 may be a smart phone, a tablet PC, or the like.

Meanwhile, the avatar unit 300 may be a game robot or an educational robot configured to be electrically and mechanically connected by a plurality of actuator modules, for example, as realistic avatars capable of wireless communication with the portable terminal 200.

The specific configuration and function of the avatar unit 300 will be described in detail later.

And the social network server 400 refers to a normal SNS server for sharing contents generated through the portable terminal 20).

Hereinafter, specific configurations and functions of the portable terminal and the avatar unit will be described with reference to FIGS. 2 and 3. FIG.

2, the portable terminal includes a communication unit 210, an output unit 220, an input unit 230, a storage unit 240, a camera unit 250, and a control unit (260).

The communication unit 210 is for communicating with the avatar unit 300 and includes one of various communication methods such as a radio frequency (RF), a WiFi, a Bluetooth, a short distance communication (NFC), and an infrared To communicate with the avatar unit (300).

The output unit 220 includes a display unit 222 for image output and a sound source output unit 224 for sound source power.

A touch screen may be applied to the display unit 222, and various data and information input from the virtual avatar and the user may be displayed.

The input unit 230 receives various information and data from a user through a key button or a screen touch. The input unit 230 is used for setting communication with the avatar unit 300, inputting synchronization adjustment signals between the virtual and real avatars, And a background music setting according to the motion of the user.

Meanwhile, the storage unit 240 may store various types of information and execution data for executing the present invention.

The camera unit 250 is a camera module included in a portable device, and is configured to simultaneously capture a motion skin and a subject output from a virtual avatar.

In addition, the controller 260 controls the overall operation of the portable terminal 200. In particular, by controlling the operations of the communication unit 210, the output unit 220, the input unit 230, the storage unit 240, and the camera unit 250, communication between the portable terminal 200 and the avatar unit 300 The avatar unit 300 is operated.

The control unit 260 controls the motion of the virtual avatar output through the display unit 222 through the execution data. At this time, the virtual avatar is driven through a motion skin, activates the camera unit 250, and photographs the avatar unit 300 together with the motion skin to generate contents.

In the mobile terminal 200 thus configured, the virtual avatar is output to the display unit 222, the avatar unit 300 is driven through the communication unit 210, and the virtual avatar is synchronized with the motion of the avatar unit 300 To adjust the exact sync.

In addition, the portable terminal 200 can activate the camera unit 250 in a state in which the virtual avatar is output, and can capture an image including the virtual avatar and the avatar unit 300 at the same time, The contents can be widely shared through the social network server 400.

The avatar unit 300 includes a communication module 310, a database 320, a control module 340, and an operation module 330.

The communication module 310 is connected to the portable terminal 200 through any one or more of a predetermined communication method such as RF, WiFi, Bluetooth, NFC, infrared And performs communication.

The database 320 may store an application program required for controlling the operation of the control module 340 and motion data received from the portable terminal 200.

Also, the control module 340 controls the operation module 330 according to the motion data received from the portable terminal 200.

The operation module 330 controls the operation of the avatar unit 300 and includes an interface 331, a controller 333, a memory 335, and a motor 337 as shown in FIG. And may further include an acceleration sensor 338 and an angular velocity sensor 339 in the case of another embodiment of the present invention.

The interface 331 is for physical or signal connection connection with the control module 340. That is, when a command for executing a motion is received from the control module 340, the command is transmitted to the controller 33.

The controller 333 drives the motor 337 according to a command for executing the motion to actually operate the avatar unit 300.

The memory 335 stores various data necessary for controlling the operation of the controller 333.

Meanwhile, the acceleration sensor 338 and the angular velocity sensor 339 are optional components in the case of the other embodiments of the present invention, and perform the role of calculating the acceleration and the angular velocity, respectively.

Hereinafter, a content generation method using synchronization between a virtual avatar and a real sense avatar according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 4 is a flowchart illustrating a content generation method using synchronization between a virtual avatar and a real feeler avatar according to a specific embodiment of the present invention. FIG. 5 is an exemplary diagram illustrating an example of motion data according to a specific embodiment of the present invention FIG. 6 is an exemplary view illustrating an example of a photographing mode execution according to a specific embodiment of the present invention, and FIG. 7 is an exemplary view illustrating an example of a synchronization control mode according to a specific embodiment of the present invention.

As shown in FIG. 4, the content generation method using the synchronization between the virtual avatar and the real feeling avatar according to the present invention starts from receiving the execution data from the service providing server 100 by the portable terminal 200 (S110, S120).

Here, the execution data may include motion data and sound source data, and the motion data is data representing driving motion information of a virtual avatar and an avatar unit (real sense avatar) Refers to a sound source to be output through the portable terminal.

The motion data as illustrated in FIG. 5 is data including driving contents (joint units) for each operation module 330, and the virtual avatar implemented on the motion skin by the corresponding data also changes the motion .

In addition, the service providing server 100 provides various types of execution data, and may be provided in units of motion, which reproduces choreography for a specific piece of music.

Meanwhile, the portable terminal 200 receiving the execution data waits for an input of an application execution command from the user and activates communication with the avatar unit 300 when the user inputs an application execution command (S120) S140, S150).

Next, the portable terminal 200 activates the camera unit 250 and drives the motion skin on the slide screen (S160, S170).

Here, the motion skin is a skin that is output on the photographing screen of the portable terminal 200, and the motion skin includes a virtual avatar image implemented in 2D or 3D.

6 shows an example in which a virtual avatar VA and an avatar unit 300 are displayed together on the screen of the mobile terminal 200 when the motion skin is driven.

When the driving command of the user is input (S210), the portable terminal 200 transmits motion data of the execution data to the avatar unit 300 (S220).

Next, the motion of the virtual avatar VA is changed by the motion data and output (S230).

At the same time, the avatar unit 300 receiving the motion data (S222) stores the received motion data, drives the operation module 330 according to the motion data, and drives the avatar unit 300 (S224, S226).

At this time, the storage of the motion data is performed to secure the stability of driving the operation module 330 and can be selectively performed.

Accordingly, the motion of the virtual avatar VA and the motion of the avatar unit 300 operate in a coincidental motion.

In addition, the portable terminal 200 outputs sound source data along with the driving of the virtual avatar (VA) (S240).

Meanwhile, when the user inputs a synchronization adjustment signal (S250), the portable terminal 200 executes the synchronization adjustment mode (S250).

The synchronization control mode adjusts the synchronization between the virtual avatar's motion, the avatar's unit's motion, and the sound output, and includes sound source synchronization and motion synchronization.

At this time, as shown in FIG. 7, in the synchronization adjustment mode, in the case of motion synchronization, the motion output sync of the virtual avatar can be increased (-) to synchronize the motion of the avatar unit with the sink.

In addition, in the case of sound source synchronization, the sound output synchronization can be increased (-) to make the virtual avatar motion synchronized with the motion.

This makes it possible to match the motion of the virtual avatar, the motion of the avatar unit, and the sink output of the sound source.

If the user inputs a photographing command (S310) after the motion skin driving, the portable terminal 200 executes a photographing mode to generate a content (S320).

Then, the generated content is stored (S330).

In this case, the shooting mode includes a still image shooting mode and a moving image shooting mode, and the content generated according to the shooting mode may also be a still image (photograph) or a moving image.

Although not shown, the stored contents can be transmitted to various social network servers 400 linked with the user subscription and started.

The above describes a method of driving the virtual avatar VA and the avatar unit 300 so that the portable terminal 200 receives the motion data and transmits it to the avatar unit 300 to drive the avatar unit 300 Respectively.

However, according to another embodiment of the present invention, the avatar unit stores motion data and is driven by the motion data, and the driving of the avatar unit is measured by the acceleration sensor 338 and the angular velocity sensor 339 It is possible to generate the motion information from the generated value and transmit the motion information to the portable terminal so as to drive the motion of the virtual avatar accordingly.

Specifically, the avatar unit can perform a motion according to a preset program or a control signal from an external device, and the motion information of the avatar unit is transmitted to the portable terminal through wireless communication.

The portable terminal implements the motion of the virtual avatar displayed on the screen according to the motion information received from the avatar unit.

At this time, the motion of the virtual avatar is matched with the motion of the avatar unit. For example, when the avatar unit performs the motion of raising the right arm, the virtual avatar performs a motion in which the right arm is lifted in the same manner on the screen of the portable terminal.

To this end, the operation module of the avatar unit according to another embodiment of the present invention includes an acceleration sensor and an angular velocity sensor. At this time, the motion information may include identification information that can identify a unique ID and a type assigned to each operation module.

The motion information may include at least one of an initial state, a minimum position, a maximum position, a move width, a maximum rotation (rpm), and an axis information axis, and the like, and such motion data can be updated according to the motion of each operation module.

Meanwhile, the unique ID of the motion information may be the unique identification information of each operation module and may be an index representing the motion information of the operation module.

In other words, when a predetermined index is assigned to at least one motion for the operation module and the avatar unit performs motion corresponding to the index, the avatar unit does not transmit motion information to the portable terminal but transmits only the index The portable terminal can extract the motion information corresponding to the index and allow the virtual avatar to perform the motion.

It is to be understood that the invention is not limited to the disclosed embodiment, but is capable of many modifications and variations within the scope of the appended claims. It is self-evident.

The present invention relates to an apparatus and a method for generating a content using a virtual avatar and a real avatar synchronizing a virtual avatar and a motion synchronized with each other and simultaneously generating a single content with the virtual avatar synchronized with the virtual avatar. It is possible to generate contents including the virtual avatar and the real feeling avatar, and to share the generated contents, thereby extending the usability of the avatar in which the synchronization is implemented.

100: Service providing server 200: Portable terminal
210: communication unit 220: output unit
222: display unit 224: sound source output unit
230: input unit 240: storage unit
250: camera unit 260:
300: avatar unit 310: communication module
320: Database 330: Operation Module
331: Interface 333: Controller
335: memory 337: motor
338: Acceleration sensor 339: Angular velocity sensor
340: control module 400: a social network server

Claims (9)

delete delete (A) the avatar unit is driven in accordance with a control signal;
(B) detecting a driving history of the avatar unit from a sensor installed at a driving site of the avatar unit;
(C) generating motion information according to the detection result;
(D) receiving, by the portable terminal, the motion information from the avatar unit;
(E) activating a camera unit and outputting a virtual avatar on a screen by driving a motion skin including a virtual avatar image implemented in 2D or 3D with a skin outputted on a screen of the portable terminal;
(F) driving a virtual avatar on the motion skin according to the motion information;
(G) receiving a synchronization adjustment command from a user;
(H) adjusting the motion drive sink of the virtual avatar according to the synchronization adjustment command when the synchronization adjustment command is motion synchronization;
(I) adjusting the synchronization of the sound source output according to the synchronization adjustment command when the synchronization adjustment command is sound source synchronization;
(J) receiving a photographing command from a user;
(K) capturing an image including the motion skin to generate content data; And
(L) storing the content data;
Wherein the content data is still image data or moving image data:
The avatar unit includes:
A modular robot composed of a plurality of operation modules,
The plurality of operating modules are configured to include information of a unique ID, an initial state, a moving width, and a moving axis,
The motion information includes:
And an angular velocity and acceleration information according to an operation of each operation module of the avatar unit.
The method of claim 3,
And outputting a sound source designated by the user by the portable terminal. The method of claim 1, wherein the virtual avatar is a virtual avatar.
delete delete delete delete 5. The method of claim 4,
The avatar unit includes:
Assigning an index to each operation module for each predetermined motion and transmitting the index from the avatar unit to the portable terminal;
The portable terminal includes:
Extracting motion information corresponding to the index, and controlling the motion of the virtual avatar to operate by applying the extracted motion to the virtual avatar.

Images