KR20200139934A - Clothes Wearing Service Apparatus and Method using Augmented Reality - Google Patents

Abstract

The present invention relates to a device and a method for a clothing wearing service using augmented reality. According to the present invention, a clothing image including clothing characteristic information such as the color, material, and size of clothing and retrieved at an online or offline clothing store is worn on an image taken using augmented reality, and thus a virtual fitting state experience is possible. The device of the present invention includes: a service management server generating the clothing image using the clothing characteristic information provided from a clothing dealer server through a communication network, generating a code corresponding to the generated clothing image, matching it with an input code, and providing the corresponding clothing image; and a user terminal recognizing or selecting a code exposed offline or online, transmitting it to the service management server, and displaying a fitting state by causing the clothing image from the service management server to be worn on an image taken using augmented reality.

Description

Clothing Wearing Service Apparatus and Method using Augmented Reality}

The present invention relates to a service device and method for wearing clothing recognized using a target picture, and in particular, a clothing image including clothing characteristic information such as color, material, and size of clothing retrieved from an online or offline clothing store is augmented reality. The present invention relates to an apparatus and method for a clothing wearing service using augmented reality that enables a virtual experience of a fitting state by wearing it on an image photographed using (Augmented Reality: AR).

When shopping for clothing, a buyer visits a store selling new products, selects a type of clothing that suits his or her body size and suits his or her personal taste and preferred style, and decides whether it suits his or her style and taste by actually wearing it. It is common to decide.

This option is possible in offline stores, but it is true that online stores are often discarded without returning or wearing them because they cannot check and determine whether clothing suits their style and taste by actually wearing them.

On the other hand, a country or a specific organization determines and announces the standard standard size by measuring the body size of a number of people or people sampled irregularly or periodically, and also in the case of color, determines and announces the standard color that is the standard. Are doing.

However, each apparel maker can separately measure the body size of the people and set its own standards to promote sales of the products they produce, and can produce limited new products reflecting unique and unique sizes, colors, and designs.

Therefore, the size, design, color, and material of each product produced by each clothing maker may be different. That is, even in the case of the same size (size), a certain area can be made larger or smaller, so that the clothing of one manufacturer may be a style that suits one's taste, but may not be clothing of another manufacturer.

On the other hand, online shopping malls that provide online product transaction services for the purpose of commerce using various media such as internet, social networks, cable TV broadcasting, etc. are in the trend of popularization, and there is also a remote transaction method using flyers and booklets. .

In the following description, stores that do not use generally designated and public product exhibition locations such as Internet stores, social network stores, cable TV broadcasting stores, leaflets, and booklets, etc. will be described as online stores.

It is difficult for modern people to allocate personal time for purchasing products, and they tend to prefer product transactions through online shopping using online stores such as online shopping malls rather than visiting offline stores such as stores, stores, department stores, and markets.

In other words, online shopping is not a direct view of the product (product), but shopping and purchase with the product image posted in the online store. Therefore, if you directly check the product purchased by delivery, it may not suit your style or be different from your size. There is a relatively high return rate.

When purchasing clothes through online shopping, by providing a fitting service that you can try on virtually, the buyer directly checks whether the product (product) to be purchased suits his or her style such as gender, age, height, weight, body type, etc. There is a growing need to do it.

However, in the prior art, it is possible to check only the mannequins or fitting models worn, and there is a problem in that it is not possible to observe the optimal style according to each individual's various body types and positions.

In addition, the method of creating an avatar created with one's body shape or face to wear clothing has a hassle of having to separately create one's own avatar. In addition, the generated avatar is configured based only on the user's body size information or is limited to avatar body type information provided by the service operator. Therefore, due to the limitation of not reflecting the user's face shape or physical characteristic at all, there is a problem in that it is not accurately reflected in the actual clothing and his or her face shape or physical characteristics, and thus it is not connected to actual purchase.

Unexamined Patent Publication No. 10-2015-0090353 (Publication date 2015.08.06.) Unexamined Patent Publication No. 10-2016-0067373 (Publication date 2016.06.14.)

Accordingly, the present invention has been devised to solve the above problems, and uses an augmented reality (AR) image of clothing that includes clothing characteristic information such as color, material, and size of clothing retrieved from online or offline clothing stores. An object of the present invention is to provide an apparatus and method for a service wearing a clothing using augmented reality that enables a virtual experience of a fitting state by wearing it on a photographed image.

Another object of the present invention is to wear clothing using augmented reality that can be worn to match the photographed image by adjusting the size of the clothing image through a touch and drag of a user terminal (such as a smartphone) having a touch screen. It is to provide a service device and method.

Other objects of the present invention are not limited to the objects mentioned above, and other objects that are not mentioned will be clearly understood by those skilled in the art from the following description.

A feature of the clothing wearing service apparatus using augmented reality according to the present invention for achieving the above object is to generate a clothing image using clothing characteristic information provided from a clothing company server through a communication network, and correspond to the generated clothing image. A service management server that generates a code and matches an input code to provide a corresponding clothing image, and a code that is exposed offline and online is recognized or selected and transmitted to the service management server, and transmitted from the service management server. It includes a user terminal for displaying a fitting state by wearing a clothing image on an image photographed using Augmented Reality (AR).

Preferably, the service management server generates a clothing image by detecting a clothing information collection unit that collects clothing characteristic information provided from the clothing company server, and a border and line of the clothing among the photographed images collected by the clothing information collection unit. A clothing image generation unit, a code generation unit that generates a code that can match information corresponding to the clothing image generated by the clothing image generation unit, and a storage unit that stores the generated clothing image and the code information, And a code matching unit that compares the code input from the user terminal with code information stored in the storage unit and searches for a matching code, and a clothing image detection unit that detects a clothing image corresponding to the code searched by the code matching unit. .

Preferably, the user terminal includes a code recognition unit for extracting and recognizing code information exposed online or offline and storing it in an allocated memory area, a clothing image receiving unit receiving clothing images from the service management server, and the clothing image receiving unit A clothing image editing unit that displays the clothing image received from the screen on the screen and adjusts the size of the clothing image displayed on the screen through touch and drag, and augmented the clothing image edited by the clothing image editing unit based on a previously captured image. A fitting state generation unit that floats on a photo using Augmented Reality (AR) and fits a clothing image to be directly worn on the photographed image, and a photo storage unit that stores the photographed image taken for fitting by the fitting state generation unit. , An augmented reality app, a clothing fitting app, a QR code, and a clothing search app using the clothing image downloaded through the service management server, stored in each allocated area, and an app operation unit for installing and operating.

A characteristic of the clothing wearing service method using augmented reality according to the present invention for achieving the above object is the step of collecting clothing characteristic information provided from a clothing company server through a clothing information collection unit, and the collection through a clothing image generation unit. Generating a clothing image by detecting a border and a line of the clothing among the captured images; generating a code that can match information corresponding to the generated clothing image through a code generator; and code information from a user terminal When is input, searching for a matching code by comparing the input code with the generated code information through a code matching unit, and detecting a clothing image corresponding to the searched code through a clothing image detection unit and transmitting it to the user terminal. Steps, wherein the clothing image received by the user terminal is displayed on the screen using a clothing image editing unit, and the size of the clothing image displayed on the screen is adjusted through touch and drag, and a photograph taken in advance through the fitting state generator And fitting the clothing image adjusted by the clothing image editing unit on the background of the image to be worn on the photographed image through Augmented Reality (AR).

The apparel wearing service apparatus and method using augmented reality according to the present invention as described above has the following effects.

First, it is possible to accurately check whether or not it suits his or her style and taste by directly wearing clothing on a photographed image representing the face and body shape of the user actually photographed.

Second, since the costume library is secured by directly extracting the costumes searched by the user or directly recognizing the costumes the user wants to match through QR codes, etc., it is possible to easily secure the costumes that the user actually wants to wear, and to create fashionable costumes. You can match it right away.

Third, the user is not limited to the clothing searched through direct shopping, and the user can send or receive the clothing he has to the other party through SNS linkage, and the transmitted clothing can be worn on the photographed image. Various clothing wearing services can be provided.

1 is a block diagram showing a clothing wearing service apparatus using augmented reality according to an embodiment of the present invention
Figure 2 is a block diagram showing in detail the configuration of the service management server in Figure 1
3 is a block diagram showing a detailed configuration of a user terminal in FIG. 1
4 is a flowchart illustrating a clothing wearing service method using augmented reality according to an embodiment of the present invention
5A to 5C are exemplary embodiments in which a process in which clothing is worn using augmented reality in the method of FIG. 4 is displayed on a screen.

Other objects, characteristics and advantages of the present invention will become apparent through detailed description of embodiments with reference to the accompanying drawings.

A preferred embodiment of a clothing wearing service apparatus and method using augmented reality according to the present invention will be described with reference to the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms. However, the present embodiment is intended to complete the disclosure of the present invention and to limit the scope of the invention to those of ordinary skill in the art. It is provided to inform you. Accordingly, the embodiments described in the present specification and the configurations shown in the drawings are only the most preferred embodiment of the present invention, and do not represent all the technical spirit of the present invention, and thus various alternatives that can be substituted for them at the time of application It should be understood that there may be equivalents and variations.

1 is a block diagram showing a clothing wearing service apparatus using augmented reality according to an embodiment of the present invention.

As shown in FIG. 1, the apparel wearing service apparatus of the present invention includes a clothing company server 100, a service management server 200, and a user terminal 300.

The clothing vendor server 100 is a corporate server engaged in a clothing industry that sells or makes clothing, and may include offline stores and online stores. In this case, the online store may include all stores using the Internet, cable broadcasting, booklets, newspapers, leaflets, and the like.

The clothing vendor server 100 exposes codes (R code, DR code) matching the clothing image generated using clothing characteristic information such as color, material, and size of clothing sold in offline stores and online stores offline and online. Let it.

The service management server 200 generates a clothing image using clothing characteristic information, such as color, material, shape, and size, of clothing provided from the clothing vendor server 100 through a communication network, and a code corresponding to the generated clothing image (QR Code, DR code). In addition, the service management server 200 provides a corresponding clothing image by matching a code input through a communication network.

At this time, the communication network may include all types of communication networks such as a mobile communication network, a wired communication network, a wireless communication network, a dedicated communication network, and an optical communication network.

The clothing dealer server 100 and the service management server 200 have the same configuration as a typical web server in terms of hardware, and use various types of languages such as C, C++, Jaba, Visual Basic, and Visual C in software. It includes program modules that are implemented through and perform various functions. In addition, the apparel vendor server 100 and the service management server 200 are various operating systems such as DOS, Windows, Linux, Unix, and Macintosh in general server hardware. It can be implemented using a provided web server program, and representative examples include a website used in a Windows environment, Internet Information Server (IIS), and CERN, NCSA, APPACH, etc. used in a UNIX environment. have.

The user terminal 300 recognizes or selects codes (QR codes, DR codes) exposed in offline stores and online stores, and transmits them to the service management server 200 through a communication network. In addition, the user terminal 300 receives a clothing image corresponding to the transmitted code from the service management server 200 and wears it on an image photographed using Augmented Reality (AR) to display a fitting state. .

In this case, the user terminal 300 is subscribed to a mobile communication system and includes a smartphone, a tablet PC, a laptop computer, a desktop computer, and a dedicated data terminal. In addition, the user terminal 300 is installed a clothing service application to receive a clothing service using augmented reality from the service management server 200 through a communication network. The application may be provided from the service management server 200, or may be provided and installed from other application markets for smartphones (eg, Apple App Store, Google Android Market, etc.).

The user terminal 300 is driven by the user's manipulation, and the installed application is executed by a simple method in which the user selects (touch or button type) an application for clothing service displayed on the display window (screen) of the user terminal 300 It becomes possible to connect to the service management server 200.

An application is a kind of application program, and is a program mainly used in small computers, tablet computers, and smartphones, which have relatively insufficient resources such as hardware and software, and are also referred to as applications and apps. In addition, the application may be referred to as an augmented reality app, a clothing fitting app, a QR code, and a clothing search app, depending on the application field, purpose of use, and function.

2 is a block diagram showing in detail the configuration of a service management server in FIG. 1.

As shown in FIG. 2, the service management server 200 includes a clothing information collection unit 210, a clothing image generation unit 220, a code generation unit 230, a storage unit 240, and a code matching unit 250. ), including the clothing image detection unit 260, the first communication unit 270,

The clothing information collection unit 210 may collect clothing characteristic information including a color, a material, and a size of clothing provided from the clothing vendor server 100. In this case, the clothing information collection unit 210 collects an image of the entire front of the clothing from the clothing company server 100 together.

The clothing image generation unit 220 generates a clothing image by detecting the edges and lines of the clothing among the photographed images collected by the clothing information collection unit 210. In this case, the clothing image generator may extract feature points for each region from the generated clothing image. For example, when the clothing is a T-shirt, the body portion and the arm portion may be detected and tracked to extract a feature point of an edge position that is a reference for a pattern for each portion.

The code generation unit 230 generates a code capable of matching information corresponding to the clothing image generated by the clothing image generation unit 220. In this case, the code may include a barcode, a QR code that is a two-dimensional code, and a DR code. In this case, the barcode and the QR code may be exposed in an offline or online store and scanned using a photographing unit (not shown) installed in the user terminal 300. The DR code may be used when the code cannot be scanned using the photographing unit installed in the user terminal 300. That is, when the user accesses the online store server using the user terminal 300 to search for clothes, the exposed QR code or the like cannot be scanned using the photographing unit installed in the user terminal 300. In this case, a selection icon called a DR code that can be selected for screen touch is separately generated and exposed on the screen of the user terminal 300 along with a QR code at the bottom.

The storage unit 240 stores clothing image and code information generated by the clothing image generation unit 220 and the code generation unit 230, respectively. In this case, the stored clothing image may store feature point information for each part of the clothing image together with the clothing image generated by the clothing image generator 220.

The code matching unit 250 searches for a matching code by comparing the code input from the user terminal 300 with code information stored in the storage unit 240.

The clothing image detection unit 260 detects a clothing image corresponding to the code searched by the code matching unit 250. In this case, the detected clothing image may detect feature point information for each region in the clothing image together with the clothing image generated by the clothing image generator 220.

The first communication unit 270 receives code information input from the user terminal 300 through a communication network, and transmits the clothing image detected by the clothing image detection unit 260 to the user terminal 300.

3 is a block diagram showing a detailed configuration of a user terminal in FIG. 1.

As shown in FIG. 3, the user terminal 300 includes a second communication unit 310, a code recognition unit 320, a clothing image receiving unit 330, a clothing image editing unit 340, and a fitting state generation unit 350. , A photo storage unit 360, and an app operation unit 370.

The second communication unit 310 receives clothing image information input from the service management server 200 through a communication network, and transmits code information to the service management server 200.

The code recognition unit 320 receives a QR code (bar code) photographed using a photographing unit (not shown) included in the user terminal 300 or a DR code selected from an online screen, and extracts code information. And it is recognized and stored in the allocated memory area.

The clothing image receiving unit 330 receives the clothing image transmitted from the service management server 200. In this case, the clothing image receiving unit 330 may receive feature point information for each portion of the clothing image together with the clothing image.

The clothing image editing unit 340 displays the clothing image received from the clothing image receiving unit 330 on the screen, and adjusts the size of the clothing image displayed on the screen through touch and drag. For example, the size of the entire clothing image may be adjusted through the touch area, the drag direction, and the area of the completion point. A technique for adjusting the size of an image displayed on the screen through touch and drag is a known technique, and a detailed description thereof will be omitted.

Meanwhile, the clothing image editing unit 340 may change the direction for each region using feature point information for each region in the clothing image along with the clothing image through touch and drag. For example, in the case of a T-shirt, when an arm is touched and an attempt is made to drag in a specific direction and area, the arm may be opened in the dragged direction and area. This may be done to accurately match the arm position of the user who is actually photographed with the arm portion of the generated clothing image. In this case, when the arm part is moved, the area connected to the body part may be created by combining a pre-stored transformed image according to the color, material, shape, and size of the clothing.

The fitting state generation unit 350 floats the clothing image edited in the clothing image editing unit 340 on the background of the photographed photographed image using augmented reality (AR) so that the clothing image is directly worn on the photographed image. Fit. In this case, the process of editing the clothing image performed by the clothing image editing unit 340 and fitting the clothing to the photographed image by the fitting state generation unit 350 may be performed simultaneously through the screen.

The photo storage unit 360 stores a photographed image photographed for fitting by the fitting state generator 350.

The app operation unit 370 stores and installs and operates an augmented reality app, a clothing fitting app, a QR code, and a clothing search app using clothing images downloaded through the service management server 200 in each allocated area. Meanwhile, the augmented reality app is described as a program that performs encryption and decryption and necessary data processing in order to process in an augmented reality (AR) method. In addition, the QR code and clothing search app will be described as a program that recognizes and analyzes the scanned or searched code so that necessary data processing is performed.

The operation of the clothing wearing service apparatus using augmented reality according to the present invention configured as described above will be described in detail with reference to the accompanying drawings. The same reference numerals as in FIGS. 1 to 3 refer to the same member performing the same function.

4 is a flowchart illustrating a clothing wearing service method using augmented reality according to an embodiment of the present invention. And FIGS. 5A to 5C are exemplary embodiments in which a process in which clothing is worn using augmented reality in the method of FIG. 4 is displayed on a screen.

Referring to FIG. 4, first, the service management server 200 collects clothing characteristic information including color, material, size, etc. of clothing provided from the clothing company server 100 through the clothing information collection unit 210. Collect (S10).

In addition, as illustrated in FIG. 5A, through the clothing image generating unit 220, a clothing image is generated by detecting a border and a line of the clothing among the collected photographed images (S20 ). In this case, the clothing image generator may extract feature points for each region from the generated clothing image. For example, when the clothing is a T-shirt, the body portion and the arm portion may be detected and tracked to extract a feature point of an edge position that is a reference for a pattern for each portion.

Then, a code for matching information corresponding to the clothing image generated through the code generation unit 230 is generated (S30). In this case, the code may include a barcode, a QR code that is a two-dimensional code, and a DR code, as shown in FIG. 5A.

Subsequently, when code information is input from the user terminal 300 (S40), the code matching unit 250 compares the input code with the code information stored in the storage unit 240 and searches for a matching code (S50). In addition, the clothing image corresponding to the code searched through the clothing image detection unit 260 is detected and transmitted to the user terminal 300 (S60). In this case, the transmitted clothing image may transmit feature point information for each portion of the clothing image together with the clothing image generated by the clothing image generator 220.

Meanwhile, the clothing image received by the user terminal 300 is displayed on the screen through the clothing image editing unit 340, and the size of the clothing image displayed on the screen is adjusted through touch and drag (S70). . For example, the size of the entire clothing image may be adjusted through the touch area, the drag direction, and the area of the completion point.

In addition, the clothing image edited by the clothing image editing unit 340 against the background of the previously photographed photographed image as shown in FIG. 5B through the fitting state generation unit 350 is a photographed image through Augmented Reality (AR). It is fitted to be worn on (S80). That is, as shown in FIG. 5C, the edited clothing image is floated on the photo to overlap the photographed image. In this case, the process of editing the clothing image performed by the clothing image editing unit 340 and fitting the clothing to the photographed image by the fitting state generation unit 350 may be performed simultaneously through the screen.

Meanwhile, the direction of each part may be changed by using the feature point information for each part in the clothing image along with the clothing image through touch and drag through the clothing image editing unit 340. For example, in the case of a T-shirt, when an arm is touched and an attempt is made to drag in a specific direction and area, the arm may be opened in the dragged direction and area. This may be done to accurately match the arm position of the user who is actually photographed with the arm portion of the generated clothing image. In this case, when the arm part is moved, the area connected to the body part may be created by combining a pre-stored transformed image according to the color, material, shape, and size of the clothing.

Although the technical idea of the present invention described above has been specifically described in the preferred embodiment, it should be noted that the above-described embodiment is for the purpose of explanation and not for the limitation thereof. In addition, those of ordinary skill in the technical field of the present invention will understand that various embodiments are possible within the scope of the technical idea of the present invention. Therefore, the true technical protection scope of the present invention should be determined by the technical spirit of the appended claims.

Claims (4)

A service management server that generates a clothing image using clothing characteristic information provided from a clothing company server through a communication network, generates a code corresponding to the generated clothing image, matches the input code, and provides a corresponding clothing image;
Recognizes or selects a code exposed in offline and online and delivers it to the service management server, and fits the clothing image transmitted from the service management server by wearing it on the image captured using Augmented Reality (AR). ) Apparel wearing service device using augmented reality, including a user terminal that displays a state.
The method of claim 1,
The service management server
A clothing information collection unit that collects clothing characteristic information provided from the clothing company server,
A clothing image generator configured to generate a clothing image by detecting an edge and a line of the clothing among the photographed images collected by the clothing information collecting unit;
A code generation unit that generates a code that can match information corresponding to the clothing image generated by the clothing image generation unit,
A storage unit for storing the generated clothing image and the code information,
A code matching unit that compares the code input from the user terminal with code information stored in the storage unit and searches for a matching code;
Apparel wearing service using augmented reality, including a clothing image detection unit for detecting a clothing image corresponding to the code searched by the code matching unit.
The method of claim 1,
The user terminal
A code recognition unit that extracts and recognizes code information exposed online or offline and stores it in an allocated memory area;
A clothing image receiving unit that receives a clothing image from the service management server,
A clothing image editing unit that displays the clothing image received by the clothing image receiving unit on the screen and adjusts the size of the clothing image displayed on the screen through touch and drag;
A fitting state generation unit for fitting the clothing image to be directly worn on the photographed image by floating the clothing image edited in the clothing image editing unit on the photo using an augmented reality (AR) with the photographed image as a background,
A photo storage unit for storing a photographed image taken for fitting by the fitting state generator;
Wearing clothes using augmented reality including an app operation unit that stores and installs and operates an augmented reality app, a clothing fitting app, a QR code, and a clothing search app using the clothing image downloaded through the service management server in each allocated area Service device.
Collecting clothing characteristic information provided from a clothing company server through a clothing information collection unit,
Generating a clothing image by detecting a border and a line of the clothing among the collected photographed images through a clothing image generator; and
Generating a code capable of matching information corresponding to the generated clothing image through a code generator; and
When code information is input from a user terminal, comparing the input code with the generated code information through a code matching unit and searching for a matching code,
Detecting a clothing image corresponding to the code searched through the clothing image detection unit and transmitting it to a user terminal;
The clothing image received by the user terminal is displayed on the screen using a clothing image editing unit, and the size of the clothing image displayed on the screen is adjusted through touch and drag;
Wearing clothing using augmented reality, including fitting the clothing image adjusted by the clothing image editing unit to be worn on the photographed image through augmented reality (AR) based on the photographed image previously photographed through the fitting state generator Service method.

Images