KR20130091991A - Augmented reality device using immage pattern reader - Google Patents

Abstract

An embodiment of the present invention relates to an augmented reality device using image pattern recognition, a technical problem to be solved is to extract the image information of the business card provider, the extracted data camera video screen of the mobile terminal such as a smart phone Or to display on a map screen.
To this end, the present invention is a camera module; An image recognition unit extracting image information related to a pattern of an image from a business card photographed by the camera module; A memory for storing the image information; Download map information and image pattern information from an information provider connected to the memory by wire or wirelessly, match the location of a building photographed with the camera module to the map information, and store the image pattern information and image information stored in the memory. Augmented reality providing unit for matching by augmenting the image information having the most similar pattern to the building by comparing the; And an image pattern recognition unit including a display unit which receives and displays map information, image pattern information, and an image of a building from the augmented reality providing unit.

Description

Augmented reality device using image pattern recognition {AUGMENTED REALITY DEVICE USING IMMAGE PATTERN READER}

One embodiment of the present invention relates to an augmented reality device using image pattern recognition.

Augmented Reality is a field of virtual reality that is a computer graphics technique that synthesizes virtual objects in the real environment and looks like objects in the original environment.

Augmented reality, unlike the existing virtual reality that targets only the virtual space and objects, by combining the virtual objects on the basis of the real world can reinforce and provide additional information difficult to obtain only in the real world. In other words, VR technology generally allows users to immerse themselves in the virtual environment, while the user cannot see the real environment, whereas in AR technology, the user can see the real environment, and the real environment and the virtual objects are mixed. Takes shape.

In other words, virtual reality is shown to the user by replacing the real world, but augmented reality has the distinction of supplementing the real world and showing it to the user by superimposing virtual objects in the real world. to provide. Due to this feature, unlike conventional virtual reality, which can be applied only to fields such as games, the present invention can be applied to various real environments, and it is particularly popular as a next-generation technology suitable for ubiquitous environment.

An embodiment of the present invention extracts the image information of the business card provider, and recognizes the image pattern of the mobile terminal such as a smart phone that can display the extracted data on the camera video screen or map screen of the mobile terminal such as a smartphone It provides an augmented reality device using.

An augmented reality device using image pattern recognition according to an embodiment of the present invention is a camera module; An information recognizing unit extracting image information related to a pattern of an image from a business card photographed by the camera module; A memory for storing the image information; Download map information and image pattern information from an information provider connected to the memory by wire or wirelessly, match the location of a building photographed with the camera module to the map information, and store the image pattern information and image information stored in the memory. Augmented reality providing unit for matching by augmenting the image information having the most similar pattern to the building by comparing the; And a display unit which receives and displays map information, image pattern information, and an image of a building from the augmented reality providing unit.

A coordinate converter for converting the business card information into coordinates for representation on a map; And a GPS sensor and a geomagnetic sensor to obtain current location and direction information of the user, and the current location and direction information of the user may be received from a Wi-Fi or a base station.

And a control unit for controlling the camera module, the information recognition unit, the memory, the augmented reality providing unit and the display unit.

One embodiment of the present invention extracts and stores business card information and displays business card information on a camera video screen or a map screen of a mobile terminal based on the information, thereby quickly and easily finding a business card provider in the vicinity.

One embodiment of the present invention is combined with the optical character recognition technology and augmented reality technology of the business card, to provide augmented reality device of a portable terminal, such as a smart phone with higher utilization.

1 is a block diagram illustrating a configuration of an augmented reality device using image pattern recognition according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the present invention.

1 is a block diagram illustrating a configuration of an augmented reality device using image pattern recognition according to an embodiment of the present invention.

Referring to FIG. 1, the augmented reality device 100 using the image pattern recognition according to the present invention includes a camera module 110, an information recognition unit 120, a coordinate converter 125, a memory 130, and a communication unit 150. , An augmented reality providing unit 160, a display unit 170, and a controller 180. In addition, the present invention may further include an information providing unit 190.

The camera module 110 photographs a business card or a street building and converts it to a still image or a video. For example, the camera module 110 photographs a business card and transmits an image thereof to the information recognition unit 120. In addition, the camera module 110 photographs a street building and outputs it to the display unit 170.

The information recognition unit 120 is a text image of the name, address, contact phone number, email, etc. in the business card image obtained from the camera module 110 and the background image for designing the background of the business card and each item image and video and audio The file and the like are extracted and transferred to the memory 130.

The coordinate converter 125 extracts coordinate information (latitude and longitude, hereinafter pattern information) corresponding to a base image and an image for each item from the extracted business card information, an address or telephone number, and the extracted business card information. This is transferred to the memory 130 along with the business card information and stored. Of course, to this end, the memory 130 has previously stored an address or a phone number and pattern information corresponding to a background image and an image of each item among the extracted business card information, and the coordinate converter 125 may thus store the memory 130. ) Can use the pattern information stored in advance. Of course, the pattern information may be downloaded from the information providing unit 190 to be used instead of the memory 130, and the present invention does not limit the storage location of the coordinate information corresponding to the address or phone number.

The memory 130 is a text image such as a name, address, contact phone number, e-mail transmitted from the information recognition unit 120 and the background image for designing the background of the business card, each item image and video and audio files, etc. Save business card information. In addition, pattern information corresponding to the business card information obtained from the coordinate converter 125 is also matched and stored. That is, the memory 130 defines and stores text data such as name, address, contact phone number, e-mail, a background image for designing a background of a business card, an image for each item, and a video and audio file and pattern information as one set. do.

Although not shown, the augmented reality device using the image pattern recognition according to an embodiment of the present invention may further include a GPS sensor and a geomagnetic sensor. The GPS sensor detects a user's current location. In more detail, the GPS sensor receives a signal from a GPS satellite to detect its current location (latitude, longitude and height), and outputs the same to the controller 180. In addition, the geomagnetic sensor detects a direction in which a portable terminal such as a user's smart phone is facing. In more detail, the direction that the camera module 110 is facing is detected, and outputs it to the controller 180.

In addition, the GPS sensor and the geomagnetic sensor in the present invention may be absent. Instead, the current location and direction of the user in the present invention can be determined using the information transmitted from the Wi-Fi or the base station. As described above, since a portable terminal such as a smart phone recognizes its location and direction using information transmitted from a GPS sensor, a geomagnetic sensor, Wi-Fi or a base station, a detailed description thereof will be omitted. .

The communication unit 150 downloads map information from the information providing unit 190 connected by wire or wirelessly and transmits the map information to the control unit 180.

The information providing unit 190 is connected to the memory by wire or wirelessly, and includes map information and image pattern information. The map information may be map information provided by an internet portal site such as Naver, Daum or Yahoo. However, the present invention is not limited to this kind. The image pattern information may be multimedia information such as a background image, an image of each item, and a video file, and the multimedia information is stored in a separate image pattern storage server. However, the present invention is not limited to this kind.

Here, the communication unit 150 may be absent. That is, the map information may be previously stored in the memory 130. For example, in an environment without a wired or wireless Internet environment, as described above, map information stored in advance in the memory 130 may be used.

The augmented reality providing unit 160 matches the map information and the image pattern information downloaded from the communication unit 150 or the memory 130 with the location of the building photographed by the camera module 110, and then the memory 130. Image information having the most similar pattern is augmented and matched with the building. More specifically, the augmented reality providing unit 160 is the camera module 110 to the map information and image pattern information corresponding to the current position and direction of the user obtained from the GPS sensor and geomagnetic sensor, Wi-Fi, or the base station. Matching the location of the building obtained, and also augmented and matched with the image information stored in advance in the memory 130. For example, the image information related to the pattern of the image extracted from the business card is superimposed on the actual building photographed by the camera module 110. Here, the technology for augmenting each other with the actual building photographed by the camera module 110 is already well known to those skilled in the art, so a detailed description thereof will be omitted. In addition, since the image information is already converted to coordinates and stored in the memory 130, a technique for augmenting image information having coordinates into an actual building photographed by the camera module 110 may be performed by those skilled in the art after reading the specification of the present invention. It will be easy to implement.

The display unit 170 receives the map information, the image information related to the pattern of the image, and the image of the building together from the augmented reality providing unit 160 and displays them. In more detail, the display unit 170 amplifies and displays the image information related to the image pattern on the image of the building. Accordingly, the display unit 170 may not only provide information on restaurants, coffee shops, shops, etc. occupied in the building, but also information on the main character of the business card having an address in the building (for example, name, address, contact telephone number, email, etc.). Quickly display the background image, the image of each item, the video and the audio file, etc. to design the text data and business card background. Meanwhile, although not shown, the display unit 170 may be formed of a display panel. In this case, a ceramic paint coating layer including fine powder tourmaline emitting anion and infrared rays is formed outside the support frame provided to support the outside of the panel. By forming a, it is possible to emit negative ions and infrared rays during normal or heat radiation, thereby contributing to the health of the user.

On the other hand, the outside of the support frame can be applied by spraying a functional oil mixed with 60 to 70% by weight of Hulanxess oil, 5 to 15% by weight of chamomile German oil, 20 to 30% by weight of Karenzula oil.

FRANKENCES oil, chamomile German oil, and Karenzula oil, which are applied to the surface of the support frame, are functional oils, and are mixed and used to have specific conditions, and are effective in improving skin diseases such as atopy.

Frankincense oil is extracted by distillation from the gin of wood. Chemical components include 1-pinene, dipentene, phellandrene, camphene, and olibannol, which are used as a substitute or perfume. Hulanxense oil helps to relax the mind and relieve stress, and is particularly effective for relieving coughs, such as colds, asthma and bronchitis. Consider inhaling Hulanxense oil in people with severe asthma.

Such furencense oil is mixed with functional oils in an amount of about 60 to 70% by weight. When the blending ratio of the flankencese oil is less than 60% by weight, the above-mentioned efficacy is lowered, so the effect is insignificant. Hulancances oil has a function to relieve asthma, but when the blending ratio of Hulancense oil exceeds 70% by weight, it is not suitable because it can make the cough worse.

Chamomile German oil, which contains a large amount of monoterpine and sesquiterpine, usually contains 7% or more (2.16 to 35.59%) of chamazulene, which has high anti-inflammatory and anti-allergic effects. It is known that matricarin is converted to chamanulene in the process of extracting oil by steam distillation. The α-bisabolol component in chamomile germany oil has been found in mice to have anti-inflammatory, anti-inflammatory and anti-inflammatory effects on arthritis. Excellent in anxiety

Such chamomile germane oil is mixed with functional oils by about 5 to 15% by weight, but when the mixing ratio of chamomile germane oil is less than 5% by weight, the above-described efficacy is lowered, so the effect is insignificant. Chamomile German oil has an excellent neuro-stable effect, so if the mixing ratio of chamomile German oil exceeds 15% by weight, the nervous system may be excessively relaxed, which may cause concentration problems.

Calendula oil contains vitamins A, B, D, and vitamin E. It is good for the treatment of skin diseases, especially eczema and dryness, and also promotes anti-inflammatory, anti-convulsion and bile secretion. It is known. Cream made with Karenzula oil is used to protect rough hands with housewives and eczema. It can be applied to the skin with varicose veins. It can be applied to the head or to the itchy legs for dandruff treatment.

Such Karenzula oil is mixed with the functional oil by about 20 to 30% by weight, but when the mixing ratio of the Karenzula oil is less than 20% by weight, the above-mentioned efficacy is lowered, so the effect is insignificant. Karenzula oil contains ketones. Therefore, if the mixing ratio of the Karenzula oil exceeds 30% by weight it may be harmful due to the excess of the ketone component contained therein. The chemical structure of the ketone component is a double bond of oxygen atoms to the center carbon. Oils containing excessive amounts of ketones should always be used when used. Do not use quantitatively because it may cause neurotoxicity in large amounts and cause side effects in continuous use. If used only, this ingredient can be used to strengthen and regenerate nerve tissue. It also acts as a powerful antitussive. Most of these oils can be used for chronic bronchial diseases, coughing from phlegm, and dyspnea.

The indicator coated with the functional perfume material helps to improve respiratory disease and concentration of the user.

The controller 180 is the camera module 110, the information recognizing unit 120, the coordinate converter 125, the memory 130, the communication unit 150, the augmented reality providing unit 160, the The display unit 170, the GPS sensor and the geomagnetic sensor is controlled according to a predetermined program or algorithm. That is, the controller 180 may be a microcomputer, a program, or software, which allows the devices to be performed smoothly without conflict with each other. For example, when a user operates the camera module 110, the controller 180 controls the camera module 110. In addition, the controller 180 controls the information recognition unit 120 to extract image information from the business card image obtained from the camera module 110. In addition, the controller 180 controls the coordinate converter 125 to convert information extracted from the business card image into coordinate information. In addition, the controller 180 accesses the memory 130 to obtain image information, or obtains or stores various data such as coordinate information from the memory 130. In addition, the controller 180 may calculate a current position and direction of the current by calculating a signal input from a GPS sensor, a geomagnetic sensor, a Wi-Fi or a base station, and supply the same to the augmented reality providing unit 160. In addition, the controller 180 obtains the map information and the image pattern information or outputs the map information and the image pattern information request signal through the communication unit 150. In addition, the controller 180 controls the display unit 170 to display the augmented screen from the augmented reality providing unit 160. In addition, when the communication unit 150 does not exist, the controller 180 controls to download map information and image pattern information from the memory 130. In addition, when there is no GPS sensor or geomagnetic sensor, the controller 180 can receive and recognize its location and direction information from the Wi-Fi or the base station as described above. Of course, such information can be received through the communication unit 150 is natural.

The information providing unit 190 may be an internet portal site or an internet server providing map information and image pattern information as described above. Since the information providing unit 190 such as the Internet portal site updates the map information and the image pattern information in real time, the user does not have to worry about updating the map information and the image pattern information separately. However, in the present invention, the information providing unit 190 may be omitted, and in this case, the map information may be stored in the memory 130.

On the other hand, it may be difficult to extract the business card information from the information recognition unit 120. That is, there is a case in which handwriting recognition is impossible or the card information cannot be extracted for other reasons. In this case, the business card information, name, address, telephone number, and business name are directly displayed on the business card image obtained from the camera module 110 using an input unit (touch screen or touch panel) provided in a portable terminal such as a smartphone. Etc. can be entered. Of course, the card information input in this way may be converted into correct coordinates via a coordinate converter and then stored in a memory.

Hereinafter, an example of a method of driving an augmented reality device using image pattern recognition according to an embodiment of the present invention configured as described above will be described with reference to FIG. 1. Here, the method of extracting and storing various information from the business card image photographed from the camera module is already well known, and thus description thereof will be omitted. In addition, the subject of the control to be described below is the controller 180.

In the augmented reality method using the image pattern recognition according to an embodiment of the present invention, first determine whether the user operated the augmented reality providing unit 160 by operating a portable terminal such as a smartphone. Then, when the user operates the augmented reality providing unit 160 by operating the camera module 110, the camera module 110 to take an external image. For example, the camera module 110 to photograph the street building. Then, at least one image information pre-stored in the memory 130 is searched for, and a position and a direction thereof are sensed using a GPS sensor and a geomagnetic sensor. Then, map information and image pattern information matching the location and direction of the user are downloaded from the information providing unit 190 via wire or wirelessly. Here, the information providing unit 190 may be stored in advance in the Internet portal site or memory 130.

On the other hand, the order of the augmented reality method using the image pattern recognition as described above is not fixed, the order may be changed. That is, the order of these steps can be changed as much as the hardware or software features of a portable terminal such as a smart phone implementing the present invention.

Thereafter, it is determined whether a location and a pattern matching the image information retrieved from the memory 130 exist within a range of the received map and image pattern. That is, it is determined whether the coordinate information corresponding to the business card information is within a range of the coordinate information corresponding to the map information and the image pattern information. Then, when there is the image information most similarly searched within the range of the received map and image pattern by controlling the augmented reality providing unit 160, and provides the retrieved image information to the image taken by the camera module 110 together with The display unit 170 is controlled to display the augmented reality.

What has been described above is only one embodiment for implementing the augmented reality device using the image pattern recognition according to the present invention, the present invention is not limited to the above-described embodiment, as claimed in the following claims Without departing from the gist of the present invention, anyone of ordinary skill in the art will have the technical spirit of the present invention to the extent that various modifications can be made.

100: augmented reality device using the image pattern recognition according to the present invention
110: camera module 120: information recognition unit
130: memory 150: communication unit
160: augmented reality providing unit 170: display unit
180: control unit 190: information providing unit

Claims (3)

Camera module 110;
An information recognizing unit 120 for extracting image information related to a pattern of an image from a business card photographed by the camera module 110;
A memory 130 for storing the image information;
Download map information and image pattern information from the information providing unit 190 connected to the memory 130 by wire or wirelessly, match the location of the building photographed by the camera module 110 to the map information, and the image. An augmented reality providing unit (160) for comparing the pattern information with the image information stored in the memory (130) to augment and match the image information having the most similar pattern to the building; And
The augmented reality device using the image pattern recognition, characterized in that it comprises a display unit 170 for receiving and displaying the map information, the image pattern information, and the image of the building from the augmented reality providing unit 160. The method of claim 1,
A coordinate converter 125 for converting the business card information into coordinates for representation on a map; And
Further includes a GPS sensor and a geomagnetic sensor to obtain the current location and direction information of the user,
Augmented reality device using image pattern recognition, characterized in that the user's current location and direction information is received from the Wi-Fi or the base station. The method of claim 1,
And a controller 180 for controlling the camera module 110, the information recognition unit 120, the memory 130, the augmented reality providing unit 160, and the display unit 170. Augmented reality device using image pattern recognition.

Images