TW200410037A - System and method for registering image of eyeglasses - Google Patents

Abstract

The present invention provides a system for registering image of eyeglasses wherein any person can take an image of eyeglasses at a predetermined quality anytime, anywhere and the image of eyeglasses which can be combined with an image of the person can be obtained quickly at low cost. The system includes a shooting apparatus (10) for taking a front shot of eyeglasses, a shooting apparatus (100) for taking a crane shot of eyeglasses, and a computer (200) for generating an image data out of the front image which can be combined with an image of a person by image processing and registering it together with specifications of the eyeglasses. The image processing includes eyeglass boundary detecting processing for detecting boundary of the eyeglasses in a direction from background part toward eyeglass part and lens boundary detecting processing for estimating lens part from the detected eyeglass boundary and detecting boundary of lenses in a direction from the lens part toward the lens boundary part. The image processing generates a frame mask image and a lens mask image to be combined with the image of a person. The registered data is transmitted to an eyeglass ordering system (300) via a network.

Description

200410037 (1) Description of the invention: [Technical field of the inventor's family 3 Field of the invention The present invention relates to glasses that first photograph a spectacle frame and form image data on a computer screen 5 that can be combined with a person's image and registered. An image registration system and a glasses image registration method, and more particularly, a glasses image registration system and a glasses image registration method for forming and registering image data required when a computer is used for sales service of glasses. t Prior Art 3 10 Background of the Invention Until now, the sales of spectacles have been carried out by the demander of the spectacles going to the spectacle store, actually trying on the spectacle frame, and selecting a pair of spectacle frames from it. In this case, the power of the lens can be determined by detecting vision, and the color of the lens and the spectacle frame must be actually tried on. It is necessary to check whether it is appropriate. 15 In this way, various spectacle frames must be prepared. Especially nowadays, there are many types of glasses frames, such as metal frames, plastic frames, nylon frames, and two-point frames, and new styles are constantly produced. difficult. Therefore, as disclosed in Japanese Patent Application Laid-Open No. 2001-350982, by using a terminal device installed in 20 stores, the face of the spectacles user is photographed, synthesized with a previously stored spectacle frame image, and displayed on a computer screen. Even if you do n’t have a physical spectacle frame, you can choose spectacle frames. Due to the development of Internet and other Internet technologies, you can open an imaginary shop on the Internet. 5 The glasses system has been developed. Even then, the face image is received from the computer of the customer, and it is combined with the image of the glasses frame stored in advance, and the information is sent to the computer of the customer and displayed on the computer screen. The customer can The above process is indispensable for selecting a desired type of spectacle frame. In the above-mentioned spectacles sales system, the facial image data of the demander, such as α, can be taken with a digital camera and stored in the demander's computer. In such a glasses sales system, it is necessary to synthesize glasses images on person images in advance. Register the image data of the spectacle frame as a possible composition. &Amp; Such image data can directly use the computer design data when designing the lens frame. If there is no computer design data, it is necessary to make a drawing again, or The frame is used for photography to form synthetic image data. 、, 疋, re-man drawing is not only nasal rework on the operation, but also on the production site «eyeglass frames made in the lock shop or imaginary shop on the Internet It is difficult to deal with the order as quickly as possible.… It is necessary to perform the following operations on the method of forming photosynthetic image data by taking pictures of the eyes and legs. That is to say, select the appropriate image from the captured images and store them in a computer towel. Transform the data of the frame part and lens part of Wei Wei. Because the above photography and computer processing require professional knowledge and proficient technology, so far ^ album section is taking photos, and then computer image processing experts will use the image data = Computer processing. Therefore, 'photographing and computer processing at the same time will cost a considerable amount of money' must have a pure frame, the above Saki's low glasses price and rapid sales are disadvantageous. The main purpose of the present invention is to provide glasses images registration that can be quickly and cost-effectively anytime, anywhere. System and image registration method. [Chi? ^ 明 内 融 1] Summary of the Invention (Japanese Patent No. 10, Patent No. 10, τ, Japanese lens mirror image registration system is provided with a photographing device that captures the image of glasses to form a composite image for composition The image forming device and the registration device are used to photograph the image of the glasses, the image forming device is used to synthesize the image of the shirt, and the registration device is used to register the elements of the glasses frame. Anyone, anytime, anywhere It is possible to obtain image data that can be synthesized with people's images at low cost and quickly. 15 :: The glasses image registration system in the second patent application scope is the glasses image registration system in the first patent scope, The camera is equipped with a door opening device and a camera device. 'Place the glasses frame in the camera box and close the door.' It is easy to take photos of eyeglasses without anybody's fancy material. The three-object image registration system is a mirror image registration system No. 2 in the scope of patent application No. 2 of the patent application, which includes a device for capturing frontal images of glasses. It is enough to know the spectacle image of the composite frontal image. 7 i S The glasses image registration system contained in item 4 of the “Patent Scope” is any I glasses image registration system in which the money is in the scope of patent application! Item 3 to the scope of patent application. This device is used to obtain an external image of the glasses used in the eyewear sales system.

… The spectacle image registration system described in item 5 of the scope of patent application is a spectacle image recording system described in any one of the scope of application scope J to the scope of application scope *. 10 A mask forming device for forming a spectacle frame mask image and a lens mask image. ^ According to the formed spectacle frame mask image, the spectacle frame portion can be replaced with the photographed spectacle image. According to the formed lens mask image, the lens portion and the lens portion of the glasses are translucently synthesized, and the person image can be easily synthesized. And glasses frame. 15 5 The glasses image registration system that has been included in item 6 of the scope of patent application is

The spectacle image registration system described in item 5 of the scope of patent application, the mask forming device includes a spectacle peripheral detection device and a lens perimeter detection device. The outer periphery of the glasses and the outer periphery of the lens form a spectacle frame mask image. The function of forming a lens mask image. 20 The outer periphery of the eyeglasses detected by the eyeglass peripheral detection device shows the shape of the eyeglasses. The outer periphery of the eyeglasses detected by the eyeglass peripheral detection device shows the range of the lenses in the eyeglasses. As the frame portion of the glasses, the portion surrounded by the outer periphery of the detected lens can be regarded as the lens portion of the glasses. 8 According to this image processing, the spectacle frame mask image and the lens mask image are automatically formed, and anyone can easily register the image data for synthesis. Not only metal frames and plastic frames, but also nylon frames and two-point frames, which have no or only a few frames, do not require special information and can automatically form composite image data. The eyeglass image registration system described in item 7 of the scope of patent application is an image registration system redundantly described in item 6 of the scope of patent application. The peripheral inspection of the eyeglasses includes a glasses boundary detection device and a lens boundary detection device. By detecting the boundary of the glasses from the background portion of the glasses image to the glasses portion, the outer periphery of the glasses can be easily detected. The frame portion of the spectacle image is estimated based on the detected periphery of the glasses, and the boundary is detected from the vicinity of the frame portion to the periphery of the lens, so that the label attached to the lens portion and the halo scene in the lens can be suppressed easily. Ground to detect the periphery of the lens. > The spectacle image registration system described in item 8 of the patent application scope is the spectacle image registration system described in item 7 of the patent application scope. The spectacle peripheral detection device includes a mirror boundary tracking device and a mirror μ boundary tracking device. Using the boundary of the glasses detected by the glasses boundary tracking device as a starting point, the nearby boundaries are sequentially detected and tracked, and the outer periphery of the eyepiece can be effectively detected, even if the frame and the nose frame of the complex shape are: The outer periphery of the glasses can be accurately detected. The glasses image in item 9 of Jiajing's patent scope shall be recorded in the full-time item in the patent application to the patent item in the patent application. A spectacle secret system, any inspection device for eyeglasses inspection, and any supplementary device for eyeglasses. According to this, when the peripheral data of the spectacles peripheral detection device and the lens peripheral detection device are incomplete due to unclear boundaries, the peripheral data of the defective part can also be estimated based on the detected peripheral data and supplemented. The eyeglasses image registration system described in item 10 of the scope of patent application is any of the eyeglasses image registration system described in item 6 of the scope of patent application to item 9 of the scope of patent application. The weekly detection device includes the outer periphery of the eyeglasses. The protrusion removing device and the lens irregular protrusion removing device. . Accordingly, when irregular protrusions occur on the outer periphery due to shading or the like, the outer periphery data of the protrusion can be estimated from the detected outer periphery data, and the irregular protrusion can be removed. The eyeglasses image registration system described in item (1) of the scope of patent application is any one of the eyeglasses image registration system described in item 6 of the scope of patent application to item 10 of the scope of patent application. The material forming device includes eyeglass machine information. Based on the device, the perimeter detection device for glasses and the perimeter detection device for lenses use the model information of glasses obtained by Pei Zhi, which has the function of detecting the periphery of glasses and the periphery of lenses. According to this, even if the detection of the outer periphery of the glasses and the outer periphery of the lens includes a complicated model, the model information of the mirror can be obtained through the job, and the mask can be automatically formed. When the operator judges that the mask that was originally formed is not suitable, he can create a mask on the screen by selecting the button according to the model of the glasses. In this case, when it is difficult to support the glasses of the model used, the operator can easily form a mask by pressing the model selection button. The article registered in the patent scope item u is registered in 200410037. It is described in the patent application scope item 5 to the patent application scope No.-a spectacle shadow silk m material shape wire placement including left and right comparison correction device . According to this, even if an erroneous portion & is generated in the-part of the image masked by the spectacle frame or lens 5 due to the spectacle frame or the lens having a shadow, it can be corrected. The spectacle image registration system described in item i 3 of the scope of patent application is described in the scope of the scope of application patent scope 5 to the scope of the scope of application patent scope-a spectacle image mask forming device including a mask manual editing device . According to this, when it is difficult to automatically form a spectacle frame mask image and a lens mask image, by specifying the spectacle frame portion and the lens portion of the spectacle image, it is possible to manually edit the spectacle frame mask image and the lens mask. Image, to correct the automatically formed image data. The eyeglasses image registration system described in item 14 of the scope of patent application is 15-any of the eyeglasses image registration described in item 5 of the scope of patent application to the scope of patent application training n the coin image forming device includes a synthetic person image and eyeglasses image Synthetic display device. Experiments were performed at the shooting site to synthesize images of people and glasses. If the shooting effect is not good, you can immediately take another shot, so it can provide high-quality 20-quality synthetic image data. Α is included in the patent scope of the 15th patent registration image registration system is registered in the scope of the patent application scope of the 14th registration of the eyeglasses image registration system, the "" When synthesizing people's images and glasses images, because the 11 beard colors and transmittance of the lenses can be specified, the product registration can be changed according to the result of the synthesis, and the photos can be taken again, which can provide more High-quality synthetic image data.… The spectacle image registration system redundantly included in the application No. 6 and 6 is a spectacle image filed in the patent application No. 14 or the patent application No. 15 The registration line and the display device have the function of adjusting the position of the glasses image. According to this, when the human figure and the glasses image are synthesized, the relative position between the two can be changed, so the optimal position at the time of composition can be set. The eyeglass image registration system in the scope of patent application No. 17 is a glasses image recorded in any of the scope of patent application No. 1 to the scope of patent application No. 16 In the registration system, the registration device is provided with a label reading device that reads the label attached to the frame portion. According to this, the product can be registered by automatically reading the label printed on the glasses image, thereby preventing human registration errors. It can more easily provide image data for synthesis. Based on the read tag information, the peripheral detection of glasses and the peripheral detection of lenses can suppress false detection due to shadows and the like, and can form a more reliable mask. Because it is possible to perform on-the-spot synthesis tests of people's images and glasses images, and if the photography is not good, it can be re-shot on the spot, so it can provide high-quality synthetic image data. The spectacle image registration system in the scope of application for patent No. 14 has a function to specify the color and transmittance of the lens in the composite display device. 200410037 According to this, when spectacle images and person images are synthesized, the color and transmittance of the lens can be specified. Change the registration content of the product based on the result of the synthesis, Re-photographing can provide higher-quality synthetic image data. 5 The eyeglass image registration system described in item 16 of the patent application scope is an eyeglass image described in item 14 of the patent application scope or item 15 of the patent application scope. Log in to the system and the composite display device has the function of adjusting the position of the glasses image. According to this, when the person image and the glasses image are combined, the relative position of the 10 person image and the glasses image can be changed, so the optimal position during the composition can be set. The spectacle image registration system described in item 17 of the scope of patent application is any spectacle image registration system described in item 16 of the scope of patent application, and the registration device includes a tag reading device that reads tags. 15 Because of this, it can automatically By reading the tag and registering the product, it is possible to prevent human registration errors, and it is possible to more easily provide image data for synthesis. Based on the read tag information, the peripheral detection of glasses and the peripheral detection of lenses are performed to suppress false detection such as shadows and form a more reliable mask. 20 The eyeglasses image registration system described in item 18 of the scope of patent application is an eyeglasses image registration system described in any one of the scope of patent application 1 to the scope of patent application 17, and has the function of sending registered data to the eyewear sales Communication device of the system. According to this, since the registered data can be provided to the eyewear sales system 13 200410037 online, eyewear can be sold more quickly and cheaply. Registration method of eyeglasses image described in item 19 of the patent application

A step of taking an image of glasses and a step of registering the formed composite image are prepared. Y 5 13 is equipped with the steps of capturing glasses images, forming composite images, and registering the formed images. Therefore, anyone can obtain image data that can be synthesized quickly and cost-effectively anytime, anywhere. The spectacle image registration method described in the patent application scope item 20 is the spectacle image registration method described in the patent application scope item 19, and the step of forming a composite image includes a step of forming a mask. The spectacle frame mask formed during the composition can replace the spectacle frame portion with the captured spectacle image, and the lens portion and the spectacle lens are translucently synthesized by the formed lens mask image, and the person image and spectacles in the spectacle sales system The synthesis can be easily performed. 15 The eyeglass image registration method described in item 21 of the patent application scope is the eyeglass image registration method described in item 20 of the patent application scope. The step of forming a mask includes the step of detecting the outer periphery of the glasses and the step of detecting the outer periphery of the lenses. , The step of forming a frame mask image, and the step of forming a lens mask image. 2 0 | The outer periphery of the eyeglasses detected by the eyeglass peripheral detection step shows the shape of the eyeglasses. The outer periphery of the eyeglasses detected by the eyeglass peripheral detection step shows the range of the lenses in the eyeglasses. The portion 'enclosed by the periphery of the lens is the lens portion. Through such image processing, the spectacle frame mask image and the lens mask image are automatically formed. Anyone can store and register image data for synthesis. For a frame like the Ni 4 frame or the two-point frame, there is only a part of the frame, or there is no spectacle frame. The information that does not need to be produced can be automatically formed into composite image data. § The eyeglass image registration method that has been included in item 22 of the scope of patent application is $ 21, which is included in the patent scope of the 21st patent application. The eyeglass periphery detection step includes the eyeglass boundary detection step and the lens periphery detection The steps include a frame part estimation step and a lens boundary detection step. Detecting the boundary of the glasses from the background portion of the glasses image to the ridge glasses portion The periphery of the glasses can be easily detected. From the periphery of the detected glasses, the lens portion of the spectacle image is detected from the vicinity of the lens to the periphery of the lens to detect the boundary, suppress the influence of labels and the like attached to the lens, and the periphery of the lens can be easily detected. The eyeglass image registration method described in item 23 of the patent application scope is the eyeglass image registration method described in item 22 of the patent application scope. The step of detecting the outer periphery of the eyeglasses includes sequentially detecting the boundaries detected by the eyeglass boundary detection step as a starting point and sequentially detecting The steps of detecting and tracking the nearby glasses boundary, and the step of detecting the periphery of the lens include the steps of sequentially detecting and tracking the boundaries of the nearby lenses with the boundary detected by the step of detecting the periphery of the lens as a starting point. In the glasses boundary detection step, the boundaries of nearby glasses are sequentially detected and tracked based on the detected boundary as a starting point, so the outer periphery of the glasses can be effectively detected, even if the shape is a combination of a complicated shape of the frame and the nose frame. It is also possible to accurately detect the periphery of the glasses on occasion. In the lens boundary detection step, the boundary of the nearby 200410037 lens is sequentially detected and tracked based on the detected boundary as a starting point, so the periphery of the lens can be effectively detected. The method for registering the eyeglasses pattern described in the 24th scope of the patent application is any one of the method for registering the eyeglasses image in any of the 21st scope of the patent application to the 23rd scope of the patent application. The step of detecting the periphery of the glasses includes the completion of the glasses. A step of the peripheral defect, and a step of detecting the periphery of the lens includes a step of completing the peripheral defect of the lens. According to this, when the peripheral part of the glasses and the peripheral part of the lenses are incomplete due to unclear borders, etc., the peripheral parts of the incomplete parts can be estimated and completed based on the detected peripheral parts. The eyeglass image registration method described in the 25th scope of the patent application is the eyeglass image registration method described in any of the 21st scope of the patent application to the 24th scope of the patent application. The step of detecting irregularities on the outer periphery of the glasses, and the step 15 of detecting the periphery of the lens includes a step of removing the irregular protrusions on the periphery of the lens. Accordingly, when irregular protrusions occur on the peripheral data of the eyeglass outer periphery detection step and the lens outer periphery detection step due to shadows or the like, the outer periphery data of the raised portions can be estimated based on the peripheral data obtained by the inspection and the irregular protrusion portions can be removed. 20 ^ The eyeglass image registration method redundantly included in the 26th patent application scope is the eyeglass image registration method recorded in any one of the 21st patent application scope to the 25th patent application scope. The mask formation step includes The step device for obtaining the model information of the glasses, the step of detecting the outer periphery of the glasses, or the step of detecting the outer periphery of the lenses includes a step of detecting the outer periphery of the glasses and the outer periphery of the lens 16 using the model information of the glasses. According to this, 'even if the outer periphery of the glasses and the outer periphery of the lens include a complicated model', the glasses model f obtained through profit sales can automatically create a mask. When the operator thinks that the mask that was originally formed is not suitable, as long as the model selection button on the book is pressed, the mask can be re-formed. ~ According to this, even if it is difficult to support all types of glasses 3 'operation S can be easily formed by auxiliary selection of the model by pressing the button ㈣ glasses registration method described in the 27th scope of the patent application is · 5 The method of registering spectacles, which is included in any one of the 20th to the 26th in the scope of patent application, includes a step of comparing and correcting the left and right images. According to this, it is possible to correct when the spectacle frame mask image or a part of the lens mask image has an irregular portion. The method for registering eyeglasses images described in item 28 of the scope of patent application is the method of registering eyeglasses images in any of the terms of the scope of patent application 20 to 27 of the scope of patent application 27. The scale formation step includes the compilation of fresh · 20 data. Therefore, even when it is difficult to automatically form a spectacle frame mask image and a lens mask = image, by designating the frame portion and the lens portion to be photographed, it is possible to manually edit the frame mask image and the material image. The formed image data is corrected. § The method of registering eyeglasses images in the 29th scope of the patent application is described in any of the 17th scope of the patent scope of the patent application to the 17th scope of the patent scope of the patent scope. The image forming step includes a step of synthesizing a human image that is not registered in advance by the crew member and a photographed spectacle image. According to this, it is possible to synthesize the person's image and the glasses image at the scene where the glasses image is taken. If the shooting is not suitable, it can be re-shot on the spot, which can provide good quality synthesis image data. "The spectacle image registration device contained in item 3G of the patent scope of the Chinese patent is the registration of the spectacle image registration of article 29 of the patent scope, and it has the steps of specifying the lens color and transmittance. According to this, since the color and transmittance of the lens can be specified when synthesizing an image, the registered content of the product can be changed based on the result of the synthesizing. The image can be taken again, and higher-quality synthetic image data can be provided. The method of registering eyeglasses images described in item 31 of the scope of patent application is any method of eyeglasses image registration method described in items 29 to 19 of the scope of patent application, and the display step includes adjusting the position of the glasses. step. According to this, when the person image and the glasses image are synthesized on the spot, since the relative positions of the person image and the glasses image can be changed, the optimal position at the time of composition can be set. The glasses image registration method described in the 32nd patent application scope is the glasses image registration method described in any one of the 19th item of the cap patent scope to the patent scope of the patent scope. The registration device has a step to read the tag Therefore, because it can automatically label and carry out the product surface, 200410037 can prevent artificial registration errors. Information can be provided more easily. "Data. Based on the read label information, the periphery of the glasses and the periphery of the lens are detected and suppressed. Mis-detection of shadows, etc., can form a more reliable mask. Coincidentally, the registration method of glasses images included in item 33 of the scope of patent application is that it has been included in item 19 of the towel, please refer to page 19 of the patent. The method for registering eyeglasses images according to any one of 32 items includes a step of transmitting synthetic image data. According to this, it is possible to provide the eyeglasses 10-selling system online with the registered data, so it can be more quickly and at a lower cost. Sell glasses. The above-mentioned object, other objects, features, and advantages of the present invention will be described with reference to the drawings. FIG. 2 is a configuration diagram of an image registration system 15 according to an embodiment of the present invention. FIG. 2 is a schematic diagram of a front image photographing device of the image registration system according to an embodiment of the present invention. 20 is a schematic view of a front-view image capturing device of an image registration system according to an embodiment of the present invention. FIG. 5 is a schematic view of an overhead image capturing device of an image registration system according to an embodiment of the present invention. The flowchart of the overall processing of the computer of the eyeglass image registration system according to one embodiment of the present invention. Fig. 6 is a processing flow 19 200410037 related to an embodiment of automatic mask processing. Fig. 7 is a process related to the detection of the periphery of the eyeglasses. A processing flowchart related to an embodiment. FIG. 8 is a flowchart of processing 5 related to an embodiment of the lens peripheral detection processing. FIG. 9 is a processing flowchart related to an embodiment of a composite image display processing. The figure is a processing flowchart related to an embodiment of the manual editing processing of the mask. 10 FIG. 11 is an embodiment related to the data registration processing. FIG. 12 is an explanatory diagram of the starting point of the detection processing at the periphery of the glasses. FIG. 13 is an explanatory diagram of the nearby points at the boundary tracking processing of the glasses and lenses. FIG. 14 is a diagram showing the glasses and lenses. An explanatory diagram of the boundary tracing process. Fig. 15 is a cross-sectional view in the long hand direction of a front image photographing apparatus according to an embodiment of the present invention. Fig. 16 is a front image photographing 20 according to an embodiment of the present invention. The diagram of the glasses viewed from the camera side of the device. Fig. 17 is an explanatory diagram showing the principle of illumination that clarifies the outline of glasses. Fig. 18 is an explanatory diagram showing the effect of illumination that clarifies the outline of glasses. 20 200410037 Fig. 19 is An explanatory view showing an example of gray processing performed on the inner surfaces of the wall plates 22 and 23 on the side surfaces of the eyeglass accommodating portion of the front image photographing apparatus according to an embodiment of the present invention. Fig. 20 is an explanatory view showing an example of gray processing performed on the inner surface of the rear wall plate 25 of the front image photographing apparatus 5 according to an embodiment of the present invention. Fig. 21 is an explanatory diagram showing an example of the shading process performed on the inner surface of the front wall plate 20 of the camera housing portion of the front image photographing apparatus according to the embodiment of the present invention. 10 FIG. 22 is an explanatory diagram showing an example of a black process performed on the inner surface of the wall plate 28 on the upper surface of the opening and closing door of the front image photographing apparatus according to the embodiment of the present invention. Fig. 23 is an explanatory diagram of an example of gray processing performed on the inner surface of the rear portion of the lower wall plate 12 of the front image photographing apparatus according to an embodiment of the present invention. Fig. 24 is an example of an image captured by a metal frame with a front image photographing apparatus according to an embodiment of the present invention. Fig. 25 is an example of an image of a plastic spectacle frame captured by a front image camera according to an embodiment of the present invention. 20 FIG. 26 is an example of an image of a plastic spectacle frame captured by a front image camera according to an embodiment of the present invention. Fig. 27 is an example of a two-point spectacle frame image captured by a front image camera according to an embodiment of the present invention. Fig. 28 is an example of a display surface (before the start of photography) in the photography of eyeglasses. 21 200410037 Fig. 29 is an example of a display image for photographing with glasses (after the end of photography). Fig. 30 shows an example of the display surface during the mask processing (before the processing is started). Fig. 31 shows an example of a display surface during mask processing (after the processing is completed). Fig. 32 is an example of a display surface edited manually by a mask. 5 Figure 33 shows an example of the display screen of the registration data (before registration starts). Fig. 34 is an example of a display screen for data registration (after registration is completed). Fig. 35 is a modification example of the display surface in the mask processing. [Embodiment 3 Best Mode for Carrying Out the Invention 10] Fig. 1 is a block diagram showing a system for connecting an eyewear image registration system, an eyewear sales system, and a network according to an embodiment of the present invention. In the figure, 1 is a glasses image registration system, and 300 is a glasses sales system. The glasses image registration system 1 is composed of a front image photographing apparatus 10, a bird's-eye view image photographing apparatus 100, and a computer 200. 15 First, an embodiment of the front image photographing apparatus 10 will be described. As shown in FIG. 2, the front image photographing device 10 is composed of a photographing case 11, a frame 30 to which a spectacle frame is fixed, an illumination lamp 40, and a digital camera 50. The photographing box 11 is composed of a lower wall panel 12, a camera storage section 14, a glasses storage section 16, and an opening / closing door 18. 20 The camera accommodating unit 14 is provided with a front wall panel 20 on one side of the frame 30, and a lens opening 21 of the camera 50 facing the fixed frame 2 is opened. A camera 50, a power socket 52, a power switch 54, and a USB socket 56 are provided on the back of the camera housing portion 14. The eyeglass accommodating portion 16 includes side wall plates 22 and 23, an upper wall plate 24, and a rear 22 200410037 face wall plate 25. The opening / closing door 18 includes side wall panels 26 and 27 and an upper wall panel 28. FIG. 2 shows the open state of the opening and closing door 18. In this state, the glasses 2 are fixed on the shelf 30, and the opening and closing door 18 is moved to the camera housing 14 and closed. At this time, the light 5 is completely blocked, so that the camera 50 can The glasses 2 are photographed. Here, for convenience, the front wall panel 20 of the photographic box 11 is referred to as the front side, the rear wall panel 25 is referred to as the rear side, the front wall panel 20 is referred to as the front portion of the photographic box 11, and the rear wall panel 25 is referred to as photography. The rear part of the case 11, the side wall panels 22 and 23 of the eyeglass storage part 16 are referred to as the rear part of the photographic case 11, the eye 10 of the lower wall panel 12 is referred to as the lower rear side of the photographic case 11, and the opening and closing door 18 The upper wall panel 28 is referred to as the upper front side of the photographing box 11. The lower wall panel 12 constituting the photographic box 11, the front wall panel 20 of the camera storage section 14, the side wall panels 22 and 23 of the eyeglass storage section 16, the upper wall panel 24, the rear wall panel 25, and the opening / closing door 18 of the eyeglass storage section 16. The side wall panel 26 is based on 15 and 27, and the interior of the upper wall panel 28 of the opening / closing door 18 is white. The illumination light is reflected by the wall surface without damaging the color tone of the glasses, and the light is illuminated from multiple directions. In the present embodiment, the photographic box 11 is formed with a white decoration. Of course, it is also possible to paint the inside with white. As shown in FIG. 3, the rear upper wall panel 24 is provided with an openable and closable structure (not shown) above the openable and closable door 18 in a state in which the openable and closable door 18 is closed. The opening / closing door 18 is of a skateboard type here, and it is of course possible to provide a cover for putting on and taking off the glasses. The frame 30 for fixing the glasses is a cylinder, and is perpendicular to the lower surface of the glasses receiving portion 16. In this embodiment, a cylindrical body with a foamed plastic core and a white oak jacket wrapped around it is used. The diameter of the cylinder is set based on the widest distance between the temples. In front of the frame 30 for fixing the glasses, that is, in the vicinity of the frame 30 on the side of the camera 5 receiving section 14 where the camera 50 is housed, in order to prevent the left and right sides of the glasses 2 from tilting, an acrylic spectacle stand 32 is provided on the frame portion where the glasses are placed. The banner of this pedestal is approximately equal to the banner of glasses 2. The thickness is so small that the frame portion of glasses 2 can be placed. The height of glasses 2 and the distance from the camera are kept within a certain range. The left and right 10 tilt. The spectacle stand 32 is made of a transparent acrylic resin plate, and the reflected light from the lower wall plate 12 can irradiate the lower part of the lens of the glasses 2. The outline of the lenses of the glasses such as a nylon frame and a two-point frame can be clearly depicted. In this embodiment, the spectacle stand 32 is fixed to the lower wall panel 12, and the lenses of the glasses 2 placed on the spectacle stand 32 and the lenses of the camera 50 are 15 meters high. In order to suppress the spectacle stand 32, the shadow of the spectacles 2 falls on the frame 30 for storing the spectacles so as to be fixed at a certain distance from the frame. Accordingly, a clear spectacle image of the lens portion of the spectacles 2 can be obtained. The surface of the camera 50 side of the spectacle stand 32 is provided with a scale and a color table. The size and color tone of the image can be confirmed by taking the image on the camera 50. The illuminating lamp 40 is fixed to the inner surface of the wall plate 24 on the upper surface of the eyeglass accommodating portion 16, and directly irradiates the eyeglasses 2 fixed to the rack from above. As the illuminating lamp 40, a circular fluorescent lamp is used. This is because the lighting of the fluorescent lamp is less likely to damage the hue of the glasses 2, and it is easy to start and easy to maintain. At the same time, the lighting area of the fluorescent lamp is large, and the lighting is performed in a large area, it is difficult to generate shadows, and glasses images with less interference can be obtained. The upper wall panel 24 can be easily exchanged for the illuminating lamp 40 because it has the aforementioned opening and closing structure. The illuminating lamp 40 is provided at the rear side of the spectacle stand 32 on the inner surface of the upper wall panel 24 so as to obtain the spectacle image of the wheel gallery with clearer lenses through the rear illumination. The principle of the 171U is clear. The upper part of the glasses 2 reflects the direct light from the light source and is photosensitive by the camera 5G. The lower part of the glasses 2 is reflected by the lower wall plate 12 to the illumination lamp 40 and is supplied through the transparent glasses stand ^. The camera 10 captures the reflected light. Therefore, as shown in Fig. 18, it is possible to more clearly capture the contours of the lenses of the nylon frame and the two-point lens. In this embodiment, the inner surfaces of the side wall panels 22 and 23 of the eyeglass accommodating portion 16 are subjected to 70% gray processing as shown in the second stage. The inner surface of the rear wall panel 25 is grayed out as shown in FIG. 2G. In order to take pictures as much as possible, the front panel 20 with the camera 15 is required to maintain a distance from the glasses 2. The distance from the glasses 2 to the side and the rear is as small as possible due to the miniaturization of the device. Photographing of glasses | The reflected light on the inner surface of gu produces a phenomenon that the side and rear are too bright compared to the front. The inner surfaces of the side wall panels 22 and 23 are 70% gray-treated. Strive for uniformity in all directions according to 20 lighting conditions. As a result, it is possible to obtain photographs closer to the eyes while obtaining glasses images with less interference. In this embodiment, the gray process is used to print black with a certain density on a synthetic synthetic paper called so-called sowing, and it is pasted on the inner surface of the siding. Needless to say, the gray surface can be painted gray. 25 200410037 In this embodiment, as shown in FIG. 15, the inner surface of the rear wall panel 25 is provided with a circular arc facing the lower wall panel 12, and the boundary between the rear wall panel 25 and the lower wall panel 12 is captured by the camera. Interference. In the present embodiment, a circular arc treatment is provided on the inner surface of the rear wall panel 25. The above-mentioned 40% gray treatment is broadcasted from the rear wall panel 25 toward the lower wall panel 12 so that the arc is pasted. The process of providing a circular arc on the inner surface of the rear wall panel 25, for example, using a member processed with a certain curvature, and of course forming a photographic box with a wall panel having a circular shape, is certainly possible. Lu 10 The front wall panel 20 is shown in FIG. 15. The mirror hole 21 of the camera 50 is provided. The camera 50 is provided in the camera housing 14. The height of the image center of the camera 50 of the camera 50 is approximately the height of the glasses. It is equal, so the lens of the glasses 2 is facing the lens hole 21 of the camera 50, which causes the problem that the lens of the camera 50 is printed on the lens of the glasses 2. 15 Therefore, as shown in FIG. 21, the inner surface of the front wall panel 20 of this embodiment is entirely subjected to 40% gray processing, and the center darkening of the camera mirror hole 21 is gradually changed to the surroundings. According to this, the reflected light of the front wall plate is suppressed, while the lenses of the camera 50 are suppressed from being printed on the lenses of the glasses 2, and the lens surface of the glasses 2 is shaded by the hue processing, preventing the lenses of the glasses 2 from being completely seen from the front 20 Transparency is like nothing. In this embodiment, 'tone processing is the same as gray processing, and black is printed at a certain density on a synthetic paper called postcast, and it is affixed to the inner surface of the siding. Here, the lens center is 100%, and the periphery is 40%. The lens part of the post-cast paper is cut out and used. The method of processing the color tone is to set the color of the lens around the camera hole 21 to the same as that of the camera 50. Of course, the hue treatment may be painted in gray by applying a constant density change to the inner surface of the siding. In this embodiment, the inner surface of the upper wall panel 28 of the opening and closing door is 100% grayed as shown in FIG. 22 and FIG. 5. This is to prevent the boundary line reflection glasses 2 of the front wall panel 20 and the lower wall panel 12. The lens on the camera 50 is printed on, and the wall plate 28 on the opening and closing door is painted black to suppress the illumination of the border portion. The lens of the glasses 2 is hardly visible. In this embodiment, as shown in FIG. 23, the inner surface 10 of the eyeglass accommodating portion 16 of the lower wall panel 12 is subjected to color tone processing, so that the side of the rear wall panel 25 is darkened and the side facing the installation position of the shelf 30 is brightened. . This is because the shelf 30 is fixed to the lower wall panel 12, and the reflected light from the lower wall panel 12 causes the bottom of the shelf 30 to be bright, the upper part to be dim, and the brightness of the upper and lower parts to be uneven. Therefore, 70% gray processing is performed on the inner surface of the eyeglass accommodating portion 16 of the lower wall panel 12 and one 15 side of the rear wall panel 25 and white processing is performed on the side of the installation position of the shelf 30 to form a hue change. The brightness is the same, so that glasses images with less interference can be obtained. As described above, the 40% gray-processed residual broadcast paper is slightly circularly affixed to the lower wall panel 12 toward the lower wall panel 25, and the 20 bonding surface of the lower wall panel 12 is set to 40 °. Gray. The camera 50 uses a digital camera with 3 million pixels and a lens with a focal distance of 5011111. The camera 50 is connected to the computer 200 via a USB interface. The glasses 2 are set on the shelf 30, the opening and closing door 18 is closed, The long-distance operation of 200 photographs the front image of the glasses. 27 200410037 5 From Figure 24 to Figure 27, the image taken by the front camera 10 is shown. Figure 24 is a metal frame, and the second one is a plastic: frame, and the 26th is a nylon frame. Figure 27 is a two-point mirror. Each kind of brother is the same as the background. It can clearly show the success of the spectacle frame. Even the outline of the frame or two-point frame can reach the level of rural image processing. Diao Fu's bird's-eye view photo "Setting up as shown in Fig. 4 _ ㈣ 镜 影像 image day ± photo box that cuts off the external light, the lighting lamp of the lighting glasses 2 and the digital phase: 150 composition

The photographic box 111 and the photographic box U are composed of a lower wall panel U2, a camera receiving section 114, an eyeglass accommodating section 116, and an opening / closing door 118. The photographic box 111 is the same as the photographic box 11, and the inner surface is formed by a wall panel with a color of white system. The illumination lamp 140 uses a circular laborer. It can project the glasses from multiple directions and can shoot good shadows and reflections. Appearance of glasses = image. 15 The bird's-eye view photography device just corresponds to the inner surface and shadow of the photography IflU

As a matter of course, it is possible to perform gray processing and hue processing similar to those of the front image photographing device 10, as well as the speckles of lightness and reflections of the lenses of the glasses. The camera housing section ii 4 and the opening and closing door i 8 of the photographic phase 111 have the same structure as the front image photographing device 10, and the description of the camera 15 will be omitted here. The picture will be 20 primes, 3 million focal lengths, and the camera 15. The interface and the electric monthly bag 2 are connected to each other, and the glasses 2 are set in the glasses storage section μ. The H18 is closed and closed, and the top-down image of the glasses is photographed by remote operation of the computer fan. The computer 200 is connected to the camera 50, the camera 150, and the USB interface 28 200410037 to remotely operate the camera 50 and the camera 15 to shoot composite images and appearance glasses images to process image data. The photographed composite glasses image is processed to form composite image data. ~ 5 The computer has a function of connecting to the Internet, and sends the formed image data to the eyewear sales system 300. The computer 200 that performs the above processing can use a personal computer and a workstation having a USB interface and a network connection function. Next, the glasses 200 and image processing performed in the computer 200 will be described. 10 This processing process can be divided into three stages from the broad aspects, namely: "eyeglass image photography", "mask processing" and "data registration". First, taking the screen displayed by the computer 200 as an example, the process of registering eyeglasses images by the eyeglasses image registration system 1 will be described. Fig. 28 is a screen before "glasses image shooting" starts. On the screen, there are "front photography" and "appearance photography" buttons, which respectively issue photographing instructions to the front camera ^ digital camera 50 owned by the video device 10 and the digital camera 150 owned by the overhead video photography device ι〇〇 The captured image data is input to the computer 200 via a USB interface device. Picture 29 after "glasses image shooting" is completed. Written on the eighth 20 front and top shots. When the captured image is king, you can adjust the angle of the glasses and use the “Front Photography Heart Heart” key or “Appearance Photography” key to re-shoot. When the captured image is good, use the "one frame" key to take the next frame. Fig. 30 shows the daytime surface before the "mask processing" starts. At the "original 29 file cool" position of the wheat image, the folder of the completed glasses image is also displayed. At this time, using the "Mask creation start" key, automatic mask processing can be performed on the photographed glasses image '. Fig. 31 is a screen after the "mask processing" is completed. In the "original image" section, a front image (photographed by the front image photographing device 10) is displayed; in the "display image" section, a clipped image is displayed; in the "composition Qin image" section, it is displayed, The front image of the lens with the color (the color specified by the customer); the frame mask image (the image without the lens) is displayed in the "frame mask" section; Image (image without lens pivot). In addition, various lens colors are set in the lower left part of the screen for customers to choose. Also, in the "Eyeglass Confirmation" section, a reference image (a person's image with a pair of glasses made of a composite image and a standard person's image) is displayed. At this time, if a certain The value 'can be combined with the person's image to have an image with this transmittance value, and the position of the glasses on the face can be fine-tuned with the ▲ key until the appropriate position. When the automatic mask processing cannot be performed smoothly, use the "adjust" key to < manually edit the mask, that is, the "manual editing of the mask" function. Fig. 32 is a screen of this "manual editing of a mask". Use the "RGB Display System" key to display a composite image on the screen; use the "Translucent Nasal Mask" button on the mask to display a composite image with a translucent mask on the composite image; use the "No RGb" key , The screen will display the masked image. At this time, if the “Lens Edit” button is selected, the mask image of the lens will be used; if the “Frame Mask Edit” button is selected, the mask image of the frame will be used. 200410037 Here, if you select the "Polygon Setting" key and click on the daytime surface with your mouse, you can draw polygonal shapes on the daytime surface, so you can set the outline of the lens or frame to achieve manual mask editing. the goal of. 5 After the above process is completed, you can use “spline” to make corrections. The curve will automatically become smooth, so as to obtain a smooth mask image. Figure 33 shows the day and night before the start of "data registration". As shown on the day, the registered items are: 1. Basic items, including: product number, type of glasses, product model, color label, and brand. 2. Frame information, including: 10 male and female styles, models, colors, lens diameters, nose width, and length of temples. 3. Other information, including: prices, sales quotes, merchandise display categories, inventory management data, sales dates, customer names. Figure 34 is the screen after the "data registration" is completed. As shown on the screen, the corresponding frame is selected based on the entered product number. In the "Images" section 15, display images, frame mask images, lens mask images, composition images, and appearance images are displayed on the screen. Then select the desired item, register it with the "Login" key, and send the message to the eyewear vending system 300 via the Internet. Fig. 5 is a schematic diagram of the overall processing flow of the computer 200 during the above-mentioned registration. When the "eyeglass image shooting" operation is performed, the screen shot by the glasses is displayed (S100), and the "front photography" key (S102) is used to issue a shooting instruction to the camera 50 owned by the front photography device 10, and the captured image is captured. The image is saved as a front image (S104). At the same time, using the "Appearance Photography" 31 200410037, the camera i50, which was just owned by the bird's-eye view image capturing device, was issued on the second day. The image was saved as a bird's-eye image (s_. UU— When the "frame" button (sm) is pressed, the photography number will be updated. 21 The above steps starting from _2 are performed on the next frame of the shirt (sm). When all the photography is complete, press "End" When "Mask processing" is performed, the mask processing screen will be displayed (S116) Use the "Mask creation start" button ⑻a) to complete the shooting.

The front side reads the "Mask automatic processing (S200)" which includes the Yu mask image and the material image. 10 The order is made for the Yu mask "The image, the mirror mask f image, and the composite image (person image). "Synthetic image display processing (_). First, use the" Zhou Zheng "key to perform" manual mask editing processing "(S4⑼) on the mask image, and then perform" synthetic image display processing "on the edited mask image (S300 ) The above processing, that is, the operation from S118 can be repeated 15 times repeatedly until the "end" key is pressed (SU2).

When "data registration" is performed, the screen of data registration will be displayed (S124). The image data and glasses are registered, that is, "data registration processing" (S500). The registered data is sent to the glasses The vending system 300 saves (S126). 20 "Mask automatic processing" (S200) will be described below. Brother 6 Figure 疋 An example of the "automatic mask processing" flow. As shown in the figure, first perform "glasses peripheral detection processing" (S220), and find the outer contour of the glasses in the direction from the background to the glasses. Then, based on the outer contour of the glasses, the position of the left lens is estimated (S202), and the "lens outer 32 32 200410037 detection process" (S250) is performed on the left lens; similarly, the position of the right lens is estimated based on the outer contour of the glasses ㈣2 ), And then perform "lens peripheral detection processing" on the right lens (S250). In addition, the estimation of the position of the lens (left and right) (s202, S204) 'as described later' based on the obtained data 5 of the outer contour of the eyeglasses (S22〇) 'from the specified point to the inner side of the eyeglasses In the meantime, the starting point for detecting the outer contour of the lens is set, and based on this point, detection is started from the center of the lens to the periphery of the lens until the outer ring of the lens is detected. Then, based on the detected lens peripheral data, a φ 10 mask image of the lens is converted (S206) ', and this image is subjected to left-right comparison and correction processing (S208). The conversion of the lens mask image (S206) refers to the process of painting the image area in this data to white and the image area outside this data to black according to the data of the left and right lens periphery. -15 The left and right contrast and correction processing (S208) refers to the conversion of the lens mask image, starting from the center of the glasses, to the left and right image contrast, and removing the difference. When the difference is beyond the specified range, Cai φ determines that one of the left and right lens images has an image that deviates from the range specified by the lens peripheral data. Compare the image on the other side with the deviation of image 20 to achieve the purpose of left-right symmetry. Therefore, even when a bar code label is attached to the lens or another cover is used to prevent the peripheral detection normally, according to this method, a desired lens mask image can be obtained. In addition, based on the obtained perimeter data of the spectacles (S22o) and the perimeter data of the lenses (S250, S252), the non-formed frame material f image (s2ig) is used to perform left-right comparison and correction processing on the image 33 (S2i2). The conversion of the frame mask image (S210) refers to the process of painting white and the rest of the area in the range specified by the outer periphery of the glasses and the outer shots of the left and right lenses. When masking ―partially or completely spectaclelessly ^ where the glasses and lenses overlap, although there is an angular image (彳 is a curve) ', the contraction and expansion of the frame mask image is performed. This phenomenon can be corrected. The left and right contrast and correction processing (S212) refers to the conversion of the converted frame mask to the image 'with the center of the eyeglasses, to compare the left and right images, and to remove the different points. When the difference is beyond the specified range, it can be judged that in the #images of the left and right frames, the image of the frame deviates from the range specified by the outer material of the glasses and the outer material of the lenses. Compare the image on the other side and correct the image with deviation to achieve the purpose of left-right symmetry. Therefore, even when a bar code label is attached to the spectacles or other coverings cannot be used to detect the eyepiece or the periphery of the lens normally, according to this method, it can be converted into the desired frame mask image. FIG. 7 is a diagram showing an example of the flow of the glasses peripheral detection process (S22o). As shown in the figure, the starting point of the detection is selected first (S222). The starting point is selected. First, specific points are defined on the line from the background to the eyeglasses, and then k is selected. At the front image photographing device 10, the glasses 2 are placed at 30 'and the lenses are placed at 32, so that the position and range of the glasses in the image are limited to a certain range. Therefore, it is easy to grasp the area 4 in which the glasses are located. Starting from the periphery of the area 4, the detection processing of the glasses boundary is performed at the location of the glasses. 200410037 For example, as shown in Figure 12, the specific point of the glasses is selected from the points where the outer periphery of the glasses can be detected smoothly. According to this method, the starting points of P1 to P17 are set on the outer periphery of the eyeglass existence area 4. On the upper part of the glasses, follow the direction from top to bottom, and on the lower part of the glasses, perform 5 shots from the bottom to the top to detect the outer circumference of the glasses. Or, along the outline of the glasses, in the horizontal or oblique direction, set the candidate points to detect the outer circumference of the glasses. Before the processing of these candidate points is completed, the following steps may be repeated (S224). Lu 1〇 According to the selected starting point, the detection is performed in the direction from the background to the eyeglasses. * The boundary is detected 6). Boundary detection is to find the points that exceed the specified brightness from the brightness of each pixel on the line, and these points represent the location of the boundary. In addition, the picture frame and the picture frame part may appear brighter or darker than the background part. On this date, it is necessary to detect the change when the brightness is deep and light. 15 If the detection of the boundary cannot be performed smoothly, it is necessary to return to S222 and perform the detection processing of the glasses boundary based on another starting point (S228). When the detection of the boundary is successful, the boundary is used as the starting point, and the detection and detection processing of the boundary of the glasses is performed according to the steps with _. That is, the detected boundary data is stored in the glasses periphery database (S23〇), and it is checked whether there is a new boundary near the boundary (S232). When the detection of the new boundary is successful (S234), the new The next boundary is detected as the starting point (S236). At the end of the tracking test 70, the above steps, that is, steps starting from 823 (§238) can be repeated multiple times. As shown in Figure 13, 'Based on the current pixels, near the boundary of the detected glasses 35, select 8 adjacent points and extract the redundancy of each day element in a certain direction' to detect the new boundary Yes or no. For example, if you want to detect the presence of the right border of adjacent points, you can take out the brightness of each pixel on the right and then do it. When the next new boundary day is not checked within the specified number of rounds (S234), that is, before the "continuous checkout failure" appears on the screen, the peripheral data checked before is used, according to The principle of the approximate curve, the next boundary is estimated (S242), and the operation is repeated from S232. When the word "Continuous detection failed" appears on the screen (S240), return to S222, select the lower starting point, and perform boundary tracking processing. Refer to Figure 14 for the tracking process of the periphery of the glasses. As shown in the figure, if P3 is the starting point, when the first boundary F1 is detected, the boundary of F2, F3, F4, ... on the right side can be tracked. Chase completion (S238) refers in principle to returning to the starting point from the chase point. However, if the outer contour of the detected glasses is incomplete or defective, the detected contour may disappear. Therefore, within a certain range of the outer periphery that has been detected, continue to track and detect for a period of time. The tracking process is not complete when it is lost. When the above-mentioned chase is completed ', the deficiency of the glasses peripheral data will be corrected (S244). Because the periphery of the glasses in the image is not necessarily captured very clearly, S244 is used to repair the parts that cannot be detected by the glasses boundary detection processing (S226) and the glasses boundary tracking processing (S230 ~ S238). Based on the detected peripheral data of the glasses, the principle of the approximate curve is used to calculate the missing peripheral data to achieve the purpose of correction. 200410037 Next, the irregularities (protrusions) on the image will be removed based on the perimeter data of the glasses (S246). This treatment is performed for irregularities caused by coverings (such as bar code labels) covering the background. For example, compare the detected perimeter data of the glasses with the estimated perimeter data (using the principle of 5-curve approximation). Sections outside the specified distance range are considered to be irregular. At this time, the estimated data will replace the original measured data to achieve the purpose of removal. Finally, the peripheral data of the glasses will be rounded (S248). This processing is performed for unevenness caused by uneven brightness at the boundary portion. For example, the average value of the coordinate data within a certain range before and after is used to replace the coordinate data 'to achieve the purpose of smooth processing. Or change the estimated curve position to achieve this purpose. In addition, when pointed out, the corners of the glasses need not be smoothed. 15 Fig. 8 is an example of the flow of the lens peripheral detection processing (S250, S252). As shown in the figure, the selection of the starting point of lens boundary detection is first performed (S254). According to the aforementioned glasses peripheral data, from the specific points of the glasses, extract the data associated with the left and right lenses, and then based on the size range of the frame, use the position inside the range as a candidate point, and select the starting point for detection from it. As shown in Fig. 12 and Fig. 20, the starting point P2, P3, P4, Pll, P12, and P13 of the boundary detection of the glasses is associated with the left lens, and the corresponding Q2, Q3, Q4, Qll, Q12, and Q13 are left. Candidate points for the starting point of lens boundary detection: Similarly, the starting points P6, P7, P8, P15, P16, P17 of the edge detection of glasses are associated with the right lens, and the corresponding Q6, Q7, Q8, Q15, Q16, Q17 are used as Right lens 37 200410037 Candidate point for starting point of boundary detection. Then, a start line 6 for the left lens boundary detection is set inside the left lens, and a start line 8 for the right lens boundary detection is set inside the right lens. The edge detection starting point of the lens can also be selected from any position of these lines. 5 In the upper part of the lens, go from top to bottom, and in the lower part of the lens, go from bottom to top. Or, the method of setting the candidate points in the horizontal direction or the oblique direction along the shape of the glasses is used to detect the periphery of the lens. In addition, it is the same as the detection process of the outer periphery of the glasses (S22〇). Before the processing of these candidate points is completed, the following steps can be repeated (S256). Starting from the detection starting point, pressing from the frame part to Boundary detection is performed in the direction outside the lens (S258). The detection of the boundary means that, from the brightness of each day element on the line, the points exceeding the prescribed brightness are found, and these points represent the location of the boundary 15. In addition, the frame part may appear brighter or darker than the background part. At this time, it is necessary to detect the change caused when the brightness is darker and lighter than the frame part. When the detection of the boundary cannot be performed smoothly, it is necessary to return to S254 again, and perform the detection processing of the spectacle boundary based on another starting point of the spectacle boundary detection (S260). 20 When the detection of the boundary is successful, the boundary is used as a starting point, and the tracking and detection processing of the lens boundary is performed according to the following steps. That is, the detected boundary information is stored in the glasses peripheral database (S262), and it is checked whether there is a new boundary near this boundary (S264). When the detection of the new boundary is successful (S266), the new The boundary is detected as a starting point (S268). Before the tracking is completed, the above step 38 200410037 step, that is, the step starting from S262 (S270) can be performed multiple times. As shown in Fig. 13, based on the current daylight element, eight adjacent points are selected near the detected lens boundary, and the brightness of each daylight element is taken in a certain direction to detect the presence of a new boundary. For example, if you want to detect the presence of the right border of the adjacent point 5, you can take out the brightness of each pixel on the right and you can do it. When the next new boundary is not checked within the specified number of rounds (S272), that is, before the word "Continuous detection failed" appears on the screen, the peripheral data checked before is used to approximate the curve Principle, the next boundary is estimated (S274), and the operation is repeated from S264. When “Continuous detection failure” appears on the screen (S272), return to S254, select the next lens boundary detection starting point, and perform boundary tracking processing. Refer to Figure 14 for the tracking process of the lens periphery. As shown in the figure, if at the left lens 'Q3 is the starting point' at the first boundary to be detected, the boundary on the right 1 ^ 2, 13, 1 ^ 4, ~ can be tracked. 15 Chase completion (S27〇) ‘In principle, it means that when you return to the starting point from the tracking point. However, if the outer contour of the detected glasses is incomplete or incomplete, the detected contour may disappear. Therefore, within a certain range from the outer periphery that has been detected, continue to track for a period of time. , Tracking processing is complete. 20 When the above tracking is completed, the deficiency of the lens peripheral data will be corrected (S276). Because the chef of the lens in the image is not necessarily captured very clearly, Hunan S276 supplements the parts that cannot be detected by the lens boundary detection process (s25_ lens boundary tracking process (S262 ~ S27〇). According to the inspection The perimeter data of the glasses is based on the principle of approximate curve, 39 is used to estimate the lack of material, and the purpose of _phase correction. Next, the perimeter data of the lens (protrusion removal treatment_) will be used. This place = covered cover (Such as the lens knife mouth lens P knife. For example, for 屮, [type code label) and irregular materials starting from 5 丨 line approximation: the second peripheral data and the principle of the estimated foreign capital) By comparison, if it exceeds the rule, it is an irregular part, and the estimated asset = the purpose of clearing the original measurement data on 1 axis. 10

Finally, the lens peripheral data will be rounded (0). This processing is aimed at the unevenness caused by the uneven brightness of the boundary part. For example, the average value of the coordinate data within a fixed range after w is used to replace the talent data to achieve dj slip processing. purpose. Or change the estimated curve position to achieve this purpose.

Fig. 9 shows an example of the flow of the synthetic image display processing (S300). As shown in FIG. 15, first, the screen is processed using a mask, and the customer is asked to input a desired lens color and lens transmittance (S302). Then, the specified color is applied to the lens mask portion in the front image to generate a colored image (S304), and the front image, bird's-eye image, composition image, frame mask image, and lens are displayed on the screen. Mask the image (S306). In addition, the customer can specify a desired position using the mouse 20, and S310 adjusts the positions of the frame mask image and the lens mask image according to the designated position. Then 'use S312 to extract the previously saved person image, use the frame mask part in the person image to replace the composite image, use S316 to set the specified color and transmittance in the lens mask part of the person image, and finally use 40 200410037 S318 This slow-synthesized character image is displayed on the screen. The above process' can use the "Resynthesis" key to repeat the operation steps from S302 (S320). After the operation, press the "End" button. Fig. 10 is an example of a mask manual editing process flow (s400). As shown in Figure 5 ', the position where the mouse clicks is first obtained by using S400, and S400 performs curve processing on the frame according to this position. This step from step 2 can be repeated before setting (S406). Click the "Set" button. The above-mentioned curve processing results will be stored in the glasses periphery database or lens periphery database (_8), and then the lenses will be generated based on the data stored in the glasses periphery database or lens periphery database. Mask image (S410) and frame mask image (8412). This generation method is the same as the aforementioned mask automatic processing method of S206 and S210. The steps from S210 can be repeated several times (S414) until the "End" key is pressed. 15 Figure 11 shows an example of the flow of data registration processing. As shown in the figure, by using the "Login" key (S502), data of "basic items" (S504), "frame information" data (S506), and "other information" data (S508) can be obtained. In addition, at the time of registration, the front image, bird's-eye image, composition image, mirror busy image, lens mask image, and glasses are registered together (S510). The steps from S502 can be repeated several times until the "End" key is pressed (S512). The process of selling eyeglasses in the image registration system of this invention will be described below. 41 As shown in Fig. 1, the eyewear registration image system 1 is connected to the eyewear sales system through the Internet, and the data generated by the eyewear image registration system 1 is sent to the eyewear sales system 300 for use at the time of sale. The glasses selling system 300 is composed of a database server 31 (recording information about glasses styles, catalogs, and image data transmitted from the computer 200), an application software server 320 (providing application service for glasses selling), and a web server 330 (an interface device connected to a customer's computer) and a protector 340 for preventing invasion of viruses. The customer uses a web browser to browse on the system's web server 330, and purchases glasses based on the information provided by the database server 310. The customer selects glasses on the Web server 330, and the selected glasses images are displayed on the daytime. Moreover, if a face image captured with a digital camera is input to the screen, the application server 32? The provided application can synthesize the face image of wearing glasses and display it on the screen for customers to confirm. The processing of this composite image has been described previously. That is, steps S312 to S318 of the composite image display process (S300). In this way, customers can buy the eyeglasses they are satisfied with in their own home, without having to go through the eyeglasses store, or worry about the availability of the inventory (whether it is in stock). The eyewear manufacturing department will mail it directly to the door. In addition, because the glasses produced can be sold quickly through online sales, the I1 cow has a low cost, and it can provide customers with a variety of low-priced glasses. In front, the bird's-eye view photography device 100 And frontal video photography device 200410037 Η) were introduced as two separate devices. In fact, these two devices can also be combined and used. ίο In the front, the computer 200 and the overhead video shooting device 100 / frontal video shooting device 10 are introduced as devices with different functions. In fact, a small-sized interior of the frontal video shooting device can be installed inside the deleted video viewing device. A computer, and use it to complete the image processing function or the communication function with the glasses weaving system (that is: not-the computer must be completed to complete the former "ship"). In this way, it is very simple for Wei Jing Manufacture Factory to install the glasses image registration system. The camera device is connected to Lai Lu to complete the communication with the glasses selling system, thereby achieving the purpose of online sales. In the foregoing implementation state, the method of connecting the computer of the "glasses image registration system" with the glasses sales system through the Internet has been introduced. In fact, it is not necessary to use a private dedicated line such as a dedicated return line or a public telephone return line. The connection is completed through the intermediary of these lines. 15 In the foregoing implementation state, a method of taking pictures with a digital camera was introduced. This material can only be used with a digital W-camcorder, and you can also use a video camera or video camera. It is possible to further reduce the size of the front-view camera / top-view camera 100. 20 In the foregoing state, Qian Qian's method of lighting was introduced. The hairline can only be used with Deng Qiqing, shirt shadow classic eyeglasses, and can also use f-pass lighting. In the foregoing implementation state, the _㈣㈣㈣㈣ method has been introduced. This translation can not only be used to perform work, but also use a plurality of rod-shaped and ㈣ lights to illuminate. Because of this, 43 200410037 can improve in a wide range and reduce the image SL. ‘,,,’ So it ’s not easy to have shadows. From the same time, not only can the photos that are full of light flash at the same time. Bright lights can also be used with the photo 5 10 15 In the aforementioned implementation state, the first lens performs a full range of Langche two glasses shooting. In order to be able to perform gray processing and tonal gradation on the eyes, the image appears in the photo box. The method of lighting, adjusting the intensity of light, etc. to achieve the use of scattered in the front, although omitted, clear. However, for the pre-processing performed on the necessary image, it is best to add the following processing. ① & Eliminate the unevenness of the light and carry out the treatment ① For the shoulder, ^ order the front line correction processing. ② Remove the noise 杂 __ processing (to make the outline clear). This makes the shading smoother. In the foregoing embodiment, the boundary tracking processing of the glasses / lenses is described after the boundary detection processing of the glasses / lenses is completed. This invention can not only perform the tracking process, but also the detection result of the glasses / lens boundary detection process.

Periodic analysis, repairing the incomplete part, so as to obtain complete peripheral data of glasses / lenses.

In the foregoing implementation state, the lens boundary detection process was introduced (from the brightness of each of the 20 celestial lines on the line, the points exceeding the predetermined brightness were taken to obtain the lens boundary data). The invention can also find out the distribution of the intensity of the entire image or a specific part of the image, and determine the degree between the background part, the eyewear part, the frame part, and the seat part according to the car-master method and the discrimination method. Limit value to obtain the lens boundary data. Or, first, obtain the approximate boundary data through a wide range of brightness distribution range 44 200410037, and then search the brightness distribution based on this data in a smaller range to obtain stricter limit data, that is, the so-called step limit value Setting method. In this way, it is also possible to detect the boundary value of images that are difficult to distinguish between light and dark. 5 The methods that can be used include: the method of detecting the boundary value according to the smoothness of calculus processing, limit value processing, and thinning processing. In the aforementioned implementation state, a single process (without consideration of the type of the glasses) for the detection of the periphery of the glasses / lenses was described. In addition, based on the information about the type of glasses obtained during the mask processing, and according to the type of glasses, the peripheral detection process of the glasses / lenses may be performed. For example: "Mask processing" shown in Figure 35 on the day, in the "individual mask reconstruction" section, there is a key to select the type of glasses, when the customer (computer operator) judges that the automatically generated mask does not match In the actual situation, you can use the "glasses type selection" key to retrieve the registered glasses type data, and you can perform 15 mask regeneration operations. On the same day, in the processing flowchart shown in Figure 5, Mα judges whether or not the "glasses type selection key" is used, and the type information of the glasses registered in advance in the "glasses type selection key" in the temple is pre-registered. Based on this data, the brightness limit value of the glasses / lens boundary detection process was changed by 20, and then returned to S200 for automatic mask processing. Or change the detection range of the periphery of the glasses / mirrors for automatic mask processing. Because according to this method, it is possible to detect more accurate glasses / lens peripheral data for different types of glasses, so even if the automatic mask processing fails, the customer (computer operator) can use the "glasses type selection" 45 200410037 The auxiliary function of the select button is used to regenerate the mask. In addition, when the edge of the glasses / lens is used as a reference; m bite ... When the brightness is used as the test for drought ingression, the brightness of the glasses ^ ^ ^ is different, and the brighter limit value is used to enter the boundary. Detecting process: When performing according to other methods, the needle = different, judgment method or various standards, and the boundary is fixed. Manual editing of the grass cover (according to the point pointed by the mouse, enter the peripheral data EDIT) method explained. At the same time, you can also use the mouse to drag and modify a part of the peripheral data generated by the automatic processing of the mask to complete the editing of the mask. In the foregoing implementation state, the data registration method performed in the computer 200 was introduced. The invention can also directly register data on the database server 310 of the eyewear vending system 300 through the Internet. 15 20 In the description of the implementation state, the "data registration process" (input of basic items such as product numbers and models by customers, input of frames and other materials) was explained. This invention can also use the OCR function of the strip digital reader or the computer 200 to directly grab the strip digital attached to the lens to complete the registration of part or all of the above. Then, from these materials, information about the frame / lens shape is extracted, and the peripheral detection process of the frame / lens is performed based on this data, and the results of the peripheral detection process are searched in a more narrow range. According to this method, boundary detection processing can be performed with respect to the shape of the glasses, so that mask processing with higher reliability can be performed. Possibility of industrial use 46 200410037 Based on the above, the invention has a function of photographing glasses, a function of generating synthetic images, and a function of registering synthetic images and glasses data, so no matter when anyone is According to this invention, you can obtain synthetic images of people quickly and at a low price. 5 [Brief Description of the Drawings] Fig. 1 is a configuration diagram of an image registration system according to an embodiment of the present invention. Fig. 2 is a schematic diagram of a front image photographing apparatus of an image registration system according to an embodiment of the present invention. 10 FIG. 3 is a schematic diagram of a front image photographing device of a glasses image registration system according to an embodiment of the present invention. Fig. 4 is a schematic diagram of a bird's-eye view image capturing device of an image registration system according to an embodiment of the present invention. Fig. 5 is a flowchart of the overall processing of a computer of the glasses image registration system 15 according to an embodiment of the present invention. Fig. 6 is a processing flow chart related to an embodiment of mask automatic processing. Fig. 7 is a flowchart of a process related to an embodiment of the glasses peripheral detection process. Fig. 8 is a flowchart showing a process related to an embodiment of the lens peripheral detection process. Fig. 9 is a flowchart of a process related to an embodiment of the composite video display process. Fig. 10 is a flowchart of a process related to an embodiment of the manual editing process of masks. Fig. 11 is a flowchart showing a process according to an embodiment of the data registration process. FIG. 12 is an explanatory diagram of the starting point of the detection processing of the outer periphery of the glasses. 5 Fig. 13 is an explanatory diagram of a point near the boundary tracking processing of glasses and lenses. Fig. 14 is an explanatory diagram showing a boundary tracking process of glasses and lenses. FIG. 15 is a schematic cross-sectional view of the front image capturing apparatus 10 according to an embodiment of the present invention in the long-hand direction. Fig. 16 is a schematic diagram of glasses viewed from the camera side of a front image photographing apparatus according to an embodiment of the present invention. Fig. 17 is an explanatory diagram showing the principle of illumination for clarifying the outline of glasses. 15 Fig. 18 is an explanatory view showing the effect of illumination for clarifying the outline of glasses. Fig. 19 is an explanatory diagram showing an example of gray processing performed on the inner surfaces of the wall plates 22 and 23 on the side surfaces of the eyeglass storage section of the front image photographing apparatus according to an embodiment of the present invention. 20 FIG. 20 is an explanatory diagram showing an example of gray processing performed on the inner surface of the rear wall plate 25 of the front image photographing apparatus according to the embodiment of the present invention. Fig. 21 is an explanatory diagram showing an example of the gradation process performed on the inner surface of the front wall 20 of the camera housing portion of the front-surface imaging device of one embodiment of the present invention. Fig. 22 is an explanatory view showing an example of black processing performed on the inner surface of the wall plate 28 on the upper surface of the opening and closing door of the front-side image capturing apparatus according to an embodiment of the present invention. 5 FIG. 23 is an explanatory diagram of an example of gray processing performed on the inner surface of the rear portion of the lower wall panel 12 of the front surface image capturing apparatus according to an embodiment of the present invention. Fig. 24 is a frame for capturing an image of a metal frame with a front image photographing apparatus according to an embodiment of the present invention. Fig. 25 is an example of an image of a plastic spectacle frame captured by a front image camera according to an embodiment of the present invention. Fig. 26 is an example of an image of a plastic spectacle frame captured by a front image camera according to an embodiment of the present invention. Fig. 27 is an example of a two-point spectacle frame image captured by a front-view image capturing device according to an embodiment of the present invention. FIG. 28 is an example of a display surface (before the start of photography) of the glasses image photography. Fig. 29 is an example of a display surface for photographing glasses (after the photographing is finished). Fig. 30 shows an example of the display surface during the mask processing (before the processing is started). Fig. 31 shows an example of a display surface during mask processing (after the processing is completed). 20 Figure 32 is an example of a display surface edited manually with a mask. Fig. 33 is an example of a display screen of the registration data (before registration starts). Fig. 34 is an example of a display screen for data registration (after registration is completed). Fig. 35 is a modification example of the display surface in the mask processing. 49 200410037 [Representative Symbols of Main Components of the Schematic] 1 ·· Glasses image registration system 32… Glass pedestal 2… Glasses 40, 140 ··· Lights 10 ... Front image photography devices 50, 150 ... Digital cameras 11, 111 ··· Photographic box 52 ... Power sockets 12, 112 ... Bottom wall plate 54 ... · Power switch 14, 114 ... Camera storage unit 56—USB sockets 16, 116 ... Glasses storage unit 100 ... Overview image photography device 18, 118 ... Opening and closing door 200 ... Computer 20 ... Front panel 300 ... Glasses sales system 21 ... Mirror hole 310 ... Database server 22, 23, 26, 27 ... Side panel 320 ... Application software server 24, 28 ... Top wall panel 330 ... Web server 25 ... Back wall panel 30 ... Shelf 340 ... Protector 50 against virus invasion

Claims (1)

200410037 Patent application scope: 1. A glasses image registration system, including: a photographing device for photographing the glasses; a production ~ image generating device, which can generate a 5-shirt glasses image and a person image using the aforementioned photographing device A synthesized image for synthesizing; and a registration device for simultaneously registering the synthetic image generated by the aforementioned synthesizing image generating device and the glasses. 2 · If the scope of patent application is the first! The glasses image registration system of the item, wherein the aforementioned photographing device includes: a lighting device with an openable door and which can accommodate the glasses to be photographed. Lu 10 photography ~ ♦ head 'for &; And an imaging device for photographing the glasses contained in the aforementioned photography box to obtain glasses-like shirt material, and the glasses image registration system stores the glasses of the right-handed shirt in the aforementioned photography box, and closes the door to Those who take glasses images. The spectacle lens multi-image registration system of Shoukouyue's patent scope item 1 or 2, wherein the aforementioned photography device has a front image photography device that captures the front image of the glasses. φ The spectacle image registration system of item i of the patent application or item 2 of the patent application scope, wherein the aforementioned photography dress is provided with a bird's-eye image photographing device that captures the image of the ship's shadow 20 of the glasses. 5 · = Apply for the glasses image registration system of item 丨 in the above range, wherein the above-mentioned shirt image generating device has a mask generating device using a matte material, and the mask contains: used to specify the aforementioned glasses image taken Brother's busy frame mask image; and the lens mask image used to specify the lens portion of the aforementioned captured eye 51 200410037 mirror image. 6. The eyeglass image registration system of item 5 of the scope of patent application, wherein the aforementioned mask generating device has: an eyeglass periphery detection device for detecting the outer periphery of the eyeglasses of the eyeglasses image captured; and an eyeglass detection device for detecting 5 The lens periphery detection device on the outer periphery of the lens of the taken glasses image, and the lens periphery detected by the lens periphery detection device and the lens periphery detected by the lens periphery detection device generate the aforementioned frame mask. The mask image 10 has a function of generating the lens mask image by the outer periphery of the lens detected by the glasses outer periphery detection device. 7. The spectacle image registration system of item 6 of the patent application, wherein the aforementioned spectacle peripheral detection device has a spectacle edge 15 boundary detection device for detecting the rim of the spectacle from the background portion of the captured spectacle image toward the spectacle portion. The aforementioned lens peripheral detection device includes: a lens portion estimation device for estimating a lens portion from the outer periphery of the glasses detected by the aforementioned lens peripheral detection device; and a lens portion facing the lens from the lens portion estimated by the lens portion estimation device. 20 lens boundary detection devices which detect the lens boundary in the peripheral portion. 8. The eyeglass image registration system of item 7 of the patent application scope, wherein the aforementioned eyeglass peripheral detection device has a method for sequentially detecting and tracking nearby eyeglass boundaries based on the eyeglass boundaries detected by the aforementioned eyeglass boundary detection device as a starting point. Lens boundary tracking device, 52 Biqiao bismuth output device has the lens boundary lens, IW in order to detect and trace the size of the lens boundary according to the ^^ ^ ^, sibling edge detected by the aforementioned lens boundary detection device, IW 9 lens boundary tracking device for the edge of the lens. ^ Fu Qing 6 and 7 follow the canning system, and its exterior = & mirror detection I set has: glasses peripheral peripheral completion device for complementing the detected part of the week, 10 = The lens peripheral detection device includes a lens peripheral completion device for complementing the detected part of the previously detected lens ::. The items specifically covering items 6, 7, or 8 are just like detailed systems. 10 'The aforementioned lens periphery detection device includes a lens irregularity removal device for removing irregular protrusions on the periphery of the front main lens. Men now 11 = Patent π Patent _ The 6th and 7th things are described in the image plane. The mask generating device has a device for acquiring glasses type information, glasses type information, and σ'im glasses phase detection device and / or the foregoing. Lens periphery 4: The device is equipped with a device for obtaining information according to the aforementioned eyeglass type information. ^ The known eyeglass type is poor to detect the outer periphery of the eyeglasses and / or the outer periphery of the lens. 53 Function 12: Such as the scope of the patent application,戍 or 8 items of eyeglass image registration system, grass image and / read Γ Yes · For the above-mentioned generated frame to cover 5 frames / lens contrast age compensation, the lens mask image, the left and right lens 13. If the application is fine == Uh ... Wherein, the aforementioned mask generates a spectacle image registration system of ^ item 'u point data kiss :: = 10 specified by the device · =: spectacle image registration system of the range 5, 6, 7 or 8 item, month j The image generating device for the heart is provided with a composite display device that synthesizes and displays the readings of the characters that have been registered in advance and the glasses images taken in the foregoing. 15. If the spectacles image ageing system of item 14 of the scope of patent application, the aforementioned synthetic display device has the function of specifying the lens color and transmittance of the spectacles image synthesized with the person's image. The spectacle image registration system of item No. 14 of the patent claim, wherein the aforementioned oral display device has a function of adjusting the position of the spectacle image synthesized on the person's image. P. The spectacle image registration system according to item 5, 6, 7, or 8 of the scope of patent application, wherein the A registration device has a reading device for reading a label provided on the lens portion of the previously ingested glasses. 18. The spectacle image registration system according to item 5, 6, 7, or 8 of the scope of application for a patent, wherein the aforementioned registration device has a communication device that sends information registered using the aforementioned registration device to an eyewear sales system. 54 19.200410037 A method for registering glasses images, comprising: a step of photographing the images of glasses; a step of generating the captured glasses image and a figure of a person into a shirt; and a combination of image 5 The method for registering the glasses image registration method of item t__19 in item% __ 19 has a step of generating a mask, and the mask = the mirror of the frame portion of the captured glasses image: ... mask image and the glasses used to specify the previously captured glasses The lens adjacent to the image masks the image. # 15 21. If the method for registering eyeglasses images in the 2G item of the patent application, wherein the step of generating a mask includes: detecting the outer periphery of the eyeglasses of the previously acquired eyeglass images; detecting the lenses of the previously acquired eyeglass images Steps of the outer periphery; steps of generating the frame mask image from the detected periphery of the glasses and the detected lens periphery; and a step of generating the lens mask image from the detected lens periphery. 22. The method for registering spectacles images according to item 21 of the patent application, wherein 20 The step of detecting the outer periphery of the glasses includes the step of detecting the eyeglass boundary of the eyeglass boundary from the background portion of the captured eyeglass image toward the eyeglass portion. The step of detecting the outer periphery of the lens includes: The step of estimating the lens portion on the periphery of the detected glasses, and the step of detecting the lens boundary from the estimated lens portion toward the peripheral portion of the lens. 23. The eyeglass image registration method according to item 22 of the scope of patent application, wherein the above-mentioned step of detecting the outer periphery of the eyeglasses of 2004200410037 includes sequentially detecting and tracking the vicinity of the vicinity using the boundary detected in the step of detecting the boundary of the glasses as a starting point. The step of glasses boundary, and the step of detecting the outer periphery of the lens includes the step of sequentially detecting and tracking the lens boundary of the nearby lens boundary based on the boundary detected by the step of detecting the lens boundary as a starting point. 24. If the method for registering eyeglasses images in the scope of patent application No. 21, 22 or 23, wherein the step of detecting the outer periphery of the eyeglasses includes the step of completing the incomplete part of the outer periphery of the eyeglasses detected as described above, The step of the lens periphery includes the step of completing the missing portion of the lens periphery detected as described above. 25. If the method for registering spectacle images according to the scope of patent application No. 21, 22 or 23, wherein the step of detecting the outer periphery of the glasses includes the step of removing the irregular protrusions on the outer periphery of the detected glasses, and the aforementioned detection lens The outer periphery step includes the step of removing the irregular protrusions on the outer periphery of the detected lens. 26. If the method for registering eyeglasses images according to item 21, 22 or 23 of the scope of patent application, wherein the aforementioned step of generating a mask includes the step of obtaining information on the type of eyeglasses, the step of detecting the outer periphery of the eyeglasses and / or the aforementioned eyeglasses The step of the outer periphery includes the step of detecting the outer periphery of the eyeglasses and / or the outer periphery of the lens by making use of the glasses type information obtained above. 27. If the method for registering eyeglasses images according to item 20, 21, 22, or 23 of the scope of the patent application, wherein the aforementioned step of generating a mask includes masking the image of the previously generated 56 5 frame and / or masking the previous red Image correction steps for left and right frames / lenses. 28. The method for registering spectacle images according to the scope of patent application No. 20 U, 22 or 23, wherein the aforementioned step of generating a mask includes a step of editing the mask by using point data specified by a calibration device. 29. For example, the method for registering eyeglasses images in the scope of patent application No. 20, 21, 22 or 23, wherein the aforementioned step of generating a synthetic image includes the steps of synthesizing and displaying a previously registered image of a person and the aforementioned captured eyeglasses image. 10 30. The spectacle image registration method according to item 29 of the scope of patent application, wherein the aforementioned display step includes a step of specifying a lens color and transmittance of a spectacle image synthesized with a person image. 31. The eyeglass image registration method according to item 29 of the patent application scope, wherein the aforementioned display step includes a step of adjusting the position of the eyeglass image synthesized on the human image. 15 32. The method of registering spectacles images according to item 20, 21, 22, or 23 of the patent application scope, wherein the aforementioned registration step includes a step for reading a label provided on the lens portion of the previously ingested glasses. 20, compared with 33. The method for registering eyeglasses images according to the scope of patent application No. 20, 21, 22 or 23 ', wherein the aforementioned registration step includes a step of transmitting the data registered by the aforementioned registration step to the eyewear sales system. 57