KR20090036400A - Image Search System and Its Search Method - Google Patents

Abstract

The present invention relates to an image retrieval system and a method thereof, comprising: an area setting unit configured to set an image display area of an electronic map by using an electronic map including an image having location information and user information; An image detector which detects images belonging to the set display area; A location classifying unit classifying the detected images for each location on the electronic map; A user information analyzer for analyzing user information of the images classified by the positions; And an icon providing unit for giving an icon to images classified for each location according to the analyzed user information.

Description

Searching system for image and the method of the same}

The present invention relates to an image retrieval system and a method thereof, and more particularly, to an image retrieval system and method that can classify and display user information for images belonging to a predetermined area on an electronic map.

With the development of communication means such as the Internet, netizens around the world can share various information with each other.In the case of images such as photographs, they can upload images they have taken to websites that can share images. You can share.

On the other hand, sites that can share such images are provided with a service that provides convenience when searching for an image by displaying the images on a predetermined electronic map using location information included in the image when the image is uploaded. .

FIG. 1 illustrates a part of a screen on which an image is displayed as an icon on an electronic map by using location information of images uploaded by users in Flickr, an example of an image sharing site. According to the drawing, since the icons 2 corresponding to the images included in the predetermined area of the electronic map 1 are displayed in different sizes according to the number of images, or the number of images is displayed on the icons, You can see the distribution of images uploaded in the area.

However, in the case of displaying the image information included on the electronic map 1 in the above manner, since it is not possible to know by whom the images represented by the icon 2 have been uploaded, the user can In order to search for a picture uploaded by a user or a picture uploaded by a person related to the user, it is difficult to efficiently search for an image, such as having to search for an image by clicking all icons.

The present invention is to solve the various problems including the above problems, by displaying images belonging to a predetermined region on the electronic map by a different icon according to the user information, it can be displayed by whom uploaded images An image retrieval system and method thereof are provided.

The present invention provides a system for searching an image using an electronic map including an image having location information and user information, comprising: an area setting unit for setting a display area of the electronic map; An image detector which detects images belonging to the set display area; A location classifying unit classifying the detected images for each location on the electronic map; A user information analyzer for analyzing user information of the images classified by the positions; And an icon providing unit for giving an icon to images classified for each location according to the analyzed user information.

According to another feature of the invention, the user information analysis unit, whether the image included in the images classified by the location is uploaded by the user himself or not whether the image uploaded by the person associated with the user on the system Can be analyzed.

According to another feature of the present invention, the icon assigning unit includes an image uploaded by a person associated with the user on the system when the image uploaded by the user is included among the images classified by location. In this case, and when the user and the image uploaded by the user associated with the user on the system are included, an icon may be assigned to the images classified by the locations so as to be distinguished in each case.

According to another feature of the present invention, the system may further include a thumbnail image classification unit for displaying a thumbnail image classified according to the analyzed user information together with the icon on the electronic map.

The present invention also provides a method for searching for an image in a system for providing an electronic map including an image having location information and user information, comprising: (a) setting a display area of the electronic map; (b) detecting images belonging to the set display area; (c) classifying the detected images by location on the electronic map; (d) analyzing user information of the images classified by location; And (e) assigning an icon corresponding to the analyzed user information to the images classified by location.

According to another feature of the present invention, the step (d) is whether the image included in the images classified by location is uploaded by the user and whether the image is uploaded by a person associated with the user on the system. Can be analyzed.

According to another feature of the present invention, in the step (e), if the image uploaded by the user is included among the images classified by location, the image uploaded by the person associated with the user on the system is displayed. If included, and if the image uploaded by the user and the person associated with the user on the system is included, an icon may be assigned to the images classified by the locations so as to be distinguished in each case.

According to another feature of the present invention, the step (e) may display a thumbnail image classified according to the analyzed user information together with the icon on the electronic map.

According to the image retrieval system and method of the present invention made as described above, by displaying the information on the images belonging to the predetermined area on the electronic map with different icons according to the user information, not only the distribution of the images for the set area For example, it is possible to provide a convenience to the user when searching for an image by clearly indicating who the images are uploaded to. In addition, by providing a thumbnail image classified according to the user together with an icon classified according to the user information, it is possible to quickly search for the image required by the user.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is a schematic block diagram of an image retrieval system according to an embodiment of the present invention.

The image retrieval system according to the present invention executes a command requested by the image retrieval apparatus 110 by communicating with the image retrieval apparatus 110 and an image retrieval apparatus 110 capable of processing and performing a signal input by a user. It may be applied to a system including a server 120 capable of processing. In addition, the image retrieval system according to the present invention is not limited to the above-described configuration, and may be performed by the image retrieval apparatus 110 alone without the help of the server 120. Hereinafter, an exemplary embodiment of an image retrieval system including an image retrieval apparatus 110 and an image sharing server 120 as a server 120 will be described in detail.

Referring to the drawings, the image retrieval apparatus 110 according to the present embodiment includes a user input unit 111, a storage unit 112, a display unit 113, a first communication unit 114, and a first control unit 115. do.

The user input unit 111 is a means input to the image retrieval apparatus 110 so that the image retrieval apparatus 110 can perform an overall operation. And a button for selecting the displayed icon.

The storage unit 112 may store an algorithm for processing the image of the image retrieval apparatus 110 or store setting data necessary for a process operation of the image retrieval apparatus 110.

The display unit 113 displays the results performed by the search system to the user, such as displaying a display area set on the electronic map or icons classified according to the user information.

The first communication unit 114 serves to transfer a signal between the image retrieval apparatus 110 and the image sharing server 120.

The first controller 115 performs an overall operation of the image storage device 110. The first controller 115 transmits user information of a user accessing the image sharing server 120 to the image sharing server 120, controls the display area of the map selected by the user to be transmitted to the image sharing server, and shares the image. The icons on the electronic map received from the server 120 are controlled to be displayed on the display unit 113.

The image retrieval apparatus 110 as described above is not limited to any type of device that can process and display a signal input by a user, such as a digital camera, a cam code, a mobile phone, or a personal digital assistant (PDA). Can be applied without

The image sharing server 120 according to the present embodiment includes an area setting unit 121, an image detecting unit 122, a location classifying unit 123, a user information analyzing unit 124, an icon providing unit 125, and a second communication unit. 126 and a second control unit 127.

The area setting unit 121 sets a display area on an electronic map that a user wants to search on an electronic map including images having location information and user information. The user may set an area to be searched by dragging a specific area on the electronic map by using a mouse or by using zoom in, zoom out, and move buttons.

In this case, the electronic map to which the present invention is applied may be applied to the present invention regardless of its name as long as it provides digitized geographic information. In addition, images are mapped on the electronic map, which includes location information and user information about the image.

In addition, the location information of the image may include GPS information received from the GPS satellites in the image file according to the Exif protocol, or may be generated by a user manually mapping the image to an electronic map. Regardless of whether it is mapped to an electronic map provided by the image retrieval system and includes location information, it can be applied without limitation.

The image detector 122 detects images belonging to the display area of the electronic map set by the area setting unit 121. Using the location information of the images mapped to the electronic map and the location information of the display area of the electronic map set by the area setting unit 121, the images included in the area to be searched by the user are detected.

The location classifying unit 123 classifies the images detected by the image detector 122 by dividing the images by location on the display area of the electronic map set by the area setting unit 121.

For example, the location information of the images may have precise data including latitude and longitude up to a unit of degrees (°), minutes ('), and seconds (″) in the case of GPS information. Electronic maps may also be expressed in units of degrees (°), minutes ('), seconds (″) or, in some cases, less precise units. At this time, the display area of the electronic map displayed on the display unit 113 by the area selector 121 has a different scale according to the area of the displayed area. In other words, a large area can be roughly displayed with a large scale, or a small area can be finely displayed with a small scale.

The location classifier 123 classifies images belonging to a predetermined area according to the scale of the displayed electronic map. For example, if the scale is large and a large area of the electronic map is roughly displayed, the electronic map is divided into degrees, and the images each having location information belonging to the divided area are classified. When the small area of the electronic map is small and displayed in detail, the area of the electronic map is divided by the minute (') or second (″) and the images having the location information belonging to the divided area are classified.

The user information analyzer 124 analyzes the user information of the images classified by the location in the predetermined region of the electronic map by the location classifier 123. For example, if three images are included in a predetermined area of the electronic map, user information of each of the images is analyzed, and if one image is included in another area, user information of the image is analyzed in order.

The user information is information representing the uploader of the images included in the electronic map. The user information analyzer 124 analyzes the user information included in the images so that the image is currently connected to the image sharing server ( In step 120), the user analyzes whether the user uploaded the image or whether the user uploaded the image. Here, the user associated with the user is a person who has designated the user to allow the image sharing to share the image uploaded by the user on the image sharing server 120, or with the user in a specific manner on the image sharing server 120 The system may be set in various ways such as a person having a specific relationship on the system (for example, a case of establishing a village relationship in a cyworld).

The icon assigning unit 125 assigns an icon corresponding to the analyzed user information to a group of images classified by locations by the location classifying unit 123 using the user information analyzed by the user information analyzing unit 124.

For example, as described above, the image classified by location includes an image uploaded by the user, an image uploaded by a person associated with the user, and the user and the user. Each of the cases in which the uploader includes the uploaded images may be classified into different icons to display the groups, and displayed on the display unit 113. In this case, if the group of images classified by location does not include the image uploaded by the user and the person who is related to the user, that is, even when only the image uploaded by the person who is not related to the user exists, Give it a distinct icon.

The second communication unit 126 transfers a signal between the image sharing server 120 and the image retrieval apparatus 110. The command signal is received from the image retrieval apparatus 110, or the result of processing by the image sharing server 120 is transmitted to the image retrieval apparatus 110.

The second controller 127 controls the overall operation of the image sharing server 120. The second control unit 127 assists the above-described area setting unit 121, the image detector 122, the position classifying unit 123, the user information analyzing unit 124, the icon providing unit 125, and the like. Make it work.

3 is a conceptual diagram illustrating an example in which the image retrieval system according to the present embodiment is applied, which is a diagram illustrating a screen provided by Flickr, an image sharing site, to explain an application example of the present invention.

Referring to the drawing, a partial area of the electronic map set by the area setting unit 121 is displayed on the display unit 113 of the image retrieval apparatus 110. Various types of icons are displayed for each location of the electronic map, and these icons detect images belonging to the electronic map in which the image detector 122 is set, and separate the predetermined units according to the scale of the area in which the location classifier 123 is set. After classifying the images belonging to the defined region by location, the icon assigning unit 125 according to the user information included in the images of each group analyzed by the user information analyzing unit 124 in the group of images classified by location It is created by assigning the corresponding icon.

For example, the icon A on the electronic map indicates that the group of images included in the area where the icon A is located includes the image uploaded by the user himself, and the icon B indicates the image included in the area where the icon B is located. Indicates that the group contains images uploaded by people associated with the user. In addition, the icon C indicates that the group of images included in the area where the icon C is located includes both an image uploaded by the user and an image uploaded by a person associated with the user. The group of images included in the located area does not include the image uploaded by the user and the person related to the user, and includes only the image uploaded by another user who is not related to the user. Here, the number displayed inside the shape of the icons indicates the number of images belonging to the position, and the larger the number of images, the larger the size of the icon. On the other hand, the shape of the icon is selected as an example to explain the present invention various modifications are of course possible.

The image sharing server 120 may not only perform an image sharing and management server such as Flickr, but also perform and process a command requested by the image retrieval apparatus 110 as described above, and provide map information mapped with images. Of course, the server is applicable to the present invention without being limited to the name. In addition, as described above, the functions of the region setting unit 121, the image detection unit 122, the position classification unit 123, the user information analysis unit 124, and the icon providing unit 125, including the second control unit 127, are described. Of course, it can be applied to an image retrieval device such as a personal computer as long as it can be performed directly on a personal computer.

According to the image retrieval system described above, information on images belonging to a predetermined area on an electronic map is displayed by different icons according to user information, so that not only the distribution of images for the set area but also those images are uploaded by whom. By clearly indicating whether or not the user can provide convenience to the user when searching for an image.

4 is a schematic block diagram of an image retrieval system according to another embodiment of the present invention. In the present embodiment, the same reference numerals may perform the same functions as the previous embodiment, and thus the detailed description may be omitted. Hereinafter, the present embodiment will be described based on differences from the previous embodiment.

Referring to the drawings, the image retrieval system according to the present embodiment further includes a thumbnail image classification unit 128.

The thumbnail image classifying unit 128 classifies the thumbnail image according to the classified user information together with the icon classified according to the user information on the set electronic map and displays it on the display unit 113.

5 is a conceptual diagram illustrating an example in which an image retrieval system including a thumbnail image classification unit is applied according to the embodiment.

In the drawing, the thumbnail image C1 displays images uploaded by the user who belongs to the group of images included in the area where the icon C is located, and the thumbnail image C2 belongs to the group of images included in the area where the icon C is located. The images uploaded by the person concerned with the user are displayed, and the thumbnail image C3 displays the images uploaded by other users who are not related to the user. In this case, each of the thumbnail images C1, C2, and C3 may be selectively displayed by a user's selection using a function such as hiding a window.

Meanwhile, although the icon C is illustrated as an example in the drawing, the present invention is not limited thereto, and in the area where the icon A is located, images uploaded by the user among the images belonging to the area are not related to the user. Images uploaded by other users can be sorted and displayed as thumbnail images on the screen. Also, in the area where the icon B is located, images uploaded by a person who is associated with the user and images uploaded by a person who is not related to the user are classified as thumbnail images on the screen. Of course, it can be displayed.

According to the above-described image retrieval system, an image required by a user is displayed by displaying information on images belonging to a predetermined area on an electronic map with different icons according to user information and providing thumbnail images classified according to the user. It allows you to search quickly.

6 is a flowchart schematically illustrating an operation of an image retrieval method according to another embodiment of the present invention. The operation method of the image retrieval system according to the present embodiment may be performed in the image sharing server 120 as shown in FIG. 2, and the main algorithm may assist the peripheral components in the image sharing server 120. It can be performed inside the second control unit 127.

Referring to the drawing, first, the area setting unit 121 sets an area of the electronic map to be displayed on the display unit 113 (step 210). The image detector 122 detects images belonging to the set area (step 220), and the location classifier 123 classifies the detected images for each location on the electronic map according to the above-described predetermined method (step 230). The user information analyzer 124 analyzes the user information of the images included in each group of images classified by location (step 240), and the icon assigner 125 determines the images classified by the location according to the analyzed user information. Icons corresponding to each group are given (step 250) and displayed on the display unit (step 260).

In addition, although not shown in the drawing, the present invention may further perform the step of classifying and displaying the thumbnail images classified according to the analyzed user information together with the icon generated in the step (250).

7 is a flowchart illustrating some steps in detail to explain an example of the above-described embodiment, and illustrates an example of a method of performing steps 240 and 250 of the above-described embodiment in detail.

Referring to the drawing, the user information analyzer 124 first analyzes user information of the images included in the first group among the images classified by location (step 241). Assigning the order of the groups to the images classified by location is performed in various ways, for example, by ordering the groups according to the latitude and longitude values using information of latitude and longitude that partitions an area on the electronic map. Can be.

It analyzes whether there is an image uploaded by the user among the images belonging to the first group and whether the image uploaded by the person related to the user is included. In this case, when the image uploaded by the user himself is included among the images belonging to the first group but does not include the image uploaded by the person associated with the user (step 242), the icon A as in the above-described embodiment of the group is included. To give. If the image included in the first group includes both the image uploaded by the user and the image uploaded by the person associated with the user (step 243), the icon C is assigned to the group as in the above-described embodiment. . In addition, if the image belonging to the first group does not include the image uploaded by the user, but includes the image uploaded by the person associated with the user (step 244), the icon B is applied to the group as in the above-described embodiment. If only the image uploaded by a person unrelated to the user (step 245), the icon D is assigned to the group. The process of analyzing the images included in the group is repeated until the last group included in the set region (step 246).

Of course, the flowchart shown in the drawings is presented as an example in which the searching method according to the present invention is performed, and the present invention is not limited to the example described above. For example, before analyzing the user information of the images included in the first group (step 241), the icon D is assigned to the group of all images by default, and then the steps 242, 243, and 244 described above are performed by default. The process of changing the icon D to icons A, C, and B may be performed, and in this case, various modifications may be made, such as step 245, which may not be performed separately.

Although the present invention has been described with reference to the above-described embodiments, these are merely exemplary, and it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention will be defined by the appended claims.

1 illustrates a part of a screen in which images are displayed as icons on an electronic map in an image sharing site.

2 is a schematic block diagram of an image retrieval system according to an embodiment of the present invention.

3 is a conceptual diagram illustrating an example in which the image retrieval system according to the present embodiment is applied.

4 is a schematic block diagram of an image retrieval system according to another embodiment of the present invention.

5 is a conceptual diagram illustrating an example in which an image retrieval system according to another embodiment of the present invention is applied.

6 and 7 are flowcharts schematically illustrating an operation of an image retrieval method according to another embodiment of the present invention.

Claims (8)

A system for searching for an image using an electronic map including an image having location information and user information. An area setting unit for setting a display area of the electronic map; An image detector which detects images belonging to the set display area; A location classifying unit classifying the detected images for each location on the electronic map; A user information analyzer for analyzing user information of the images classified by the positions; And And an icon providing unit to give an icon to the images classified by the locations according to the analyzed user information. The method of claim 1, The user information analysis unit analyzes whether an image included in the images classified by location is an image uploaded by the user and whether the image is uploaded by a person associated with the user on the system. Search system. The method of claim 2, The icon assigning unit may include an image uploaded by the user, among the images classified by the location, when an image uploaded by a person associated with the user is included on the system, and on the user and the system. If an image uploaded by a person associated with the user is included, an icon is assigned to the images classified by the locations so as to be distinguished from each other. The method of claim 1, The system may further include a thumbnail image classifier that displays a thumbnail image classified according to the analyzed user information together with the icon on the electronic map. A method of searching for an image in a system that provides an electronic map including an image having location information and user information, (a) setting a display area of the electronic map; (b) detecting images belonging to the set display area; (c) classifying the detected images by location on the electronic map; (d) analyzing user information of the images classified by location; And and (e) assigning an icon corresponding to the analyzed user information to the images classified by the location. The method of claim 5, In the step (d), the image included in the images classified by the location is analyzed by the user, whether the image is uploaded by the user, and whether the image is uploaded by a person associated with the user on the system. Search method. The method of claim 6, In the step (e), if the image classified by the location includes an image uploaded by the user, an image uploaded by a person associated with the user on the system is included, and the user and the system If an image uploaded by a person associated with the user on the image is included in the image, an icon is assigned to the images classified by the locations so as to be distinguished from each other in each case. The method of claim 5, In the step (e), the thumbnail image classified according to the analyzed user information together with the icon is displayed on the electronic map.

Images