JP2018136913A - Image processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing apparatus capable of facilitating an image processing flow creation work and an editing work even when an inspection by image processing is performed on a plurality of works. An image processing apparatus that executes image processing on a work image including a plurality of works based on an image processing flow in which a plurality of image processing tools are combined, and the image processing flow is the same. It is characterized by having a loop tool that performs loop processing in which a combination of image processing tools is sequentially applied to each of a plurality of works included in the work image. [Selection diagram] Fig. 2

Description

  The present invention relates to an image processing apparatus that performs image processing on a workpiece image obtained by imaging a workpiece.

  There has been proposed an image processing apparatus that inspects an object to be inspected (hereinafter referred to as a workpiece) by imaging the workpiece with an imaging unit and performing image processing on the photographed workpiece image to determine whether the product is good or bad. (For example, refer to Patent Document 1). In the image processing apparatus disclosed in Patent Document 1, image processing is performed on a work image based on an image processing flow configured by a plurality of image processing tools selected by a user.

JP2013-171026A

  However, conventionally, when inspecting a plurality of workpieces within the imaging field of view of the imaging unit, that is, a plurality of workpieces included in the workpiece image, a plurality of image processing tools are combined for each workpiece to individually perform an image processing flow. There was a need to create. For this reason, there has been a problem that it takes time and effort to create the image processing flow. Also, when editing an image processing flow that has been created once, such as changing settings for some image processing tools in the image processing flow, for example, the editing operation is performed for each image processing flow corresponding to each work. It must be made. Furthermore, as the number of image processing tools to be combined increases, more icons (hereinafter referred to as image processing icons) corresponding to each image processing tool are displayed on the user interface related to the image processing application. May have difficulty in overlooking the entire image processing flow. In addition, it is conceivable that a plurality of image processing tools are simply displayed with a single icon. In this case, however, it may be difficult for the user to understand what kind of image processing is performed by this icon. For this reason, there is a problem that the work burden on the user is large and the maintainability is poor.

  The present invention has been made in view of such circumstances, and an object thereof is to facilitate creation and editing of an image processing flow even when a plurality of workpieces are inspected by image processing. An object of the present invention is to provide an image processing apparatus that can perform the above-described processing.

The image processing apparatus of the present invention has been proposed to achieve the above object, and is based on an image processing flow in which a plurality of image processing tools are combined with a workpiece image including a plurality of workpieces. An image processing apparatus that executes image processing,
The image processing flow includes a loop tool that performs a loop process in which a combination of image processing tools is sequentially applied to each of a plurality of works included in the work image.

  According to the present invention, the image processing flow includes a loop tool that performs a loop process that sequentially applies a combination of image processing tools to each of a plurality of workpieces, thereby individually creating an image processing flow for each workpiece. This makes it easier to create an image processing flow. In addition, even when editing an image processing flow that has been created once, such as changing settings for some image processing tools in the image processing flow, The image processing flow after editing is similarly applied to each workpiece. As a result, the burden on the work for the user is reduced and the maintainability is improved.

In the above configuration, the image processing flow includes, as an image processing tool, a search tool that detects a predetermined workpiece included in the workpiece image.
The loop tool may employ a configuration in which the loop process is performed a number of times corresponding to the number of workpieces detected by the search tool.

  According to this configuration, loop processing is automatically executed as many times as the number of workpieces detected by the search tool, so that setting work by the user is not necessary.

  In the above configuration, a configuration in which the number of execution times of the loop processing by the loop tool is set by a user can be adopted.

  According to this configuration, the number of execution times of the loop process can be set to a number desired by the user.

Further, in the above configuration, the image processing flow includes a search tool for detecting a predetermined work included in the work image as an image processing tool,
It is also possible to adopt a configuration in which either the automatic setting based on the number of workpieces detected by the search tool or the setting by the user can be selected as the number of times the loop process is executed by the loop tool.

  According to this configuration, it is possible to select a more suitable setting for the number of executions of the loop process according to the inspection application or the like.

In the above configuration, the image processing flow includes, as an image processing tool, a search tool that detects a predetermined workpiece included in the workpiece image.
The loop tool preferably employs a configuration having a mode in which the loop process is selectively performed on a part of the workpieces detected by the search tool.

  According to this configuration, even when the number of workpieces detected by the search tool is larger, the loop process is selectively applied to only some of the detected workpieces as in the so-called sampling inspection. Therefore, the processing time can be reduced accordingly.

  In this configuration, the loop tool may employ a configuration in which workpieces to be inspected are selected from the workpieces detected by the search tool at a fixed number of intervals.

  According to this configuration, since the workpieces to be inspected are selected from the detected workpieces at a constant number interval, the sampling inspection can be performed with simpler settings.

  Further, in the above configuration, the loop tool sets a selection area for selecting a workpiece to be inspected from the workpieces detected by the search tool in a distributed manner in the workpiece image, and within the selection area It is also possible to adopt a configuration in which an included workpiece is selected as a workpiece to be inspected.

  According to this configuration, by selecting the workpieces included in the selected area from the detected workpieces as the workpieces to be inspected, the workpieces are more evenly taken into account by taking into account variations in shapes, dimensions, etc. based on the workpiece positions. It becomes possible to perform the inspection.

Furthermore, in the above configuration, the image processing flow includes a first loop tool and a second loop tool,
The first loop process executed by the first loop tool can employ a configuration including a second loop process executed by the second loop tool.

  According to this configuration, for example, when the detected workpiece has a plurality of parts to be inspected, the inspection of each part is performed by the second loop process executed by the second loop tool. can do. As a result, it is possible to inspect a plurality of parts of the work by a simple operation of adding the second loop tool in the image processing flow.

In the above-described configuration, the image processing tool has icon display means for displaying an image processing icon corresponding to the image processing tool on the display device,
The icon display means is preferably configured to display on the display device a group icon corresponding to an image processing group composed of a combination of a plurality of image processing tools.

  According to this configuration, an image processing group configured by a combination of a plurality of image processing tools is displayed as a single group icon, so that the image processing icons of the image processing tools constituting the image processing group are individually displayed. As compared with the case where the image processing is performed, the user can easily recognize that the image processing group is a combination of a plurality of image processing tools. In addition, a limited display area in the display device can be used effectively.

  Further, in the above configuration, the icon display means can display the group icon corresponding to the image processing group including the loop tool and a plurality of image processing tools on which the loop processing is performed by the loop tool. Desirably configured.

  According to this configuration, the user can more easily recognize that the image processing group is subjected to loop processing by the loop tool.

  In the above configuration, the icon display means arranges a group display state for displaying the group icon corresponding to the image processing group and image processing icons corresponding to the image processing tools included in the image processing group. It is desirable to be able to switch to the expanded display state to be displayed.

  According to this configuration, since it is possible to switch between the summary display state and the expanded display state, the user can use the display area effectively or check each image processing tool constituting the image processing group. The display can be performed as needed.

  Further, in the above configuration, the icon display means includes a still image display state for displaying a still image of the group icon in the summary display state, and an image processing icon corresponding to an image processing tool included in the image processing group. It is desirable to be able to switch to a moving image display state where images are sequentially displayed instead of the still image.

  According to this configuration, since it is possible to switch between the still image display state and the moving image display state in the summary display state, it is possible to suppress the load on the image processing apparatus by setting the still image display state, or By doing so, the user can easily check each image processing tool constituting the image processing group while effectively using the limited display area.

  Further, in the above configuration, the icon display means can select and display an image processing icon corresponding to a part of the image processing tools included in the image processing group in the moving image display state. It is desirable that

  According to this configuration, in the moving image display state, by selecting and displaying an image processing icon corresponding to a part of the image processing tools included in the image processing group, the load on the image processing apparatus in the moving image display state is reduced. This can be further reduced.

In the above configuration, the image processing group has an edit mode for editing,
The editing mode is preferably configured to be able to edit the image processing group by adding or deleting the image processing icon.

  According to this configuration, since the image processing group can be edited by adding or deleting an image processing icon, the editing operation of the image processing group can be performed more easily and intuitively. Become.

  In the configuration described above, it is desirable that the editing mode is configured to be able to register the edited image processing group as one of the image processing tools.

  According to this configuration, by registering the edited image processing group as one of the image processing tools, the image processing group that has been edited once can be used repeatedly, which improves user convenience. .

It is a figure explaining one form of an image processing device. It is a display example (expanded display state) of a user interface related to image processing. It is a display example (summary display state) of a user interface related to image processing. It is an example of a display of the work screen in edit mode. It is an example of a display of the work screen in edit mode. It is an example of a display of the work screen in edit mode. It is a transition diagram explaining the animation display state of a group icon. It is an example of a display of the work screen in edit mode. It is a figure explaining the other example of a display of a group icon. It is a figure explaining the other example of a display of a group icon. It is a figure explaining the other example of a display of a group icon. It is a figure explaining the other example of a display of a group icon. It is a figure explaining the other example of a display of a group icon. It is a figure explaining the other example of a display of a group icon. It is a figure explaining the other example of a display of a group icon. It is a figure explaining the other example of a display of a group icon. It is a figure explaining a pattern search tool. It is a figure explaining position shift correction. It is a figure explaining an image processing flow. It is a figure explaining an image processing flow. It is a figure explaining an image processing flow. It is a figure explaining an image processing flow. It is a figure explaining 2nd Embodiment. It is a figure explaining 3rd Embodiment. It is a figure explaining 4th Embodiment.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings. In the embodiments described below, various limitations are made as preferred specific examples of the present invention. However, the scope of the present invention is not limited to the following description unless otherwise specified. However, the present invention is not limited to these embodiments.

  FIG. 1 is a block diagram showing an embodiment of an image processing apparatus according to the present invention. An image processing apparatus 10 according to the present embodiment includes an XY stage 2, an imaging device 3, a computer 6, a display device 7, an input device 8, and the like. The workpiece 1 (see FIG. 2 and the like) is, for example, a metal processed product such as a screw or a gear, or various inspection objects (objects) such as a flexible substrate, a liquid crystal panel (TFT panel), and a semiconductor wafer. In the present embodiment, the workpiece 1 is placed on the XY stage 2 and configured to be movable in a first direction (X direction) and a second direction (Y direction) orthogonal to the first direction. ing. Note that the configuration is not limited to the XY stage 2, and for example, a configuration that can sequentially convey the workpiece 1 below the photographing apparatus 3 like a belt conveyor can be adopted.

  The photographing device 3 receives an optical system composed of a lens or a microscope having a magnification sufficient to optically enlarge the workpiece 1 and detect a defect, and an image of the workpiece 1 enlarged by the optical system. A CCD or the like for converting to an electrical signal is provided. The photographing apparatus 3 photographs the work 1 on the XY stage 2, converts the photographed image into image data, and outputs the image data to the computer 6. The computer 6 controls the photographing apparatus 3 and performs inspection such as measurement of shape / dimension and detection of defects by image processing on the workpiece 1 based on the photographed image obtained from the photographing apparatus 3. The display device 7 is a display device such as a liquid crystal display connected to the computer 6. The input device 8 includes, for example, a keyboard and a mouse, and outputs an operation signal based on the operation to the computer 6 in response to a user operation.

  The computer 6 in this embodiment includes a calculation unit 11 and a storage unit 12. The storage unit 12 is composed of, for example, a hard disk drive, and the storage unit 12 stores an operation system, various application programs including an image processing application, image processing data, and the like. The calculation unit 11 includes a CPU, a ROM, a RAM, and the like (not shown), and performs various processes such as image processing according to an operation system stored in the storage unit 12. The calculation unit 11 includes an image input unit 13 and an image processing unit 14. Captured image data of the workpiece 1 captured by the imaging device 3 is input to the image input unit 13. The captured image data is stored in the storage unit 12 as a work image.

  The image processing means 14 detects a predetermined work 1 from the work image by sequentially executing image processing tools constituting an image processing flow (image processing recipe) described later on the work image (captured image), The dimension of the detected workpiece 1 is measured, or a defect of the workpiece 1 is detected. The image processing flow is generated by a user combining various image processing tools. In addition, the image processing unit 14 in the present embodiment functions as an icon display unit in the present invention, and causes the display device 7 to display an image processing icon 23 and a group icon 25 corresponding to various image processing tools, as will be described later. Or

  FIGS. 2 and 3 are diagrams for explaining a display example of the user interface 17 related to the image processing application executed by the calculation unit 11, and FIG. 2 illustrates each image corresponding to a group of image processing tools (image processing group). FIG. 3 shows a state (image display state) in which the image processing icons 23 are individually arranged and displayed (development display state), and FIG. The user interface 17 in the present embodiment is provided with a display area such as a work area 18, a setting area 19, and an image processing flow display area 21, a scroll bar 22, and the like. The work area 18 is an area in which a work image input from the photographing apparatus 3 is displayed and a state in which image processing is performed by an image processing tool is displayed. The setting area 19 is an area in which settings for overall image processing and the like are made, various image processing tools are individually set and adjusted, and other settings and measurement values are displayed.

  In the image processing flow display area 21, image processing icons 23 composed of thumbnail images corresponding to various image processing tools are displayed in a predetermined order. The image processing icon 23 displayed in the image processing flow display area 21 is selected by the user. That is, when a user sequentially registers necessary image processing tools, an image processing icon 23 corresponding to each image processing tool is generated and displayed in the image processing flow display area 21. The image processing icon 23 is not limited to a thumbnail image, and for example, an image that characterizes a corresponding image processing tool can be employed.

  In the present embodiment, the image processing icons 23 are displayed side by side in the horizontal direction of the screen. Further, below the image processing flow display area 21, a scroll bar 22 that can slide in the horizontal direction of the screen along the image processing flow display area 21 is displayed. The scroll bar 22 is configured such that, for example, the display of the image processing flow display area 21 can be scrolled in the horizontal direction by a user sliding operation via a mouse (not shown) which is a kind of the input device 8. . In the display example shown in FIG. 2, a total of six image processing icons 23 a to 23 f are displayed in the image processing flow display area 21, but there are seven or more image processing tools constituting the image processing flow. Can display other image processing icons 23 not displayed in the state of FIG. 2 in the image processing flow display area 21 by sliding the scroll bar 22 in the horizontal direction (for example, the right direction in FIG. 2). it can. In the present embodiment, in addition to the image processing icons 23a to 23f, three image processing icons 23g to 23h (see FIG. 3) are included in one image processing flow. A combination of these image processing tools constitutes a series of image processing flows. Note that the position of the image processing flow display area 21, the direction in which the image processing icons 23 are arranged, the number of image processing icons 23 to be displayed, and the like are not limited to those illustrated, for example, any one of the left and right sides of the user interface 17. It is also possible to adopt a configuration in which the image processing flow display area 21 is provided on the side, and the image processing icons 23 are arranged in the vertical direction. In this case, the scroll bar 22 is also configured to slide in the vertical direction of the screen.

  In the present embodiment, among the image processing icons 23 displayed in the image processing flow display area 21 of FIG. 2, each image from the second image processing icon 23b from the left to the sixth (right end) image processing icon 23f. The processing tools constitute one group (image processing group). This image processing group is composed of a combination of a plurality of image processing tools, and those prepared in advance in the image processing program, those composed of image processing tools arbitrarily selected by the user in the editing mode described later, etc. is there. In the present embodiment, as shown in FIG. 2, these image processing tools are set to 1 by a group mark 24 composed of a broken line connecting the first image processing icon 23 b and the last image processing icon 23 f of the image processing group. One image processing group is shown. Note that the group mark 24 is not limited to the exemplified mode. For example, each image processing icon 23 constituting the image processing group is surrounded by one frame, or the background color of the corresponding image processing icon 23 is set to another image processing icon. As long as it is a sign that allows the user to determine that the image processing tool is one image processing group, such as a different background color from 23, the group sign 24 in various modes can be adopted. .

  As shown in FIG. 2, the state in which the image processing icons 23 corresponding to the image processing groups are individually arranged and displayed is an expanded display state in the present invention. In the present embodiment, as shown in FIG. 3, the image processing icons 23 corresponding to the image processing groups are switched to the collective display state in the present invention, which is representatively displayed by one group icon 25. It is configured to be able to. That is, for example, when the pointer is placed on any of the image processing icons 23 in the image processing group in the expanded display state and the mouse is double-clicked, it is switched to the collective display state, as shown in FIG. Instead of each image processing icon 23 of the image processing group, one group icon 25 is displayed. Similarly, by double-clicking the group icon 25 in the summary display state, it is possible to switch to the expanded display state as shown in FIG. In the summary display state, an image processing group composed of a combination of a plurality of image processing tools is displayed with one group icon 25, so that the image processing icons of the image processing tools constituting the image processing group are individually displayed. Compared to the expanded display state, the user can easily recognize that the image processing group is a combination of a plurality of image processing tools. In addition, a limited display area can be used effectively. On the other hand, in the expanded display state, the user can more accurately grasp which image processing tool the image processing group is configured from. Since such a summary display state and an unfolded display state can be switched, the display area can be used effectively, or each image processing tool constituting the image processing group can be confirmed, etc. , Display according to the user's needs. Furthermore, in the collective display state, a moving image can be displayed by performing a single click operation on the group icon 25. Details of this point will be described later.

  4 to 6 are diagrams showing display examples of the work screen in the edit mode (user creation / edit mode). This editing mode is a mode executed by the image processing program when editing (creating) an image processing flow or an image processing group included in the image processing flow. The editing mode work screen may be displayed in the setting area 19 of the user interface 17 or may be displayed as a screen different from the user interface 17. The upper part of the work screen is an area (tool list area) in which image processing icons 23 of various image processing tools registered in the image processing program are displayed. The lower part of the work screen is an area (user creation / editing area) in which a user sequentially registers and creates image processing tools constituting the image processing flow, and creates or edits group icons. That is, the user can create an image processing flow by selecting the image processing icon 23 displayed in the tool list area and sequentially adding it to the user creation / editing area. It is also possible to add a new image processing tool to the created image processing flow or delete an already registered image processing tool. Similarly, an image processing group can be edited by adding or deleting an image processing tool in the user creation / editing area. As described above, since the image processing group can be created / edited by adding or deleting the image processing icon 23, the image processing group can be created / edited more easily and intuitively. It becomes possible. Scroll bars 26a and 26b are respectively provided in the tool list display area and the user creation / edit display area. When the image processing icon 23 cannot be displayed in each display area, the scroll bars 26a and 26b are slid in the vertical direction (vertical direction in the figure) to scroll the display in the display area in the vertical direction. Other image processing icons 23 that have not been displayed in the display area can be displayed in the display area. Of course, the scroll bars 26a and 26b are not limited to those that are slid in the vertical direction, and adopt a configuration in which the display area is scrolled in the horizontal direction by sliding in the horizontal direction like the scroll bar 22. You can also.

  When creating an image processing group, for example, an image processing tool is selected from the ten types of image processing tools A to J displayed in the tool list area in the order of execution, and each image processing icon 23 is displayed. Display in user creation / edit area. For example, the image processing icon 23 of the image processing tool displayed in the tool list area can be displayed by single-clicking or dragging and dropping the image processing tool displayed in the tool list area. It can be displayed in the user creation / edit area. In the example of FIG. 4, the image processing tool B, the image processing tool C, the image processing tool G, the image processing tool H, and the image processing tool J are selected in this order and correspond to each image processing tool in the user creation / editing area. An image processing icon 23 is displayed. Even in the case of creating this image processing group, it is possible to switch between the expanded display state (FIG. 4) and the collective display state (FIG. 5) by double-clicking as described above. The group icon 25 in the summary display state can also display a moving image described later. As shown in FIG. 6, the created or edited image processing group can be registered in the tool list area as one of the image processing tools. As a result, as with other image processing tools, when creating an image processing flow, the group icon 25 of the image processing group can be selected and used at any time. In this way, once edited image processing groups can be used repeatedly, user convenience is improved.

  FIG. 7 is a transition diagram for explaining the moving image display state of the group icon 25. As described above, the group icon 25 in the present embodiment is arranged such that the image processing icon 23 of each image processing tool constituting the image processing group is arranged in front of the image processing icon 23 of the first image processing tool. It is configured to be displayed as shown in a perspective view in a superimposed manner. In this state, since the user can only visually recognize the image processing icon 23 corresponding to the first image processing tool, it is difficult to grasp what image processing tool the image processing group is configured from. In the expanded display state, the image processing icons of the respective image processing tools constituting the image processing group are individually displayed, so that the display area may be difficult to see. For this reason, in the present embodiment, the group icon 25 is replaced with the still image by, for example, a single click operation in a state where the still image of the group icon 25 is displayed (still image display state) in the summary display state. Thus, it is possible to perform a moving image display such as so-called frame advance for sequentially displaying the image processing icons 23 of the image processing tools constituting the image processing group. In this moving image display state, in the case of the group icon 25 described above, the image processing tool B → the image processing tool C → the image processing tool G → the image processing tool H → the image processing tool J at regular intervals (for example, every second). In this order, the display of the foremost image processing icon 23 changes. Accordingly, the user can easily grasp what kind of image processing tool the image processing group is configured without being in the expanded display state. In addition, by single-clicking the group icon 25 again in this moving image display state, it is possible to switch to the still image display state in which the image processing icon 23 of the first image processing tool is arranged in the foreground.

  As described above, since the still image display state and the moving image display state can be switched in the summary display state, the load on the computer 6 is suppressed by setting the still image display state, or the moving image display state is set. The user can easily check each image processing tool constituting the image processing group while effectively using the limited display area. In the moving image display state, it is not always necessary to display the image processing icons 23 of all the image processing tools constituting the image processing group. For example, characteristic image processing from among the image processing tools constituting the image processing group is possible. The image processing icon 23 of the tool may be selectively displayed, or one or more image processing icons 23 may be displayed. In this case as well, the load on the computer 6 in the moving image display state can be further reduced. Further, it is possible to adopt a configuration in which the interval (display speed) for sequentially displaying the image processing icons 23 in the moving image display state is arbitrarily changed.

  FIG. 8 is a diagram illustrating a display example of a work screen when the group icon 25 is edited in the edit mode. The image processing group can further include the same or different image processing groups. In the example of FIG. 8, the image processing group corresponding to the group icon 25 (1) is expanded and displayed in the user creation / editing area, and the user can add and process image processing tools constituting the image processing group in this expanded display state. Can be deleted. The image processing group includes two image processing groups corresponding to the group icon 25 (2). In this way, by including the same or different image processing groups in the image processing group, the image processing groups can have a hierarchical structure.

  9 to 16 are diagrams for describing other display examples of the group icon 25. FIG. In the above, the group icon 25 having the configuration in which the image processing icons 23 of the respective image processing tools constituting the image processing group are superimposed and displayed as shown in the perspective view is illustrated, but the present invention is not limited thereto, and other image processing is performed. As long as it can be distinguished from the icon 23, various modes can be adopted. For example, as shown in FIG. 9, the group icon 25 can be displayed surrounded by a frame that emphasizes that it is the group icon 25 (hereinafter, emphasized frame). In this case, the highlight frame may be colored so that it is easier to understand.

  Further, for example, as shown in FIGS. 10 and 11, the group icon 25 is related to the image processing group by adding a number indicating the number of image processing tools constituting the image processing group together with the group icon 25. And the number of image processing tools constituting the image processing group can be indicated. In the example of FIG. 10, a small frame smaller than the main body of the group icon 25 is displayed so as to overlap the lower right corner of the group icon 25, and the number “5” indicating the number of image processing tools is displayed in the small frame. It is written (also written). In the example of FIG. 11, a small frame is provided at a position off the upper left of the main body of the group icon 25, and a number “5” indicating the number of image processing tools is written in the small frame. As described above, in the configuration in which the number indicating the number of image processing tools is written together with the group icon 25, the image processing group is configured as compared with the configuration in which the image processing icons 23 of the image processing tool are simply superimposed and displayed. Even when the number of image processing tools is large, the display size of the group icon 25 is prevented from increasing.

  Further, as shown in FIG. 12, it is possible to adopt a configuration in which both the emphasis frame and the small frame are combined. In the example of FIG. 12, the main body of the group icon 25 is surrounded by a white highlight frame, and a small frame is provided at a position off the lower right of the main body of the group icon 25, and an image is included in the small frame. A number “5” indicating the number of processing tools is written. This makes it easier for the user to recognize that the group icon 25 corresponds to the image processing group. Note that the position of the small frame is not limited to that illustrated in FIGS. 10 to 12, and can be displayed at any position as long as it does not interfere with other adjacent image processing icons 23 and the like. In addition, since it is sufficient that the number of image processing tools can be recognized, only the number indicating the number of image processing tools needs to be written, and the small frame does not necessarily have to be displayed. Furthermore, the shape of the small frame is not limited to a quadrangle, and various shapes that can represent numbers, such as a circle, can be employed.

  The example shown in FIG. 13 and FIG. 14 is a configuration in which the image processing icons 23 of the image processing tools constituting the image processing group are displayed in an overlapping manner. That is, the group icon 25 shown in FIG. 13 is configured such that the image processing icons 23 of the image processing tools constituting the image processing group are viewed from the diagonal right. Further, the group icon 25 shown in FIG. 14 is configured such that a combination of the image processing icons 23 of the image processing tools constituting the image processing group is viewed obliquely from above. As described above, in the configuration in which the image processing icons 23 of the image processing tool are displayed in a superimposed manner, the user can more intuitively recognize that the group icon 25 is related to the image processing group.

  Further, as shown in FIG. 15, the group icon 25 may be a three-dimensional shape. In this case, it is desirable to adopt a configuration in which a number indicating the number of image processing tools is written on the body of the group icon 25 having a three-dimensional shape so that the number of image processing tools constituting the image processing group can be easily understood. Further, for example, as shown in FIG. 16, it is possible to adopt a shape completely different from that of the normal image processing icon 23. A group icon 25 shown in FIG. 16 has a shape similar to a so-called folder icon used in an operation system or the like, and a number indicating the number of image processing tools is also written on the main body of the group icon 25. It has become. That is, the group icon 25 shown in FIG. 16 has a shape indicating that an image processing tool constituting an image processing group is included in the folder. In this way, by making the shape completely different from the normal image processing icon 23, the user can more intuitively recognize that it is the group icon 25 related to the image processing group.

Next, specific examples of various image processing tools will be described.
In the embodiment shown in FIG. 2, the image processing tool corresponding to the image processing icon 23a at the head (left end in the image processing flow display area 21) among the image processing tools constituting the image processing flow is, for example, an image input This is a binarization processing tool for binarizing the work image input by the means 13. The binarized work image is stored in the storage unit 12 and appropriately read out by the image processing means 14. In the present embodiment, an image processing group including image processing tools corresponding to the image processing icons 23a to 23f is executed after the binarization processing tool. Below, the image processing tool which comprises the said image processing group is demonstrated.

FIG. 17 is a diagram for explaining processing of a pattern search tool which is a kind of image processing tool (display example in the work area 18).
In the present embodiment, the image processing tool corresponding to the first image processing icon 23b (second from the left in the image processing flow display area 21) among the plurality of image processing tools constituting the image processing group is included in the work image. A pattern search tool (corresponding to a search tool in the present invention) for detecting a workpiece 1 having a predetermined shape. In the example of FIG. 17, a total of four types of workpieces 1 including workpieces 1 a to 1 d are included in the workpiece image. In addition, a total of five workpieces 1a which are a kind of these workpieces 1 are included. Then, the pattern search tool detects, based on the reference image of the workpiece 1 to be inspected, the workpiece 1 that is recognized as having the same shape as the workpiece of the reference image from the plurality of workpieces 1 included in the workpiece image. The reference image is an image for quality determination that is registered in advance for each type of workpiece 1 and is stored in the storage unit 12 or the like. When the pattern search tool detects a workpiece 1 having a predetermined shape from the workpiece image, a frame-shaped detection indicator 28 is displayed so as to overlap the detected workpiece 1 as shown in FIG. The detection sign 28 is not limited to the frame shape, and various signs can be adopted.

  As described above, when a plurality of workpieces 1 are detected based on the reference image, the pattern search tool assigns an index composed of, for example, a serial number to each detected workpiece 1 to thereby identify the same type (same shape). A plurality of workpieces 1 are identified. That is, for example, serial numbers 1 to 5 are assigned as indexes to the five workpieces 1a included in the workpiece image. In FIG. 17, the numbers in parentheses attached to the reference numerals are indexes (the same applies hereinafter). Of course, the index is not limited to the serial number, and various indexes such as alphabets and symbols can be adopted as long as the plurality of workpieces 1 can be identified.

  Further, the pattern search tool acquires coordinate information (absolute value or relative value with respect to the reference image) and angle information when compared with the reference image for the detected workpiece 1. In the pattern search tool, a target work (representative object) on which an image processing tool subsequent to the pattern search tool is performed is designated by the index. An index for designating the target workpiece (hereinafter, target designation index) is set to 1 as an initial value, for example. The value of the target designation index is changed by a loop tool described later. Also, the initial value of the target designation index can be changed to an arbitrary value.

FIG. 18 is a diagram for explaining misalignment correction performed in the pattern search tool.
In the reference image, an area (hereinafter referred to as an inspection area) for inspecting a work that becomes a reference (hereinafter referred to as a reference work) with each image processing tool is set in advance. In the example of FIG. 18, the workpiece of the reference image and a frame-shaped area label 27 ′ as an example of a label indicating the inspection area corresponding thereto are indicated by broken lines. Here, since the workpiece 1 detected by the pattern search tool may have different coordinates and angles with respect to the reference workpiece, the inspection area is also shifted from the reference inspection area accordingly (in FIG. 18, A work 1a is shown as an example of the work 1 detected by the pattern search tool). For this reason, the pattern search tool corrects the displacement of the inspection area based on the detected individual coordinate information and angle information of the workpiece 1. In FIG. 18, the region marking 27 in which the positional deviation is corrected is displayed so as to be superimposed on the workpiece 1 a. Note that the position, shape, number, and the like of the inspection area set for the workpiece 1 are different depending on the image processing tool.

  In the present embodiment, among the image processing tools constituting the image processing group, each of the image processing tools corresponding to the image processing icons 23c to 23e following the pattern search is a variety of known image processing for inspection / measurement. It is a combination of tools. Specifically, each of the image processing tools corresponding to the image processing icons 23c to 23e is specified in the inspection area, for example, for the target work specified by the target specifying index among the works 1 detected by the pattern search. An image processing tool for measuring the distance between two points, an image processing tool for detecting defects such as scratches, burrs, and chips. These image processing tools are sequentially executed in the order in which they are arranged (in the example of FIG. 2, from the left side to the right side in the direction in which the image processing icons 23 are arranged side by side). The type and number of image processing tools to be combined are selected by the user when the image processing tools constituting the image processing flow are sequentially registered.

  Here, conventionally, when there are a plurality of workpieces to be inspected with respect to an image processing flow composed of a combination of these image processing tools and an image processing group included therein, an individual image processing flow or An image processing group was created. For this reason, there is a problem that the more the number of workpieces to be inspected, the more time is required for creating an image processing flow and an image processing group. In addition, when editing an image processing flow that has been created once, such as changing the settings for some image processing tools in the image processing flow or image processing group, the image processing flow or image processing group of each workpiece is edited. There was a problem that each of them had to be edited. The image processing apparatus 10 according to the present invention solves the above problem by providing a loop tool that sequentially applies image processing tools constituting an image processing flow and an image processing group to a plurality of workpieces to be inspected. .

  In the present embodiment, among the image processing tools constituting the image processing group, the image processing tool corresponding to the last image processing icon 23f is a loop tool. This loop tool is an image processing tool that performs a loop process in which a combination of image processing tools constituting an image processing flow or an image processing group is sequentially executed for a plurality of workpieces 1 to be inspected. In the loop tool, the image processing tool that is the head of the repetition can be designated as the loop destination. In this embodiment, the head pattern search tool of the image processing group is designated as the loop destination. As a result, the combination of the image processing tools from the designated image processing tool to the image processing tool immediately before the loop tool is repeatedly executed (that is, loop processing is performed). That is, the image processing group in the present embodiment is composed of image processing tools that respectively execute loop processing for each workpiece. Then, by displaying this image processing group with the group icon 25, the user can more easily recognize that the image processing group is subjected to loop processing by the loop tool.

  As described above, since an index is allocated to each work 1 detected by the pattern search tool, the loop tool is configured to change the value of the target designation index every time the loop process is repeated. That is, the loop tool adds the value of the target designation index, for example, one by one from the initial value. Thus, each time the loop process is repeated by the loop tool, the target work sequentially changes, and the image processing tools of the image processing group are sequentially applied to the plurality of works 1 in the same manner. Then, the loop processing is repeated as many times as the number of workpieces 1 detected by the pattern search tool. As described above, the loop processing is automatically executed as many times as the number of workpieces 1 detected, so that the user does not need to set the number of execution times of the loop processing (hereinafter referred to as the number of loops). Note that the setting of the number of loops can be changed as will be described later. Further, the loop tool has a function of associating the result of each image processing tool in the loop processing with each work 1 and storing it in the storage unit 12 or the like. Thereby, when the loop processing is repeated by the loop tool, the inspection / measurement results of each workpiece 1 are acquired and stored without being overwritten.

  Regarding the number of loops by the above loop tool, either automatic setting or setting by the user can be selected. Thereby, a more suitable setting can be selected for the number of loops according to the inspection application or the like. The number of loops is defined by the maximum value of the target designation index. When the automatic setting is selected for the number of loops, the loop process is automatically repeated until the value of the target designation index becomes maximum. Regarding this automatic setting, the user can set the maximum value (maximum number of detections) of the number of workpieces 1 detected by the pattern search tool. In the case where the maximum number of detections is set, when the number of detections of the pattern search tool exceeds the maximum number of detections, it is treated that the excess work 1 is not detected. When the maximum number of detections is set and the number of detections by the pattern search tool is less than the maximum number of detections, the number of detections is handled as the maximum number of detections (the maximum number of detections is changed). When automatic setting is selected for the number of loops, the maximum value of the target designation index is automatically set to the maximum detection number. For example, when 100 workpieces 1 of the same type are included in the workpiece image, the maximum number of detections by the pattern search tool can be set to 50. As a result, the maximum value of the target designation index is set to 50, and the loop processing is repeated until the target designation index reaches 50 which is the maximum value for the detected work 1. It is also possible not to specify the maximum number of detections. As a result, when the number of workpieces 1 detected by the pattern search tool is 100 as described above, the maximum value of the target designation index is set to 100 corresponding to the number of detections. On the other hand, the loop processing is repeated until the target designation index reaches 100 which is the maximum value.

  In the case of setting by the user, the user can set the number of loops to a desired number. When the loop count is set by the user, the maximum value of the target designation index is set to a value corresponding to the set loop count. When the number of loops set by the user exceeds the number detected by the pattern search tool, the maximum value of the target designation index is automatically adjusted to the above detection number. In this case, a display that informs the user and confirms the fact may be performed.

Hereinafter, the loop processing will be described with reference to FIGS. In the following description, it is assumed that the maximum number of detections and the number of loops are not set.
When the image processing flow is started, first, the pattern search tool detects the workpiece 1 having a shape based on the reference image from the workpiece image, and the detection indication 28 is superimposed on each workpiece and displayed. In the example shown in FIG. 19, a total of four workpieces 1 a (1) to 1 a (4) are detected, and frame-shaped detection signs 28 a to 28 d are displayed respectively. As described above, each work 1 detected by the pattern search tool is assigned an individual index. In other words, in the example of FIG. 19, the detected workpieces 1 a (1) to 1 a (4) are assigned indexes having serial numbers 1 to 4. Here, in the present embodiment, 1 is set as the initial value of the target designation index. As shown in FIG. 19, only the detection sign 28a of the work 1a (1) to which (1) corresponding to the target designation index is allocated is shown by a thick frame. Further, as described above, the pattern search tool corrects the displacement of the inspection area based on the detected individual coordinate information and angle information of the workpiece 1.

  Subsequently, for the work 1 (work 1a (1)) corresponding to the target designation index, combinations of image processing tools subsequent to the pattern search tool in the image processing flow are sequentially executed. For example, as shown in FIG. 20, various types of image processing such as an image processing tool for measuring a distance between two points designated by the region marking 27 are sequentially executed. In the example of FIG. 20, the distance between two points specified by the pair of area markings 27x and the distance between two points specified by the pair of area markings 27y are measured, and the respective measurement results are acquired. . As described above, the measurement / inspection result information acquired by each image processing tool is stored in the storage unit 12 or the like in association with the index of the workpiece 1, for example.

  After the image processing tool is executed up to the previous one of the loop tool, the loop tool is subsequently executed to return to the pattern search tool designated as the image processing tool that becomes the head of the repetition, and the subsequent processing is performed. Repeated. At this time, the value of the target designation index is changed by the loop tool. That is, 1 is added to the value (1) of the target designation index that is currently set, and the value of the target designation index is updated to (2). Then, returning to the top of the image processing flow, the pattern search tool detects the workpiece 1 having a shape based on the reference image from the workpiece image. Since the target designation index is changed by the loop tool, as shown in FIG. 21, only the detection sign 28b of the work 1a (2) to which (2) corresponding to the changed target designation index is allocated. Shown in bold. Further, based on the detected individual coordinate information and angle information of the workpiece 1, the positional deviation of the inspection area is corrected. Then, as in the case of the work 1a (1) designated by the target designation index (1), the work 1a (2) newly designated by the target designation index (2) is shown in FIG. A combination of various image processing tools following the pattern search tool is sequentially executed. Each time the loop tool is executed, the target designation index is changed, and the combination of image processing tools constituting the image processing flow is similarly applied to the remaining works 1a (3) and 1a (4). Sequentially executed (that is, loop processing is executed).

  As described above, in the image processing apparatus 10 according to the present invention, the loop tool that sequentially applies the image processing flow and the image processing tools included in the image processing group included in the plurality of workpieces 1 to be inspected in the same manner. By providing, it is not necessary to individually create an image processing flow and an image processing group for each workpiece 1, and the creation work of the image processing flow and the like becomes easier. In addition, even when editing an image processing flow that has been created once, such as changing the setting of an image processing flow or some image processing tools in an image processing group, one image processing flow or image If editing is performed for the processing group, the edited image processing flow and loop processing by the image processing group are similarly applied to each workpiece 1. As a result, the burden on the work for the user is reduced and the maintainability is improved.

Next, another embodiment of the present invention will be described.
FIG. 23 is a diagram for explaining a second embodiment of the present invention.
In the present embodiment, the number of workpieces 1 detected by the pattern search tool with respect to the workpiece image is larger. In this case, if the loop processing is similarly applied to all the workpieces 1 detected by the pattern search tool, much time is required accordingly. For this reason, in the loop tool, it is possible to set a mode in which loop processing is selectively applied to a part of the works 1 among the plurality of works 1 detected by the pattern search tool. More specifically, by setting the addition value at the time of updating the value of the target designation index to a value larger than 1, the workpieces 1 to be inspected are detected at regular intervals from the detected workpieces 1. It is selected and loop processing is applied. For example, when a total of 17 workpieces 1a (1) to 1a (17) are detected by the pattern search tool as in the example shown in FIG. 23 (the workpiece 1b that does not match the reference image is not detected) When the initial value of the target designation index is “1” and the addition value when updating the value of the target designation index by the loop tool is set to “2”, the workpiece 1 from which the index (1) is assigned Loop processing is sequentially applied to the workpieces 1a to which odd-numbered indexes are assigned every other order (at intervals). Similarly, when the initial value of the target designation index is “2” and the addition value when the target designation index value is updated by the loop tool is set to “2”, the index (2) is assigned. The loop processing is sequentially applied to the workpieces 1a to which even-numbered indexes are assigned every other (in intervals of one) from the workpiece 1. Furthermore, when the number of workpieces 1 detected by the pattern search tool is larger, the addition value at the time of updating the value of the target designation index by the loop tool can be arbitrarily set to, for example, “4”. In this case, the loop processing is sequentially applied to the workpiece 1a at three intervals. Thereby, even when the number of workpieces 1 detected by the pattern search tool is larger, the loop process can be applied only to a part of the workpieces 1 detected as in the so-called sampling inspection. Therefore, the processing time can be reduced accordingly. In the present embodiment, since the workpieces to be inspected are selected from the detected workpieces at a constant number interval, the sampling inspection can be performed with simpler settings. Other configurations are the same as those in the first embodiment.

FIG. 24 is a diagram for explaining a third embodiment according to the present invention.
In the present embodiment, when the number of workpieces 1 detected by the pattern search tool for a workpiece image is large, the image processing flow is applied only to some of the workpieces 1 detected. This is common with the second embodiment. On the other hand, in consideration of variation characteristics such as the shape and dimensions of the workpiece 1 based on the detected position (coordinates), a plurality of selection areas for specifying the workpiece 1 to be inspected for the workpiece image are dispersed and set. The second embodiment is different from the second embodiment in that the workpiece 1 included in the selected area is an inspection target. In the example of FIG. 24, in a configuration in which a plurality of components are individually cut out from a silicon wafer (silicon single crystal substrate) 30, regions (hereinafter referred to as component regions) that become components on the silicon wafer 30 are indicated by broken lines in the figure. It is divided into multiple sections by vertical and horizontal cutting lines. In the image processing apparatus 10 according to the present embodiment, each of the component areas partitioned on the silicon wafer 30 is an inspection target as the work 1. An orientation flat (hereinafter referred to as orientation flat) OF showing a predetermined plane orientation of the silicon wafer 30 is formed on a part of the outer periphery of the silicon wafer 30. The planned cutting line is a fragile portion that triggers the cutting / dividing of the silicon wafer 30 such as a plurality of recesses, through holes, or grooves formed along the outer edge of the component region (work 1). .

  As described above, in the configuration in which the part regions as the plurality of workpieces 1 are set on the silicon wafer 30, the characteristics may change depending on the position on the silicon wafer 30. For example, the shape, size, and the like may be slightly different between the workpiece 1 located at the more end portion (more outer peripheral side) of the silicon wafer 30 and the workpiece 1 located at the more central portion of the silicon wafer 30. For this reason, in the loop tool in the present embodiment, it is possible to select an inspection mode in consideration of variations in the shape and characteristics of the workpiece 1 based on the detected position. In this inspection mode, as shown in FIG. 24, a plurality of selection areas 31 are set in a distributed manner based on the positions (coordinates) of the plurality of workpieces 1 detected by the pattern search tool. The position and number of the selection area 31 are set so as not to be biased as much as possible according to the number and distribution of the workpieces 1 detected by the pattern search tool. Then, the workpiece 1 (the workpiece 1 indicated by hatching in FIG. 24) that is entirely included in the range of the selection area 31 is selected as an inspection target to which the image processing flow is applied. In this case, each time the loop process is repeated by the loop tool, the target designation index is updated so that the indices of the workpieces 1 selected by the selection area 31 are designated sequentially. According to the configuration of the present embodiment, it is possible to perform a sampling inspection of the workpiece 1 with no bias in consideration of variations in shape, dimensions, and the like based on the position of the workpiece 1. Other configurations are the same as those in the first embodiment.

FIG. 25 is a diagram for explaining a fourth embodiment according to the present invention. In the figure, the upper row is an image in the work area 18, and the lower row is an image processing icon 23 displayed in the icon display area.
This embodiment is different from the above embodiments in that a plurality of loop tools are provided in the image processing flow and the image processing group. In the present embodiment, as illustrated in FIG. 25, the workpiece 1 detected by the pattern search tool has a plurality of parts to be inspected. That is, in the example of FIG. 25, the work 1 made of a gear has a plurality of (for example, 11) teeth 33 as the inspection target part, and the detection of defects by the image processing tool is sequentially performed on these teeth 33 sequentially. Can be considered. In the present embodiment, the image processing tool corresponding to the first image processing icon 23a among the image processing tools constituting the image processing flow and the image processing group, as described above, the workpiece 1 having a predetermined shape included in the workpiece image. The pattern search tool to be detected, and the image processing tool corresponding to the next image processing icon 23b is a parts search tool for detecting a part to be inspected with respect to the work 1 detected by the pattern search tool. The image processing tools corresponding to the subsequent image processing icons 23c and 23d are image processing tools for performing defect detection, for example.

  In the present embodiment, the image processing tools corresponding to the image processing icons 23e and 23f are both loop tools. Among these, the loop tool corresponding to the image processing icon 23f functions as a first loop tool, and in the present embodiment, the leading pattern search tool is designated as the loop destination. As a result, each image processing tool from the pattern search tool to the image processing tool immediately before the first loop tool (in the present embodiment, the following second loop tool) is repeatedly executed. Hereinafter, this loop is referred to as a main loop (corresponding to the first loop processing in the present invention). The loop tool corresponding to the image processing icon 23e functions as a second loop tool, and in this embodiment, the parts search tool is designated as the loop destination. Thereby, each image processing tool from the part search tool to the image processing tool immediately before the second loop tool is repeatedly executed. Hereinafter, this loop is referred to as a sub-loop (corresponding to the second loop processing in the present invention).

  The parts search tool detects an inspection target portion determined to match the inspection target portion of the reference image with respect to the workpiece 1 specified by the target specification index, and assigns an individual index to each detected inspection target portion. To do. In the example of FIG. 25, serial numbers 1 to 11 are assigned as indexes to the plurality of teeth 33 detected as the inspection target parts for the workpiece 1b (1) designated by the target designation index. And the 2nd loop tool is comprised so that the value of the site | part designation | designated index which designates a test object site | part may be changed whenever a subloop is repeated. That is, the second loop tool adds the value of the part designation index, for example, one by one from the initial value. As a result, each time the sub-loop is repeated by the second loop tool, the inspection target parts designated by the part designation index are sequentially changed, and the combination of the image processing tools in the sub-loop is sequentially changed in the same manner for the plurality of examination target parts. Will be applied. Then, the sub-loop is repeated until the value of the part designation index becomes a value corresponding to the number detected by the parts search tool. Of course, also in this embodiment, a mode in which a sub-loop is applied to a part of a plurality of inspection target parts detected by the parts search tool may be selected. Then, after inspection of each inspection target part is performed on the workpiece 1 specified by the target specification index and the sub-loop is exited, the main loop is executed by the first loop tool, and is detected by the pattern search tool. Similarly, the image processing tools are sequentially executed for the other workpieces 1. That is, the main loop (first loop process) executed by the first loop tool includes a sub-loop (second loop process) executed by the second loop tool. According to the configuration of the present embodiment, it is possible to inspect a plurality of parts of the work 1 with a simple operation of adding the second loop tool in the image processing flow or the image processing group. In the present embodiment, an example is shown in which two loop tools, a first loop tool and a second loop tool, are provided in the image processing flow or the like. If the inspection target part is included, three or more loop tools may be provided accordingly. That is, the main loop may include a plurality of sub-loops. In this case, each sub-loop may perform independent loop processing, and other sub-loops may be included in the sub-loop. Other configurations are the same as those in the first embodiment.

  In addition, this invention is not limited to above-described embodiment, A various deformation | transformation is possible based on description of a claim. In short, an image processing tool configured to perform image processing on a captured image (work image) obtained by photographing a workpiece by various image processing tools, and constituting an image processing flow for a plurality of workpieces. As long as each is executed, the present invention can be applied to various image processing apparatuses.

  DESCRIPTION OF SYMBOLS 1 ... Work, 2 ... XY stage, 3 ... Image pick-up device, 6 ... Computer, 7 ... Display device, 8 ... Input device, 10 ... Image processing device, 11 ... Calculation part, 12 ... Memory | storage part, 13 ... Image input means, DESCRIPTION OF SYMBOLS 14 ... Image processing means, 17 ... User interface, 18 ... Work area, 19 ... Setting area, 20 ... Emphasis processing area, 21 ... Icon display area, 22 ... Scroll bar, 23 ... Image processing icon, 24 ... Group indication, 25 ... Group icon, 26 ... Scroll bar, 27 ... Area marking, 28 ... Detection marking, 30 ... Silicon wafer, 31 ... Selection area, 33 ... Teeth

Claims (15)

An image processing apparatus that performs image processing on a work image including a plurality of workpieces based on an image processing flow in which a plurality of image processing tools are combined,
The image processing apparatus includes: a loop tool that performs a loop process that sequentially applies a combination of image processing tools to each of a plurality of works included in the work image. The image processing flow includes, as an image processing tool, a search tool that detects a predetermined work included in a work image,
The image processing apparatus according to claim 1, wherein the loop tool performs the loop processing a number of times corresponding to the number of workpieces detected by the search tool.   The image processing apparatus according to claim 1, wherein the number of execution times of the loop processing by the loop tool is set by a user. The image processing flow includes, as an image processing tool, a search tool that detects a predetermined work included in a work image,
The number of executions of the loop processing by the loop tool can be selected from either automatic setting based on the number of workpieces detected by the search tool or setting by a user. The image processing apparatus described. The image processing flow includes, as an image processing tool, a search tool that detects a predetermined work included in a work image,
The image processing apparatus according to claim 1, wherein the loop tool has a mode in which the loop processing is selectively performed on a part of the workpieces detected by the search tool.   The image processing apparatus according to claim 5, wherein the loop tool selects workpieces to be inspected at regular intervals from workpieces detected by the search tool.   The loop tool sets a selection area for selecting a workpiece to be inspected from the workpieces detected by the search tool, distributed over the workpiece image, and sets the workpiece included in the selected area to be inspected. The image processing apparatus according to claim 5, wherein the image processing apparatus is selected as a workpiece. The image processing flow includes a first loop tool and a second loop tool,
The first loop process executed by the first loop tool includes a second loop process executed by the second loop tool. The image processing apparatus according to one item. Having icon display means for displaying on the display device an image processing icon corresponding to the image processing tool;
The said icon display means is comprised so that the group icon corresponding to the image processing group comprised from the combination of a several image processing tool can be displayed on the said display apparatus. The image processing apparatus according to claim 8.   The icon display means is configured to display the group icon corresponding to the image processing group including the loop tool and a plurality of image processing tools on which the loop processing is performed by the loop tool. The image processing apparatus according to claim 9.   The icon display means displays a group display state that displays the group icon corresponding to the image processing group, and an expanded display state that displays the image processing icons corresponding to the image processing tools included in the image processing group side by side. The image processing apparatus according to claim 9, wherein the image processing apparatus is configured to be able to be switched between.   In the summary display state, the icon display means changes a still image display state in which a still image of the group icon is displayed and an image processing icon corresponding to an image processing tool included in the image processing group to the still image. The image processing apparatus according to claim 11, wherein the image processing apparatus is configured to be capable of switching to a moving image display state in which images are sequentially displayed.   The icon display means is configured to be able to select and display an image processing icon corresponding to a part of the image processing tools included in the image processing group in the moving image display state. The image processing apparatus according to claim 12. An editing mode for editing the image processing group;
14. The editing mode according to claim 9, wherein the image processing group is configured to be edited by adding or deleting the image processing icon. 15. Image processing apparatus.   The image processing apparatus according to claim 14, wherein the editing mode is configured to register the edited image processing group as one of the image processing tools.

Images