WO2025163714A1 - Inspection device - Google Patents

Abstract

This inspection device comprises: a measurement unit that acquires shape data of an object; and a processing unit that refers to substrate data, in which information of an inspection portion indicating an inspection subject in the mounting substrate is set, and generates three-dimensional information of the inspection portion on the basis of the shape data of the object acquired by the measurement unit, the object being the mounting substrate. The processing unit sets, as the substrate data, information of a specific region in which superimposition of noise is assumed in the shape data of the mounting substrate, and when generating the three-dimensional information of the inspection portion, the processing unit performs mask processing for excluding specific data corresponding to the specific region in the shape data, or performs correction processing for correcting the specific data.

Description

Inspection Equipment

The present invention relates to an inspection device that inspects mounting boards on which components are mounted.

Patent Document 1 discloses a three-dimensional measuring device used to inspect the mounting state of components on a mounting board. The three-dimensional measuring device acquires three-dimensional data of an object using both the phase shift method and the light section method, and generates three-dimensional information about the object based on this three-dimensional data.

Modified boards have through-holes where lead terminals connected to components are inserted, silk sections where silk printing is performed, and clamp sections that hold the board in place. These through-holes, silk sections, clamp sections, and other areas are areas where noise is likely to be superimposed on the three-dimensional data. When three-dimensional information about an inspection area on a mounted board is generated based on three-dimensional data that has noise superimposed on it, a problem can occur where accurate three-dimensional information about the inspection area cannot be generated. In this case, it may not be possible to inspect the inspection area on the mounted board with high precision.

International Publication No. 2020-065850

The object of the present invention is to provide an inspection device that can inspect inspection areas on mounting boards with high accuracy.

An inspection device according to one aspect of the present invention is installed in a production line that produces mounted boards, which are printed circuit boards on which components are mounted, and inspects the mounted boards. This inspection device includes a measurement unit that acquires shape data of an object, and a processing unit that references board data in which information about an inspection area indicating an inspection target on the mounted board is set, and generates three-dimensional information of the inspection area based on the shape data acquired by the measurement unit with the mounted board as the object. The processing unit sets information about a specific area on the mounted board where noise is expected to be superimposed on the shape data in the board data, and when generating the three-dimensional information of the inspection area, performs a masking process to exclude specific data corresponding to the specific area in the shape data, or performs a correction process to correct the specific data.

The objects, features, and advantages of the present invention will become more apparent from the following detailed description and accompanying drawings.

FIG. 1 is a diagram showing the configuration of a production line to which an inspection device according to an embodiment of the present invention is applied. FIG. 2 is a block diagram showing the configuration of the inspection device. FIG. 3 is a cross-sectional view showing a measurement unit provided in the inspection device, and is a diagram showing the configuration of a first measurement section that acquires two-dimensional data. FIG. 4 is a diagram showing the configuration of a second measurement section that acquires three-dimensional data in the measurement unit. FIG. 5 is a diagram for explaining the processing content of the processing unit provided in the inspection device. FIG. 6 is a flowchart showing the flow of the board data creation process executed by the processing unit. FIG. 7 is a flowchart showing the flow of a specific area setting process based on three-dimensional data executed by the processing unit. FIG. 8 is a flowchart showing the flow of a specific area setting process based on two-dimensional data and three-dimensional data, which is executed by the processing unit. FIG. 9 is a flowchart showing the flow of the trained model creation process executed by the processing unit. FIG. 10 is a flowchart showing the flow of a specific area setting process based on design data executed by the processing unit. FIG. 11 is a flowchart showing the flow of the inspection process executed by the processing unit. FIG. 12 is a flowchart showing the flow of the new specific area setting process executed by the processing unit.

The following describes an inspection device according to an embodiment of the present invention, with reference to the drawings.

[Configuration of production line to which inspection device is applied]
FIG. 1 is a diagram showing the configuration of a production line 1 to which an inspection apparatus 2M according to this embodiment is applied. The production line 1 is a line that produces mounted boards P2, each having a component B mounted on a printed circuit board P1, and includes a board transport path TR and multiple operating devices. The board transport path TR is a transport path along which boards are transported. The multiple operating devices are arranged on the board transport path TR and perform predetermined operations on the boards. The multiple operating devices include a printing machine 11, a print inspection machine 12, a mounting machine 13, a board inspection machine 14, a reflow oven 15, and a visual inspection machine 16, which are arranged in tandem from upstream to downstream in the board transport direction along the board transport path TR.

The printer 11 applies solder to the pads of the printed circuit board P1. The print inspection machine 12 takes an image of the printed circuit board P1 to which solder has been applied, and inspects whether the position, amount, and height of the solder are appropriate. The mounting machine 13 is equipped with a component mounting head, and produces a mounted board P2 by mounting the required component B on the printed circuit board P1. The reflow oven 15 heats the mounted board P2 to melt the solder and fix the component B to the board.

The board inspection machine 14 takes images of the mounted board P2 produced by the mounting machine 13 and inspects the mounting condition of the components B on the mounted board P2, such as misalignment of the components B, lead misalignment, component lift, and soldering defects. The appearance inspection machine 16 takes images of the mounted board P2 after heat treatment in the reflow furnace 15 and, similar to the board inspection machine 14, inspects the mounting condition of the components B on the mounted board P2.

The inspection device 2M according to this embodiment is applied to the board inspection machine 14 and the visual inspection machine 16. In this case, the inspection device 2M acquires shape data of the mounting board P2 in order to inspect the mounting state of the component B on the mounting board P2, and generates three-dimensional information about the mounting board P2 based on the shape data.

The printed circuit boards P1 and mounted circuit boards P2 transported along the board transport path TR of production line 1 are marked with fiducial marks M and include through-hole sections A1 into which lead terminals connected to components B are inserted, silk sections A21 with silk printing, and clamp sections A22 that serve as holding sections when the boards are held. The through-hole sections A1 can be a specific area A on boards P1 and P2 where noise is expected to be superimposed on the shape data acquired by inspection device 2M. The silk sections A21 and clamp sections A22 are included in noise superimposition section A2 other than through-hole section A1 where noise is expected to be superimposed. In other words, the printed circuit boards P1 and mounted circuit boards P2 include the through-hole sections A1 and the noise superimposition section A2 including the silk sections A21 and clamp sections A22 as specific areas A where noise is expected to be superimposed on the shape data acquired by inspection device 2M.

[Configuration of inspection device]
2 is a block diagram showing the configuration of the inspection device 2M. The inspection device 2M is a device that inspects the mounting board P2 produced on the production line 1. The mounting board P2 is carried in to the inspection stage of the inspection device 2M while placed on a conveyor 202, and is carried out after inspection. The inspection device 2M includes a measurement unit 2 and a processing unit 5. The measurement unit 2 is a unit that acquires shape data D1 of an object. The measurement unit 2 is movable in the X, Y, and Z directions by a movement mechanism 201. The processing unit 5 performs processing to analyze the shape data D1 acquired by the measurement unit 2, and also performs processing to control the operation of the measurement unit 2.

<About the measurement unit>
The measurement unit 2 is configured to be able to acquire two-dimensional data D2 and three-dimensional data D3 of an object as shape data D1. When the object is a mounting substrate P2, the measurement unit 2 acquires two-dimensional data D2 and three-dimensional data D3 of the mounting substrate P2 as shape data D1. The measurement unit 2 includes a first measurement unit 3 that acquires the two-dimensional data D2 of the object, and a second measurement unit 4 that acquires three-dimensional data D3 of the object by a phase shift method.

Figure 3 is a cross-sectional view of the measurement unit 2. The measurement unit 2 includes a first camera 21. The first camera 21 is shared by the first measurement unit 3 and the second measurement unit 4. The first camera 21 includes a camera body 22 and a lens barrel 23. The camera body 22 includes an image sensor 24 that captures images. The image sensor 24 is a sensor in which pixels made of photoelectric conversion elements are arranged in a matrix. A CMOS sensor, for example, can be used as the image sensor 24. The lens barrel 23 includes multiple optical lenses that form an optical image of the object on the light receiving surface of the image sensor 24. A half mirror 25 that forms the measurement optical path of the first measurement unit 3 is arranged on the optical path within the lens barrel 23.

The first measurement unit 3 includes a coaxial illumination unit 31 and a multi-directional illumination unit 32 as illumination systems, and a camera body 22 as an imaging system. The coaxial illumination unit 31 irradiates coaxial illumination light L11 onto the mounting board P2 as an object. The coaxial illumination unit 31 includes an LED light-emitting unit and is attached to the side surface of the lens barrel 23. The coaxial illumination light L11 emitted from the coaxial illumination unit 31 is reflected by the half mirror 25 and irradiated onto the mounting board P2 along the imaging optical axis of the first camera 21. The reflected light RL from the mounting board P2 enters the camera body 22 through the lens barrel 23 and is received by the imaging sensor 24.

The multi-directional illumination unit 32 includes an upper illumination unit 34, a middle illumination unit 35, and a lower illumination unit 36, all of which are composed of LED light-emitting units. The upper illumination unit 34 is attached to the lower end of the first camera 21 and irradiates the mounting board P2 with upper illumination light L12 at an illumination angle close to the vertical direction. The upper illumination light L12 is, for example, white light or a combination of white light and infrared light. Reflected light RL of the upper illumination light L12 along the imaging optical axis is also received by the imaging sensor 24.

The middle illumination unit 35 irradiates the mounting board P2 with middle illumination light L13 at an illumination angle that is more tilted relative to the vertical direction than the upper illumination light L12. The middle illumination light L13 is, for example, white light. A dome reflector 331 with a hemispherical reflective surface is attached to the lower end of the first camera 21. The middle illumination unit 35 is positioned facing upward, and the middle illumination light L13 is reflected by the dome reflector 331 and irradiated onto the mounting board P2.

The lower illumination unit 36 irradiates the mounting substrate P2 with lower illumination light L14 at an illumination angle that is even more tilted relative to the vertical direction than the middle illumination light L13. The lower illumination light L14 is, for example, white light. A holding dish 332 with a larger diameter than the dome reflector 331 is attached to the lower end of the dome reflector 331. The lower illumination unit 36 is attached to the holding dish 332 at a predetermined inclination. Reflected light RL of the middle illumination light L13 and lower illumination light L14 along the imaging optical axis is also received by the imaging sensor 24.

The camera body 22 of the first camera 21 functions as a camera that captures a two-dimensional image of the mounting board P2 in the first measurement unit 3, which acquires the two-dimensional data D2. When the first measurement unit 3 acquires the two-dimensional data D2, one or more of the coaxial illumination unit 31, upper illumination unit 34, middle illumination unit 35, and lower illumination unit 36 are selected. As in this embodiment, by being able to emit coaxial illumination light L11, upper illumination light L12, middle illumination light L13, and lower illumination light L14, the mounting board P2 can be illuminated from multiple angles. This allows the first measurement unit 3 to acquire two-dimensional data D2 represented as a clear two-dimensional image of the mounting board P2 as the target object.

Figure 4 is a diagram showing the configuration of the second measurement unit 4 that acquires three-dimensional data D3 in the measurement unit 2. In Figure 4, the configuration related to the first measurement unit 3 is omitted from the measurement unit 2 shown in Figure 3. The second measurement unit 4 includes multiple projectors 41 as an illumination system and a camera body 22 as an imaging system. The projectors 41 are arranged at a predetermined inclination around the imaging optical axis of the first camera 21. In other words, the projection axis of the projector 41 is inclined at a predetermined angle with respect to the imaging optical axis. For example, four projectors 41 or eight projectors 41 are arranged at equal distances and evenly spaced intervals in the circumferential direction surrounding the imaging optical axis.

The second measurement unit 4, which employs the phase shift method, captures images while changing the phase of light irradiated onto the mounting substrate P2 as an object, and acquires three-dimensional data D3 of the surface of the mounting substrate P2. The projector 41 irradiates the mounting substrate P2 with pattern light L2, such as a sine wave pattern or stripe pattern. Reflected light RL1 of the pattern light L2 along the imaging optical axis is incident on the first camera 21. The imaging sensor 24 of the camera body 22 receives the reflected light RL1.

The projector 41 emits pattern light L2 with different phases per field of view, for example, four times. The first camera 21 captures an image each time pattern light L2 is emitted. The second measurement unit 4 analyzes the phase change resulting from the surface shape of the mounting board P2 based on the brightness change in the four acquired images. Then, based on the analysis results, the second measurement unit 4 acquires three-dimensional data D3 such as the height of component B on the mounting board P2.

<About the processing unit>
2 , the processing unit 5 is realized by a processor that operates by loading a predetermined program. The processing unit 5 performs processing to analyze the shape data D1, including the two-dimensional data D2 and three-dimensional data D3, acquired by the measurement unit 2, and also performs processing to control the operation of the measurement unit 2. The processing unit 5 functionally includes an axis processing unit 51, an image processing unit 52, a measurement processing unit 53, a memory unit 54, a display unit 55, an operation unit 56, and an overall processing unit 57.

The overall processing unit 57 performs processing to comprehensively control the operations of the axis processing unit 51, image processing unit 52, measurement processing unit 53, memory unit 54, display unit 55, and operation unit 56.

The display unit 55 is a display that displays various information and data. The operation unit 56 is composed of a keyboard, mouse, or a touch panel provided on the display unit 55. The operation unit 56 accepts input operations of various commands by the operator.

The memory unit 54 stores various data and setting values necessary for the operation of the inspection device 2M. For example, the memory unit 54 stores board data BD. The board data BD contains information regarding the position and shape of the inspection portion indicating the inspection target on the mounting board P2, and information regarding the position and shape of the specific area A on the mounting board P2. Note that if design data exists for the mounting board P2 that specifies the mounting position of component B and the position of the specific area A, this design data may be stored in the memory unit 54.

The axis processing unit 51 controls the movement mechanism 201 to move the measurement unit 2 in the X, Y, and Z directions. The movement mechanism 201 has an X-axis drive motor, a Y-axis drive motor, and a Z-axis drive motor for moving the measurement unit 2. The axis processing unit 51 controls these drive motors to move the measurement unit 2 to the imaging positions of the first measurement unit 3 and the second measurement unit 4.

The imaging processing unit 52 controls the first measurement unit 3 and second measurement unit 4 mounted on the measurement unit 2 to acquire shape data D1 including two-dimensional data D2 and three-dimensional data D3 of the mounting substrate P2.

The measurement processing unit 53 performs a setting process to set various information in the board data BD, and also performs an inspection process to inspect the mounting board P2. The board data BD in which various information has been set by the measurement processing unit 53 is stored in the memory unit 54. The measurement processing unit 53 performs an inspection process to inspect the mounting board P2 while referencing the board data BD. The setting process and inspection process performed by the measurement processing unit 53 will be explained below with reference to Figure 5.

The measurement processing unit 53 sets inspection portion information BD1 related to the inspection portion of the mounting substrate P2, and also sets specific area information BD2 related to the specific area A of the mounting substrate P2, in the substrate data BD.

Inspection portion information BD1 is information including the shape and position of the inspection portion on mounting board P2. This inspection portion information BD1 is associated with inspection item information BD11 indicating the inspection item of the inspection portion, and inspection method information BD12 indicating the inspection method for the inspection item. In the example shown in FIG. 5, the inspection portion indicated by inspection portion information BD1 is component B, the inspection item indicated by inspection item information BD11 is component height, and the inspection method indicated by inspection method information BD12 is three-dimensional data analysis. In this case, when performing inspection processing to inspect mounting board P2 while referencing board data BD, measurement processing unit 53 generates three-dimensional information DA of the height of component B on mounting board P2 based on three-dimensional data D3 of mounting board P2 acquired by measurement unit 2. Then, measurement processing unit 53 inspects whether the condition of the inspection portion on mounting board P2 is normal based on the generated three-dimensional information DA.

Specific area information BD2 is information about specific area A on mounting board P2 where noise is expected to be superimposed on the shape data D1 acquired by measurement unit 2. The measurement processing unit 53 sets information about through-hole section A1 formed on mounting board P2 as specific area information BD2 in the board data BD, and also sets information about noise superimposition section A2, which includes silk section A21 and clamp section A22, as specific area information BD2 in the board data BD. As described above, on mounting board P2, through-hole section A1 is a portion that could be specific area A where noise is expected to be superimposed on the shape data D1 acquired by measurement unit 2, and silk section A21 and clamp section A22 are included in noise superimposition section A2 other than through-hole section A1 where noise is expected to be superimposed.

Specific area information BD2 is associated with detection item information BD21 indicating detection items such as the shape and position of specific area A on mounting board P2, detection method information BD22 indicating the detection method for the detection items, and countermeasure method information BD23 indicating the countermeasure method for the data values of shape data D1 corresponding to specific area A. In the example shown in FIG. 5, the information associated with through-hole portion A1 indicated by specific area information BD2 includes: detection items indicated by detection item information BD21 are shape and position; detection methods indicated by detection method information BD22 are two-dimensional data analysis and three-dimensional data analysis; and countermeasure method indicated by countermeasure method information BD23 is masking. Furthermore, the information associated with noise superimposition portion A2 indicated by specific area information BD2 includes: detection items indicated by detection item information BD21 are shape and position; detection method indicated by detection method information BD22 is three-dimensional data analysis; and countermeasure method indicated by countermeasure method information BD23 is correction processing.

In this case, the measurement processing unit 53 extracts the through-hole portion A1 based on the two-dimensional data D2 and three-dimensional data D3 acquired by the measurement unit 2, and extracts the noise superimposed portion A2 based on the three-dimensional data D3, and sets information on the shape and position of the extracted through-hole portion A1 and noise superimposed portion A2 as specific area information BD2 in the board data BD. Then, when generating three-dimensional information DA of the inspection area of the mounting board P2 during the inspection process, the measurement processing unit 53 divides the three-dimensional data D3 of the mounting board P2 acquired by the measurement unit 2 into normal data D31 corresponding to areas other than the specific area A, and specific data D32 corresponding to the specific area A. Furthermore, the measurement processing unit 53 divides the specific data D32 into first data D321 corresponding to the through-hole portion A1 and second data D322 corresponding to the noise superimposed portion A2. The measurement processing unit 53 then references the countermeasure technique information BD23 associated with the specific region information BD2 set in the board data BD, performs masking to remove the first data D321 corresponding to the through-hole portion A1, and performs correction processing to correct the second data D322 corresponding to the noise superimposition portion A2 to, for example, "0," the ideal height value measured with the board surface as the reference. As a result, the measurement processing unit 53 can generate three-dimensional information DA of the inspection portion of the mounting board P2 based on the three-dimensional data D3 obtained by excluding data corresponding to the through-hole portion A1, where noise is expected to be superimposed, and correcting data corresponding to the noise superimposition portion A2. In this case, accurate three-dimensional information DA can be generated for the inspection portion, enabling the inspection portion to be inspected with high precision.

(Board data creation process)
In this embodiment, the processing unit 5 is capable of performing a board data creation process for creating board data BD in the measurement processing unit 53. The measurement processing unit 53 performs the board data creation process prior to an inspection process for inspecting the inspection portion of the mounting board P2 so as to be linked to the production of the mounting board P2 in the production line 1. The board data creation process performed by the measurement processing unit 53 will be described with reference to the flowchart of FIG.

The measurement processing unit 53 converts, for example, board data for the mounting machine used by the mounting machine 13 into data for the inspection device, and causes the measurement unit 2 to acquire an overall image of the prototype board via the imaging processing unit 52 (step s1). The prototype board is a board prototyped by the mounting machine 13 before the production of the mounting board P2, and is a board on which components B are mounted in the same way as the mounting board P2. The measurement processing unit 53 sets information about the board's fiducial marks M in the board data BD based on the overall image of the prototype board (step s2).

Next, the measurement processing unit 53 causes the measurement unit 2 to acquire shape data D1, including two-dimensional data D2 and three-dimensional data D3 for each field of view of the prototype board, via the imaging processing unit 52 (step s3). Then, the measurement processing unit 53 sets inspection area information BD1 in the board data BD based on the shape data D1 of the prototype board (step s4), and sets inspection item information BD11 and inspection method information BD12 in the board data BD in association with the inspection area information BD1 (step s5).

Next, the measurement processing unit 53 determines whether or not a through-hole portion A1 exists based on the prototype board shape data D1 (step s6), and if so, recognizes the shape and position of the through-hole portion A1 (step s7). The measurement processing unit 53 also determines whether or not a noise superimposition portion A2 including a silk portion A21 and a clamp portion A22 exists based on the prototype board shape data D1 (step s8), and if so, recognizes the shape and position of the noise superimposition portion A2 (step s9). The measurement processing unit 53 then performs a specific area setting process to set specific area information BD2, which is information about the specific area A including the through-hole portion A1 and the noise superimposition portion A2, in the board data BD (step s10).

(Specific area setting process)
The measurement processing unit 53 performs a specific area setting process when creating the board data BD. In the specific area setting process, the measurement processing unit 53 extracts a specific area A based on the shape data D1 acquired by the measurement unit 2 using the printed circuit board P1 as the target, and sets information about the extracted specific area A as specific area information BD2 in the board data BD. That is, the measurement processing unit 53 sets information about the specific area A in the board data BD in advance when creating the board data BD, prior to the inspection process that generates and inspects three-dimensional information DA of the inspection portion of the mounted board P2. In this case, when the measurement processing unit 53 performs the inspection process to inspect the inspection portion of the mounted board P2, the process of setting information about the specific area A in the board data BD can be omitted. This simplifies the inspection process for the mounted board P2 by the measurement processing unit 53 and improves the takt time.

Alternatively, the measurement processing unit 53 may perform the specific area setting process during setup before production of the mounted board P2 on the production line 1. In this case, the measurement processing unit 53 can extract the specific area A based on the shape data D1 acquired by the measurement unit 2 using the printed board P1 as the target during production setup on the production line 1, and set the information about the extracted specific area A in the board data BD as specific area information BD2.

The measurement processing unit 53 may extract a specific area A based solely on the three-dimensional data D3 acquired by the measurement unit 2, and set information about the extracted specific area A as specific area information BD2 in the board data BD. The specific area setting process performed by the measurement processing unit 53 in this case will be described with reference to the flowchart in Figure 7.

The measurement processing unit 53 causes the measurement unit 2 to acquire three-dimensional data D3 of the printed circuit board P1 via the imaging processing unit 52 (step a1). The measurement processing unit 53 then determines whether the data value H of the three-dimensional data D3 is less than the lower limit value Thlo of a predetermined judgment range (step a2). The predetermined judgment range indicates the range of three-dimensional data D3 in which the three-dimensional information DA generated based on the three-dimensional data D3 is the ideal "0 (zero)," and is indicated by the range from the lower limit value Thlo to the upper limit value Thhi. The measurement processing unit 53 extracts the area of the printed circuit board P1 where the data value H of the three-dimensional data D3 is less than the lower limit value Thlo of the judgment range as a specific area A corresponding to the through-hole portion A1, and sets the information of the extracted through-hole portion A1 in the board data BD (step a3).

Next, the measurement processing unit 53 determines whether the data value H of the three-dimensional data D3 exceeds the upper limit value Thhi of a predetermined judgment range (step a4). The measurement processing unit 53 extracts the area of the printed circuit board P1 where the data value H of the three-dimensional data D3 exceeds the upper limit value Thhi of the judgment range as a specific area A corresponding to the noise superimposition area A2, and sets the information of the extracted noise superimposition area A2 in the board data BD (step a5).

As described above, the measurement processing unit 53 can appropriately extract, as a specific area A, an area on the printed circuit board P1 where the data value H of the three-dimensional data D3 is outside a predetermined judgment range, and set information about the extracted specific area A in the board data BD.

The measurement processing unit 53 may also extract a specific area A based on both the two-dimensional data D2 and the three-dimensional data D3 acquired by the measurement unit 2, and set information about the extracted specific area A as specific area information BD2 in the board data BD. The specific area setting process performed by the measurement processing unit 53 in this case will be described with reference to the flowchart in Figure 8.

The measurement processing unit 53 causes the measurement unit 2 to acquire two-dimensional data D2 and three-dimensional data D3 of the printed circuit board P1 via the imaging processing unit 52 (step b1).

The measurement processing unit 53 performs binarization processing to binarize the brightness values of the pixels that make up the two-dimensional image represented by the two-dimensional data D2, thereby distinguishing the area of the two-dimensional image into high-brightness areas and the remaining areas (step b2). The measurement processing unit 53 acquires contour data of the high-brightness areas in the two-dimensional image (step b3), and extracts high-brightness areas whose contour shapes satisfy predetermined shape conditions (step b4). For example, the measurement processing unit 53 extracts high-brightness areas whose contour shapes satisfy predetermined circularity conditions.

Next, the measurement processing unit 53 recognizes the three-dimensional data D3 corresponding to the extracted high-brightness portion (step b5) and determines whether the data value H of the three-dimensional data D3 is less than the lower limit Thlo of the predetermined judgment range (step b6). The measurement processing unit 53 extracts the area on the printed circuit board P1 where the data value H of the three-dimensional data D3 is less than the lower limit Thlo of the judgment range as a specific area A corresponding to the through-hole portion A1, and sets the information on the extracted through-hole portion A1 in the board data BD (step b7). The measurement processing unit 53 also determines whether the data value H of the three-dimensional data D3 exceeds the upper limit Thhi of the predetermined judgment range (step b8). The measurement processing unit 53 extracts the area on the printed circuit board P1 where the data value H of the three-dimensional data D3 exceeds the upper limit Thhi of the judgment range as a specific area A corresponding to the noise superimposition portion A2, and sets the information on the extracted noise superimposition portion A2 in the board data BD (step b9).

As described above, the measurement processing unit 53 can appropriately extract, as specific area A, an area on the printed circuit board P1 where the contour shape based on the two-dimensional data D2 satisfies predetermined shape conditions and where the data value H of the three-dimensional data D3 is outside a predetermined judgment range, and set information about the extracted specific area A in the board data BD.

Furthermore, when the measurement processing unit 53 sets information about the specific area A as the specific area information BD2 in the substrate data BD, and extracts the specific area A based on the three-dimensional data D3 acquired by the measurement unit 2, the measurement processing unit 53 may extract the specific area A using a trained model that has learned examples of the three-dimensional data D3 in the specific area A. The measurement processing unit 53 can appropriately extract the specific area A using the trained model.

The measurement processing unit 53 is capable of performing a process for creating a trained model. The measurement processing unit 53 learns examples of three-dimensional data D3 in specific area A through machine learning using a neural network. The measurement processing unit 53 then uses the three-dimensional data D3 as input data and generates a trained model that outputs information about specific area A. This trained model creation process will be explained with reference to the flowchart in Figure 9.

The measurement processing unit 53 causes the measurement unit 2 to acquire two-dimensional data D2 and three-dimensional data D3 of the universal board via the imaging processing unit 52 (step c1). The universal board is a sample board for creating a trained model, and is a board with multiple through-holes formed similar to those of the printed board P1 and mounting board P2.

The measurement processing unit 53 performs a binarization process to binarize the brightness values of the pixels that make up the two-dimensional image represented by the two-dimensional data D2 of the universal board, thereby distinguishing the areas of the two-dimensional image into high-brightness areas and the remaining areas (step c2). The measurement processing unit 53 acquires contour data of the high-brightness areas in the two-dimensional image of the universal board (step c3) and extracts high-brightness areas whose contour shapes satisfy predetermined shape conditions (step c4). The measurement processing unit 53 then recognizes three-dimensional data D3 corresponding to the extracted high-brightness areas (step c5). This allows the measurement processing unit 53 to create a trained model that has learned examples of three-dimensional data D3 for the through-hole portion A1 as the specific area A (step c6). The trained model created in this way uses the three-dimensional data D3 as input data and outputs information about the specific area A.

The measurement processing unit 53 may also extract a specific area A based on the design data CAD of the mounting board P2, and set information about the extracted specific area A in the board data BD. The design data CAD is stored, for example, in the memory unit 54. When multiple specific areas A are extracted based on the design data CAD, the measurement processing unit 53 sets information about all or part of the multiple specific areas A in the board data BD. The specific area setting process performed by the measurement processing unit 53 in this case will be described with reference to the flowchart in Figure 10.

The measurement processing unit 53 acquires design data CAD for the mounting board P2 from the memory unit 54 (step d1). The measurement processing unit 53 recognizes the position and shape of the through-hole portion A1 based on the design data CAD (step d2), and sets the recognized information for the through-hole portion A1 in the board data BD as information for the specific area A (step d3). The measurement processing unit 53 also recognizes the position and shape of the noise superimposition portion A2 based on the design data CAD (step d4), and sets the recognized information for the noise superimposition portion A2 in the board data BD as information for the specific area A (step d5).

As described above, the measurement processing unit 53 sets information about the specific area A in the board data BD based on the design data CAD of the mounting board P2. In this case, when the measurement processing unit 53 performs the process of setting information about the specific area A in the board data BD, it is possible to omit the work of acquiring the shape data D1 by the measurement unit 2. This simplifies the process of setting information about the specific area A by the measurement processing unit 53 and improves the takt time.

Furthermore, during production of the mounting board P2 on the production line 1, the measurement processing unit 53 may extract a specific area A based on the shape data D1 acquired by the measurement unit 2 using the mounting board P2 as the target, and set the information of the extracted specific area A in the board data BD. According to this aspect, the measurement processing unit 53 can perform an inspection process that generates three-dimensional information DA of the inspection portion of the mounting board P2 and inspects it, while performing a process of setting the information of the specific area A in the board data BD based on the shape data D1 of the mounting board P2 acquired by the measurement unit 2, so as to be linked to the production of the mounting board P2 on the production line 1. The inspection process performed by the measurement processing unit 53 in this case will be described with reference to the flowcharts of Figures 11 and 12.

During the inspection process, the measurement processing unit 53 causes the measurement unit 2 to acquire shape data D1, including two-dimensional data D2 and three-dimensional data D3, of the mounting substrate P2 via the imaging processing unit 52 (step e1). The measurement processing unit 53 analyzes the state of noise superposition in the shape data D1 of the mounting substrate P2 (step e2).

The measurement processing unit 53 determines whether data corresponding to the noise superimposed portion A2 is present in the shape data D1 of the mounting board P2 (step e3). If data corresponding to the noise superimposed portion A2 is present, the measurement processing unit 53 sets the information about the noise superimposed portion A2 in the board data BD as information about the specific area A (step e4) and performs a correction process to correct the data corresponding to the noise superimposed portion A2 to, for example, an ideal "0 (zero)" (step e5). The measurement processing unit 53 also determines whether data corresponding to the through-hole portion A1 is present in the shape data D1 of the mounting board P2 (step e6). If data corresponding to the through-hole portion A1 is present, the measurement processing unit 53 sets the information about the through-hole portion A1 in the board data BD as information about the specific area A (step e7) and performs a mask process to exclude the data corresponding to the through-hole portion A1 (step e8).

Next, the measurement processing unit 53 determines whether a new noise superimposition portion not set in the board data BD exists based on the shape data D1 of the mounting board P2 (step e9). If a new noise superimposition portion exists, the measurement processing unit 53 performs a new specific area setting process to set information about the new noise superimposition portion in the board data BD (step e10). After the new specific area setting process, the measurement processing unit 53 generates three-dimensional information DA of the inspection portion on the mounting board P2 based on three-dimensional data D3 in which data corresponding to the through-hole portion A1 where noise is expected to be superimposed has been excluded and data corresponding to the noise superimposition portion A2 has been corrected. The measurement processing unit 53 then inspects whether the condition of the inspection portion on the mounting board P2 is normal based on the generated three-dimensional information DA (step e11). In this case, the measurement processing unit 53 can generate accurate three-dimensional information DA about the inspection portion, allowing for accurate inspection of the inspection portion.

The measurement processing unit 53 performs the following process for the new specific area setting process. That is, if a new noise superimposition area is present on the mounting board P2, the measurement processing unit 53 temporarily suspends the inspection process (step f1) and displays an image of the new noise superimposition area on the display unit 55 (step f2). The measurement processing unit 53 then outputs request information requesting the operator to determine whether or not a new noise superimposition area needs to be set for the board data BD (step f3).

In response to the request information, the measurement processing unit 53 determines whether a command to set a new noise superimposition area has been input to the operation unit 56 (step f4). If a setting command has been input to the operation unit 56, the measurement processing unit 53 displays a setting screen on the display unit 55 for setting information about the new noise superimposition area in the board data BD (step f5). In response to the input operation on the setting screen, the measurement processing unit 53 sets the information about the new noise superimposition area in the board data BD as information about a new specified area (step f6). The measurement processing unit 53 then performs correction or masking on the data corresponding to the new noise superimposition area in the shape data D1 of the mounting board P2 (step f7) and resumes the inspection process (step f8).

Other Embodiments
Although the embodiment of the present invention has been described above, the present invention is not limited to the above embodiment. For example, the following modified embodiment may be adopted.

The mounting board P2 includes a double-sided mounting board with components mounted on both the first and second surfaces in the thickness direction. In this case, the inspection device 2M may be applied to a device that inspects double-sided mounting boards. When inspecting the mounting state of components on the second surface of a double-sided mounting board after components have already been mounted on the first surface, noise may be superimposed on the shape data D1 related to the area on the second surface that corresponds to the mounting position of the components on the first surface. Therefore, when inspecting a double-sided mounting board, the measurement processing unit 53 of the processing unit 5 simply sets information about the area on the second surface that corresponds to the mounting position of the components on the first surface in the board data BD as information about the specific area A.

In this case, the measurement processing unit 53 references the information on the specific area A on the second surface set in the board data BD, and performs masking or correction processing on the data corresponding to the specific area A on the second surface in the shape data D1 of the double-sided mounted board acquired by the measurement unit 2. As a result, the measurement processing unit 53 can generate three-dimensional information DA of the inspection area on the second surface of the double-sided mounted board based on three-dimensional data D3 from which data corresponding to the specific area A on the second surface where noise is expected to be superimposed has been removed or corrected during the inspection process. In this case, accurate three-dimensional information DA for the inspection area can be generated, allowing the inspection area to be inspected with high precision.

[Inventions included in the above embodiments]
The above-described embodiment includes the following inventions.

An inspection device according to one aspect of the present invention is installed in a production line that produces mounted boards, which are printed circuit boards on which components are mounted, and inspects the mounted boards. This inspection device includes a measurement unit that acquires shape data of an object, and a processing unit that references board data in which information about an inspection area indicating an inspection target on the mounted board is set, and generates three-dimensional information of the inspection area based on the shape data acquired by the measurement unit with the mounted board as the object. The processing unit sets information about a specific area on the mounted board where noise is expected to be superimposed on the shape data in the board data, and when generating the three-dimensional information of the inspection area, performs a masking process to exclude specific data corresponding to the specific area in the shape data, or performs a correction process to correct the specific data.

With this inspection device, when generating three-dimensional information about the inspection area of the mounting board, the processing unit references information about the specific area set in the board data and performs masking or correction processing on specific data corresponding to the specific area in the shape data of the mounting board acquired by the measurement unit. This allows the processing unit to generate three-dimensional information about the inspection area on the mounting board based on shape data from which data corresponding to the specific area where noise is expected to be superimposed has been removed or corrected. In this case, accurate three-dimensional information about the inspection area can be generated, allowing the inspection area to be inspected with high precision.

In the above-mentioned inspection device, the processing unit may set information about at least one of the through-hole portions formed on the mounting board and noise superimposition portions other than the through-hole portions where noise superimposition is expected in the board data as information about the specific region.

In this aspect, when generating three-dimensional information about the inspection area of the mounting board, the processing unit performs masking or correction on specific data corresponding to through-hole portions and noise superimposition portions set as specific areas in the board data in the shape data of the mounting board acquired by the measurement unit. This allows the processing unit to generate three-dimensional information about the inspection area of the mounting board based on shape data from which data corresponding to through-hole portions and noise superimposition portions where noise superimposition is expected has been removed or corrected.

In the above-described inspection device, the processing unit may perform processing to create the board data, and when creating the board data, the measurement unit may extract the specific area based on the shape data acquired using the printed circuit board as the target object, and set information about the extracted specific area in the board data.

In this aspect, when creating the board data, the processing unit sets information about the specific area in the board data based on the shape data of the printed circuit board acquired by the measurement unit. That is, when creating the board data, prior to the process of generating and inspecting three-dimensional information about the inspection portion of the mounted board, the processing unit sets information about the specific area in the board data in advance. In this case, when the processing unit performs the process of inspecting the inspection portion of the mounted board, the process of setting information about the specific area in the board data can be omitted. This makes it possible to simplify the inspection process for mounted boards by the processing unit and improve takt time.

In the above-mentioned inspection device, the processing unit may perform processing to create the board data, and when creating the board data, may extract the specific area based on design data for the mounting board, and set information about the extracted specific area in the board data.

Furthermore, in the above-mentioned inspection device, if multiple specific regions are extracted, the processing unit may set information about all or part of the multiple specific regions in the substrate data.

In this aspect, when creating the board data, the processing unit sets information about the specific area in the board data based on the design data for the mounting board. In this case, when the processing unit performs the process of setting information about the specific area in the board data, it is possible to omit the work of acquiring shape data by the measurement unit. This simplifies the process of setting information about the specific area by the processing unit and improves takt time.

In the above-described inspection device, the processing unit may extract the specific area based on the shape data acquired by the measurement unit using the mounting board as the target object during production of the mounting board on the production line, and set information about the extracted specific area in the board data.

In this aspect, the processing unit can perform processing to set information about a specific area in the board data based on the shape data of the mounted board acquired by the measurement unit, in conjunction with the production of mounted boards on the production line, while also generating three-dimensional information about the inspection area of the mounted board and performing inspection processing.

In the above-described inspection device, the processing unit may extract the specific area based on the shape data acquired by the measurement unit using the printed circuit board as the target object during production setup on the production line, and set information about the extracted specific area in the board data.

In this aspect, the processing unit can perform processing to set information about specific areas in the board data based on the shape data of the printed circuit board acquired by the measurement unit during production setup on the production line.

In the above-described inspection device, the measurement unit may acquire two-dimensional data and three-dimensional data of the object as the shape data, and the processing unit may extract the specific area of the mounting board based on the three-dimensional data acquired by the measurement unit or both the two-dimensional data and the three-dimensional data, and set information about the extracted specific area in the board data.

In this aspect, the processing unit can perform processing to set information about a specific area in the substrate data based on the three-dimensional data acquired by the measurement unit, or both the two-dimensional data and the three-dimensional data.

In the above-described inspection device, the processing unit may extract, as the specific area, an area on the mounting board where the data values of the three-dimensional data are outside a predetermined judgment range.

Furthermore, in the above-mentioned inspection device, the processing unit may extract as the specific area an area on the mounting board where the contour shape based on the two-dimensional data satisfies predetermined shape conditions and where the data value of the three-dimensional data is outside a predetermined judgment range.

In this embodiment, the processing unit can appropriately extract a specific region based on the three-dimensional data acquired by the measurement unit, or on both the two-dimensional data and the three-dimensional data.

In the above-mentioned inspection device, the processing unit may extract the specific area of the mounting board using a trained model that has been trained on examples of the three-dimensional data in the specific area.

In this manner, the processing unit can appropriately extract specific regions using the trained model.

In the above-mentioned inspection device, the mounting board includes a double-sided mounting board in which components are mounted on both the first and second surfaces in the thickness direction.

In this aspect, the inspection device can be used as a device for inspecting double-sided mounted boards. For example, when inspecting the mounting state of components on the second surface of a double-sided mounted board after components have already been mounted on the first surface, there is a possibility that noise will be superimposed on the shape data relating to the area on the second surface that corresponds to the mounting position of the component on the first surface. Therefore, when inspecting a double-sided mounted board, the processing unit can set information about the area on the second surface that corresponds to the mounting position of the component on the first surface as information about the specific area in the board data.

As described above, according to the present invention, it is possible to provide an inspection device that can inspect an inspection portion of a mounting board with high precision.

Claims (12)

An inspection device that is provided in a production line that produces mounted boards in which components are mounted on printed circuit boards, and that inspects the mounted boards,
a measurement unit for acquiring shape data of an object;
a processing unit that references board data in which information about an inspection portion indicating an inspection target on the mounting board is set, and generates three-dimensional information about the inspection portion based on the shape data acquired by the measurement unit using the mounting board as the target,
The processing unit
setting information about a specific area on the mounting board where noise is expected to be superimposed on the shape data in the board data;
When generating the three-dimensional information of the inspection area, an inspection device performs a masking process to exclude specific data corresponding to the specific region in the shape data, or performs a correction process to correct the specific data. 2. The inspection device according to claim 1,
The processing unit sets information on at least one area of a through-hole portion formed in the mounting board and a noise superposition portion other than the through-hole portion where noise is expected to be superimposed in the board data as information on the specific area. 2. The inspection device according to claim 1,
The processing unit
A process for creating the board data can be performed,
An inspection device in which, when creating the board data, the measurement unit extracts the specific area based on the shape data acquired of the printed circuit board as the object, and sets information about the extracted specific area in the board data. 2. The inspection device according to claim 1,
The processing unit
A process for creating the board data can be performed,
An inspection device that, when creating the board data, extracts the specific area based on design data of the mounting board, and sets information about the extracted specific area in the board data. 5. The inspection device according to claim 4,
When a plurality of the specific regions are extracted, the processing unit sets information on all or part of the plurality of specific regions in the substrate data. 2. The inspection device according to claim 1,
The processing unit extracts the specific area based on the shape data acquired by the measurement unit using the mounting board as the target object during production of the mounting board on the production line, and sets information about the extracted specific area in the board data. 2. The inspection device according to claim 1,
The processing unit extracts the specific area based on the shape data acquired by the measurement unit using the printed circuit board as the target object during production setup on the production line, and sets information about the extracted specific area in the board data. 2. The inspection device according to claim 1,
the measurement unit is capable of acquiring two-dimensional data and three-dimensional data of the object as the shape data,
The processing unit extracts the specific area of the mounting board based on the three-dimensional data acquired by the measurement unit, or both the two-dimensional data and the three-dimensional data, and sets information about the extracted specific area in the board data. 9. The inspection device according to claim 8,
The processing unit extracts, as the specific area, an area on the mounting board where the data value of the three-dimensional data is outside a predetermined determination range. 9. The inspection device according to claim 8,
The processing unit extracts, as the specific area, an area on the mounting board where the contour shape based on the two-dimensional data satisfies predetermined shape conditions and where the data value of the three-dimensional data is outside a predetermined judgment range. 9. The inspection device according to claim 8,
The processing unit extracts the specific area of the mounting board using a trained model that has been trained on examples of the three-dimensional data in the specific area. 2. The inspection device according to claim 1,
The mounting board includes a double-sided mounting board having components mounted on both a first surface and a second surface in the thickness direction.