WO2015076343A1 - Data-stitching device, data-stitching method, and computer program - Google Patents
Data-stitching device, data-stitching method, and computer program Download PDFInfo
- Publication number
- WO2015076343A1 WO2015076343A1 PCT/JP2014/080802 JP2014080802W WO2015076343A1 WO 2015076343 A1 WO2015076343 A1 WO 2015076343A1 JP 2014080802 W JP2014080802 W JP 2014080802W WO 2015076343 A1 WO2015076343 A1 WO 2015076343A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- elastic
- measurement
- stitching
- elastic body
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B2210/00—Aspects not specifically covered by any group under G01B, e.g. of wheel alignment, caliper-like sensors
- G01B2210/52—Combining or merging partially overlapping images to an overall image
Definitions
- the present invention relates to an apparatus, a method, and a computer program for stitching a plurality of data.
- Patent Documents 1 and 2 disclose a method of calculating shape data of the entire test surface by connecting shape data obtained by partially measuring the test surface.
- Data stitching (data connection) is not limited to stitching of shape measurement data, but is performed on various data such as stitching of a plurality of image data.
- ⁇ ⁇ Simple average is used to calculate the midpoint.
- rotation and offset values a total of six parameters including three parameters related to translation and three parameters related to rotation
- the least square method is often used as a method for determining these parameters.
- connection such as three-dimensional data
- connection error is distributed only to the data connection region, and tends to be a value far from a likely value (maximum likelihood value).
- an object of the present invention is to provide a new technical means for suppressing a mismatch of connection areas in data stitching.
- the present invention from a certain viewpoint is a data stitching device for stitching a plurality of data each having a plurality of data elements,
- Each of the plurality of data is regarded as data of the shape of the elastic body, and includes a processing unit that obtains elastic deformation generated in each of the plurality of elastic bodies corresponding to the plurality of data,
- the shape of the elastic body is a shape connecting values indicated by a plurality of data elements included in the data,
- the elastic deformation is caused by connecting the plurality of elastic bodies to each other so that the positions coincide with each other at the position of the elastic body corresponding to the data element that should have the same data element value in the plurality of data.
- the processing unit is a data stitching device that outputs data indicating the shapes of the plurality of elastic bodies having undergone the elastic deformation as stitching data obtained by stitching the plurality of data.
- the processing unit is a data stitching device that outputs data indicating the shapes of the plurality of elastic bodies having undergone the elastic deformation as stitching data obtained by stitching the plurality of data.
- the present invention performs data stitching by an approach completely different from conventional data stitching, in which analysis of elastic deformation is applied to data analysis called data stitching.
- the processing unit is configured to set an elastic modulus of each of the plurality of elastic bodies.
- the said process part can set a different elastic modulus to each of a some elastic body.
- the processing unit is configured to determine an elastic modulus of each of the plurality of elastic bodies based on reliability of each of the plurality of data.
- the processing unit is configured to perform a process of adding an interpolation data element for interpolating the plurality of data elements to at least one of the plurality of data, and the value of the data element in the plurality of data
- the data elements that should be matched preferably include the interpolated data elements.
- the processing unit is configured to obtain internal stress of the plurality of elastic bodies in which the elastic deformation has occurred, and detect inappropriate data among the plurality of data based on the internal stress. Is preferred.
- the processing unit obtains internal stress of the plurality of elastic bodies in which the elastic deformation has occurred, and detects inappropriate connection of the plurality of elastic bodies based on the internal stress.
- the processing unit obtains the elastic deformation by deformation analysis using a plurality of elastic body deformation models generated based on the plurality of data.
- each of the plurality of elastic body deformation models includes at least a plurality of elements that can be bent and deformed.
- the element preferably includes a beam element.
- the element preferably includes a shell element.
- the deformation analysis is preferably performed by a finite element method.
- the elastic deformation includes at least bending deformation.
- the plurality of data are a plurality of shape measurement data obtained by measuring the surface of the measurement object along a plurality of measurement paths
- Each of the plurality of data elements is a data element indicating a measurement value on the measurement path
- Each of the plurality of measurement paths has an intersection with another measurement path included in the plurality of measurement paths
- the shape of the elastic body is a shape of a line connecting the measurement values indicated by a plurality of data elements included in the shape measurement data
- the elastic deformation is preferably elastic deformation generated by connecting the plurality of elastic bodies so that the positions coincide with each other at the position of the elastic body corresponding to the data element indicating the measurement value of the intersection.
- the plurality of data is image data, Each of the plurality of data elements is a pixel; Each of the shooting ranges of the plurality of image data has an overlapping area with shooting ranges of other image data included in the plurality of image data,
- the shape of the elastic body is a shape of a surface connecting pixel values indicated by a plurality of pixels included in the image data,
- the elastic deformation is preferably elastic deformation generated by connecting the plurality of elastic bodies so that the positions coincide with each other at the positions of the elastic bodies corresponding to the pixels included in the overlapping region.
- the plurality of data are a plurality of observation data obtained by observing an observation object with an observation device, Each of the observation ranges of the plurality of observation data preferably has an overlapping area with the observation ranges of other observation data included in the plurality of observation data.
- the processing unit is configured to perform a process of evaluating how to observe the observation object,
- the processing to be evaluated is preferably performed based on a result of eigenvalue analysis on the whole of the plurality of elastic bodies in which the elastic deformation has occurred.
- the present invention from another viewpoint is a method in which a computer performs a process of stitching a plurality of data each having a plurality of data elements, Each of the plurality of data is regarded as data of the shape of the elastic body, and the computer executes a process for obtaining elastic deformation occurring in each of the plurality of elastic bodies corresponding to the plurality of data,
- the computer outputs data indicating the shapes of the plurality of elastic bodies in which the elastic deformation has occurred as stitching data obtained by stitching the plurality of data
- the shape of the elastic body includes a value connecting values indicated by a plurality of data elements included in the data,
- the elastic deformation is caused by connecting the plurality of elastic bodies to each other so that the positions coincide with each other at the position of the elastic body corresponding to the data element that should have the same data element value in the plurality of data. It is.
- the present invention from another point of view A computer program for causing a computer to execute a process of stitching a plurality of data each having a plurality of data elements,
- the processing is as follows:
- Each of the plurality of data is regarded as data of the shape of the elastic body, obtaining elastic deformation generated in each of the plurality of elastic bodies corresponding to the plurality of data;
- Including The shape of the elastic body is a shape connecting values indicated by a plurality of data elements included in the data,
- the elastic deformation is caused by connecting the plurality of elastic bodies to each other so that the positions coincide with each other at the position of the elastic body corresponding to the data element that should have the same data element value in the plurality of data.
- the present invention is a recording medium on which the computer program is recorded.
- FIG. 1 shows a stitching apparatus 1 according to the embodiment.
- the stitching processing apparatus 1 described below is used for stitching (connecting) a plurality of data (data to be stitched) to obtain stitching data.
- the stitching device 1 according to the embodiment handles a plurality of measurement data output from the measurement device 2 as a plurality of stitched data. A wide range of measurement data can be obtained by performing data stitching.
- the “stitched data” is not limited to the measurement data, and for example, the data (for example, measurement data) obtained for a part of a specific target (for example, measurement target or imaging target). Or image data).
- the stitching device 1 includes a data acquisition unit 2 and a processing device 3.
- the data acquisition unit 2 in the present embodiment is configured as a measurement device that measures the surface shape of a (measurement) object and outputs measurement data to the processing device 3.
- the data acquisition unit 2 is not limited to the measurement device, and may be a camera that outputs image data to be stitched data, for example. That is, the data acquisition part 2 should just be what can acquire the data about a specific object. In other words, the data acquisition unit 2 only needs to be able to observe an observation target (for example, a measurement target or a photographing target) with an observation device (for example, a measurement device or a camera) and acquire observation data of the observation target.
- an observation target for example, a measurement target or a photographing target
- an observation device for example, a measurement device or a camera
- Observation devices such as measurement devices and cameras have a limited observation range (for example, a measurement range and an imaging range).
- a limited observation range can be expanded by data connection (data stitching) of a plurality of observation data having an overlap region of the observation range in the overlap region.
- the data acquisition unit 2 may not be provided, and the processing device 3 acquires and processes the stitched data stored in the storage unit 12 in the processing device 3 or an external storage device. Also good.
- the processing device 3 is configured by a computer, and includes a processing unit 11, a storage unit 12, an input unit 13 such as a keyboard / mouse, and an output unit 14 such as a display.
- the processing unit 11 exhibits the functions of the processing device 3 by executing the computer program stored in the storage unit 12.
- the processing unit 11 includes a data acquisition processing unit 11a, an elastic modulus setting unit (deformation model generation unit) 11b, a coincidence data point setting unit 11c, a deformation calculation unit 11d, and a detection unit 11e.
- the functions of the output processing unit 11f and the evaluation unit 11g are exhibited. Details of each functional unit will be described later.
- the measurement apparatus (data acquisition unit) 2 of the present embodiment performs a one-dimensional scan along the measurement path on the measurement target surface (xy plane) in order to measure the fine uneven shape of the measurement target surface.
- the thickness direction position (height; z direction position) of the measurement target is obtained.
- FIG. 2 shows a plurality of measurement paths when the measuring device 2 measures a circular flat plate.
- the measurement path shown in FIG. 2 includes 60 linear measurement paths (straight path) and one annular measurement path (annular path). Each measurement path has an intersection with another measurement path.
- An intersection of measurement paths is an overlapping range (overlapping point) of measurement ranges along a plurality of measurement paths.
- the intersection (overlapping range) is the position where data is connected.
- the straight paths are arranged at intervals of 6 ° on the circular flat plate, and the individual straight paths intersect with many other straight paths.
- the annular path is arranged on the outer peripheral side of the circular flat plate, and is an annular path that connects the distal ends on the radially outer side of all straight paths.
- the measurement range is a donut-shaped region.
- the measurement device 2 outputs measurement data (stitched data) obtained by measuring the surface shape of the measurement target along each measurement path.
- measurement data for the first measurement path (straight line path) and the second measurement path (straight line path) shown in FIG. 3A has a data structure as shown in FIGS. 3B and 3C. Have.
- the first measurement path shown in FIG. 3A connects the coordinates (x 1n , y 1n ) from the coordinates (x 11 , y 11 ) on the xy plane that are parallel to the surface of the circular flat plate to be measured. It is a straight path.
- the measurement data for the first measurement path includes a plurality of (n) measurement points (sampling points) from the coordinates (x 11 , y 11 ) to the coordinates (x 1n , y 1n ).
- Each of the measurement target thickness direction positions (height: z direction position) is configured as a data string having data results as measurement results.
- the measurement data for the second measurement path includes a plurality (n) of measurement points (sampling points) from the coordinates (x 21 , y 21 ) to the coordinates (x 2n , y 2n ).
- Each of the measurement target thickness direction positions (height: z direction position) is configured as a data string having data results as measurement results.
- the measurement data is a data string of three-dimensional data in which each data element has a three-dimensional value of x, y, z.
- Individual measurement data is only a measurement result of the measurement range in a part of the measurement path when viewed from the circular flat plate that is the measurement target, so to obtain the measurement result of the entire measurement object, along the multiple measurement paths It is necessary to stitch (connect) a plurality of measurement data obtained by measurement at intersections (overlap ranges) of measurement paths.
- each measurement data has an independent error, and the values of a plurality of data to be connected do not always match even at a point (intersection) to which the data is to be connected.
- the intersection since the same position of the measurement object is measured at the intersection (coordinates (x a , y a )) of the first measurement path and the second measurement path, the true values are naturally the same.
- each measurement data has an error such as a measurement error independently. For this reason, even at the intersection (coordinates (x a , y a )) that is the overlapping range of the first measurement path and the second measurement path, the measurement data values (z-direction positions) of the first measurement path and the second measurement path are the same. Usually they do not match.
- FIG. 4 illustrates measurement data (data before processing by the processing device 3) measured by the measuring device 2 along all the measurement paths shown in FIG. 2 on the x, y, and z coordinates.
- the measurement data of the straight path does not always coincide with the measurement data of the other straight paths even at the position that should be the intersection.
- the measurement data of the circular path does not always coincide with the radially outer tip of the measurement data of the straight path.
- each of the plurality of measurement data is mutually contradictory data due to an error.
- the processing device 3 of the present embodiment regards the measurement data group as an elastic body data group. That is, each measurement data (stitched data) is treated as a model of an object (elastic body) having a shape defined by the value of the measurement data.
- the shape of the elastic body is a line shape that connects values indicated by the data elements constituting the measurement data in three-dimensional coordinates. If the shape connecting the values indicated by the data elements constituting the stitched data becomes a surface, the shape of the elastic body becomes a surface shape. If the shape connecting the values indicating the data elements constituting the stitched data becomes a three-dimensional shape, the shape of the elastic body becomes a three-dimensional shape.
- the data stitching (data connection) problem is replaced with an elastic body connection problem.
- the inconsistency of the data connection area is solved by solving the elastic body connection problem.
- FIG. 5A shows the procedure of the stitching process for performing data stitching by solving the elastic body connection problem.
- the data acquisition processing unit 11 a of the processing unit 11 of the processing device 11 performs a data acquisition process for controlling the measurement of the data acquisition unit 2.
- the data acquisition processing unit 11a receives a plurality of measurement data (stitched data) corresponding to a plurality of measurement paths in the same measurement target from the measurement device 2.
- the elastic modulus setting unit (physical property value setting unit) 11b of the processing unit 11 of the processing device 3 sets an elastic modulus (such as Young's modulus) for each of a plurality of measurement data (physical property value setting process; step) S1) is performed.
- an elastic modulus such as Young's modulus
- step S1 physical property values other than the elastic modulus may be set as necessary.
- the elastic modulus and other physical property values are used for deformation calculation processing S3 described later.
- the elastic modulus is set for an elastic body whose shape is indicated by the measurement data.
- the measurement data is three-dimensional data as described above, it can be handled as three-dimensional elastic body shape data by setting the elastic modulus.
- a plurality of measurement data is handled as an elastic body set made up of a large number of linear elastic bodies.
- the thickness of the linear elastic body is numerically given, it can be virtually regarded as zero in order to stitch data.
- the elasticity modulus setting process should just be performed before the start of the below-mentioned deformation
- the elastic modulus setting unit 11a can also set a common elastic modulus for a plurality of measurement data with respect to a plurality of measurement data (data to be stitched), or a different elastic modulus for each of the plurality of measurement data. Can also be set. In the present embodiment, since the magnitude of the absolute value of the elastic modulus is not a problem, the magnitude of the elastic modulus may be set as appropriate. When different elastic moduli are set for each of the plurality of measurement data, the elastic modulus set for each of the plurality of measurement data is determined according to the accuracy of the measurement data (data reliability; the magnitude of the included error) (details) Will be described later).
- the matching data point setting unit (matching data element setting unit) 11c of the processing unit 11 matches data elements (data points) whose data values (x value, y value, z value) should match among a plurality of measurement data.
- a matching data point setting process (step S2) to be set is performed as a data point.
- the coincidence data point setting unit 11c of the present embodiment sets intersections (overlapping areas) of a plurality of measurement paths as coincidence data points. In the case of the measurement path as shown in FIG. 2, the position (xy coordinate) that is the intersection of the measurement path is known in advance, so that the intersection coordinates of the first and second measurement paths are (x a ) as shown in FIG.
- xy coordinates of the measurement data for each measurement path (x a, y a) a is a data element ((x a, y a, z 1a) and (x a, y a, z 2a )) is set as the coincidence data point, and the measurement data of each measurement path is set. It is preferable that a plurality of matching data points (matching data elements) are set for each measurement data.
- the coincidence data points are set corresponding to all the intersections in the measurement path shown in FIG.
- the matched data point may be automatically set by the matched data point setting unit 11c, or may be set by the matched data point setting unit 11c based on the designation of the matched data point by the user input.
- a plurality of pieces of measurement data in which the elastic modulus is set and the coincidence data point is set are given to the deformation calculation unit 11d.
- the deformation calculation unit 11d treats each piece of measurement data for which the elastic modulus is set as data of an elastic body having a shape indicated by the value of the measurement data (a shape when no external force is applied). That is, the measurement data is handled as elastic body shape data.
- the deformation of the elastic body is obtained by the finite element method.
- the finite element method is a numerical analysis method generally used in structural analysis and the like, and in this embodiment, the finite element method is used to perform elastic deformation analysis.
- the deformation calculation unit (finite element deformation analysis unit) 11d generates an elastic body deformation model (finite element model) obtained by dividing an elastic body having a shape indicated by the measurement data value for deformation analysis. The element division is performed for each of a plurality of elastic bodies corresponding to a plurality of measurement data.
- the elements constituting the deformation model are, for example, beam elements (one-dimensional elements) or shell elements (two-dimensional elements).
- Each element constituting the elastic body deformation model is an elastic body element that is at least bendable and has a sectional moment of inertia. Therefore, the elastic deformation model is capable of bending deformation and other elastic deformation.
- the strain due to the force applied to an arbitrary point of the elastic body deformation model (elastic body) can be transmitted to the entire elastic body deformation model (elastic body).
- Beam elements and shell elements are elements used in the finite element method. Therefore, the element division can be performed using a function installed in software of the finite element method.
- the elastic body is linear, as shown in FIG. 5B, an elastic body deformation model divided into elements by beam elements is generated.
- the elastic body deformation model can be configured, for example, by connecting each data element of measurement data by one or a plurality of beam elements.
- the stitched data may be image data.
- the image data is three-dimensional data including two-dimensional position and luminance information, and can be handled in the same manner as measurement data that is three-dimensional data.
- the image data including the two-dimensional position of each pixel and the luminance value of each pixel can be regarded as elastic body shape data indicating the shape (curved surface shape) of the surface elastic body having irregularities corresponding to the magnitude of the luminance value.
- elastic body shape data indicating the shape (curved surface shape) of the surface elastic body having irregularities corresponding to the magnitude of the luminance value.
- the data elements may be coupled by beam elements.
- the finite element model has a mesh-like surface shape.
- FIG. 5C (a) shows curved elastic body deformation models M1 and M2 made of shell elements.
- Each image data has an overlapping photographing range (overlapping area). Pixels included in the overlapping area are set as matching data points (matching data elements).
- a plurality of elastic body deformation models M1, M2 are connected in the overlapping region.
- the physical property value (elastic modulus and the like) set in the setting process in step S1 is set as element information for each finite element constituting the elastic body deformation model. Therefore, the elastic body deformation model can be deformed according to the set physical property value (elastic modulus or the like).
- the deformation calculation unit 11d matches the measurement data (elastic body shape data; elastic body) whose values may not match each other even in the matching data points, and the values of the data elements match (connection) in all the set matching data points. ).
- the relative values (relative distances) of the plurality of data elements that are matching data points become zero. Thereby, the values of the data elements to be matched can be matched.
- a plurality of elastic bodies indicated by the elastic deformation model are connected at the position of the coincidence data point.
- each elastic body indicated by the elastic deformation model is elastically deformed. Due to the forced displacement of the position (displacement position) of the elastic body corresponding to the coincidence data point, bending occurs in each finite element (beam element) constituting the elastic body deformation model, and the elastic deformation due to the forced displacement affects the entire elastic body. To do. As a result, the elastic deformation due to the forced displacement spreads over the connected elastic body aggregates.
- the deformation calculation unit 11d obtains a shape that the elastic body aggregate naturally takes (a shape that minimizes the sum of energy due to internal stress of the elastic body) by deformation analysis using a finite element method.
- the boundary condition of the deformation analysis is performed so that all data points are not over-constrained. That is, a constraint point is arbitrarily selected, and six degrees of freedom (in this embodiment, three translational degrees of freedom and three degrees of freedom of rotation) are constrained. It is also possible to constrain data points with zero error. In this case, over-restraint may be used.
- the deformation calculation unit 11d has a constraint that data values of matching data points that should match data values are equal (relative values (relative distances) between displacement positions corresponding to the matching data points in a plurality of elastic bodies become zero. Is given as a constraint for deformation operations. This restriction is physically equivalent to preventing the elastic bodies from being separated at the displacement positions corresponding to the intersections of the measurement paths. Under such restrictions, the deformation calculation unit 11 obtains a shape that the whole connected elastic body aggregate naturally takes. Note that the setting function for elastic deformation so that arbitrary points of a plurality of elastic bodies are connected is installed in general finite element method software, and the setting can be performed by using such a function. .
- the shape of the bamboo basket obtained by weaving bamboo bamboo of various shapes is in a state in which the sum of energy due to the internal stress of bamboo bamboo is minimal.
- Obtaining the shape of a bamboo basket obtained by weaving bamboo strings is equivalent to obtaining the most likely result when connecting mutually contradictory data (measurement data of this embodiment) at intersections (matching data points).
- the shape of the bamboo basket obtained by knitting bamboo can be obtained by the finite element method if the shape and elastic modulus of each bamboo basket (elastic body) are known. Therefore, the shape of the elastic body set connected by the coincidence data point can be obtained by the finite element method based on the measurement data handled as the elastic body shape data and the elastic modulus in the same manner as the shape of the bamboo basket. it can.
- Data indicating the shape of the elastic body set connected by the coincidence data point is a solution of maximum likelihood as measurement data, and can be expected to be a value close to a true value. That is, it is possible to realize a method of least squares in all degrees of freedom of data and output a result closer to the true value. And even if data with contradictions due to errors are connected by considering the measurement data as an elastic body, the contradictions due to the errors can be distributed to the entire measurement data as an elastic body by elastic deformation. Inconsistency in the connection region can be suppressed.
- the deformation calculation unit 11d sets a plurality of elastic bodies (measurement data) so that the relative value becomes zero at the coincidence data point.
- the data value of the coincidence data point of the measurement data of the first measurement path is (x a , y a , z 1a ), and the measurement data of the second measurement path ( In the case of the data value (x a , y a , z 2a ) of the matching data point in FIG.
- the data value of each matching data point is, for example, It is set to be an intermediate value (x a , y a , (z 1a + z 2a ) / 2) of data values.
- the data value (x a , y a , z 1a ) of the coincidence data point (coincidence data element) of the measurement data of the first measurement path is an intermediate value (x a , y a ,
- the first measurement path measurement data regarded as an elastic body is elastically deformed so as to be displaced to the position of (z 1a + z 2a ) / 2), and coincides with the measurement data (FIG.
- the matching data point data value should match (x a, y a, z 1a), (x a, y a, z 2a) the data value x of the, y, of z ,
- the data value may be matched. in this case, the value x a which originally coincide, y a, since not changed, can be omitted operation of xy coordinates.
- the xy coordinate value of the elastic body may use a value before connection of the coincidence data point, and may use a value after connection of the coincidence data point only for the z coordinate value.
- the displacement in the xy coordinates of each elastic body is obtained by sufficiently expanding each elastic body in the xy direction in advance and connecting the coincidence data points to elastically deform the elastic body. It can be suppressed by reducing the size to the original size.
- the expansion in the xy direction is made sufficiently larger than the displacement amount in the z direction of the displacement position of the elastic body accompanying the connection of the coincidence data points.
- the measurement data includes data elements (for example, (x a , y a , z 1a ) in FIG. 3B and (x a , It was assumed that y a , z 2a )) existed.
- the measurement data data to be stitched
- the measurement data is discrete data, there is not always a data element that completely matches the measurement path intersection position of the actual measurement target. If high-precision data stitching is not required, data elements in the vicinity of the actual measurement path intersection position can be selected as matching data points from the data elements included in the measurement data. Is required, it is desirable to set the matching data points more accurately.
- the coincidence data point setting unit 11c of the present embodiment also has a function of setting the coincidence data point more accurately when the measurement data does not include a data element that coincides with the actual measurement path intersection position.
- FIG. 6 shows a more accurate way to set matching data points.
- the coincidence data point setting unit 11c uses the first data element (x 1i , y 1i , z 1i ) of the measurement data of the first measurement path and the first data based on the measurement data (discrete data) of the first measurement path.
- An interpolation function for interpolating a section between two data elements (x 1 (i + 1) , y 1 (i + 1) , z 1 (i + 1) ) (in this case, a primary interpolation function is adopted) and a second measurement path Is interpolated between the third data element (x 2j , y 2j , z 2j ) and the fourth data element (x 2 (j + 1) , y 2 (j + 1) , z 2 (j + 1) ) of the measured data of An interpolation function (here, the primary interpolation function is minimized) is obtained.
- the coincidence data point setting unit 11c determines the position (x a , y a ) of the xy coordinates where the two interpolation functions intersect in the xy plane of FIG. 6A as the intersection in the xy coordinates.
- the obtained interpolation data element (x a , y a , z 1a ) is added to the measurement data of the first measurement path and set as a coincidence data point in the measurement data of the first measurement path.
- the obtained interpolation data element (x a , y a , z 2a ) is added to the measurement data of the second measurement path and set as a coincidence data point in the measurement data of the second measurement path.
- the matching data points are more accurate regardless of the sampling frequency of the measurement data. Can be set.
- the data value of the interpolation data element set as a coincidence data point is each
- the first measurement path measurement data and the second measurement path measurement data regarded as an elastic body are elastically deformed so as to be displaced to the position of the intermediate value (x a , y a , z 3a ) of the data values of the coincidence data points. .
- the deformation calculation unit 11d obtains elastic body shape data of the elastic body aggregate after elastic deformation as stitching data.
- the deformation calculation unit 11d outputs not only the elastic body shape data of the elastic body aggregate after deformation but also data indicating the internal stress of the elastic body aggregate after deformation.
- the detection unit 11e of the processing unit 11 is improper measurement data (stitched data) such as a relatively large error or improperly set matching data. Detection processing for detecting a point (inappropriate connection of the elastic body) is executed (step S4).
- the measurement data with a large error It is a big contradiction to the data. If measurement data with a large error is connected to other measurement data to cause elastic deformation, the elastic measurement data with a large error will cause unreasonable elastic deformation. The stress becomes very large. That is, when there is a large discrepancy between a plurality of measurement data, the internal stress increases at a location where such measurement data is connected.
- the detection unit 11e uses the internal stress data to detect measurement data or coincident data points (elastic body connection positions) belonging to a range where the internal stress is large. As a result, more appropriate deformation analysis results can be obtained by excluding inappropriate measurement data or removing matching data points (connection of elastic bodies) and performing deformation analysis again. .
- the detection unit 11e In order for the detection unit 11e to detect a range where the internal stress is large, for example, the internal stress is compared with a predetermined threshold, and a range where the internal stress exceeds the threshold can be detected as a range where the internal stress is large.
- the threshold value can be set, for example, based on the average value of the internal stress of the entire elastic body assembly (for example, the threshold value is set to twice the average value of the internal stress).
- the output processing unit 11f of the processing unit 11 outputs the deformed elastic body shape data to the output unit (for example, a display unit such as a display) 14 as stitching data obtained by stitching a plurality of pieces of stitched data.
- the output unit 14 may output stitching data to the storage unit 12.
- FIG. 7 shows the output stitching data.
- the RMS (Root Mean Square) of the measurement data before processing by the processing unit 11 is 54 nm and the PV (Peak-to-valley) is 510 nm (see FIG. 4), whereas the stitch according to Embodiment 11 is used.
- RMS in the stitching data after the bending process was 15.8 nm, and PV was 100 nm. Therefore, it can be seen that the measurement accuracy of the stitching data is significantly improved as compared with the measurement data before the processing by the processing unit 11, and a highly accurate result is obtained. Therefore, even when the measurement accuracy of the measurement device 2 is low, a highly accurate measurement result can be obtained by stitching.
- the finite element method generally used for deformation analysis is used in the deformation calculation processing by the deformation calculation unit 11d, it is easy to construct a stitching device. Further, since the finite element method performs deformation analysis at high speed, stitching processing can be performed at high speed. For example, when a home computer is used as the processing device 3, the deformation calculation process (step S3) in the stitching process can be performed in a few seconds.
- FIG. 7 shows measurement data before processing by the processing unit 3 as in FIG.
- FIG. 8 shows measurement data before processing by the processing unit 3 as in FIG.
- the convex portion exists at the position of the “convex portion that should exist” shown by the thick black line in FIG.
- FIG. 9 shows stitching data after processing by the processing unit 3, as shown in FIG. 9, a shape corresponding to the convex portion appears, and it can be seen that a highly accurate measurement result is obtained.
- FIG. 9 it can be confirmed that a highly accurate measurement result is obtained by the stitching process of the present embodiment.
- the elastic modulus setting unit 11b can obtain a measurement result with higher accuracy by changing the elastic modulus set for each of the plurality of measurement data according to the accuracy of each measurement data. For example, if the accuracy of the measurement data is high, the elastic modulus setting unit 11b sets a relatively large elastic modulus in the measurement data to make it difficult to deform, and if the accuracy of the measurement data is low, the elastic modulus setting unit 11b has a relatively small elastic modulus. Is set to the measurement data to facilitate deformation. In other words, highly reliable (high accuracy) measurement data is difficult to deform, while low reliability (low accuracy) measurement data is easily deformed, so that highly reliable measurement data is highly reliable. Since the deformation is performed along the measurement data, the accuracy of the stitching data can be increased.
- the circular path is measured n times, and measurement data with small error and high accuracy (reliability) is obtained.
- the elastic modulus set in the highly accurate circular path measurement data is made n times larger than the elastic modulus set in the low precision linear path measurement data, and the circular path measurement data (elasticity Make body shape data) difficult to deform.
- the elastic modulus setting unit 11b may accept the number of times of measurement of each measurement data from the user via the input unit 13 as data relating to accuracy, or measurement. Data such as the number of measurements of individual measurement data may be acquired from the device 2.
- FIG. 10 shows the evaluation process by the evaluation unit 11g.
- the evaluation process evaluates observation methods such as measurement and photographing.
- the evaluation unit 11g of the present embodiment evaluates the appropriateness of how to determine an observation range such as a measurement path (measurement range) and an imaging range.
- the process of evaluating the appropriateness of how to determine the observation range is performed by eigenvalue analysis on a set of a plurality of elastic bodies connected to each other (step S11). The higher the eigenvalue (e.g., natural frequency) obtained as a result of the eigenvalue analysis, the higher the evaluation of how to determine the observation range is output (step S12).
- eigenvalue e.g., natural frequency
- a set of a plurality of elastic bodies connected to each other has a high rigidity as a whole when the eigenvalue is high, and is difficult to be deformed. If the eigenvalue is low, the rigidity is low as a whole and is easily deformed. The harder the set of elastic bodies, the more efficiently the data are linked together, and it can be evaluated that the data stitch is an excellent data stitch with a higher correction force. Therefore, the evaluation of the quality of the observation range of the data and the overlapping region can be performed in advance before observation by eigenvalue analysis.
- FIG. 11 and FIG. 12 show that the eigenvalues of an elastic body set in which a plurality of linear elastic bodies corresponding to a plurality of measurement data are connected at the intersections of measurement paths differ depending on how to determine a linear measurement path (observation range).
- the measurement path shown in FIG. 11A is the same as the measurement path shown in FIG. 2, and has a large number of straight paths and an annular path on the outer peripheral side of the straight paths.
- FIG. 11B is obtained by removing the circular path from the measurement path of FIG. Since the elastic body set corresponding to the measurement path in FIG. 11B does not have an elastic body corresponding to the annular path, the eigenvalue is low and the rigidity is low.
- FIGS. 12A to 12C also show the measurement paths.
- the eigenvalues become smaller in the order of FIGS. 12 (a), (b), and (c). Therefore, the data correction force of the measurement path in FIG. 12A is the highest, and the data correction force decreases in the order of FIGS. 12B and 12C.
- FIG. 13 shows how to determine the shooting range (observation range) of image data, and that the eigenvalues of the elastic body sets in which a plurality of planar elastic bodies corresponding to a plurality of image data are connected in overlapping areas of the shooting range are different.
- FIGS. 13A and 13B show a state in which 16 pieces of image data are overlapped in the overlapping region of the shooting range. In FIGS. 13A and 13B, the overlapping region is indicated by hatching.
- the overlapping area of the imaging range shown in FIG. 13B is larger than the overlapping area in FIG. Therefore, the eigenvalue is higher in FIG. 13B, and the image data obtained according to the imaging range set as shown in FIG. 13B has a higher data correction capability by data stitching.
- the range that can be covered by 16 pieces of image data is small in FIG. 13B.
- the range that can be covered by the 16 images in FIG. 13A is indicated by “A”.
- FIG. 13B if an attempt is made to secure a range having the same size as the range A, the required number of image data increases and the amount of data increases. An increase in data amount leads to an increase in data acquisition cost. Therefore, when evaluating how to determine the imaging range (observation range), an evaluation value that considers not only the data correction power based on the eigenvalue but also the necessary data amount may be obtained.
- the density of data elements as viewed from the whole measurement target (observation target) varies depending on how the measurement path (observation range) is set, the density of the data elements may be considered in the evaluation value.
- the density of the data elements may be considered in the evaluation value. For example, in FIGS. 12A and 12B, while FIG. 12A has a large number of measurement paths and a high data density, the data density decreases in the order of FIGS. 12B and 12C. The part which is not measured in a measurement object will increase. Therefore, the higher the data duplication density, the more accurate the data can be evaluated.
- the data regarded as the elastic body may be actual observation data or evaluation data created in accordance with the observation range.
- the evaluation data for the measurement data having the data structure shown in FIGS. 3B and 3C can be such that the height (z coordinate value) is all set to a constant value.
- the evaluation data for the image data can be obtained by setting all the pixel values to a constant value.
- FIG. 14 shows a plurality of data (first data and second data) to be stitched.
- each data element is assumed to have the x m_n and f n (x m_n) of 2-dimensional value (discrete value).
- 14A the x coordinate value of the data shown in FIG. 3 is represented by xm_n , the y coordinate value of the data shown in FIG. 3 is omitted, and the z coordinate value of the data shown in FIG. This corresponds to that represented by f n (x m — n ).
- n 1 to N N: Number of data to be stitched (data to be stitched)
- m_n 1 to M_n
- M_n the number of data elements constituting the nth data.
- the f value of each data element of the first data is denoted by f 1 (x m — 1 ).
- the x value of each data element of the second data for which n 2 is indicated by x m — 2
- the f value of each data element of the second data is indicated by f 2 (x m — 2 ).
- the first data and the second data are discrete data.
- each piece of data is regarded as an elastic body having a continuous shape.
- the shape of each elastic body is a continuous shape connecting values (x m — n , f n (x m — n )) indicating data elements constituting each data.
- FIG. 14B shows a line shape in which data elements are connected by lines for each data.
- the shape of the elastic body corresponding to the discrete first data is represented by the function f 1 (x).
- the line shape of the elastic body corresponding to the discrete second data is represented by the function f 2 (x).
- the function f n (x) indicates the shape of the elastic body when the n-th data is regarded as the shape of the elastic body.
- FIG. 14B shows a curved shape in which each data element is connected by a smoothly bent line.
- FIG. 14C shows a polygonal line shape in which each data element is connected by a straight line.
- the elastic body deformation model is a finite element model composed of beam elements
- the data elements are connected by linear beam elements
- the shape of the elastic body deformation model is as shown in FIG. .
- the shape of the elastic body is a shape in which data elements are connected by a smooth curve as shown in FIG.
- i ⁇ j.
- the matching data point of the first data is set to f i (x 2 — i )
- the matching data point of the second data is set to f j (x 2 — j ).
- f j (x 2 — j ) is displaced.
- f i ′ (x 2 — i ) and f j ′ (x 2 — j ) indicate values after displacement of f i (x 2 — i ) and f j (x 2 — j ), respectively. That is, the generalized stitching condition is as the following formula (1).
- Equation (1) and Equation (2) correspond to connecting a plurality of elastic bodies to each other at the displacement position (matching data point).
- FIG. 16 shows functions f i ′ (x) and f j ′ (x) corresponding to the shape of the elastic body after deformation.
- the function f i ′ (x) indicates a function f i (x) deformed with the connection of two elastic bodies.
- the function f j ′ (x) indicates a function f j (x) that is deformed along with the connection of two elastic bodies. That is, it is as the following formulas (3) and (4).
- u i (x) is a function (displacement function) indicating the amount of displacement from f i (x) to f i ′ (x)
- u j (x) is f j (x)
- It is a function (displacement function) indicating the amount of displacement from x) to f j ′ (x).
- u i (x) and u j (x) there are innumerable ways to modify the functions f i (x) and f j (x) that satisfy the stitching condition. Accordingly, there are innumerable displacement functions u i (x) and u j (x). Therefore, it is necessary to optimize the displacement functions u i (x) and u j (x).
- the transformation from the function f i (x), f j (x) to the function f i ′ (x), f j ′ (x) is the function f i (x ), F j (x).
- An elastic body assembly made up of a plurality of elastic bodies connected to each other takes a shape that minimizes elastic energy caused by bending.
- the displacement functions u i (x) and u j (x) can be optimized by a method of analyzing the elastic deformation.
- the process of “obtaining elastic deformation” can be performed by optimizing the displacement function according to the concept according to the equation (5).
- the finite element method described above is also one of the processes based on the concept according to Equation (5).
- the finite element method is excellent as a method for obtaining an elastic body shape that minimizes elastic energy caused by bending. Therefore, the finite element method is very suitable as a method for obtaining elastic deformation.
- Equation (6) Optimization in the case where different elastic moduli are set for a plurality of elastic bodies is formulated as shown in Equation (6).
- the elastic modulus i.e. the weight w n increases.
- the curvature of the displacement function corresponding to the elastic body corresponding to the data with high accuracy is more greatly evaluated (the elastic body is not easily deformed).
- the stitching data to be stitched is not limited to measurement data, and may be arbitrary data such as image data (satellite photo data, panoramic photo data, etc.). When the image is a color image, data stitching may be performed for each of the RGB colors. Further, since the finite element method can be applied to data of two dimensions or less, naturally, the stitched data may be data of two dimensions or less. Further, the stitched data may be four-dimensional data or more. If the stitched data is data of four or more dimensions, the stitched data is regarded as elastic body shape data of four or more dimensions, and the finite element method expanded to a dimension corresponding to the number of data dimensions is used. Good. That is, the stitching data may be arbitrary n-dimensional data (n is an integer of 1 or more).
- the elastic modulus set in the stitched data may be different for each dimension.
- the elastic modulus related to coordinates and the elastic modulus related to time are made different so that the deformation of coordinates and the deformation of time are different. May be.
- the coincidence data point may be set by user input, or a common object in a plurality of images is extracted by image processing, and the extracted portions are matched. It may be set as a data point.
- the deformation analysis method is not limited to the finite element method, and may be another method capable of obtaining the deformation by numerical analysis.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Length Measuring Devices With Unspecified Measuring Means (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
本発明は、複数のデータをステッチング(stitching)するための装置、方法、及びコンピュータプログラムに関するものである。 The present invention relates to an apparatus, a method, and a computer program for stitching a plurality of data.
計測装置の測定範囲を超える対象を計測する場合、独立した計測データをステッチング(接続)することが必要となる。
例えば、特許文献1,2は、被検面を部分的に測定した形状データをつなぎ合わせて、被検面全体の形状データを計算する方法を開示している。
また、データステッチング(データ接続)は、形状の計測データのステッチングに限らず、複数の画像データのステッチングなど、様々なデータを対象に行われる。
When measuring an object that exceeds the measurement range of the measurement device, it is necessary to stitch (connect) independent measurement data.
For example,
Data stitching (data connection) is not limited to stitching of shape measurement data, but is performed on various data such as stitching of a plurality of image data.
ステッチングされる個々の計測データは、独立して誤差を有しているため、データステッチングの際には、尤もらしい値(最尤度な値)が得られるようにする必要がある。
一般的に、従来のデータステッチングに際しては、各データにおける接続領域の値が尤もらしくなるような中間点の値の生成が行われる。そして、その中間点を橋渡しとして、2つの異なるデータの接続が行われる。
Since individual measurement data to be stitched has an error independently, it is necessary to obtain a plausible value (maximum likelihood value) at the time of data stitching.
Generally, in the conventional data stitching, intermediate point values are generated so that the value of the connection area in each data is likely. Then, using the intermediate point as a bridge, two different data are connected.
中間点の算出には、単純平均等が用いられる。また、比較的高度な方法として、各データ群の全データに対して回転やオフセット値(並進に関する3つのパラメータと回転に関する3つのパラメータの合計6つのパラメータ)を加える方法がある。これらのパラメータの決定方法として、最小二乗法がしばしば用いられる。 単 純 Simple average is used to calculate the midpoint. As a relatively advanced method, there is a method of adding rotation and offset values (a total of six parameters including three parameters related to translation and three parameters related to rotation) to all data in each data group. The least square method is often used as a method for determining these parameters.
しかしながら、上記のパラメータだけで3次元データなどのステッチング(接続)を行っても、データの接続領域における値の不連続さが解消されることはない。しかも、データの接続領域のみに接続誤差を配分することになり、尤もらしい値(最尤度な値)から懸け離れた値になりやすい。 However, even when stitching (connection) such as three-dimensional data is performed using only the above parameters, the discontinuity of values in the data connection area is not eliminated. In addition, the connection error is distributed only to the data connection region, and tends to be a value far from a likely value (maximum likelihood value).
そこで、本発明は、データステッチングにおいて、接続領域の不整合を抑制するための新たな技術的手段を提供することを目的とする。 Therefore, an object of the present invention is to provide a new technical means for suppressing a mismatch of connection areas in data stitching.
(1)ある観点からみた本発明は、それぞれが複数のデータ要素を有する複数のデータをステッチするためのデータステッチング装置であって、
前記複数のデータそれぞれを弾性体の形状のデータとみなし、前記複数のデータに対応する複数の弾性体それぞれに生じる弾性変形を求める処理部を備え、
前記弾性体の前記形状は、前記データが有する複数のデータ要素が示す値を結ぶ形状であり、
前記弾性変形は、前記複数のデータにおいてデータ要素の値が一致すべきデータ要素に対応した弾性体の位置において、前記位置が一致するように前記複数の弾性体を互いに接続することで生じる弾性変形であり、
前記処理部は、前記弾性変形が生じた前記複数の弾性体の形状を示すデータを、前記複数のデータをステッチしたステッチングデータとして出力するデータステッチング装置である。接続される弾性体の部分同士の相対距離が完全にゼロになる場合のほか、相対距離がほぼゼロになる場合、すなわち、実質的にゼロとみなせる程度の相対距離にする場合を含む。
(1) The present invention from a certain viewpoint is a data stitching device for stitching a plurality of data each having a plurality of data elements,
Each of the plurality of data is regarded as data of the shape of the elastic body, and includes a processing unit that obtains elastic deformation generated in each of the plurality of elastic bodies corresponding to the plurality of data,
The shape of the elastic body is a shape connecting values indicated by a plurality of data elements included in the data,
The elastic deformation is caused by connecting the plurality of elastic bodies to each other so that the positions coincide with each other at the position of the elastic body corresponding to the data element that should have the same data element value in the plurality of data. And
The processing unit is a data stitching device that outputs data indicating the shapes of the plurality of elastic bodies having undergone the elastic deformation as stitching data obtained by stitching the plurality of data. In addition to the case where the relative distance between the elastic body parts to be connected becomes completely zero, the case where the relative distance becomes substantially zero, that is, the case where the relative distance is such that it can be regarded as substantially zero is included.
本発明は、弾性変形の解析を、データステッチングというデータ解析に適用するという、従来のデータステッチングとは全く異なるアプローチで、データステッチングを行うものである。 The present invention performs data stitching by an approach completely different from conventional data stitching, in which analysis of elastic deformation is applied to data analysis called data stitching.
(2)前記処理部は、前記複数の弾性体それぞれの弾性率を設定するよう構成されているのが好ましい。 (2) It is preferable that the processing unit is configured to set an elastic modulus of each of the plurality of elastic bodies.
(3)前記処理部は、複数の弾性体それぞれに異なる弾性率を設定可能であるのが好ましい。 (3) It is preferable that the said process part can set a different elastic modulus to each of a some elastic body.
(4)前記処理部は、前記複数のデータそれぞれの信頼度に基づいて、前記複数の弾性体それぞれの弾性率を決定するよう構成されているのが好ましい。 (4) It is preferable that the processing unit is configured to determine an elastic modulus of each of the plurality of elastic bodies based on reliability of each of the plurality of data.
(5)前記処理部は、前記複数のデータのうちの少なくとも一つのデータに、前記複数のデータ要素を補間する補間データ要素を加える処理を行うよう構成され、前記複数のデータにおいてデータ要素の値が一致すべきデータ要素は、前記補間データ要素を含むのが好ましい。 (5) The processing unit is configured to perform a process of adding an interpolation data element for interpolating the plurality of data elements to at least one of the plurality of data, and the value of the data element in the plurality of data The data elements that should be matched preferably include the interpolated data elements.
(6)前記処理部は、前記弾性変形が生じた前記複数の弾性体の内部応力を求め、前記内部応力に基づいて、前記複数のデータのうち不適切なデータを検出するよう構成されているのが好ましい。 (6) The processing unit is configured to obtain internal stress of the plurality of elastic bodies in which the elastic deformation has occurred, and detect inappropriate data among the plurality of data based on the internal stress. Is preferred.
(7)前記処理部は、前記弾性変形が生じた前記複数の弾性体の内部応力を求め、前記内部応力に基づいて、複数の弾性体の不適切な接続を検出するのが好ましい。 (7) It is preferable that the processing unit obtains internal stress of the plurality of elastic bodies in which the elastic deformation has occurred, and detects inappropriate connection of the plurality of elastic bodies based on the internal stress.
(8)前記処理部は、前記複数のデータに基づいて生成された複数の弾性体変形モデルを用いた変形解析によって、前記弾性変形を求めるのが好ましい。 (8) It is preferable that the processing unit obtains the elastic deformation by deformation analysis using a plurality of elastic body deformation models generated based on the plurality of data.
(9)前記複数の弾性体変形モデルそれぞれは、少なくとも曲げ変形可能な複数の要素を有して構成されているのが好ましい。 (9) It is preferable that each of the plurality of elastic body deformation models includes at least a plurality of elements that can be bent and deformed.
(10)前記要素は、梁要素を含むのが好ましい。 (10) The element preferably includes a beam element.
(11)前記要素は、シェル要素を含むのが好ましい。 (11) The element preferably includes a shell element.
(12)前記変形解析は、有限要素法によって行われるのが好ましい。 (12) The deformation analysis is preferably performed by a finite element method.
(13)前記弾性変形は、少なくとも曲げ変形を含むのが好ましい。 (13) It is preferable that the elastic deformation includes at least bending deformation.
(14)前記複数のデータは、計測対象物の表面を複数の計測パスに沿って計測して得られた複数の形状計測データであり、
前記複数のデータ要素それぞれは、前記計測パス上の計測値を示すデータ要素であり、
前記複数の計測パスそれぞれは、前記複数の計測パスに含まれる他の計測パスとの交点を有し、
前記弾性体の前記形状は、前記形状計測データが有する複数のデータ要素が示す前記計測値を結ぶ線の形状であり、
前記弾性変形は、前記交点の計測値を示すデータ要素に対応した前記弾性体の位置において、前記位置が一致するように前記複数の弾性体を接続することで生じる弾性変形であるのが好ましい。
(14) The plurality of data are a plurality of shape measurement data obtained by measuring the surface of the measurement object along a plurality of measurement paths,
Each of the plurality of data elements is a data element indicating a measurement value on the measurement path,
Each of the plurality of measurement paths has an intersection with another measurement path included in the plurality of measurement paths,
The shape of the elastic body is a shape of a line connecting the measurement values indicated by a plurality of data elements included in the shape measurement data,
The elastic deformation is preferably elastic deformation generated by connecting the plurality of elastic bodies so that the positions coincide with each other at the position of the elastic body corresponding to the data element indicating the measurement value of the intersection.
(15)前記複数のデータは、画像データであり、
前記複数のデータ要素それぞれは、画素であり、
前記複数の画像データの撮影範囲それぞれは、前記複数の画像データに含まれる他の画像データの撮影範囲との重複領域を有し、
前記弾性体の前記形状は、前記画像データが有する複数の画素が示す画素値を結ぶ面の形状であり、
前記弾性変形は、前記重複領域に含まれる画素に対応した前記弾性体の位置において、前記位置が一致するように前記複数の弾性体を接続することで生じる弾性変形であるのが好ましい。
(15) The plurality of data is image data,
Each of the plurality of data elements is a pixel;
Each of the shooting ranges of the plurality of image data has an overlapping area with shooting ranges of other image data included in the plurality of image data,
The shape of the elastic body is a shape of a surface connecting pixel values indicated by a plurality of pixels included in the image data,
The elastic deformation is preferably elastic deformation generated by connecting the plurality of elastic bodies so that the positions coincide with each other at the positions of the elastic bodies corresponding to the pixels included in the overlapping region.
(16)前記複数のデータは、観測装置によって観測対象物を観測して得られた複数の観測データであり、
前記複数の観測データの観測範囲それぞれは、前記複数の観測データに含まれる他の観測データの観測範囲との重複領域を有するのが好ましい。
(16) The plurality of data are a plurality of observation data obtained by observing an observation object with an observation device,
Each of the observation ranges of the plurality of observation data preferably has an overlapping area with the observation ranges of other observation data included in the plurality of observation data.
(17)前記処理部は、前記観測対象物の観測の仕方を評価する処理を行うよう構成され、
前記評価する処理は、前記弾性変形が生じた前記複数の弾性体全体に対する固有値解析の結果に基づいて行われるのが好ましい。
(17) The processing unit is configured to perform a process of evaluating how to observe the observation object,
The processing to be evaluated is preferably performed based on a result of eigenvalue analysis on the whole of the plurality of elastic bodies in which the elastic deformation has occurred.
(18)他の観点からみた本発明は、それぞれが複数のデータ要素を有する複数のデータをステッチする処理をコンピュータが行う方法であって、
前記複数のデータそれぞれを弾性体の形状のデータとみなし、前記複数のデータに対応する複数の弾性体それぞれに生じる弾性変形を求める処理を前記コンピュータが実行すること、
前記弾性変形が生じた前記複数の弾性体の形状を示すデータを、前記複数のデータをステッチしたステッチングデータとして、前記コンピュータが出力すること、
を含み
前記弾性体の前記形状は、前記データが有する複数のデータ要素が示す値を結ぶ形状であり、
前記弾性変形は、前記複数のデータにおいてデータ要素の値が一致すべきデータ要素に対応した弾性体の位置において、前記位置が一致するように前記複数の弾性体を互いに接続することで生じる弾性変形である。
(18) The present invention from another viewpoint is a method in which a computer performs a process of stitching a plurality of data each having a plurality of data elements,
Each of the plurality of data is regarded as data of the shape of the elastic body, and the computer executes a process for obtaining elastic deformation occurring in each of the plurality of elastic bodies corresponding to the plurality of data,
The computer outputs data indicating the shapes of the plurality of elastic bodies in which the elastic deformation has occurred as stitching data obtained by stitching the plurality of data,
The shape of the elastic body includes a value connecting values indicated by a plurality of data elements included in the data,
The elastic deformation is caused by connecting the plurality of elastic bodies to each other so that the positions coincide with each other at the position of the elastic body corresponding to the data element that should have the same data element value in the plurality of data. It is.
(19)他の観点からみた本発明は、
それぞれが複数のデータ要素を有する複数のデータをステッチする処理をコンピュータに実行させるためのコンピュータプログラムであって、
前記処理は、
前記複数のデータそれぞれを弾性体の形状のデータとみなし、前記複数のデータに対応する複数の弾性体それぞれに生じる弾性変形を求めることと、
前記弾性変形が生じた前記複数の弾性体の形状を示すデータを、前記複数のデータをステッチしたステッチングデータとして出力することと、
を含み、
前記弾性体の前記形状は、前記データが有する複数のデータ要素が示す値を結ぶ形状であり、
前記弾性変形は、前記複数のデータにおいてデータ要素の値が一致すべきデータ要素に対応した弾性体の位置において、前記位置が一致するように前記複数の弾性体を互いに接続することで生じる弾性変形である。
さらに他の観点からみた本発明は、前記コンピュータプログラムを記録した記録媒体である。
(19) The present invention from another point of view
A computer program for causing a computer to execute a process of stitching a plurality of data each having a plurality of data elements,
The processing is as follows:
Each of the plurality of data is regarded as data of the shape of the elastic body, obtaining elastic deformation generated in each of the plurality of elastic bodies corresponding to the plurality of data;
Outputting data indicating the shapes of the plurality of elastic bodies in which the elastic deformation has occurred, as stitching data obtained by stitching the plurality of data;
Including
The shape of the elastic body is a shape connecting values indicated by a plurality of data elements included in the data,
The elastic deformation is caused by connecting the plurality of elastic bodies to each other so that the positions coincide with each other at the position of the elastic body corresponding to the data element that should have the same data element value in the plurality of data. It is.
From another viewpoint, the present invention is a recording medium on which the computer program is recorded.
本発明によれば、データステッチングにおいて、接続領域の不整合を抑制し、より真値に近い結果を出力することができる。 According to the present invention, in data stitching, it is possible to suppress inconsistency of connection areas and output a result closer to the true value.
以下、本発明の好ましい実施形態について添付図面を参照しながら説明する。 Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.
図1は、実施形態に係るステッチング装置1を示している。以下に説明するステッチング処理装置1は、複数のデータ(被ステッチングデータ)をステッチ(接続)して、ステッチングデータを得るために用いられる。実施形態に係るステッチング装置1は、計測装置2から出力された複数の計測データを、複数の被ステッチングデータとして扱う。データステッチングを行うことで、広範囲な計測データを得ることができる。
FIG. 1 shows a
「被ステッチングデータ」は、そのデータの種類が、計測データに限定されるものではなく、例えば、特定の対象(例えば、計測対象又は撮影対象)の一部分について得られたデータ(例えば、計測データ又は画像データなど)でもよい。 The “stitched data” is not limited to the measurement data, and for example, the data (for example, measurement data) obtained for a part of a specific target (for example, measurement target or imaging target). Or image data).
本実施形態のステッチング装置1は、データ取得部2と、処理装置3と、を有して構成されている。本実施形態におけるデータ取得部2は、(計測)対象物の表面形状を測定し、計測データを処理装置3へ出力する計測装置として構成されている。ただし、データ取得部2は、計測装置に限定されるものではなく、例えば、被ステッチングデータとなる画像データを出力するカメラであってもよい。つまり、データ取得部2は、特定の対象についてのデータを取得できるものであればよい。換言すると、データ取得部2は、観測装置(例えば、計測装置又はカメラ)によって観測対象(例えば、計測対象又は撮影対象)を観測し、観測対象の観測データを取得できるものであればよい。計測装置及びカメラなどの観測装置には、限られた観測範囲(例えば、計測範囲、撮影範囲)がある。観測範囲の重複領域を有する複数の観測データを、重複領域においてデータ接続(データステッチング)することで、限られた観測範囲を拡張することができる。
また、データ取得部2は、設けられていなくてもよく、処理装置3が、処理装置3内の記憶部12又は外部の記憶装置に記憶された被ステッチングデータを取得して処理を行っても良い。
The
Further, the
処理装置3は、コンピュータによって構成されており、処理部11と、記憶部12と、キーボード・マウスなどの入力部13と、ディスプレイなどの出力部14と、を備えている。
処理部11は、記憶部12に記憶されたコンピュータプログラムを実行することにより、処理装置3の有する機能を発揮する。具体的には、図1に示すように、処理部11は、データ取得処理部11a、弾性率設定部(変形モデル生成部)11b、一致データポイント設定部11c、変形演算部11d、検出部11e、出力処理部11f、評価部11gとしての機能を発揮する。各機能部の詳細については後述する。
The processing device 3 is configured by a computer, and includes a
The
本実施形態の計測装置(データ取得部)2は、計測対象の表面の微細な凹凸形状を測定するために、計測対象の表面(xy平面)に対して計測パスに沿った1次元スキャンを行って、計測対象の厚さ方向位置(高さ;z方向位置)を求める。
図2は、円形平板を計測装置2が測定する場合の複数の計測パスを示している。
The measurement apparatus (data acquisition unit) 2 of the present embodiment performs a one-dimensional scan along the measurement path on the measurement target surface (xy plane) in order to measure the fine uneven shape of the measurement target surface. Thus, the thickness direction position (height; z direction position) of the measurement target is obtained.
FIG. 2 shows a plurality of measurement paths when the measuring
図2に示す計測パスは、60本の直線状の計測パス(直線パス)と、1本の円環状の計測パス(円環パス)と、から構成されている。各計測パスは、他の計測パスとの交点を有する。計測パスの交点は、複数の計測パスに沿った計測範囲の重複範囲(重複点)である。交点(重複範囲)がデータ接続される位置となる。
直線パスは、円形平板上において6°おきに配置されており、個々の直線パスは、他の多数の直線パスと交わっている。円環パスは、円形平板の外周側に配置されており、全直線パスの径方向外側の先端部を繋ぐような円環状のパスとなっている。
なお、円形平板の中央部は測定範囲外とされているため、計測範囲は、ドーナツ状の領域となる。
The measurement path shown in FIG. 2 includes 60 linear measurement paths (straight path) and one annular measurement path (annular path). Each measurement path has an intersection with another measurement path. An intersection of measurement paths is an overlapping range (overlapping point) of measurement ranges along a plurality of measurement paths. The intersection (overlapping range) is the position where data is connected.
The straight paths are arranged at intervals of 6 ° on the circular flat plate, and the individual straight paths intersect with many other straight paths. The annular path is arranged on the outer peripheral side of the circular flat plate, and is an annular path that connects the distal ends on the radially outer side of all straight paths.
In addition, since the center part of the circular flat plate is outside the measurement range, the measurement range is a donut-shaped region.
計測装置2は、それぞれの計測パスに沿って計測対象の表面形状を測定した計測データ(被ステッチングデータ)を出力する。例えば、図3(a)に示す第1計測パス(直線パス)と第2計測パス(直線パス)についての計測データは、図3(b)及び図3(c)に示すようなデータ構造を有する。
The
図3(a)に示す第1計測パスは、計測対象である円形平板の表面に対して平行であるxy平面上の座標(x11,y11)から座標(x1n,y1n)を結ぶ直線パスである。第1計測パスについての計測データは、図3(b)に示すように、座標(x11,y11)から座標(x1n,y1n)における複数(n個)の計測ポイント(サンプリングポイント)それぞれにおける計測対象厚さ方向位置(高さ;z方向位置)の測定結果をデータ要素として有するデータ列として構成される。
図3(a)に示す第2計測パスは、前記xy平面上の座標(x21,y21)から座標(x2n,y2n)を結ぶ直線パスである。第2計測パスについての計測データは、図3(c)に示すように、座標(x21,y21)から座標(x2n,y2n)における複数(n個)の計測ポイント(サンプリングポイント)それぞれにおける計測対象厚さ方向位置(高さ;z方向位置)の測定結果をデータ要素として有するデータ列として構成される。
このように、計測データは、各データ要素がx,y,zという3次元の値を持つ3次元データのデータ列である。
The first measurement path shown in FIG. 3A connects the coordinates (x 1n , y 1n ) from the coordinates (x 11 , y 11 ) on the xy plane that are parallel to the surface of the circular flat plate to be measured. It is a straight path. As shown in FIG. 3B, the measurement data for the first measurement path includes a plurality of (n) measurement points (sampling points) from the coordinates (x 11 , y 11 ) to the coordinates (x 1n , y 1n ). Each of the measurement target thickness direction positions (height: z direction position) is configured as a data string having data results as measurement results.
The second measurement path shown in FIG. 3A is a straight path connecting the coordinates (x 2n , y 2n ) to the coordinates (x 21 , y 21 ) on the xy plane. As shown in FIG. 3C, the measurement data for the second measurement path includes a plurality (n) of measurement points (sampling points) from the coordinates (x 21 , y 21 ) to the coordinates (x 2n , y 2n ). Each of the measurement target thickness direction positions (height: z direction position) is configured as a data string having data results as measurement results.
Thus, the measurement data is a data string of three-dimensional data in which each data element has a three-dimensional value of x, y, z.
個々の計測データは、計測対象である円形平板からみると、計測パスという一部分における計測範囲についての測定結果に過ぎないため、計測対象全体の測定結果を得るには、複数の計測パスに沿って測定して得られた複数の計測データを、計測パスの交点(重複範囲)においてステッチング(接続)する必要がある。 Individual measurement data is only a measurement result of the measurement range in a part of the measurement path when viewed from the circular flat plate that is the measurement target, so to obtain the measurement result of the entire measurement object, along the multiple measurement paths It is necessary to stitch (connect) a plurality of measurement data obtained by measurement at intersections (overlap ranges) of measurement paths.
しかし、個々の計測データは、それぞれ独立した誤差を有しており、データを接続すべきポイント(交点)においても、接続対象の複数のデータの値が一致しているとは限らない。例えば、図3において第1計測パスと第2計測パスの交点(座標(xa,ya))においては、計測対象の同一位置が測定されるので、当然に真値は同一である。しかし、それぞれの計測データが、独立して、測定誤差等の誤差を持つ。このため、第1計測パス及び第2計測パスの重複範囲である交点(座標(xa,ya)においても、第1計測パス及び第2計測パスの計測データの値(z方向位置)は一致していないのが通常である。 However, each measurement data has an independent error, and the values of a plurality of data to be connected do not always match even at a point (intersection) to which the data is to be connected. For example, in FIG. 3, since the same position of the measurement object is measured at the intersection (coordinates (x a , y a )) of the first measurement path and the second measurement path, the true values are naturally the same. However, each measurement data has an error such as a measurement error independently. For this reason, even at the intersection (coordinates (x a , y a )) that is the overlapping range of the first measurement path and the second measurement path, the measurement data values (z-direction positions) of the first measurement path and the second measurement path are the same. Usually they do not match.
図4は、図2に示す全計測パスに沿って計測装置2で計測した計測データ(処理装置3による処理前のデータ)を、x,y,z座標上に図示したものである。図4に示すように、個々の計測データに含まれる誤差のため、直線パスの計測データは、交点となるべき位置においても、他の直線パスの計測データと一致しているとは限らない。また、円環パスの計測データも、直線パスの計測データの径方向外側の先端部と一致しているとは限らない。
このように、複数の計測データそれぞれは、誤差のために、相互に矛盾したデータとなっている。
FIG. 4 illustrates measurement data (data before processing by the processing device 3) measured by the measuring
Thus, each of the plurality of measurement data is mutually contradictory data due to an error.
したがって、データステッチングの際には、本来の交点における値の不一致を解消し、尤もらしいデータにする必要がある。一般的には、交点の真値が共通しているということを利用して、各交点に対応する複数のデータ要素の値の平均点を求め、各平均点を多角形平面で内挿するなどの方法をとることが考えられる。
しかし、この場合、交点近傍のみで値の不一致が解消されるにすぎず、全体的には交点付近を境界としてデータ値の不整合が残ることになる。つまり、データ接続領域における不整合が残ることになる。
Therefore, when data stitching is performed, it is necessary to eliminate the mismatch of the values at the original intersection and to obtain a plausible data. In general, using the fact that the true value of the intersection point is common, the average point of the values of multiple data elements corresponding to each intersection point is obtained, and each average point is interpolated with a polygonal plane, etc. It is conceivable to take this method.
However, in this case, the mismatch of values is only resolved in the vicinity of the intersection, and as a whole, the inconsistency of the data values remains around the intersection. That is, inconsistency in the data connection area remains.
そこで、本実施形態の処理装置3は、計測データ群を、弾性体のデータ群とみなす。つまり、それぞれの計測データ(被ステッチングデータ)は、計測データの値で規定される形状を有する物体(弾性体)のモデルとして扱われる。計測データの場合、弾性体の形状は、3次元座標において、計測データを構成する各データ要素が示す値を結ぶ線形状となる。被ステッチングデータを構成する各データ要素が示す値を結ぶ形状が面になれば、弾性体の形状は面形状となる。被ステッチングデータを構成する各データ要素を示す値を結ぶ形状が立体になれば、弾性体の形状は立体形状となる。
計測データを弾性体とみなすことで、データステッチング(データ接続)問題は、弾性体接続問題に置き換わる。本実施形態では、弾性体接続問題を解くことにより、データ接続領域の不整合を解消する。
Therefore, the processing device 3 of the present embodiment regards the measurement data group as an elastic body data group. That is, each measurement data (stitched data) is treated as a model of an object (elastic body) having a shape defined by the value of the measurement data. In the case of measurement data, the shape of the elastic body is a line shape that connects values indicated by the data elements constituting the measurement data in three-dimensional coordinates. If the shape connecting the values indicated by the data elements constituting the stitched data becomes a surface, the shape of the elastic body becomes a surface shape. If the shape connecting the values indicating the data elements constituting the stitched data becomes a three-dimensional shape, the shape of the elastic body becomes a three-dimensional shape.
By regarding the measurement data as an elastic body, the data stitching (data connection) problem is replaced with an elastic body connection problem. In the present embodiment, the inconsistency of the data connection area is solved by solving the elastic body connection problem.
図5Aは、弾性体接続問題を解くことによりデータステッチングを行うステッチング処理の手順を示している。
まず、処理装置11の処理部11のデータ取得処理部11aは、データ取得部2の計測を制御するデータ取得処理を行う。データ取得処理部11aは、計測装置2から同一の計測対象における複数の計測パスに対応した複数の計測データ(被ステッチングデータ)を受け付ける。
FIG. 5A shows the procedure of the stitching process for performing data stitching by solving the elastic body connection problem.
First, the data
そして、処理装置3の処理部11の弾性率設定部(物性値設定部)11bは、複数の計測データそれぞれに弾性率(ヤング率等)を設定する弾性率設定処理(物性値設定処理;ステップS1)を行う。ステップS1での設定処理では、必要に応じて弾性率以外の物性値を設定してもよい。弾性率及びその他の物性値は、後述の変形演算処理S3に用いられる。計測データに弾性率などの物性値を設定すると、計測データによって形状が示される弾性体に弾性率を設定することになる。計測データそれぞれに弾性率を設定することで、計測データを、設定された弾性率を有する弾性体の形状データとして取り扱うことができる。
計測データは、前述のように3次元データであるため、弾性率が設定されることにより3次元の弾性体形状のデータとして取り扱うことができる。具体的には、複数の計測データが、多数の線状弾性体からなる弾性体集合として取り扱われる。弾性体集合に含まれる多数の線状弾性体それぞれは、xyz空間において、図4に示す形態で、個別に存在する。
なお、線状弾性体の太さは、数値上は与えても、データをステッチするために仮想的にはゼロとみなすことができる。
また、弾性率設定処理は、後述の変形演算処理(ステップS3)の開始前までに行われていればよく、後述の一致データポイント設定処理(ステップS2)の後に行われてもよい。
Then, the elastic modulus setting unit (physical property value setting unit) 11b of the
Since the measurement data is three-dimensional data as described above, it can be handled as three-dimensional elastic body shape data by setting the elastic modulus. Specifically, a plurality of measurement data is handled as an elastic body set made up of a large number of linear elastic bodies. Each of a large number of linear elastic bodies included in the elastic body set individually exists in the form shown in FIG. 4 in the xyz space.
Although the thickness of the linear elastic body is numerically given, it can be virtually regarded as zero in order to stitch data.
Moreover, the elasticity modulus setting process should just be performed before the start of the below-mentioned deformation | transformation calculation process (step S3), and may be performed after the below-mentioned matching data point setting process (step S2).
弾性率設定部11aは、複数の計測データ(被ステッチングデータ)に対して、複数の計測データに対して全て共通の弾性率を設定することもできるし、複数の計測データそれぞれに異なる弾性率を設定することもできる。
なお、本実施形態において、弾性率の絶対値の大きさは問題とならないため、弾性率の大きさは適宜設定すればよい。複数の計測データそれぞれに異なる弾性率を設定する場合、計測データの精度(データ信頼度;含まれる誤差の大きさ)に応じて、複数の計測データそれぞれに設定される弾性率を決定する(詳細は後述する)。
The elastic
In the present embodiment, since the magnitude of the absolute value of the elastic modulus is not a problem, the magnitude of the elastic modulus may be set as appropriate. When different elastic moduli are set for each of the plurality of measurement data, the elastic modulus set for each of the plurality of measurement data is determined according to the accuracy of the measurement data (data reliability; the magnitude of the included error) (details) Will be described later).
処理部11の一致データポイント設定部(一致データ要素設定部)11cは、複数の計測データ同士でデータ値(x値,y値,z値)が一致すべきデータ要素(データポイント)を、一致データポイントとして、設定する一致データポイント設定処理(ステップS2)を行う。本実施形態の一致データポイント設定部11cは、複数の計測パスの交点(重複領域)を一致データポイントとして設定する。図2に示すような計測パスの場合、計測パスの交点となる位置(xy座標)は、予めわかっているため、図3に示すように第1及び第2計測パスの交点座標が(xa,ya)であれば、それぞれの計測パスの計測データのxy座標が(xa,ya)であるデータ要素((xa,ya,z1a)と(xa,ya,z2a))を一致データポイントとして、それぞれの計測パスの計測データについて設定される。各計測データには、複数の一致データポイント(一致データ要素)が設定されるのが好ましい。
一致データポイントは、図2に示す計測パスにおける全ての交点に対応して設定される。
なお、一致データポイントは、一致データポイント設定部11cが自動的に設定してもよいし、ユーザ入力による一致データポイントの指定に基づいて、一致データポイント設定部11cが設定してもよい。
The matching data point setting unit (matching data element setting unit) 11c of the
The coincidence data points are set corresponding to all the intersections in the measurement path shown in FIG.
The matched data point may be automatically set by the matched data point setting unit 11c, or may be set by the matched data point setting unit 11c based on the designation of the matched data point by the user input.
弾性率が設定され、かつ一致データポイントが設定された複数の計測データは、変形演算部11dに与えられる。変形演算部11dは、弾性率が設定された計測データそれぞれを、その計測データの値で示される形状(外力が加わっていない場合の形状)の弾性体のデータであるとして取り扱う。つまり、計測データは弾性体形状データとして取り扱われる。
本実施形態の変形演算部11dでは、有限要素法によって、弾性体の変形を求める。有限要素法は、一般に、構造解析などで用いられる数値解析手法であり、本実施形態では、弾性変形解析を行うために有限要素法を用いる。
A plurality of pieces of measurement data in which the elastic modulus is set and the coincidence data point is set are given to the
In the
変形演算部(有限要素変形解析部)11dは、変形解析のために、計測データの値で示される形状を持つ弾性体を要素分割した弾性体変形モデル(有限要素モデル)を生成する。要素分割は、複数の計測データに対応する複数の弾性体それぞれについて行われる。変形モデルを構成する要素は、例えば、梁要素(1次元要素)又はシェル要素(2次元要素)である。弾性体変形モデルを構成するそれぞれの要素は、少なくとも曲げ変形可能であり、断面二次モーメントを持つ弾性体要素である。したがって、弾性変形モデルは、曲げ変形及びその他の弾性変形が可能である。弾性体変形モデル(弾性体)の任意のポイントに加わった力によるひずみは、弾性体変形モデル(弾性体)全体に波及可能である。
梁要素及びシェル要素は有限要素法で用いられる要素である。したがって、要素分割は、有限要素法のソフトウェアに搭載された機能を用いて行うことができる。
本実施形態では、弾性体は線状であるため、図5Bに示すように、梁要素によって要素分割された弾性体変形モデルが生成される。弾性体変形モデルは、例えば、計測データの各データ要素間を、1又は複数の梁要素によって接続することによって構成することができる。
The deformation calculation unit (finite element deformation analysis unit) 11d generates an elastic body deformation model (finite element model) obtained by dividing an elastic body having a shape indicated by the measurement data value for deformation analysis. The element division is performed for each of a plurality of elastic bodies corresponding to a plurality of measurement data. The elements constituting the deformation model are, for example, beam elements (one-dimensional elements) or shell elements (two-dimensional elements). Each element constituting the elastic body deformation model is an elastic body element that is at least bendable and has a sectional moment of inertia. Therefore, the elastic deformation model is capable of bending deformation and other elastic deformation. The strain due to the force applied to an arbitrary point of the elastic body deformation model (elastic body) can be transmitted to the entire elastic body deformation model (elastic body).
Beam elements and shell elements are elements used in the finite element method. Therefore, the element division can be performed using a function installed in software of the finite element method.
In the present embodiment, since the elastic body is linear, as shown in FIG. 5B, an elastic body deformation model divided into elements by beam elements is generated. The elastic body deformation model can be configured, for example, by connecting each data element of measurement data by one or a plurality of beam elements.
なお、被ステッチングデータは、画像データでもよい。画像データは、2次元位置及び輝度情報からなる3次元データであり、3次元データである計測データと同様に取り扱うことができる。各画素の2次元位置及び各画素の輝度値からなる画像データは、輝度値の大小に応じた凹凸を有する面状弾性体の形状(曲面形状)を示す弾性体形状データとみなすことができる。面状弾性体の変形モデルを生成するには、シェル要素を用いた要素分割をするのが好ましい。画像データの場合においても、データ要素を梁要素で結合してもよい。この場合、有限要素モデルは網目状の面形状となる。 The stitched data may be image data. The image data is three-dimensional data including two-dimensional position and luminance information, and can be handled in the same manner as measurement data that is three-dimensional data. The image data including the two-dimensional position of each pixel and the luminance value of each pixel can be regarded as elastic body shape data indicating the shape (curved surface shape) of the surface elastic body having irregularities corresponding to the magnitude of the luminance value. In order to generate a deformation model of a planar elastic body, it is preferable to perform element division using a shell element. Even in the case of image data, the data elements may be coupled by beam elements. In this case, the finite element model has a mesh-like surface shape.
図5C(a)は、シェル要素からなる曲面形状の弾性体変形モデルM1,M2を示している。
各画像データは、重複した撮影範囲(重複領域)を有する。重複領域に含まれる画素は、一致データポイント(一致データ要素)として設定される。重複領域において複数の弾性体変形モデルM1,M2が接続される。
FIG. 5C (a) shows curved elastic body deformation models M1 and M2 made of shell elements.
Each image data has an overlapping photographing range (overlapping area). Pixels included in the overlapping area are set as matching data points (matching data elements). A plurality of elastic body deformation models M1, M2 are connected in the overlapping region.
なお、ステップS1の設定処理で設定された物性値(弾性率等)は、弾性体変形モデルを構成する各有限要素のための要素情報として設定される。したがって、弾性体変形モデルは、設定された物性値(弾性率等)に応じた変形が可能である。 Note that the physical property value (elastic modulus and the like) set in the setting process in step S1 is set as element information for each finite element constituting the elastic body deformation model. Therefore, the elastic body deformation model can be deformed according to the set physical property value (elastic modulus or the like).
変形演算部11dは、一致データポイントにおいても互いに値が一致しないことがある計測データ(弾性体形状データ;弾性体)同士を、設定された全ての一致データポイントにおいてデータ要素の値が一致(接続)するように設定する。一致データポイントである複数のデータ要素の値が一致すると、一致データポイントである複数のデータ要素の相対値(相対距離)はゼロになる。これにより、一致すべきデータ要素の値が一致することができる。
この設定によって、弾性変形モデルによって示される複数の弾性体同士が一致データポイントの位置において接続される。一致データポイントに対応した位置(変位位置)において複数の弾性体を接続すると、各弾性体における一致データポイントに対応した位置(変位位置)が強制変位される。この強制変位によって、弾性変形モデルによって示される各弾性体が弾性変形する。
一致データポイントに対応した弾性体の位置(変位位置)の強制変位によって、弾性体変形モデルを構成する各有限要素(梁要素)それぞれに曲げが生じ、強制変位による弾性変形は弾性体全体に波及する。この結果、強制変位による弾性変形は、接続された弾性体集合体全体に波及する。変形演算部11dは、このような弾性変形の結果、弾性体集合体が自然にとる形状(弾性体の内部応力によるエネルギーの総和が最小になる形状)を、有限要素法による変形解析により求める。
変形解析の境界条件は、全データポイントに対して過拘束とならないように行う。すなわち、拘束点を任意に選択し、6自由度(本実施形態では、並進3自由度と回転3自由度)を拘束する。また誤差がゼロのデータポイントがあればそれらを拘束することも可能である。この場合は、過拘束でも構わない。
The
With this setting, a plurality of elastic bodies indicated by the elastic deformation model are connected at the position of the coincidence data point. When a plurality of elastic bodies are connected at a position (displacement position) corresponding to the coincidence data point, the position (displacement position) corresponding to the coincidence data point in each elastic body is forcibly displaced. By this forced displacement, each elastic body indicated by the elastic deformation model is elastically deformed.
Due to the forced displacement of the position (displacement position) of the elastic body corresponding to the coincidence data point, bending occurs in each finite element (beam element) constituting the elastic body deformation model, and the elastic deformation due to the forced displacement affects the entire elastic body. To do. As a result, the elastic deformation due to the forced displacement spreads over the connected elastic body aggregates. As a result of such elastic deformation, the
The boundary condition of the deformation analysis is performed so that all data points are not over-constrained. That is, a constraint point is arbitrarily selected, and six degrees of freedom (in this embodiment, three translational degrees of freedom and three degrees of freedom of rotation) are constrained. It is also possible to constrain data points with zero error. In this case, over-restraint may be used.
変形演算部11dは、データ値が一致すべき一致データポイント同士のデータ値が一致するという制約(複数の弾性体において一致データポイントに対応した変位位置同士の相対値(相対距離)がゼロになるという制約)を、変形演算の制約として与える。この制約は、物理的には、弾性体が、計測パスの交点に対応する変位位置同士において接続されて離れなくなるようにすることと等価である。かかる制約の下、変形演算部11では、接続された弾性体集合体全体が自然にとる形状を求める。
なお、複数の弾性体の任意のポイント同士を接続するように弾性変形させる設定の機能は、一般的な有限要素法のソフトウェアに搭載されており、当該設定は、かかる機能を利用することで行える。
The
Note that the setting function for elastic deformation so that arbitrary points of a plurality of elastic bodies are connected is installed in general finite element method software, and the setting can be performed by using such a function. .
ここで、様々な形の竹ひごを編んで得られる竹籠の形は、竹ひごの内部応力によるエネルギーの総和が最小の状態である。竹ひごを編んで得られる竹籠の形を求めることは、相互に矛盾するデータ(本実施形態の計測データ)を交点(一致データポイント)で接続した時に最尤な結果を求めることと等価である。
そして、竹ひごを編んで得られた竹籠の形は、個々の竹ひご(弾性体)の形と弾性率がわかれば、有限要素法で求めることができる。
したがって、竹籠の形を求めるのと同様に、一致データポイントで接続した弾性体集合の形状を、弾性体形状データとして取り扱われる計測データとその弾性率に基づいて、有限要素法で求めることができる。
Here, the shape of the bamboo basket obtained by weaving bamboo bamboo of various shapes is in a state in which the sum of energy due to the internal stress of bamboo bamboo is minimal. Obtaining the shape of a bamboo basket obtained by weaving bamboo strings is equivalent to obtaining the most likely result when connecting mutually contradictory data (measurement data of this embodiment) at intersections (matching data points). is there.
The shape of the bamboo basket obtained by knitting bamboo can be obtained by the finite element method if the shape and elastic modulus of each bamboo basket (elastic body) are known.
Therefore, the shape of the elastic body set connected by the coincidence data point can be obtained by the finite element method based on the measurement data handled as the elastic body shape data and the elastic modulus in the same manner as the shape of the bamboo basket. it can.
一致データポイントで接続した弾性体集合の形状を示すデータ(変形後の弾性体形状データ)は、計測データとしての最尤度の解であり、真値に近い値であることが期待できる。
つまり、データのもつ全自由度における最小二乗法を実現し、より真値に近い結果を出力することができる。そして、計測データを弾性体とみなすことで、誤差による矛盾を有するデータを接続した場合であっても、その誤差による矛盾を、弾性変形によって、弾性体としての計測データ全体に配分することができ、接続領域における不整合を抑制することができる。
Data indicating the shape of the elastic body set connected by the coincidence data point (elastic body shape data after deformation) is a solution of maximum likelihood as measurement data, and can be expected to be a value close to a true value.
That is, it is possible to realize a method of least squares in all degrees of freedom of data and output a result closer to the true value. And even if data with contradictions due to errors are connected by considering the measurement data as an elastic body, the contradictions due to the errors can be distributed to the entire measurement data as an elastic body by elastic deformation. Inconsistency in the connection region can be suppressed.
さて、変形演算部11dが、複数の弾性体(計測データ)が、一致データポイントにおいて相対値がゼロとなるように設定する場合の設定例を説明する。
図3に示すように、第1計測パスの計測データ(図3(b))の一致データポイントのデータ値が(xa,ya,z1a)であり、第2計測パスの計測データ(図3(c))の一致データポイントのデータ値(xa,ya,z2a)である場合、各一致データポイント(各一致データ要素)のデータ値それぞれが、例えば、各一致データポイントのデータ値の中間値(xa,ya,(z1a+z2a)/2)になるように設定される。
この場合、第1計測パスの計測データ(図3(b))の一致データポイント(一致データ要素)のデータ値(xa,ya,z1a)が、中間値(xa,ya,(z1a+z2a)/2)の位置へ変位するように、弾性体とみなされた第1計測パス計測データが弾性変形し、第2計測パスの計測データ(図3(c))の一致データポイント(一致データ要素)のデータ値(xa,ya,z2a)が、中間値(xa,ya,(z1a+z2a)/2)の位置へ変位するように、弾性体とみなされた第2計測バス計測データが弾性変形する。
以上の処理により、データ値が一致すべき各一致データポイント(一致データ要素)のデータ値が一致(相対値がゼロ)し、各一致データポイントが接続されたことになる。
なお、演算の簡単化のため、データ値が一致すべき各一致データポイント(xa,ya,z1a),(xa,ya,z2a)のデータ値x,y,zのうち、ステッチングすべき方向(ステッチング方向(ここではz方向)の値z1a,z2aだけを変更する(z1a,z2aを(z1a+z2a)/2にする)ことで、データ値を一致させてもよい。この場合、元々一致している値xa,yaは、変更されないため、xy座標の演算を省略できる。
ただし、厳密には、ステッチング方向の値z1a,z2aが一致するように、それぞれの弾性体を弾性変形させると、それぞれの弾性体の各一致データポイントのxy座標値も元の値(xa,ya)からわずかにずれた値(xa’,ya’)になる。したがって、厳密な演算を行う場合には、各一致データポイントのデータ値を一致させた場合のxyz座標値は、(xa’,ya’,(z1a+z2a)/2)となるべきである。
しかし、xy座標におけるずれは、大変小さく、演算結果にほとんど影響を与えないため、xy座標値の演算を省略してもよい。すなわち、弾性体のxy座標値は、一致データポイントの接続前の値を使用し、z座標値についてのみ一致データポイントの接続後の値を使用してもよい。
Now, a setting example will be described in which the
As shown in FIG. 3, the data value of the coincidence data point of the measurement data of the first measurement path (FIG. 3B) is (x a , y a , z 1a ), and the measurement data of the second measurement path ( In the case of the data value (x a , y a , z 2a ) of the matching data point in FIG. 3 (c)), the data value of each matching data point (each matching data element) is, for example, It is set to be an intermediate value (x a , y a , (z 1a + z 2a ) / 2) of data values.
In this case, the data value (x a , y a , z 1a ) of the coincidence data point (coincidence data element) of the measurement data of the first measurement path (FIG. 3B) is an intermediate value (x a , y a , The first measurement path measurement data regarded as an elastic body is elastically deformed so as to be displaced to the position of (z 1a + z 2a ) / 2), and coincides with the measurement data (FIG. 3C) of the second measurement path. The elastic body so that the data value (x a , y a , z 2a ) of the data point (matching data element) is displaced to the position of the intermediate value (x a , y a , (z 1a + z 2a ) / 2) The second measurement bus measurement data regarded as being elastically deformed.
As a result of the above processing, the data values of the matching data points (matching data elements) whose data values should match are matched (relative value is zero), and the matching data points are connected.
For the sake of simplicity of calculation, the matching data point data value should match (x a, y a, z 1a), (x a, y a, z 2a) the data value x of the, y, of z , By changing only the values z 1a and z 2a of the stitching direction (here z direction) (by changing z 1a and z 2a to (z 1a + z 2a ) / 2), the data value may be matched. in this case, the value x a which originally coincide, y a, since not changed, can be omitted operation of xy coordinates.
However, strictly speaking, if each elastic body is elastically deformed so that the values z 1a and z 2a in the stitching direction coincide with each other, the xy coordinate value of each coincidence data point of each elastic body also becomes the original value ( A value (x a ′ , y a ′ ) slightly deviated from x a , y a ). Therefore, when performing a strict calculation, the xyz coordinate values when the data values of the matching data points are matched should be (x a ′ , y a ′ , (z 1a + z 2a ) / 2). It is.
However, since the deviation in the xy coordinates is very small and hardly affects the calculation result, the calculation of the xy coordinate values may be omitted. That is, the xy coordinate value of the elastic body may use a value before connection of the coincidence data point, and may use a value after connection of the coincidence data point only for the z coordinate value.
ここで、各弾性体のxy座標におけるずれは、予め各弾性体をxy方向に十分に拡大した上で、一致データポイントの接続を行って弾性体を弾性変形させ、その後に、各弾性体の大きさをもとの大きさに縮小することで、抑制することができる。xy方向への拡大は、一致データポイントの接続に伴う弾性体の変位位置のz方向の変位量よりも十分に大きくする。弾性体をxy方向に十分に拡大することで、拡大された弾性体からみて、一致データポイントの接続によって生じるz方向の変位は相対的に微小になるため、接続に伴うxy方向のずれも微小になる。このような手法により、弾性体内に働く圧縮力と引張力の影響をおさえることができ、より適切な演算が可能になる。 Here, the displacement in the xy coordinates of each elastic body is obtained by sufficiently expanding each elastic body in the xy direction in advance and connecting the coincidence data points to elastically deform the elastic body. It can be suppressed by reducing the size to the original size. The expansion in the xy direction is made sufficiently larger than the displacement amount in the z direction of the displacement position of the elastic body accompanying the connection of the coincidence data points. By sufficiently expanding the elastic body in the xy direction, the displacement in the z direction caused by the connection of the coincidence data points becomes relatively small when viewed from the expanded elastic body, so that the displacement in the xy direction accompanying the connection is also small. become. By such a method, the influence of the compressive force and the tensile force acting on the elastic body can be suppressed, and more appropriate calculation becomes possible.
また、前述の説明では、計測データに、計測パスの交点に対応するデータ要素(例えば、図3(b)の(xa,ya,z1a)及び図3(c)の(xa,ya,z2a))が存在していることを前提としていた。
ただし、計測データ(被ステッチングデータ)は、離散的なデータであるため、実際の計測対象の計測パス交点位置に完全に一致したデータ要素が存在しているとは限らない。高精度のデータステッチングが必要ない場合には、計測データに含まれるデータ要素のうち実際の計測パス交点位置の近傍のデータ要素を一致データポイントとして選択すればよいが、高精度のデータステッチングが求められる場合、より正確に一致データポイントを設定することが望まれる。
In the above description, the measurement data includes data elements (for example, (x a , y a , z 1a ) in FIG. 3B and (x a , It was assumed that y a , z 2a )) existed.
However, since the measurement data (data to be stitched) is discrete data, there is not always a data element that completely matches the measurement path intersection position of the actual measurement target. If high-precision data stitching is not required, data elements in the vicinity of the actual measurement path intersection position can be selected as matching data points from the data elements included in the measurement data. Is required, it is desirable to set the matching data points more accurately.
本実施形態の一致データポイント設定部11cは、計測データが実際の計測パス交点位置に一致するデータ要素を含んでいない場合に、より正確に一致データポイントを設定する機能も有している。
図6は、より正確な一致データポイント設定の仕方を示している。ここでは、図6(a)に示すように、第1計測パスの計測データの第1データ要素(x1i,y1i,z1i)と第2データ要素(x1(i+1),y1(i+1),z1(i+1))との間、及び第2計測パスの計測データの第3データ要素(x2j,y2j,z2j)と第4データ要素(x2(j+1),y2(j+1),z2(j+1))との間に、実際の計測パス交点(一致データポイント)が存在するものとする。
The coincidence data point setting unit 11c of the present embodiment also has a function of setting the coincidence data point more accurately when the measurement data does not include a data element that coincides with the actual measurement path intersection position.
FIG. 6 shows a more accurate way to set matching data points. Here, as shown in FIG. 6A , the first data element (x 1i , y 1i , z 1i ) and the second data element (x 1 (i + 1) , y 1 ( i + 1), z 1 ( i + 1)) between the, and the third data element of the measurement data of the second measurement path (x 2j, y 2j, z 2j) and the fourth data element (x 2 (j + 1) ,
この場合、一致データポイント設定部11cは、第1計測パスの計測データ(離散データ)に基づいて、第1計測パスの計測データの第1データ要素(x1i,y1i,z1i)と第2データ要素(x1(i+1),y1(i+1),z1(i+1))との間の区間を補間する補間関数(ここでは1次補間関数を採用)を求めるとともに、第2計測パスの計測データの第3データ要素(x2j,y2j,z2j)と第4データ要素(x2(j+1),y2(j+1),z2(j+1))との間の区間を補間する補間関数(ここでは1次補間関数を最小)を求める。
そして、一致データポイント設定部11cは、2つの補間関数が、図6(a)のxy平面において交差するxy座標の位置(xa,ya)を、xy座標における交点として決定する。
In this case, the coincidence data point setting unit 11c uses the first data element (x 1i , y 1i , z 1i ) of the measurement data of the first measurement path and the first data based on the measurement data (discrete data) of the first measurement path. An interpolation function for interpolating a section between two data elements (x 1 (i + 1) , y 1 (i + 1) , z 1 (i + 1) ) (in this case, a primary interpolation function is adopted) and a second measurement path Is interpolated between the third data element (x 2j , y 2j , z 2j ) and the fourth data element (x 2 (j + 1) , y 2 (j + 1) , z 2 (j + 1) ) of the measured data of An interpolation function (here, the primary interpolation function is minimized) is obtained.
Then, the coincidence data point setting unit 11c determines the position (x a , y a ) of the xy coordinates where the two interpolation functions intersect in the xy plane of FIG. 6A as the intersection in the xy coordinates.
さらに、一致データポイント設定部11cは、第1計測パスの補間関数を用いて、交点xy座標(xa,ya)におけるzの値(=z1a)を求める。これにより、第1計測パスの補間関数上において、交点に対応する補間データ要素のxyz座標値=(xa,ya,z1a)が得られる。得られた補間データ要素(xa,ya,z1a)は、第1計測パスの計測データに加えられ、第1計測パスの計測データおける一致データポイントとして設定される。
同様に、一致データポイント設定部11cは、第2計測パスの補間関数を用いて、交点xy座標(xa,ya)におけるzの値(=z2a)を求める。これにより、第2計測パスの補間関数上において、交点に対応する補間データ要素のxyz座標値=(xa,ya,z2a)が得られる。得られた補間データ要素(xa,ya,z2a)は、第2計測パスの計測データに加えられ、第2計測パスの計測データおける一致データポイントとして設定される。
以上の処理によって、より正確な一致データポイントの設定が行える。
Furthermore, the coincidence data point setting unit 11c obtains the value of z (= z 1a ) at the intersection xy coordinates (x a , y a ) using the interpolation function of the first measurement path. Thereby, the xyz coordinate value = (x a , y a , z 1a ) of the interpolation data element corresponding to the intersection point is obtained on the interpolation function of the first measurement path. The obtained interpolation data element (x a , y a , z 1a ) is added to the measurement data of the first measurement path and set as a coincidence data point in the measurement data of the first measurement path.
Similarly, the coincidence data point setting unit 11c obtains the value of z (= z 2a ) at the intersection xy coordinates (x a , y a ) using the interpolation function of the second measurement path. Thereby, the xyz coordinate value = (x a , y a , z 2a ) of the interpolation data element corresponding to the intersection is obtained on the interpolation function of the second measurement path. The obtained interpolation data element (x a , y a , z 2a ) is added to the measurement data of the second measurement path and set as a coincidence data point in the measurement data of the second measurement path.
With the above processing, more accurate matching data points can be set.
このように、計測データ(被ステッチングデータ)を構成するデータ要素間で補間された補間データ要素を一致データポイントとして設定することで、計測データのサンプリング頻度にかかわらず、一致データポイントのより正確な設定が可能となる。 In this way, by setting the interpolated data elements interpolated between the data elements that make up the measurement data (data to be stitched) as matching data points, the matching data points are more accurate regardless of the sampling frequency of the measurement data. Can be set.
そして、変形演算部11dが、設定された一致データポイント同士の相対値をゼロにする場合、図6(b)に示すように、一致データポイントとして設定された補間データ要素のデータ値が、各一致データポイントのデータ値の中間値(xa,ya,z3a)の位置へ変位するように、弾性体とみなされた第1計測パス計測データ及び第2計測パス計測データを弾性変形させる。
And when the deformation |
図5Aに戻り、有限要素法による変形演算処理(ステップS3)が終了すると、変形演算部11dは、弾性変形後の弾性体集合体の弾性体形状データを、ステッチングデータとして得る。変形演算部11dは、有限要素法による変形解析の結果として、変形後の弾性体集合体の弾性体形状データのほか、変形後の弾性体集合体の内部応力を示すデータも出力する。
処理部11の検出部11eは、変形後の弾性体の内部応力データに基づいて、誤差が相対的に大きいなどの不適切な計測データ(被ステッチングデータ)又は不適切に設定された一致データポイント(弾性体の不適切な接続)を検出する検出処理を実行する(ステップS4)。
Returning to FIG. 5A, when the deformation calculation process by the finite element method (step S3) ends, the
Based on the internal stress data of the deformed elastic body, the detection unit 11e of the
例えば、複数の計測データのうち、ある一つの計測データに含まれる誤差が、何らかの原因により、他の計測データに含まれる誤差よりも非常に大きい場合、その誤差の大きい計測データは、他の計測データに対して大きな矛盾を内包していることになる。誤差の大きい計測データを、他の計測データと接続して、弾性変形を行わせると、誤差の大きい計測データによって無理な弾性変形が生じ、誤差の大きい計測データ(弾性体)及びその付近の内部応力が非常に大きくなる。つまり、複数の計測データ間の矛盾が大きいと、そのような計測データ同士が接続されている箇所では、内部応力が大きくなる。 For example, if the error included in one measurement data out of multiple measurement data is much larger than the error included in other measurement data for some reason, the measurement data with a large error It is a big contradiction to the data. If measurement data with a large error is connected to other measurement data to cause elastic deformation, the elastic measurement data with a large error will cause unreasonable elastic deformation. The stress becomes very large. That is, when there is a large discrepancy between a plurality of measurement data, the internal stress increases at a location where such measurement data is connected.
そこで、検出部11eは、内部応力データを利用し、内部応力が大きい範囲に属する計測データ又は一致データポイント(弾性体の接続位置)を検出する。これにより、不適切な計測データを除外したり、一致データポイント(弾性体の接続)の設定を外したりして、再度、変形解析を行うことで、より適切な変形解析結果を得ることができる。 Therefore, the detection unit 11e uses the internal stress data to detect measurement data or coincident data points (elastic body connection positions) belonging to a range where the internal stress is large. As a result, more appropriate deformation analysis results can be obtained by excluding inappropriate measurement data or removing matching data points (connection of elastic bodies) and performing deformation analysis again. .
検出部11eが、内部応力の大きい範囲を検出するには、例えば、内部応力を、所定の閾値と比較し、内部応力が閾値を超えている範囲を内部応力の大きい範囲として検出できる。閾値は、例えば、弾性体集合体全体の内部応力の平均値に基づいて設定(例えば、閾値を内部応力の平均値の2倍に設定)することができる。 In order for the detection unit 11e to detect a range where the internal stress is large, for example, the internal stress is compared with a predetermined threshold, and a range where the internal stress exceeds the threshold can be detected as a range where the internal stress is large. The threshold value can be set, for example, based on the average value of the internal stress of the entire elastic body assembly (for example, the threshold value is set to twice the average value of the internal stress).
処理部11の出力処理部11fは、変形後の弾性体形状データを、複数の被ステッチングデータをステッチングしたステッチングデータとして、出力部(例えば、ディスプレイなどの表示部)14に出力する。出力部14は、記憶部12にステッチングデータを出力してもよい。図7は、出力されたステッチングデータを示している。
The
処理部11による処理前の計測データのRMS(Root Mean Square)は54nmであり、P-V(Peak-to-valley)は510nmである(図4参照)のに対し、本実施形態11によるステッチング処理後のステッチングデータ(変形後の弾性体形状データ)でのRMSは15.8nmであり、P-Vは100nmとなった。したがって、ステッチングデータの測定精度は、処理部11による処理前の計測データよりも大幅に向上しており、精度のよい結果が得られていることがわかる。
したがって、測定装置2の測定精度が低い場合であっても、ステッチングによって精度の高い測定結果を得ることができる。
The RMS (Root Mean Square) of the measurement data before processing by the
Therefore, even when the measurement accuracy of the
さらに、本実施形態では、変形演算部11dによる変形演算処理において、変形解析に一般的に用いられる有限要素法を用いたため、ステッチング装置の構築が容易である。また、有限要素法は、高速で変形解析を行うため、ステッチング処理を高速に行うことができる。例えば、処理装置3として家庭用コンピュータを用いた場合、数秒でステッチング処理における変形演算処理(ステップS3)を行うことができる。
Furthermore, in this embodiment, since the finite element method generally used for deformation analysis is used in the deformation calculation processing by the
また、図7に示す測定結果(ステッチングデータ)は、表面が滑らかな鏡面である円形円板を計測した場合のものであるが、図8,9は、表面の一部に凸部が存在する円形円板を測定した場合の結果を示している。
図8は、図4と同様に、処理部3による処理前の計測データである。処理前の計測データでは、図8の太い黒線で示す「存在するはずの凸部」の位置に凸部が存在していることを把握するのは困難である。
一方、処理部3による処理後のステッチングデータでは、図9に示すように、凸部に対応した形状が現われており、精度の良い測定結果が得られていることがわかる。
この図9からも、本実施形態のステッチング処理によって、高精度の測定結果が得られていることが確認できる。
In addition, the measurement results (stitching data) shown in FIG. 7 are obtained when a circular disk having a smooth surface is measured, but in FIGS. 8 and 9, there are convex portions on the surface. The result when measuring the circular disk to be shown is shown.
FIG. 8 shows measurement data before processing by the processing unit 3 as in FIG. In the measurement data before processing, it is difficult to grasp that the convex portion exists at the position of the “convex portion that should exist” shown by the thick black line in FIG.
On the other hand, in the stitching data after processing by the processing unit 3, as shown in FIG. 9, a shape corresponding to the convex portion appears, and it can be seen that a highly accurate measurement result is obtained.
Also from FIG. 9, it can be confirmed that a highly accurate measurement result is obtained by the stitching process of the present embodiment.
また、弾性率設定部11bが、個々の計測データの精度に応じて、複数の計測データそれぞれに設定される弾性率を異ならせることで、より精度の高い測定結果を得ることができる。例えば、弾性率設定部11bは、計測データの精度が高ければ、相対的に大きい弾性率をその計測データに設定して変形し難くし、計測データの精度が低ければ、相対的に小さい弾性率をその計測データに設定して変形し易くする。つまり、信頼性の高い(精度の高い)計測データは変形し難くする一方、信頼性の低い(精度の低い)計測データは変形し易くすることで、信頼性の高い計測データが信頼性の高い計測データに沿うように変形するため、ステッチングデータの精度を高めることができる。
Further, the elastic
例えば、図2の測定パスのうち、円環パスについては、n回繰り返し測定を行って、誤差が少なく精度(信頼度)の高い計測データが得られている一方、多数の直線パスについては、1回しか測定を行わず、相対的に精度の低い計測データしか得られていないものとする。この場合、精度の高い円環パスの計測データに設定される弾性率を、精度の低い直線パスの計測データに設定される弾性率よりもn倍大きくして、円環パスの計測データ(弾性体形状データ)を変形し難くする。
これにより、精度の低い直線パスの計測データが、精度の高い円環パスの計測データに合せて変形するため、精度の高いステッチングデータが得られる。しかも、直線パスについては測定回数を少なくできるため、測定の高速化も図られる。
For example, among the measurement paths in FIG. 2, the circular path is measured n times, and measurement data with small error and high accuracy (reliability) is obtained. On the other hand, for many linear paths, It is assumed that only one measurement is performed and only relatively low-precision measurement data is obtained. In this case, the elastic modulus set in the highly accurate circular path measurement data is made n times larger than the elastic modulus set in the low precision linear path measurement data, and the circular path measurement data (elasticity Make body shape data) difficult to deform.
Thereby, since the measurement data of the straight path with low accuracy is deformed in accordance with the measurement data of the circular path with high accuracy, high-precision stitching data is obtained. In addition, since the number of measurements can be reduced for the straight path, the measurement speed can be increased.
なお、計測データの精度(信頼度)については、弾性率設定部11bが、ユーザから入力部13を介して、個々の計測データの測定回数などを、精度に関するデータとして受け付けてもよいし、計測装置2から、個々の計測データの測定回数などのデータを取得してもよい。
As for the accuracy (reliability) of the measurement data, the elastic
図10は、評価部11gによる評価処理を示している。評価処理は、計測及び撮影などの観測の仕方を評価するものである。本実施形態の評価部11gは、計測パス(計測範囲)及び撮影範囲などの観測範囲の決め方の適切さを評価する。
観測範囲の決め方の適切さを評価する処理は、互いに接続された複数の弾性体の集合に対する固有値解析によって行われる(ステップS11)。固有値の解析の結果得られた固有値(固有振動数など)が高いほど、観測範囲の決め方についてより高い評価が出力される(ステップS12)。
FIG. 10 shows the evaluation process by the
The process of evaluating the appropriateness of how to determine the observation range is performed by eigenvalue analysis on a set of a plurality of elastic bodies connected to each other (step S11). The higher the eigenvalue (e.g., natural frequency) obtained as a result of the eigenvalue analysis, the higher the evaluation of how to determine the observation range is output (step S12).
互いに接続された複数の弾性体の集合は、固有値が高いと、全体的に剛性が高く、変形し難いものとなり、固有値が低ければ、全体的に剛性が低く変形し易い。弾性体の集合が固いほどデータ同士が効率よく連結され、より補正力の高い優れたデータステッチであると評価できる。したがって、データの観測範囲とその重複領域の良否の評価は、固有値解析によって観測前に事前に行える。 A set of a plurality of elastic bodies connected to each other has a high rigidity as a whole when the eigenvalue is high, and is difficult to be deformed. If the eigenvalue is low, the rigidity is low as a whole and is easily deformed. The harder the set of elastic bodies, the more efficiently the data are linked together, and it can be evaluated that the data stitch is an excellent data stitch with a higher correction force. Therefore, the evaluation of the quality of the observation range of the data and the overlapping region can be performed in advance before observation by eigenvalue analysis.
図11及び図12は、線状の計測パス(観測範囲)の決め方によって、複数の計測データに対応する複数の線状弾性体を計測パスの交点で接続した弾性体集合の固有値が異なることを示している。図11(a)に示す計測パスは、図2に示した計測パスと同じものであり、多数の直線パスと直線パスの外周側の円環パスとを有している。図11(b)は、図11(a)の計測パスから円環パスを除いたものである。図11(b)の計測パスに対応した弾性体集合は、円環パスに相当する弾性体を有していないため、固有値が低く、剛性が低い。 FIG. 11 and FIG. 12 show that the eigenvalues of an elastic body set in which a plurality of linear elastic bodies corresponding to a plurality of measurement data are connected at the intersections of measurement paths differ depending on how to determine a linear measurement path (observation range). Show. The measurement path shown in FIG. 11A is the same as the measurement path shown in FIG. 2, and has a large number of straight paths and an annular path on the outer peripheral side of the straight paths. FIG. 11B is obtained by removing the circular path from the measurement path of FIG. Since the elastic body set corresponding to the measurement path in FIG. 11B does not have an elastic body corresponding to the annular path, the eigenvalue is low and the rigidity is low.
図12(a)~(c)も計測パスを示している。図12(a),(b),(c)の順で固有値が小さくなる。したがって、図12(a)の計測パスのデータ補正力が最も高く、図12(b),(c)の順でデータ補正力が小さくなる。 FIGS. 12A to 12C also show the measurement paths. The eigenvalues become smaller in the order of FIGS. 12 (a), (b), and (c). Therefore, the data correction force of the measurement path in FIG. 12A is the highest, and the data correction force decreases in the order of FIGS. 12B and 12C.
図13は、画像データの撮影範囲(観測範囲)の決め方で、複数の画像データに対応する複数の面状弾性体を撮影範囲の重複領域で接続した弾性体集合の固有値が異なることを示している。図13(a)(b)は、それぞれ16枚の画像データを撮影範囲の重複領域において重ねた状態を示している。図13(a)(b)において、重複領域はハッチングで示している。図13(b)に示す撮影範囲の重複領域は、図13(a)における重複領域よりも大きい。したがって、図13(b)の方が固有値が高く、図13(b)に示すように設定された撮影範囲に従って得られた画像データの方が、データステッチングによるデータ補正力が高い。 FIG. 13 shows how to determine the shooting range (observation range) of image data, and that the eigenvalues of the elastic body sets in which a plurality of planar elastic bodies corresponding to a plurality of image data are connected in overlapping areas of the shooting range are different. Yes. FIGS. 13A and 13B show a state in which 16 pieces of image data are overlapped in the overlapping region of the shooting range. In FIGS. 13A and 13B, the overlapping region is indicated by hatching. The overlapping area of the imaging range shown in FIG. 13B is larger than the overlapping area in FIG. Therefore, the eigenvalue is higher in FIG. 13B, and the image data obtained according to the imaging range set as shown in FIG. 13B has a higher data correction capability by data stitching.
ただし、図13(b)は重複領域が大きいため、図13(b)では、16個の画像データでカバーできる範囲が、小さくなる。図13(b)では、図13(a)の16個の画像でカバーできる範囲を「A」で示した。図13(b)において、範囲Aと同様の大きさの範囲を確保しようとすれば、画像データの必要数が大きくなり、データ量が増加する。データ量の増加は、データ取得コストの増大につながる。
したがって、撮影範囲(観測範囲)の決め方の評価の際には、固有値に基づくデータ補正力だけでなく、必要となるデータ量も考慮した評価値を求めても良い。
また、計測パス(観察範囲)の設定の仕方によって、計測対象(観測対象)全体からみたデータ要素の密度が変化するため、評価値には、データ要素の密度も考慮してもよい。例えば、図12(a)(b)では、図12(a)は計測パスの数が多く、データ密度が高いのに対し、図12(b)(c)の順でデータ密度が低くなり、計測対象において計測されていない部分が増加することになる。したがって、データ重複の密度が高くなるほど、より高精度のデータとして評価することができる。
However, since the overlapping area is large in FIG. 13B, the range that can be covered by 16 pieces of image data is small in FIG. 13B. In FIG. 13B, the range that can be covered by the 16 images in FIG. 13A is indicated by “A”. In FIG. 13B, if an attempt is made to secure a range having the same size as the range A, the required number of image data increases and the amount of data increases. An increase in data amount leads to an increase in data acquisition cost.
Therefore, when evaluating how to determine the imaging range (observation range), an evaluation value that considers not only the data correction power based on the eigenvalue but also the necessary data amount may be obtained.
Further, since the density of data elements as viewed from the whole measurement target (observation target) varies depending on how the measurement path (observation range) is set, the density of the data elements may be considered in the evaluation value. For example, in FIGS. 12A and 12B, while FIG. 12A has a large number of measurement paths and a high data density, the data density decreases in the order of FIGS. 12B and 12C. The part which is not measured in a measurement object will increase. Therefore, the higher the data duplication density, the more accurate the data can be evaluated.
なお、評価処理の際には、弾性体とみなされるデータは、実際の観測データであってもよいし、観測範囲に合せて作成された評価用のデータであってもよい。例えば図3(b)(c)に示すデータ構造を有する計測データについての評価用のデータは、高さ(z座標値)を全て一定値にしたものとすることができる。また、画像データについての評価用のデータは、画素値を全て一定値にしたものとすることができる。 In the evaluation process, the data regarded as the elastic body may be actual observation data or evaluation data created in accordance with the observation range. For example, the evaluation data for the measurement data having the data structure shown in FIGS. 3B and 3C can be such that the height (z coordinate value) is all set to a constant value. Further, the evaluation data for the image data can be obtained by setting all the pixel values to a constant value.
以下、実施形態に係るデータステッチングについて、数学的観点からの説明も加えてさらに詳細に説明する。図14は、ステッチングされる複数のデータ(第1データ及び第2データ)を示している。ここでは、説明の簡略化のため、各データ要素は、xm_nとfn(xm_n)という2次元の値(離散値)を持つものとする。図14(a)に示す複数のデータは、図3に示すデータのx座標値をxm_nで表し、図3に示すデータのy座標値を省略し、図3に示すデータのz座標値をfn(xm_n)で表したものに相当する。
図14(a)において、
n=1~N
N:ステッチングされるデータ(被ステッチングデータ)の数
m_n=1~M_n
M_n:n番目のデータを構成するデータ要素の数
である。
Hereinafter, the data stitching according to the embodiment will be described in more detail with an explanation from a mathematical viewpoint. FIG. 14 shows a plurality of data (first data and second data) to be stitched. Here, for simplification of explanation, each data element is assumed to have the x m_n and f n (x m_n) of 2-dimensional value (discrete value). 14A, the x coordinate value of the data shown in FIG. 3 is represented by xm_n , the y coordinate value of the data shown in FIG. 3 is omitted, and the z coordinate value of the data shown in FIG. This corresponds to that represented by f n (x m — n ).
In FIG. 14 (a),
n = 1 to N
N: Number of data to be stitched (data to be stitched) m_n = 1 to M_n
M_n: the number of data elements constituting the nth data.
n=1である第1データの各データ要素のx値は、xm_1で示され、第1データの各データ要素のf値は、f1(xm_1)で示される。n=2である第2データの各データ要素のx値は、xm_2で示され、第2データの各データ要素のf値は、f2(xm_2)で示される。 The x value of each data element of the first data with n = 1 is denoted by x m — 1 , and the f value of each data element of the first data is denoted by f 1 (x m — 1 ). The x value of each data element of the second data for which n = 2 is indicated by x m — 2 , and the f value of each data element of the second data is indicated by f 2 (x m — 2 ).
図14(a)に示すように、第1データ及び第2データは、離散データである。これらの離散的な第1データ及び第2データは、ステッチングされる際には、各データ毎に、連続的な形状の弾性体とみなされる。各弾性体の形状は、各データを構成するデータ要素を示す値(xm_n,fn(xm_n))を結ぶ連続的な形状となる。
図14(b)は、データ毎に、データ要素を線で結んだ線形状を示している。離散的な第1データに対応した弾性体の形状は、関数f1(x)によって表される。離散的な第2データに対応した弾性体の線形状は、関数f2(x)によって表される。以下、関数fn(x)は、n番目のデータを弾性体の形状とみなした場合における当該弾性体の形状を示す。
As shown in FIG. 14A, the first data and the second data are discrete data. When the discrete first data and second data are stitched, each piece of data is regarded as an elastic body having a continuous shape. The shape of each elastic body is a continuous shape connecting values (x m — n , f n (x m — n )) indicating data elements constituting each data.
FIG. 14B shows a line shape in which data elements are connected by lines for each data. The shape of the elastic body corresponding to the discrete first data is represented by the function f 1 (x). The line shape of the elastic body corresponding to the discrete second data is represented by the function f 2 (x). Hereinafter, the function f n (x) indicates the shape of the elastic body when the n-th data is regarded as the shape of the elastic body.
ここで、図14(b)は、各データ要素を滑らかに曲がった線で結んだ曲線形状を示す。一方、図14(c)は、各データ要素を直線で結んだ折れ線形状を示す。ステッチングされるデータを弾性体形状データとしてみなす場合、弾性体の形状としては、図14(b)を観念してもよいし、図14(c)を観念してもよい。後述のように、弾性変形を利用したデータステッチングでは、各データ要素の変位un(x)を扱えれば十分であるため、弾性体の形状は、図14(b)であっても、図14(c)であっても等価である。なお、弾性体変形モデルが梁要素からなる有限要素モデルである場合、データ要素間は直線形状の梁要素によって接続されるため、弾性体変形モデルの形状は、図14(c)のようになる。
ただし、ここでは、数学的観点からの説明の便宜上、弾性体の形状は、図14(b)に示されるように滑らかな曲線でデータ要素を結んだ形状とする。
Here, FIG. 14B shows a curved shape in which each data element is connected by a smoothly bent line. On the other hand, FIG. 14C shows a polygonal line shape in which each data element is connected by a straight line. When the stitched data is regarded as elastic body shape data, as the shape of the elastic body, FIG. 14B may be considered, or FIG. 14C may be considered. As will be described later, in the data stitching using elastic deformation, it is sufficient to handle the displacement u n (x) of each data element. Therefore, even if the shape of the elastic body is FIG. FIG. 14C is also equivalent. When the elastic body deformation model is a finite element model composed of beam elements, the data elements are connected by linear beam elements, so the shape of the elastic body deformation model is as shown in FIG. .
However, here, for convenience of explanation from a mathematical point of view, the shape of the elastic body is a shape in which data elements are connected by a smooth curve as shown in FIG.
図15は、一般化のため、第1データに対応する形状関数をfi(x)で示し(i=1)、第2データに対応する形状関数をfj(x)で示している(j=2)。なお、i≠jである。
ここで、第1データの一致データポイントは、fi(x2_i)に設定され、第2データの一致データポイントは、fj(x2_j)に設定されるものとする。一致データポイントに対応する変位位置での2つの弾性体の接続は、数学的には、fi’(x2_i)=fj’(x2_j)となるように、fi(x2_i)とfj(x2_j)とを変位させることである。なお、fi’(x2_i)及びfj’(x2_j)は、それぞれ、fi(x2_i)及びfj(x2_j)の変位後の値を示す。
すなわち、一般化したステッチング条件は、次の式(1)のとおりである。
Here, the matching data point of the first data is set to f i (x 2 — i ), and the matching data point of the second data is set to f j (x 2 — j ). The connection of two elastic bodies at the displacement position corresponding to the coincidence data point is mathematically expressed as f i (x 2 — i ) such that f i ′ (x 2 — i ) = f j ′ (x 2 — j ). f j (x 2 — j ) is displaced. In addition, f i ′ (x 2 — i ) and f j ′ (x 2 — j ) indicate values after displacement of f i (x 2 — i ) and f j (x 2 — j ), respectively.
That is, the generalized stitching condition is as the following formula (1).
fi(x2_i)からfi’(x2_i)への変位量をui(x2_i)と表し、fj(x2_j)からfj’(x2_j)への変位量をuj(x2_j)と表した場合、式(1)に示すステッチング条件は、次のように表される。
式(1)及び式(2)に示すステッチング条件が、変位位置(一致データポイント)において、複数の弾性体を互いに接続することに相当する。 The stitching conditions shown in Equation (1) and Equation (2) correspond to connecting a plurality of elastic bodies to each other at the displacement position (matching data point).
fi(x2_i)とfj(x2_j)を弾性体とみなす場合、fi’(x2_i)=fj’(x2_j)となるように、fi(x2_i)とfj(x2_j)とを変位させると、関数f1(x),f2(x)によって示される形状は全体的に、変化する。
図16は、変形後の弾性体の形状に対応する関数fi’(x),fj’(x)を示している。関数fi’(x)は、2つの弾性体の接続に伴って変形した関数fi(x)を示している。関数fj’(x)は、2つの弾性体の接続に伴って変形した関数fj(x)を示している。
つまり、以下の式(3)(4)のとおりである。
FIG. 16 shows functions f i ′ (x) and f j ′ (x) corresponding to the shape of the elastic body after deformation. The function f i ′ (x) indicates a function f i (x) deformed with the connection of two elastic bodies. The function f j ′ (x) indicates a function f j (x) that is deformed along with the connection of two elastic bodies.
That is, it is as the following formulas (3) and (4).
図17に示すように、ui(x)は、fi(x)からfi’(x)への変位量を示す関数(変位関数)であり、uj(x)は、fj(x)からfj’(x)への変位量を示す関数(変位関数)である。
ここで、上記ステッチング条件を満たすような関数fi(x),fj(x)の変形の仕方は、無数に存在する。したがって、変位関数ui(x),uj(x)も、無数に存在する。したがって、変位関数ui(x),uj(x)の最適化が必要である。
変位関数の最適化のため、本実施形態では、関数fi(x),fj(x)から関数fi’(x),fj’(x)への変形は、関数fi(x),fj(x)によって示される形状を持つ弾性体の弾性変形であると考える。互いに接続された複数の弾性体からな弾性体集合は、曲げによる弾性エネルギーが最小となる形状をとる。関数の変形が弾性変形であると考えることで、弾性変形を解析する手法によって、変位関数ui(x),uj(x)を最適化することができる。
曲げによる弾性エネルギーの最小化は、数学的に表すと、変位関数ui(x),uj(x)の曲率の積分値を最小化することと等価である。したがって、弾性変形の概念を導入した場合における変位関数の最適化は、例えば、以下の式(5)のように定式化される。
Here, there are innumerable ways to modify the functions f i (x) and f j (x) that satisfy the stitching condition. Accordingly, there are innumerable displacement functions u i (x) and u j (x). Therefore, it is necessary to optimize the displacement functions u i (x) and u j (x).
In order to optimize the displacement function, in the present embodiment, the transformation from the function f i (x), f j (x) to the function f i ′ (x), f j ′ (x) is the function f i (x ), F j (x). An elastic body assembly made up of a plurality of elastic bodies connected to each other takes a shape that minimizes elastic energy caused by bending. By considering that the deformation of the function is elastic deformation, the displacement functions u i (x) and u j (x) can be optimized by a method of analyzing the elastic deformation.
Minimizing the elastic energy by bending is equivalent to minimizing the integral value of the curvature of the displacement functions u i (x), u j (x) in mathematical terms. Therefore, the optimization of the displacement function when the concept of elastic deformation is introduced is formulated, for example, as in the following equation (5).
式(5)では、変位関数un(x)(n=1~N)それぞれの二階微分値(曲率)を二乗したものの積分値の総和を、最小化している。本実施形態において、「弾性変形を求める」という処理は、式(5)に従った概念によって変位関数を最適化することによって行うことができる。先に説明した有限要素法も、式(5)に従った概念に基づく処理の一つである。有限要素法は、曲げによる弾性エネルギーが最小となる弾性体形状を求める手法として優れている。したがって、有限要素法は、弾性変形を求める手法として非常に好適である。 In equation (5), the sum of integral values of the squares of the second-order differential values (curvatures) of the displacement functions u n (x) (n = 1 to N) is minimized. In the present embodiment, the process of “obtaining elastic deformation” can be performed by optimizing the displacement function according to the concept according to the equation (5). The finite element method described above is also one of the processes based on the concept according to Equation (5). The finite element method is excellent as a method for obtaining an elastic body shape that minimizes elastic energy caused by bending. Therefore, the finite element method is very suitable as a method for obtaining elastic deformation.
複数の弾性体毎に異なる弾性率が設定される場合の最適化は式(6)のように定式化される。
式(6)では、変位関数un(x)(n=1~N)それぞれの二階微分値(曲率)に重みwnを乗じている。データの精度(信頼度)が高いほど、弾性率、すなわち重みwnを大きくする。これにより、高い精度を持つデータに対応した弾性体に対応する変位関数の曲率がより大きく評価される(弾性体が変形しにくい)ことになる。
Optimization in the case where different elastic moduli are set for a plurality of elastic bodies is formulated as shown in Equation (6).
In equation (6), it is multiplied by the weight w n to the
最適化された(弾性変形した)変位関数un(x)(n=1~N)が求まると、式(7)に基づき、元のデータfn(xm_n)と最適化された変位関数un(x)とから、fn’(xm_n)が得られる。図18に示すように、fn’(x)は、弾性変形した弾性体の形状を示している。
本発明は、上記実施形態に限定されるものではない。例えば、ステッチング処理の対象となる被ステッチングデータは、計測データに限定されるものではなく、画像データ(衛星写真データ、パノラマ写真データなど)など、任意のデータであってもよい。なお、画像がカラー画像である場合、RGBの色ごとにデータステッチングを行えばよい。
また、有限要素法は、2次元以下のデータにも適用可能であるから、当然に、被ステッチングデータは2次元以下のデータであってもよい。
さらに、被ステッチングデータは、4次元以上のデータであってもよい。被ステッチングデータが4次元以上のデータである場合、被ステッチングデータを4次元以上の弾性体形状データとみなすとともに、有限要素法をデータの次元数に応じた次元に拡張したものを用いればよい。
つまり、被ステッチングデータは、任意のn次元(nは1以上の整数)のデータでよい。
The present invention is not limited to the above embodiment. For example, the stitching data to be stitched is not limited to measurement data, and may be arbitrary data such as image data (satellite photo data, panoramic photo data, etc.). When the image is a color image, data stitching may be performed for each of the RGB colors.
Further, since the finite element method can be applied to data of two dimensions or less, naturally, the stitched data may be data of two dimensions or less.
Further, the stitched data may be four-dimensional data or more. If the stitched data is data of four or more dimensions, the stitched data is regarded as elastic body shape data of four or more dimensions, and the finite element method expanded to a dimension corresponding to the number of data dimensions is used. Good.
That is, the stitching data may be arbitrary n-dimensional data (n is an integer of 1 or more).
また、被ステッチングデータに設定される弾性率は、次元毎に異なるものであってもよい。例えば、3次元座標と時間からなる4次元データの場合、座標と時間とは性質が異なるため、座標の変形と時間の変形が異なるように、座標に関する弾性率と時間に関する弾性率とを異ならせても良い。 Further, the elastic modulus set in the stitched data may be different for each dimension. For example, in the case of four-dimensional data composed of three-dimensional coordinates and time, since the properties of the coordinates and time are different, the elastic modulus related to coordinates and the elastic modulus related to time are made different so that the deformation of coordinates and the deformation of time are different. May be.
被ステッチングデータが画像データである場合、一致データポイントは、ユーザ入力による指定で設定されてもよいし、複数の画像中の共通する物体を画像処理により抽出し、抽出された箇所を、一致データポイントとして設定してもよい。 When the stitched data is image data, the coincidence data point may be set by user input, or a common object in a plurality of images is extracted by image processing, and the extracted portions are matched. It may be set as a data point.
変形解析の手法は、有限要素法に限定されるものではなく、変形を数値解析によって求めることができる他の手法であってもよい。 The deformation analysis method is not limited to the finite element method, and may be another method capable of obtaining the deformation by numerical analysis.
1 ステッチング装置
2 データ取得部
3 処理装置
11 処理部
11a データ取得処理部
11b 弾性率設定部
11c 一致データポイント設定部
11d 変形演算部
11e 検出部
11f 出力処理部
11g 評価部
12 記憶部
13 入力部
14 出力部
DESCRIPTION OF
Claims (19)
前記複数のデータそれぞれを弾性体の形状のデータとみなし、前記複数のデータに対応する複数の弾性体それぞれに生じる弾性変形を求める処理部を備え、
前記弾性体の前記形状は、前記データが有する複数のデータ要素が示す値を結ぶ形状であり、
前記弾性変形は、前記複数のデータにおいてデータ要素の値が一致すべきデータ要素に対応した弾性体の位置において、前記位置が一致するように前記複数の弾性体を互いに接続することで生じる弾性変形であり、
前記処理部は、前記弾性変形が生じた前記複数の弾性体の形状を示すデータを、前記複数のデータをステッチしたステッチングデータとして出力する
データステッチング装置。 A data stitching device for stitching a plurality of data, each having a plurality of data elements,
Each of the plurality of data is regarded as data of the shape of the elastic body, and includes a processing unit that obtains elastic deformation generated in each of the plurality of elastic bodies corresponding to the plurality of data,
The shape of the elastic body is a shape connecting values indicated by a plurality of data elements included in the data,
The elastic deformation is caused by connecting the plurality of elastic bodies to each other so that the positions coincide with each other at the position of the elastic body corresponding to the data element that should have the same data element value in the plurality of data. And
The data processing apparatus, wherein the processing unit outputs data indicating the shapes of the plurality of elastic bodies having undergone the elastic deformation as stitching data obtained by stitching the plurality of data.
請求項1記載のデータステッチング装置。 The data stitching device according to claim 1, wherein the processing unit is configured to set an elastic modulus of each of the plurality of elastic bodies.
請求項2記載のデータステッチング装置。 The data stitching apparatus according to claim 2, wherein the processing unit can set different elastic moduli for each of the plurality of elastic bodies.
請求項2又は3に記載のデータステッチング装置。 The data stitching device according to claim 2 or 3, wherein the processing unit is configured to determine an elastic modulus of each of the plurality of elastic bodies based on reliability of each of the plurality of data.
前記複数のデータにおいてデータ要素の値が一致すべきデータ要素は、前記補間データ要素を含む
請求項1~4のいずれか1項に記載のデータステッチング装置。 The processing unit is configured to perform a process of adding an interpolation data element that interpolates the plurality of data elements to at least one of the plurality of data.
The data stitching device according to any one of claims 1 to 4, wherein a data element whose data element values should match in the plurality of data includes the interpolated data element.
請求項1~5のいずれか1項に記載のデータステッチング装置。 2. The processing unit is configured to obtain internal stress of the plurality of elastic bodies in which the elastic deformation has occurred, and to detect inappropriate data among the plurality of data based on the internal stress. 6. The data stitching device according to any one of 1 to 5.
請求項1~6のいずれか1項に記載のデータステッチング装置。 The processing unit obtains internal stresses of the plurality of elastic bodies in which the elastic deformation has occurred, and detects inappropriate connection of the plurality of elastic bodies based on the internal stresses. 2. A data stitching apparatus according to item 1.
請求項1~7のいずれか1項に記載のデータステッチング装置。 The data stitching device according to any one of claims 1 to 7, wherein the processing unit obtains the elastic deformation by deformation analysis using a plurality of elastic body deformation models generated based on the plurality of data. .
請求項8に記載のデータステッチング装置。 The data stitching apparatus according to claim 8, wherein each of the plurality of elastic body deformation models includes a plurality of elements that can be bent and deformed at least.
請求項9記載のデータステッチング装置。 The data stitching device according to claim 9, wherein the element includes a beam element.
請求項9記載のデータステッチング装置。 The data stitching device according to claim 9, wherein the element includes a shell element.
請求項8~12のいずれか1項に記載のデータステッチング装置。 The data stitching apparatus according to any one of claims 8 to 12, wherein the deformation analysis is performed by a finite element method.
請求項1~12のいずれか1項に記載のデータステッチング装置。 The data stitching device according to any one of claims 1 to 12, wherein the elastic deformation includes at least bending deformation.
前記複数のデータ要素それぞれは、前記計測パス上の計測値を示すデータ要素であり、
前記複数の計測パスそれぞれは、前記複数の計測パスに含まれる他の計測パスとの交点を有し、
前記弾性体の前記形状は、前記形状計測データが有する複数のデータ要素が示す前記計測値を結ぶ線の形状であり、
前記弾性変形は、前記交点の計測値を示すデータ要素に対応した前記弾性体の位置において、前記位置が一致するように前記複数の弾性体を接続することで生じる弾性変形である
請求項1~13のいずれか1項に記載のデータステッチング装置。 The plurality of data is a plurality of shape measurement data obtained by measuring the surface of the measurement object along a plurality of measurement paths,
Each of the plurality of data elements is a data element indicating a measurement value on the measurement path,
Each of the plurality of measurement paths has an intersection with another measurement path included in the plurality of measurement paths,
The shape of the elastic body is a shape of a line connecting the measurement values indicated by a plurality of data elements included in the shape measurement data,
The elastic deformation is an elastic deformation generated by connecting the plurality of elastic bodies so that the positions coincide with each other at a position of the elastic body corresponding to a data element indicating a measurement value of the intersection. 14. The data stitching device according to any one of items 13.
前記複数のデータ要素それぞれは、画素であり、
前記複数の画像データの撮影範囲それぞれは、前記複数の画像データに含まれる他の画像データの撮影範囲との重複領域を有し、
前記弾性体の前記形状は、前記画像データが有する複数の画素が示す画素値を結ぶ面の形状であり、
前記弾性変形は、前記重複領域に含まれる画素に対応した前記弾性体の位置において、前記位置が一致するように前記複数の弾性体を接続することで生じる弾性変形である
請求項1~13のいずれか1項に記載のデータステッチング装置。 The plurality of data is image data,
Each of the plurality of data elements is a pixel;
Each of the shooting ranges of the plurality of image data has an overlapping area with shooting ranges of other image data included in the plurality of image data,
The shape of the elastic body is a shape of a surface connecting pixel values indicated by a plurality of pixels included in the image data,
The elastic deformation is an elastic deformation generated by connecting the plurality of elastic bodies so that the positions coincide with each other at a position of the elastic body corresponding to a pixel included in the overlapping region. The data stitching apparatus of any one of Claims.
前記複数の観測データの観測範囲それぞれは、前記複数の観測データに含まれる他の観測データの観測範囲との重複領域を有する
請求項1~13のいずれか1項に記載のデータステッチング装置。 The plurality of data is a plurality of observation data obtained by observing an observation object with an observation device,
The data stitching apparatus according to any one of claims 1 to 13, wherein each of the observation ranges of the plurality of observation data has an overlapping area with an observation range of other observation data included in the plurality of observation data.
前記評価する処理は、前記複数の弾性体全体に対する固有値解析の結果に基づいて行われる
請求項1~16のいずれか1項に記載のデータステッチング装置。 The processing unit is configured to perform a process of evaluating how to observe the observation object,
The data stitching apparatus according to any one of claims 1 to 16, wherein the evaluation process is performed based on a result of eigenvalue analysis on the entire plurality of elastic bodies.
前記複数のデータそれぞれを弾性体の形状のデータとみなし、前記複数のデータに対応する複数の弾性体それぞれに生じる弾性変形を求める処理を前記コンピュータが実行すること、
前記弾性変形が生じた前記複数の弾性体の形状を示すデータを、前記複数のデータをステッチしたステッチングデータとして、前記コンピュータが出力すること、
を含み
前記弾性体の前記形状は、前記データが有する複数のデータ要素が示す値を結ぶ形状であり、
前記弾性変形は、前記複数のデータにおいてデータ要素の値が一致すべきデータ要素に対応した弾性体の位置において、前記位置が一致するように前記複数の弾性体を互いに接続することで生じる弾性変形である
方法。 A method in which a computer performs a process of stitching a plurality of data each having a plurality of data elements,
Each of the plurality of data is regarded as data of the shape of the elastic body, and the computer executes a process for obtaining elastic deformation occurring in each of the plurality of elastic bodies corresponding to the plurality of data,
The computer outputs data indicating the shapes of the plurality of elastic bodies in which the elastic deformation has occurred as stitching data obtained by stitching the plurality of data,
The shape of the elastic body includes a value connecting values indicated by a plurality of data elements included in the data,
The elastic deformation is caused by connecting the plurality of elastic bodies to each other so that the positions coincide with each other at the position of the elastic body corresponding to the data element that should have the same data element value in the plurality of data. Is the method.
前記処理は、
前記複数のデータそれぞれを弾性体の形状のデータとみなし、前記複数のデータに対応する複数の弾性体それぞれに生じる弾性変形を求めることと、
前記弾性変形が生じた前記複数の弾性体の形状を示すデータを、前記複数のデータをステッチしたステッチングデータとして出力することと、
を含み、
前記弾性体の前記形状は、前記データが有する複数のデータ要素が示す値を結ぶ形状であり、
前記弾性変形は、前記複数のデータにおいてデータ要素の値が一致すべきデータ要素に対応した弾性体の位置において、前記位置が一致するように前記複数の弾性体を互いに接続することで生じる弾性変形である
コンピュータプログラム。 A computer program for causing a computer to execute a process of stitching a plurality of data each having a plurality of data elements,
The processing is as follows:
Each of the plurality of data is regarded as data of the shape of the elastic body, obtaining elastic deformation generated in each of the plurality of elastic bodies corresponding to the plurality of data;
Outputting data indicating the shapes of the plurality of elastic bodies in which the elastic deformation has occurred, as stitching data obtained by stitching the plurality of data;
Including
The shape of the elastic body is a shape connecting values indicated by a plurality of data elements included in the data,
The elastic deformation is caused by connecting the plurality of elastic bodies to each other so that the positions coincide with each other at the position of the elastic body corresponding to the data element that should have the same data element value in the plurality of data. Is a computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2015549192A JP6508723B2 (en) | 2013-11-21 | 2014-11-20 | Data stitching apparatus, data stitching method, and computer program |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2013241001 | 2013-11-21 | ||
| JP2013-241001 | 2013-11-21 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2015076343A1 true WO2015076343A1 (en) | 2015-05-28 |
Family
ID=53179603
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2014/080802 Ceased WO2015076343A1 (en) | 2013-11-21 | 2014-11-20 | Data-stitching device, data-stitching method, and computer program |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP6508723B2 (en) |
| WO (1) | WO2015076343A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110146029A (en) * | 2019-05-28 | 2019-08-20 | 北京林业大学 | A quasi-static full-field deformation measurement device and method for slender members |
| WO2023243173A1 (en) * | 2022-06-14 | 2023-12-21 | パナソニックIpマネジメント株式会社 | Shape measurement method and shape measurement device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH02138665A (en) * | 1988-08-31 | 1990-05-28 | Hitachi Ltd | Graphic processing method and device |
| JP2000090070A (en) * | 1998-09-09 | 2000-03-31 | Hitachi Ltd | Analysis result display method |
| WO2012008031A1 (en) * | 2010-07-15 | 2012-01-19 | キヤノン株式会社 | Method and apparatus for measuring shape of surface to be inspected, and method for manufacturing optical element |
| JP2012112852A (en) * | 2010-11-26 | 2012-06-14 | Jfe Steel Corp | Method for predicting fatigue life of welded structure |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4384825B2 (en) * | 2001-04-26 | 2009-12-16 | 上村工業株式会社 | Method for calculating film thickness of electrodeposition coating |
-
2014
- 2014-11-20 JP JP2015549192A patent/JP6508723B2/en active Active
- 2014-11-20 WO PCT/JP2014/080802 patent/WO2015076343A1/en not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH02138665A (en) * | 1988-08-31 | 1990-05-28 | Hitachi Ltd | Graphic processing method and device |
| JP2000090070A (en) * | 1998-09-09 | 2000-03-31 | Hitachi Ltd | Analysis result display method |
| WO2012008031A1 (en) * | 2010-07-15 | 2012-01-19 | キヤノン株式会社 | Method and apparatus for measuring shape of surface to be inspected, and method for manufacturing optical element |
| JP2012112852A (en) * | 2010-11-26 | 2012-06-14 | Jfe Steel Corp | Method for predicting fatigue life of welded structure |
Non-Patent Citations (3)
| Title |
|---|
| JIAYA JIA ET AL.: "Image Stitching Using Structure Deformation", IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, vol. 30, no. 4, April 2008 (2008-04-01), pages 617 - 631, XP055013220, DOI: doi:10.1109/TPAMI.2007.70729 * |
| KE-CHENG PAN ET AL.: "Remote sensing image stitch using modified structure deformation", PROC. SPIE 8420, 6TH INTERNATIONAL SYMPOSIUM ON ADVANCED OPTICAL MANUFACTURING AND TESTING TECHNOLOGIES: OPTICAL SYSTEM TECHNOLOGIES FOR MANUFACTURING AND TESTING, 84200S, vol. 8420, 15 October 2012 (2012-10-15), pages 1 - 8 * |
| MIKIO KURITA: "A New method for smooth and accurate data stitching", KYOTO UNIVERSITY NEW TECHNOLOGY PRESENTATION MEETINGS, PROGRAM TOJITSU HAIFU SHIRYO, 10 August 2014 (2014-08-10), Retrieved from the Internet <URL:http://web.archive.org/web/20140820132411/http://www.jstshingi.jp/abst/2014/kyoto/program.html> [retrieved on 20150209] * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110146029A (en) * | 2019-05-28 | 2019-08-20 | 北京林业大学 | A quasi-static full-field deformation measurement device and method for slender members |
| WO2023243173A1 (en) * | 2022-06-14 | 2023-12-21 | パナソニックIpマネジメント株式会社 | Shape measurement method and shape measurement device |
Also Published As
| Publication number | Publication date |
|---|---|
| JP6508723B2 (en) | 2019-05-08 |
| JPWO2015076343A1 (en) | 2017-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Zhao et al. | Initial guess by improved population-based intelligent algorithms for large inter-frame deformation measurement using digital image correlation | |
| US10497111B2 (en) | Information processing apparatus and method of selecting viewpoint for measuring object, and measuring system | |
| US20110262015A1 (en) | Image processing apparatus, image processing method, and storage medium | |
| JP6376873B2 (en) | Image processing apparatus, image processing method, and program | |
| CN106061379A (en) | Processing device, processing method, and program | |
| JP6332951B2 (en) | Image processing apparatus, image processing method, and program | |
| US20200051278A1 (en) | Information processing apparatus, information processing method, robot system, and non-transitory computer-readable storage medium | |
| JP6238755B2 (en) | Information processing apparatus, information processing method, and program | |
| WO2015076343A1 (en) | Data-stitching device, data-stitching method, and computer program | |
| JP4970118B2 (en) | Camera calibration method, program thereof, recording medium, and apparatus | |
| CN102725774B (en) | Similarity degree calculation device, similarity degree calculation method, and program | |
| US11010634B2 (en) | Measurement apparatus, measurement method, and computer-readable recording medium storing measurement program | |
| Reich et al. | Global robust image rotation from combined weighted averaging | |
| JP5669372B2 (en) | Image analysis apparatus, measurement method thereof, and program | |
| JP6464815B2 (en) | Distortion measuring method and apparatus, program and recording medium | |
| CN103092814B (en) | A kind of general least square adjustment method of measurement data | |
| Bartoli et al. | A robust analytical solution to isometric shape-from-template with focal length calibration | |
| JP2006343234A (en) | Aspheric shape error evaluation method and shape evaluation apparatus | |
| US10325367B2 (en) | Information processing apparatus, information processing method, and storage medium | |
| TWI412721B (en) | System and method for detecting a gap between two parts of an object | |
| JP6452086B2 (en) | Shape calculating apparatus and method, measuring apparatus, article manufacturing method, and program | |
| JP5913900B2 (en) | Measuring method | |
| JP7621228B2 (en) | Shape inspection method and system | |
| Pai et al. | Image registration using stationary velocity fields parameterized by norm-minimizing wendland kernel | |
| TWI692648B (en) | Sensors positions determinations |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14864357 Country of ref document: EP Kind code of ref document: A1 |
|
| DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
| ENP | Entry into the national phase |
Ref document number: 2015549192 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14864357 Country of ref document: EP Kind code of ref document: A1 |