US20070122025A1 - Automated macromolecular crystal detection system and method - Google Patents
Automated macromolecular crystal detection system and method Download PDFInfo
- Publication number
- US20070122025A1 US20070122025A1 US10/452,668 US45266803A US2007122025A1 US 20070122025 A1 US20070122025 A1 US 20070122025A1 US 45266803 A US45266803 A US 45266803A US 2007122025 A1 US2007122025 A1 US 2007122025A1
- Authority
- US
- United States
- Prior art keywords
- line segments
- image
- crystals
- crystal
- edges
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
- G06V10/431—Frequency domain transformation; Autocorrelation
Definitions
- the present invention relates to automated image recognition and detection systems and methods, and more particularly to an automated system and method using a phase-based edge detection process to detect macromolecular crystals from two-dimensional images obtained from light microscopy of crystallization experiments.
- Proteomics is the field of bioscience involving the characterization of the proteins encoded by the human genome, and enabled by the gene sequence data produced by the human genome project. Since the structure of a protein is key to understanding its function, one field of proteomics in particular has rapidly emerged concerning high throughput structure determination or structural genomics. In determining protein structure, the proteins are first crystallized, and then an X-ray generator produces diffraction patterns from which a three-dimensional picture of the atomic arrangement in the crystal can be obtained. Advances in macromolecular crystallography techniques, computer speed, and the availability of high-energy synchrotron x-ray sources, make rapid structure determination possible given adequate quality protein crystals.
- FIGS. 3-7 illustrate images of screening results are analyzed using a two-dimensional Fourier transform.
- FIG. 5C illustrates the Fourier frequency spectrum used in the analysis
- FIG. 5D illustrates an analysis of the spectrum derivatives and circular averages to provide features information of the image. From this feature extraction and analysis, the outcome of the experiment is classified as, clear drop, amorphous precipitate, phase separation, microcrystals, crystals, or unknown.
- crystals may have less contrast relative to the background than other objects or particles.
- the difference between the crystal and the background based on 256 gray levels is often 15 levels, whereas the difference for dirt is usually above 40 levels.
- many different crystal shapes exist due to, for example, the existence of several large classes of crystal shape, the picture is a 2-D projection of a 3-D object, crystal imperfections with faulty edges, and large variations in crystal size, e.g. ranging from about 10 ⁇ m to nearly 300 ⁇ m.
- an automated crystal detection process must also achieve a high threshold of accuracy by being able to identify virtually all crystals with a low false-positive rate.
- One aspect of the present invention includes a method of detecting macromolecular crystals in light microscopy images comprising: detecting edges in said images by identifying local maxima of a phase congruency-related function associated with each image; segmenting the detected edges into discrete line segments; evaluating the geometric relationships that the line segments have with each other to identify any crystal-like qualities; and determining the presence of crystals in each image based on said evaluation.
- Another aspect of the present invention includes a computerized system for detecting macromolecular crystals from light microscopy images comprising: a digital conversion component that converts said light microscopy images into corresponding phase-based digital image data using the Fourier transform; an edge detection component that detects edges from the image data by computing local maxima of a phase congruency-related function associated with each image; a segmentation component that divides the detected edges into discrete line segments; and a geometric analyzer component that evaluates the geometric relationships that the line segments have with each other to identify any crystal-like qualities, and determines whether crystals are present in each image based on said evaluation.
- Another aspect of the present invention includes a computerized system for detecting macromolecular crystals from light microscopy images comprising: means for digitally converting said light microscopy images into corresponding phase-based digital image data using the Fourier transform; means for detecting edges from the image data by computing local maxima of a phase congruency-related function associated with each image; means for dividing the detected edges into discrete line segments; means for evaluating the geometric relationships that the line segments have with each other to identify any crystal-like qualities; and means for determining the presence of crystals in an image from said evaluation.
- Another aspect of the present invention includes a computer program product comprising: a computer useable medium having a computer readable code embodied therein for causing the detection of macromolecular crystals in light microscopy images, said computer program product having: computer readable program code means for causing a computer to detect edges in said images by identifying local maxima of a phase congruency-related function associated with each image; computer readable program code means for causing said computer to segment the detected edges into discrete line segments; computer readable program code means for causing said computer to evaluate the geometric relationships that the line segments have with each other to identify any crystal-like qualities; and computer readable program code means for causing said computer to determine the presence of crystals in each image based on said evaluation.
- Another aspect of the present invention includes an article of manufacture comprising: a computer useable medium having a computer readable code means embodied therein for causing the detection of macromolecular crystals in light microscopy images, said computer readable code means in said article of manufacture comprising: computer readable program code means for causing a computer to detect edges in said images by identifying local maxima of a phase congruency-related function associated with each image; computer readable program code means for causing said computer to segment the detected edges into discrete line segments; computer readable program code means for causing said computer to evaluate the geometric relationships that the line segments have with each other to identify any crystal-like qualities; and computer readable program code means for causing said computer to determine the presence of crystals in each image based on said evaluation.
- FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present invention.
- FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present invention.
- FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present invention.
- FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present invention.
- FIG. 1 is an overview flow diagram of a general embodiment of the present invention.
- FIG. 2 is a flow diagram detailing an exemplary edge detection process using phase congruency, and including a noise reduction subprocess.
- FIG. 3 is a flow diagram detailing an exemplary geometric analysis/evaluation process which evaluates the geometric relationships that the line segments have with each other to identify any crystal-like qualities.
- FIG. 4 is a flow diagram of a second exemplary embodiment of the present invention.
- FIG. 5 is a graph of a 1-D step signal and its cosine decomposition via the Fourier transform.
- FIG. 6 is a screen shot of a sample edge map produced from the edge detection step of the present invention.
- FIG. 7 is a multiple screen shot of the sample edge map of FIG. 5 , separated into several images with each containing features having a given orientation.
- FIG. 8 is a multiple screen shot showing two orientations before and after auto-correlation is performed.
- the present invention is an automated method and system (hereinafter “method”) for detecting the presence of macromolecular crystals from light microscopy images, such as those obtained from crystallography experiments.
- the automated method utilizes the phase information of the pixels in each image in performing crystal detection. This provides greater resistance to noise and other artifacts than amplitude based properties, e.g. pixel intensity, which can lead to poor image quality.
- the phase information of the pixels is used to identify specific geometric features in an image attributable to and most likely indicative of a crystalline structure, such as, for example, parallel edges, of similar length, facing each other, in relatively close proximity.
- Implementation of the present invention is suitably achieved using, for example, software, computer code, ROM, integrated circuit, etc. (hereinafter “software”) to execute and control the method steps and system functions.
- software may be written in any suitable programming language for operation on a suitable operating system or platform, not limited to any particular language or operating system or platform.
- the software may be written as object oriented code having implementable subroutines that enable the user to call them in sequence to solve problems.
- FIG. 1 shows an overview flow diagram of the steps involved in a first general embodiment of the present invention, indicated at reference character 10 .
- Two-dimensional images captured from crystallography experiments are first provided as input 11 to begin the process.
- edge features, if any, in each image are detected using phase congruency, and in particular, a phase congruency-based function.
- the detected edges are then segmented into discrete, straight line segments in the line segmentation step of 13 , followed by a geometric analysis and evaluation (hereinafter “evaluation”) of the geometric relationships that the line segments have with each other to identify any crystal-like qualities, at 14 .
- evaluation geometric analysis and evaluation
- geometric relationships such as parallel lines, facing each other, and similarity in length, as well as relative proximity to each other, are all crystal-like qualities in that they are characteristic of crystalline structure.
- a determination and decision is made based on the preceding geometric evaluation, as to whether crystals are present in a particular image. A decision with respect to any one image may be reported separately, or together in a list with other images determined to have detected crystals. The corresponding ones of the experiments may subsequently be collected for X-ray determination of atomic structure and protein identification.
- identifying the local maxima of the phase congruency function will also identify and thereby detect the edges. It is notable, however, that while this function provides the correct computational results, it is slow to compute directly.
- I(x) is obtained by convolving the original signal by a filter to remove the DC component.
- H(x) is obtained by filtering the previous result by the Hilbert transform of the first filter.
- the human visual system has neuronal structures similar to a pair of odd and even symmetric filters in quadrature.
- M e is the even filter and M o is the odd filter, one has: M e * f ⁇ ( x ) ⁇ ⁇ - ⁇ + ⁇ ⁇ a ⁇ ⁇ cos ( ⁇ ⁇ ⁇ x + ⁇ ⁇ ⁇ ) ⁇ d ⁇ ( 5 ) and M o * f ⁇ ( x ) ⁇ - ⁇ - ⁇ + ⁇ ⁇ a ⁇ ⁇ sin ⁇ ( ⁇ ⁇ ⁇ x + ⁇ ⁇ ) ⁇ ⁇ d ⁇ ( 6 )
- the even symmetric filter is chosen so that it covers as much of the frequency spectrum as possible, and at the same time removing the D.C. term.
- the filters are band-pass filters and different local energies are computed for different scale. This allows for a multi-scale analysis of the image to be performed, with the possibility to look for features of different size, and for example getting rid of noise or features very small that cannot be crystal.
- a local maximum in the local energy corresponds to a local maximum in the phase congruency, and to an edge. Therefore, in order to search for local maxima in the phase congruency function, one equivalently searches for local maxima in the local energy function. These local maxima will occur at step edges of both parity (up or down), lines and bar edges, and other types of features such as the illusion patterns mentioned before. While the previous calculations for both PC(x) and I(x) were for 1-D signals, it is appreciated that a 2-D signal can also be decomposed in a series of 1-D signals by traversing and accounting for many orientations. The local energy of a point will be the maximum local energy among all the orientations.
- FIG. 2 shows a detailed flow diagram, indicated at reference character 12 ′, of an exemplary edge detection step using a phase congruency-based function (e.g. local energy function) associated with an image.
- a phase congruency-based function e.g. local energy function
- FIG. 2 shows a detailed flow diagram, indicated at reference character 12 ′, of an exemplary edge detection step using a phase congruency-based function (e.g. local energy function) associated with an image.
- a phase congruency-based function e.g. local energy function
- noise variance and mean of the local energy is estimated, and a noise threshold is applied on the local energy.
- the filter response will be decreased by the noise threshold to remove the components considered as noise.
- finding the right threshold can be difficult.
- the noise amplitude distribution must be determined.
- the median value is considered as a statistically robust estimation of the mean.
- the smallest scale of the Gabor filter is used because the noise should be the most present at this scale.
- the noise threshold at larger scales can be deduced by the threshold at the smallest scale
- phase congruency function is obtained.
- local maxima of the phase-congruency-based function is identified to detect corresponding edges. In this manner an edge map may be constructed as shown in FIG. 6 , for example, with local maxima occurring at step edges of both parity (up or down), lines and bar edges, and other types of features such as the illusion patterns.
- FIG. 3 shows a flow diagram of a preferred geometry analysis and evaluation process, generally indicated at reference character 14 ′.
- the geometric evaluation stage at 14 occurs subsequent to the segmentation 13 of the detected edges into discrete line segments, and evaluates the geometric relationships that the line segments have with each other to identify crystal-like qualities.
- each combination of pairs of segments are first rated based on characteristically crystal-like qualities, including, but not limited to: parallel lines, facing each other, similarity in length, and relative proximity to each other.
- the line segments are grouped based on the preceding crystal-like quality ratings. For each group at 32 , each edge pixel is classified according to the local edge orientation at 33 . For example, FIG.
- FIG. 7 shows a multiple screen shot view of the edge map of FIG. 5 separated into eight images, with each image containing features having a given orientation.
- auto-correlation is calculated to enhance shapes with parallel lines, and subsequently analyzed at 35 to decide if the shape is a crystal or not.
- FIG. 8 illustrates two orientations before (left column) and after (right column) auto-correlation is performed, showing the enhancements. Additionally at 35 the quality of the auto-correlation is rated using the following criteria: numbers of features in the auto-correlation above specific threshold, and length and location of these features. A global “quality score” is then calculated from the auto-correlation quality ratings.
- the geometry analysis and evaluation stage may also be performed using additional criteria, including: (1) minimum gradient along edges, and (2) central symmetry.
- the gradient i.e. first derivative of the original picture
- the edge is then considered relevant.
- symmetry centers are found using the phase information.
- An important aspect of symmetry is the periodicity that it implies in the structure of the object.
- the picture is filtered with the same pair of even and odd symmetric Gabor filters as for the edge detection technique. At a point of symmetry, the absolute value of the even filter will be large, and the absolute value of the odd one will be small. Taking the difference of the absolute value of the even-symmetric filter and the odd one give a quantification of the degree of symmetry in an object.
- a flow diagram of an exemplary second embodiment is also shown in FIG. 4 . Similar to the general algorithm of FIG. 1 , the process here also begins with the input of images at 41 , captured from, for example, crystallography experiments. Steps 42 and 43 illustrate optional pre-processing functions available for improving the crystal detection process. At 42 , noise reduction is performed as a pre-processing step, similar to that previously discussed. Additionally, at step 43 , a smoothing filter is employed, such as that performing nonlinear anisotropic diffusion, to clean the image prior to edge detection. Nonlinear anisotropic diffusion filters are commonly known and used for image enhancement while preserving edges. In particular, the filter performs intraregion smoothing while inhibiting interregion smoothing.
- edge detection is performed according to the process previously described, using a phase congruency-related function, such as either PC(x) or LE(x).
- a skeletonization step extracts the skeleton of the acquired edge map by removing the non-maximal values of the edge map without breaking the object topology. This is accomplished by setting the non-maximal values to zero in the perpendicular direction (orientation) to the edge. While crystals generally have straight edges, the phase congruency-based edge detection discussed previously finds any kind of edge, not necessarily only straight ones.
- a line can be distinguished from other objects because the local energy in its perpendicular direction is high, and low in the parallel direction of the line. It is notable that a spot feature has the same local energy for all the orientations. This information is used to remove all the edges that are not line features.
- spur lines may also be removed from the skeleton structure obtained, as a post-edge detection image-cleaning step.
- the detected edges are then segmented into discrete, straight line segments in the line segmentation step of 47 , followed by a geometric analysis and evaluation at 48 , utilizing evaluation criteria characteristic of crystals as previously described.
- a determination and decision is made based on the preceding geometric evaluation, as to whether crystals are present in a particular image.
- a second edge detection (not shown) may be optionally utilized in conjunction with the first edge detection process described above, in order to further refine or otherwise limit the edge detection results obtained from the first edge detection.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
Abstract
Description
- This application claims priority in provisional application filed on May 30, 2002, entitled “Augmented Automated Macromolecular Crystal Detection from Light Microscopy Images” Ser. No. 60/385,210, by inventors Christian et al.
- The United States Government has rights in this invention pursuant to Contract No. W-7405-ENG-48 between the United States Department of Energy and the University of California for the operation of Lawrence Livermore National Laboratory.
- The present invention relates to automated image recognition and detection systems and methods, and more particularly to an automated system and method using a phase-based edge detection process to detect macromolecular crystals from two-dimensional images obtained from light microscopy of crystallization experiments.
- Proteomics is the field of bioscience involving the characterization of the proteins encoded by the human genome, and enabled by the gene sequence data produced by the human genome project. Since the structure of a protein is key to understanding its function, one field of proteomics in particular has rapidly emerged concerning high throughput structure determination or structural genomics. In determining protein structure, the proteins are first crystallized, and then an X-ray generator produces diffraction patterns from which a three-dimensional picture of the atomic arrangement in the crystal can be obtained. Advances in macromolecular crystallography techniques, computer speed, and the availability of high-energy synchrotron x-ray sources, make rapid structure determination possible given adequate quality protein crystals.
- Crystal growth, however, is difficult because proteins are large, irregularly shaped molecules that do not readily come together in a repeating pattern, and the complete set of crystallization conditions is too large and impractical to screen comprehensively. Thus, previously uncrystallized proteins must be screened on a trial and error basis against a large array of conditions that have the potential to induce crystal formation. Automated methods using, for example, robotic liquid handling devices, robotic CCD-based microscope cameras, or light microscopes equipped with robotic stages and CCD cameras, have been developed and are commercially available to speed up the process of setting up and recording the results (automated image capture) of a large number of crystallization trials. However, a practical problem remains in that each experiment must still be visually inspected to determine successful crystal formation. In fact, the high throughput enabled by the automation in setup and image-capture has increased the visual inspection bottleneck, which is typically performed manually by human intervention.
- One example of an automated crystal detection method developed to address the visual inspection bottleneck is disclosed in the article “Intelligent Decision Support for Protein Crystal Growth” (by Jurisica et al, IBM Systems Journal, Vol. 40, No. 2, 2001). In that article, and as shown in
FIGS. 3-7 thereof, images of screening results are analyzed using a two-dimensional Fourier transform. In particular,FIG. 5C illustrates the Fourier frequency spectrum used in the analysis, andFIG. 5D illustrates an analysis of the spectrum derivatives and circular averages to provide features information of the image. From this feature extraction and analysis, the outcome of the experiment is classified as, clear drop, amorphous precipitate, phase separation, microcrystals, crystals, or unknown. - Despite such efforts, difficulties in automating (i.e. without human intervention) crystal detection remain due to such factors as poor image quality due to noise and low contrast, differences in crystal shapes, poorly formed crystals, etc. With respect to poor image quality, crystals may have less contrast relative to the background than other objects or particles. For example, the difference between the crystal and the background based on 256 gray levels is often 15 levels, whereas the difference for dirt is usually above 40 levels. Additionally, many different crystal shapes exist due to, for example, the existence of several large classes of crystal shape, the picture is a 2-D projection of a 3-D object, crystal imperfections with faulty edges, and large variations in crystal size, e.g. ranging from about 10 μm to nearly 300 μm. There are also many things on the picture that are not real crystals, such as dirt, precipitation, quasi-crystals, small drop due to condensation, and unidentified effects. Additionally, an automated crystal detection process must also achieve a high threshold of accuracy by being able to identify virtually all crystals with a low false-positive rate.
- Thus in summary, there is a need for an automated crystal detection method and system for inspecting two-dimensional images and successfully detecting crystals therefrom. An automated solution for crystal detection, such as implemented by a software program, would be a great labor savor by possessing the capability of processing thousands of images a day and provide analysis substantially free from false positives.
- One aspect of the present invention includes a method of detecting macromolecular crystals in light microscopy images comprising: detecting edges in said images by identifying local maxima of a phase congruency-related function associated with each image; segmenting the detected edges into discrete line segments; evaluating the geometric relationships that the line segments have with each other to identify any crystal-like qualities; and determining the presence of crystals in each image based on said evaluation.
- Another aspect of the present invention includes a computerized system for detecting macromolecular crystals from light microscopy images comprising: a digital conversion component that converts said light microscopy images into corresponding phase-based digital image data using the Fourier transform; an edge detection component that detects edges from the image data by computing local maxima of a phase congruency-related function associated with each image; a segmentation component that divides the detected edges into discrete line segments; and a geometric analyzer component that evaluates the geometric relationships that the line segments have with each other to identify any crystal-like qualities, and determines whether crystals are present in each image based on said evaluation.
- Another aspect of the present invention includes a computerized system for detecting macromolecular crystals from light microscopy images comprising: means for digitally converting said light microscopy images into corresponding phase-based digital image data using the Fourier transform; means for detecting edges from the image data by computing local maxima of a phase congruency-related function associated with each image; means for dividing the detected edges into discrete line segments; means for evaluating the geometric relationships that the line segments have with each other to identify any crystal-like qualities; and means for determining the presence of crystals in an image from said evaluation.
- Another aspect of the present invention includes a computer program product comprising: a computer useable medium having a computer readable code embodied therein for causing the detection of macromolecular crystals in light microscopy images, said computer program product having: computer readable program code means for causing a computer to detect edges in said images by identifying local maxima of a phase congruency-related function associated with each image; computer readable program code means for causing said computer to segment the detected edges into discrete line segments; computer readable program code means for causing said computer to evaluate the geometric relationships that the line segments have with each other to identify any crystal-like qualities; and computer readable program code means for causing said computer to determine the presence of crystals in each image based on said evaluation.
- Another aspect of the present invention includes an article of manufacture comprising: a computer useable medium having a computer readable code means embodied therein for causing the detection of macromolecular crystals in light microscopy images, said computer readable code means in said article of manufacture comprising: computer readable program code means for causing a computer to detect edges in said images by identifying local maxima of a phase congruency-related function associated with each image; computer readable program code means for causing said computer to segment the detected edges into discrete line segments; computer readable program code means for causing said computer to evaluate the geometric relationships that the line segments have with each other to identify any crystal-like qualities; and computer readable program code means for causing said computer to determine the presence of crystals in each image based on said evaluation.
- And another aspect of the present invention includes a program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform method steps for detecting macromolecular crystals from light microscopy images, said method steps comprising: detecting edges in said images by identifying local maxima of a phase congruency-related function associated with each image; segmenting the detected edges into discrete line segments; evaluating the geometric relationships that the line segments have with each other to identify any crystal-like qualities; and determining the presence of crystals in each image based on said evaluation.
- The accompanying drawings, which are incorporated into and form a part of the disclosure, are as follows:
-
FIG. 1 is an overview flow diagram of a general embodiment of the present invention. -
FIG. 2 is a flow diagram detailing an exemplary edge detection process using phase congruency, and including a noise reduction subprocess. -
FIG. 3 is a flow diagram detailing an exemplary geometric analysis/evaluation process which evaluates the geometric relationships that the line segments have with each other to identify any crystal-like qualities. -
FIG. 4 is a flow diagram of a second exemplary embodiment of the present invention. -
FIG. 5 is a graph of a 1-D step signal and its cosine decomposition via the Fourier transform. -
FIG. 6 is a screen shot of a sample edge map produced from the edge detection step of the present invention. -
FIG. 7 is a multiple screen shot of the sample edge map ofFIG. 5 , separated into several images with each containing features having a given orientation. -
FIG. 8 is a multiple screen shot showing two orientations before and after auto-correlation is performed. - The present invention is an automated method and system (hereinafter “method”) for detecting the presence of macromolecular crystals from light microscopy images, such as those obtained from crystallography experiments. Generally, the automated method utilizes the phase information of the pixels in each image in performing crystal detection. This provides greater resistance to noise and other artifacts than amplitude based properties, e.g. pixel intensity, which can lead to poor image quality. And in particular, the phase information of the pixels is used to identify specific geometric features in an image attributable to and most likely indicative of a crystalline structure, such as, for example, parallel edges, of similar length, facing each other, in relatively close proximity. Evaluation of detected geometries in this manner makes possible a low rate of false-positive detections and an effective resolution to the visual inspection bottleneck discussed in the Background caused by manual inspections. It is notable that the term “automated” suggests the absence of human intervention, although oversight of detection performance may still be present.
- Implementation of the present invention is suitably achieved using, for example, software, computer code, ROM, integrated circuit, etc. (hereinafter “software”) to execute and control the method steps and system functions. It is appreciated that the software may be written in any suitable programming language for operation on a suitable operating system or platform, not limited to any particular language or operating system or platform. For example, the software may be written as object oriented code having implementable subroutines that enable the user to call them in sequence to solve problems.
- Turning now to the figures,
FIG. 1 shows an overview flow diagram of the steps involved in a first general embodiment of the present invention, indicated atreference character 10. Two-dimensional images captured from crystallography experiments are first provided asinput 11 to begin the process. Atreference character 12, edge features, if any, in each image are detected using phase congruency, and in particular, a phase congruency-based function. The detected edges are then segmented into discrete, straight line segments in the line segmentation step of 13, followed by a geometric analysis and evaluation (hereinafter “evaluation”) of the geometric relationships that the line segments have with each other to identify any crystal-like qualities, at 14. In particular, geometric relationships, such as parallel lines, facing each other, and similarity in length, as well as relative proximity to each other, are all crystal-like qualities in that they are characteristic of crystalline structure. And finally at 15, a determination and decision is made based on the preceding geometric evaluation, as to whether crystals are present in a particular image. A decision with respect to any one image may be reported separately, or together in a list with other images determined to have detected crystals. The corresponding ones of the experiments may subsequently be collected for X-ray determination of atomic structure and protein identification. - Generally, the
edge detection stage 12 uses the phase of the Fourier transform of the image to find the images. Taking, for example, a 1-D step signal (representing the equivalent of an edge) and its cosine decomposition shown inFIG. 5 , the phases of all cosines are equal to zero only at the edge location, while everywhere else, the phases have different values. Since the phases of real signals are never actually equal, phase congruency or repartition is a method for measuring how much the phases of all the cosines are equal, with an edge corresponding to a local maximum of the phase congruency. It is preferred to compute the standard deviation of the cosine of the phases since computing the standard deviation of the phases at each point can give wrong results for the simple reason that 0=2π. The phase congruency function for a 1-D continuous signal is therefore defined as: where aω and Φω are respectively the amplitude and phase of the signal. Thus identifying the local maxima of the phase congruency function will also identify and thereby detect the edges. It is notable, however, that while this function provides the correct computational results, it is slow to compute directly. - In the alternative, the same result can be obtained using local energy, and Gabor filters which are similar in function to those present in the human brain for image perception and vision. The local energy of a 1-D signal is defined as:
LE(x)=√{square root over (I 2(x)+H 2(x))} (2)
where I(x) is the 1-D signal, and H(x) is the Hilbert transform of I (i.e. ninety degree phase shift of I(x) in the frequency domain). Given the cosine decomposition of I(x) is:
∫a ω cos(ωx+Φ ω)dω (3)
then H(x) has the decomposition:
−∫a ω sin(ωx+Φ ω)dω (4)
I(x) is obtained by convolving the original signal by a filter to remove the DC component. And H(x) is obtained by filtering the previous result by the Hilbert transform of the first filter. The human visual system has neuronal structures similar to a pair of odd and even symmetric filters in quadrature. If Me is the even filter and Mo is the odd filter, one has:
The even symmetric filter is chosen so that it covers as much of the frequency spectrum as possible, and at the same time removing the D.C. term. Since it is nearly impossible to have such a perfect filter, the approximate equal sign is used in Equations (5) and (6) above. The odd filter is the π/2 phase shift even one. In the real implementation, the filters are band-pass filters and different local energies are computed for different scale. This allows for a multi-scale analysis of the image to be performed, with the possibility to look for features of different size, and for example getting rid of noise or features very small that cannot be crystal. - The phase congruency function and the local energy function are related by:
As used herein and in the claims, the term “phase congruency-based function” is used to describe both the phase congruency function PC(x) as well as the local energy function LE(x). A local maximum in the local energy corresponds to a local maximum in the phase congruency, and to an edge. Therefore, in order to search for local maxima in the phase congruency function, one equivalently searches for local maxima in the local energy function. These local maxima will occur at step edges of both parity (up or down), lines and bar edges, and other types of features such as the illusion patterns mentioned before. While the previous calculations for both PC(x) and I(x) were for 1-D signals, it is appreciated that a 2-D signal can also be decomposed in a series of 1-D signals by traversing and accounting for many orientations. The local energy of a point will be the maximum local energy among all the orientations. -
FIG. 2 shows a detailed flow diagram, indicated atreference character 12′, of an exemplary edge detection step using a phase congruency-based function (e.g. local energy function) associated with an image. As indicated atreference character 20, and as discussed above, multiple orientations are considered. For each orientation and each scale at 21, aGabor filter 22 is used to filter the image. The objective of this filtering step is to convert the spatial information in another space representation where the noise will be present everywhere, and the information will be more localized, so that the noise and information can be separated, and converted back to the normal space. Gabor filters are used since they closely approximate the human visual system, as previously discussed. They are the combination of the two real filters in quadrature, and are the result of a sine wave modulated by a Gaussian function as in:
where (x′, y′)=(x cos θ+y sin θ, −x sin θ+y cos θ). In other words, (x′, y′) is the θ rotation of (x, y). And atreference character 23, local energy is calculated from the information at the different scales. - At
24 and 25, noise variance and mean of the local energy is estimated, and a noise threshold is applied on the local energy. Considering first the noise threshold, the filter response will be decreased by the noise threshold to remove the components considered as noise. However, finding the right threshold can be difficult. The expected response of the Gabor filters to a pure noise signal must first be examined. If the noise is supposed to be Gaussian, the complex response will have a 2-D Gaussian distribution. And the magnitude will be a Rayleigh distribution as:reference characters
where σg 2 is the variance of the 2-D Gaussian distribution. The mean and variance of the Rayleigh distribution are given by:
The noise threshold can be set to some number of standard deviation beyond the mean of the distribution as in T=μ+kσr. - Additionally, the noise amplitude distribution must be determined. The median value is considered as a statistically robust estimation of the mean. The smallest scale of the Gabor filter is used because the noise should be the most present at this scale. The median of a Rayleigh distribution is the value x such that
that leads to
median=σg√{square root over (−2ln(½))} (13)
The mean of the Rayleigh distribution being σg√{square root over (π/2)}, one gets the estimated mean of the amplitude response at smallest scale by a simple proportionality
Assuming that noise has a uniform repartition among frequency, the noise threshold at larger scales can be deduced by the threshold at the smallest scale since the noise amplitude response will be proportional to the bandwidth, itself related to the scale. It is notable that while the noise reduction process is described as executed in theedge detection stage 12′, it is appreciated that noise reduction may be performed as a pre-processing step prior to edge detection. - At
reference character 26, local energy from each orientation is summed together, and the magnitude from each orientation is summed together at 27. The summations provide the values necessary to solve Equation (8) above. In particular, by dividing local energy by the magnitude, as indicated atreference character 28, the phase congruency function is obtained. Furthermore, atreference character 29; local maxima of the phase-congruency-based function (either PC(x) or LE(x)) is identified to detect corresponding edges. In this manner an edge map may be constructed as shown inFIG. 6 , for example, with local maxima occurring at step edges of both parity (up or down), lines and bar edges, and other types of features such as the illusion patterns. -
FIG. 3 shows a flow diagram of a preferred geometry analysis and evaluation process, generally indicated atreference character 14′. As discussed with respect toFIG. 1 , the geometric evaluation stage at 14 occurs subsequent to thesegmentation 13 of the detected edges into discrete line segments, and evaluates the geometric relationships that the line segments have with each other to identify crystal-like qualities. As indicated at 30, each combination of pairs of segments are first rated based on characteristically crystal-like qualities, including, but not limited to: parallel lines, facing each other, similarity in length, and relative proximity to each other. Next at 31, the line segments are grouped based on the preceding crystal-like quality ratings. For each group at 32, each edge pixel is classified according to the local edge orientation at 33. For example,FIG. 7 shows a multiple screen shot view of the edge map ofFIG. 5 separated into eight images, with each image containing features having a given orientation. For each orientation at 34, auto-correlation is calculated to enhance shapes with parallel lines, and subsequently analyzed at 35 to decide if the shape is a crystal or not.FIG. 8 illustrates two orientations before (left column) and after (right column) auto-correlation is performed, showing the enhancements. Additionally at 35 the quality of the auto-correlation is rated using the following criteria: numbers of features in the auto-correlation above specific threshold, and length and location of these features. A global “quality score” is then calculated from the auto-correlation quality ratings. At 36 a final decision is made from the global quality score for each orientation as to whether a crystal has or has not been detected. Both statistical analysis and neural networks are used for this purpose. Depending on such determination that a crystal has in fact been detected, the results are written to a crystal list at 37, which may subsequently be viewed or otherwise reported to a researcher, scientist, or operator, or stored for later retrieval. The process may also be augmented by ranking the images according to crystal quality as determined from the aforementioned steps. - Additionally, the geometry analysis and evaluation stage may also be performed using additional criteria, including: (1) minimum gradient along edges, and (2) central symmetry. With respect to the first additional criteria, and for a given edge, the gradient (i.e. first derivative of the original picture) for each pixel overlapping this edge is summed together. If this sum is above a specific gradient, the edge is then considered relevant. With respect to the second criteria, symmetry centers are found using the phase information. An important aspect of symmetry is the periodicity that it implies in the structure of the object. To determine the centers of symmetry, the picture is filtered with the same pair of even and odd symmetric Gabor filters as for the edge detection technique. At a point of symmetry, the absolute value of the even filter will be large, and the absolute value of the odd one will be small. Taking the difference of the absolute value of the even-symmetric filter and the odd one give a quantification of the degree of symmetry in an object.
- A flow diagram of an exemplary second embodiment is also shown in
FIG. 4 . Similar to the general algorithm ofFIG. 1 , the process here also begins with the input of images at 41, captured from, for example, crystallography experiments. 42 and 43 illustrate optional pre-processing functions available for improving the crystal detection process. At 42, noise reduction is performed as a pre-processing step, similar to that previously discussed. Additionally, atSteps step 43, a smoothing filter is employed, such as that performing nonlinear anisotropic diffusion, to clean the image prior to edge detection. Nonlinear anisotropic diffusion filters are commonly known and used for image enhancement while preserving edges. In particular, the filter performs intraregion smoothing while inhibiting interregion smoothing. It is notable also that image cleaning by smoothing step may be alternatively employed following the edge detection process, to clean and smooth the edge map of an image (not shown). At 44 edge detection is performed according to the process previously described, using a phase congruency-related function, such as either PC(x) or LE(x). - Next at 45 a skeletonization step extracts the skeleton of the acquired edge map by removing the non-maximal values of the edge map without breaking the object topology. This is accomplished by setting the non-maximal values to zero in the perpendicular direction (orientation) to the edge. While crystals generally have straight edges, the phase congruency-based edge detection discussed previously finds any kind of edge, not necessarily only straight ones. A line can be distinguished from other objects because the local energy in its perpendicular direction is high, and low in the parallel direction of the line. It is notable that a spot feature has the same local energy for all the orientations. This information is used to remove all the edges that are not line features. Additionally at 46 spur lines may also be removed from the skeleton structure obtained, as a post-edge detection image-cleaning step. In any case, the detected edges are then segmented into discrete, straight line segments in the line segmentation step of 47, followed by a geometric analysis and evaluation at 48, utilizing evaluation criteria characteristic of crystals as previously described. And finally at 49, a determination and decision is made based on the preceding geometric evaluation, as to whether crystals are present in a particular image. It is notable that a second edge detection (not shown) may be optionally utilized in conjunction with the first edge detection process described above, in order to further refine or otherwise limit the edge detection results obtained from the first edge detection.
- While particular operational sequences, materials, temperatures, parameters, and particular embodiments have been described and or illustrated, such are not intended to be limiting. Modifications and changes may become apparent to those skilled in the art, and it is intended that the invention be limited only by the scope of the appended claims.
Claims (34)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10/452,668 US7227983B1 (en) | 2002-05-30 | 2003-05-30 | Automated macromolecular crystal detection system and method |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US38521002P | 2002-05-30 | 2002-05-30 | |
| US10/452,668 US7227983B1 (en) | 2002-05-30 | 2003-05-30 | Automated macromolecular crystal detection system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20070122025A1 true US20070122025A1 (en) | 2007-05-31 |
| US7227983B1 US7227983B1 (en) | 2007-06-05 |
Family
ID=38087604
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US10/452,668 Expired - Fee Related US7227983B1 (en) | 2002-05-30 | 2003-05-30 | Automated macromolecular crystal detection system and method |
Country Status (1)
| Country | Link |
|---|---|
| US (1) | US7227983B1 (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060029284A1 (en) * | 2004-08-07 | 2006-02-09 | Stmicroelectronics Ltd. | Method of determining a measure of edge strength and focus |
| US20060067388A1 (en) * | 2004-09-30 | 2006-03-30 | Hossein Sedarat | Methods and apparatuses for detecting impulse noise in a multi-carrier communication system |
| US20090238466A1 (en) * | 2008-03-24 | 2009-09-24 | Oren Golan | Method and system for edge detection |
| US20130287283A1 (en) * | 2012-04-30 | 2013-10-31 | General Electric Company | Systems and methods for performing quality review scoring of biomarkers and image analysis methods for biological tissue |
| GB2511744A (en) * | 2013-03-11 | 2014-09-17 | Reeves Wireline Tech Ltd | Methods of and apparatuses for identifying geological characteristics in boreholes |
| CN106999132A (en) * | 2014-12-03 | 2017-08-01 | 皇家飞利浦有限公司 | Device and method for the signal compensation in medical X-ray images |
| CN107341781A (en) * | 2017-07-20 | 2017-11-10 | 中国科学院电子学研究所 | Based on the SAR image correcting methods for improving the matching of phase equalization characteristic vector base map |
| CN110070519A (en) * | 2019-03-13 | 2019-07-30 | 西安电子科技大学 | Stitching image measuring method, image mosaic system based on phase equalization |
| GB2573075A (en) * | 2013-03-11 | 2019-10-23 | Reeves Wireline Tech Ltd | Method of and apparatuses for identifying geological characteristics |
Families Citing this family (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8229196B2 (en) * | 2003-08-18 | 2012-07-24 | Rigaku Corporation | Method of detecting specific polymer crystal |
| US20050237522A1 (en) * | 2004-04-27 | 2005-10-27 | Swift Kerry M | Methods for visualizing crystals and distinguishing crystals from other matter within a biological sample |
| US20070050152A1 (en) * | 2005-08-24 | 2007-03-01 | The Scripps Research Institute | Protein Structure Determination |
| US7940955B2 (en) * | 2006-07-26 | 2011-05-10 | Delphi Technologies, Inc. | Vision-based method of determining cargo status by boundary detection |
| US8644574B2 (en) * | 2006-10-03 | 2014-02-04 | The Brigham And Women's Hospital, Inc. | Measurement of thin-layered structures in X-ray computer tomography |
| US7831098B2 (en) * | 2006-11-07 | 2010-11-09 | Recognition Robotics | System and method for visual searching of objects using lines |
| US8331685B2 (en) * | 2008-05-28 | 2012-12-11 | Apple Inc. | Defining a border for an image |
| US8548251B2 (en) * | 2008-05-28 | 2013-10-01 | Apple Inc. | Defining a border for an image |
| US9536022B1 (en) | 2009-06-01 | 2017-01-03 | Paradigm Sciences Ltd. | Systems and methods for modeling faults in the subsurface |
| US8711140B1 (en) | 2009-06-01 | 2014-04-29 | Paradigm Sciences Ltd. | Systems and methods for building axes, co-axes and paleo-geographic coordinates related to a stratified geological volume |
| US8600708B1 (en) | 2009-06-01 | 2013-12-03 | Paradigm Sciences Ltd. | Systems and processes for building multiple equiprobable coherent geometrical models of the subsurface |
| US9418182B2 (en) | 2009-06-01 | 2016-08-16 | Paradigm Sciences Ltd. | Systems and methods for building axes, co-axes and paleo-geographic coordinates related to a stratified geological volume |
| US8743115B1 (en) | 2009-10-23 | 2014-06-03 | Paradigm Sciences Ltd. | Systems and methods for coordinated editing of seismic data in dual model |
| US10114134B2 (en) | 2012-03-02 | 2018-10-30 | Emerson Paradigm Holding Llc | Systems and methods for generating a geological model honoring horizons and faults |
| US9759826B2 (en) | 2012-04-03 | 2017-09-12 | Paradigm Sciences Ltd. | System and method for generating an implicit model of geological horizons |
| EP2778725B1 (en) | 2013-03-15 | 2018-07-18 | Emerson Paradigm Holding LLC | Systems and methods to build sedimentary attributes |
| US10795053B2 (en) | 2013-10-29 | 2020-10-06 | Emerson Paradigm Holding Llc | Systems and methods of multi-scale meshing for geologic time modeling |
| US10422923B2 (en) | 2014-03-28 | 2019-09-24 | Emerson Paradigm Holding Llc | Systems and methods for modeling fracture networks in reservoir volumes from microseismic events |
| US9690002B2 (en) | 2015-06-18 | 2017-06-27 | Paradigm Sciences Ltd. | Device, system and method for geological-time refinement |
| US10466388B2 (en) | 2016-09-07 | 2019-11-05 | Emerson Paradigm Holding Llc | System and method for editing geological models by switching between volume-based models and surface-based structural models augmented with stratigraphic fiber bundles |
| JP2019046530A (en) | 2017-09-07 | 2019-03-22 | 東芝メモリ株式会社 | Memory system |
| US10520644B1 (en) | 2019-01-10 | 2019-12-31 | Emerson Paradigm Holding Llc | Imaging a subsurface geological model at a past intermediate restoration time |
| US11156744B2 (en) | 2019-01-10 | 2021-10-26 | Emerson Paradigm Holding Llc | Imaging a subsurface geological model at a past intermediate restoration time |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5077767A (en) * | 1988-06-16 | 1991-12-31 | Gersan Establishment | Determining the existence of misorientation in a crystal |
| US5138179A (en) * | 1990-03-29 | 1992-08-11 | Shin-Etsu Handotai Company, Limited | Method of and device for diameter measurement used in automatically controlled crystal growth |
| US5378900A (en) * | 1992-11-27 | 1995-01-03 | Shin-Etsu Handotai Co., Ltd. | Crystal diameter measuring device |
| US5544254A (en) * | 1993-02-12 | 1996-08-06 | General Electric Company | Classifying and sorting crystalline objects |
| US5846318A (en) * | 1997-07-17 | 1998-12-08 | Memc Electric Materials, Inc. | Method and system for controlling growth of a silicon crystal |
| US5978444A (en) * | 1997-12-30 | 1999-11-02 | The United States Of America As Represented By The United States Department Of Energy | Direct detection of x-rays for protein crystallography employing a thick, large area CCD |
| US6171391B1 (en) * | 1998-10-14 | 2001-01-09 | Memc Electronic Materials, Inc. | Method and system for controlling growth of a silicon crystal |
| US6404849B1 (en) * | 1999-08-11 | 2002-06-11 | Abbott Laboratories | Automated sample handling for X-ray crystallography |
| US20030048341A1 (en) * | 2000-09-25 | 2003-03-13 | Mutz Mitchell W. | High-throughput biomolecular crystallization and biomolecular crystal screening |
| US6548811B1 (en) * | 1999-02-22 | 2003-04-15 | Hitachi, Ltd. | Transmission electron microscope apparatus with equipment for inspecting defects in specimen and method of inspecting defects in specimen using transmission electron microscope |
| US20040013231A1 (en) * | 2001-06-29 | 2004-01-22 | He Bob Baoping | Diffraction system for biological crystal screening |
| US20040153256A1 (en) * | 2002-10-18 | 2004-08-05 | Woods Virgil L. | Methods for crystallographic structure determination employing hydrogen exchange analysis |
| US20040218798A1 (en) * | 2000-03-09 | 2004-11-04 | The Regents Of The University Of California | Automated video-microscopic imaging and data acquisition system for colloid deposition measurements |
| US20040258203A1 (en) * | 2002-06-17 | 2004-12-23 | Akihito Yamano | Crystal evaluating device |
| US6985616B2 (en) * | 2001-10-18 | 2006-01-10 | Robodesign International, Inc. | Automated verification and inspection device for sequentially inspecting microscopic crystals |
| US20060207066A1 (en) * | 2005-03-16 | 2006-09-21 | The Regents Of The University Of California | Robotic CCD microscope for enhanced crystal recognition |
| US20060222220A1 (en) * | 2003-08-18 | 2006-10-05 | Akihito Yamano | Method for detecting specified polymer crystal |
| US7118626B2 (en) * | 2003-08-29 | 2006-10-10 | University Of Alabama In Huntsville | Crystallization cassette for the growth and analysis of macromolecular crystals and an associated method |
-
2003
- 2003-05-30 US US10/452,668 patent/US7227983B1/en not_active Expired - Fee Related
Patent Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5077767A (en) * | 1988-06-16 | 1991-12-31 | Gersan Establishment | Determining the existence of misorientation in a crystal |
| US5138179A (en) * | 1990-03-29 | 1992-08-11 | Shin-Etsu Handotai Company, Limited | Method of and device for diameter measurement used in automatically controlled crystal growth |
| US5378900A (en) * | 1992-11-27 | 1995-01-03 | Shin-Etsu Handotai Co., Ltd. | Crystal diameter measuring device |
| US5544254A (en) * | 1993-02-12 | 1996-08-06 | General Electric Company | Classifying and sorting crystalline objects |
| US5846318A (en) * | 1997-07-17 | 1998-12-08 | Memc Electric Materials, Inc. | Method and system for controlling growth of a silicon crystal |
| US5978444A (en) * | 1997-12-30 | 1999-11-02 | The United States Of America As Represented By The United States Department Of Energy | Direct detection of x-rays for protein crystallography employing a thick, large area CCD |
| US6171391B1 (en) * | 1998-10-14 | 2001-01-09 | Memc Electronic Materials, Inc. | Method and system for controlling growth of a silicon crystal |
| US6548811B1 (en) * | 1999-02-22 | 2003-04-15 | Hitachi, Ltd. | Transmission electron microscope apparatus with equipment for inspecting defects in specimen and method of inspecting defects in specimen using transmission electron microscope |
| US20020126802A1 (en) * | 1999-08-11 | 2002-09-12 | Olson Jeffrey A. | Automated sample handling for X-ray crystallography |
| US6404849B1 (en) * | 1999-08-11 | 2002-06-11 | Abbott Laboratories | Automated sample handling for X-ray crystallography |
| US20040218798A1 (en) * | 2000-03-09 | 2004-11-04 | The Regents Of The University Of California | Automated video-microscopic imaging and data acquisition system for colloid deposition measurements |
| US20030048341A1 (en) * | 2000-09-25 | 2003-03-13 | Mutz Mitchell W. | High-throughput biomolecular crystallization and biomolecular crystal screening |
| US20040013231A1 (en) * | 2001-06-29 | 2004-01-22 | He Bob Baoping | Diffraction system for biological crystal screening |
| US6985616B2 (en) * | 2001-10-18 | 2006-01-10 | Robodesign International, Inc. | Automated verification and inspection device for sequentially inspecting microscopic crystals |
| US20040258203A1 (en) * | 2002-06-17 | 2004-12-23 | Akihito Yamano | Crystal evaluating device |
| US20040153256A1 (en) * | 2002-10-18 | 2004-08-05 | Woods Virgil L. | Methods for crystallographic structure determination employing hydrogen exchange analysis |
| US20060222220A1 (en) * | 2003-08-18 | 2006-10-05 | Akihito Yamano | Method for detecting specified polymer crystal |
| US7118626B2 (en) * | 2003-08-29 | 2006-10-10 | University Of Alabama In Huntsville | Crystallization cassette for the growth and analysis of macromolecular crystals and an associated method |
| US20060207066A1 (en) * | 2005-03-16 | 2006-09-21 | The Regents Of The University Of California | Robotic CCD microscope for enhanced crystal recognition |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7899264B2 (en) * | 2004-08-07 | 2011-03-01 | Stmicroelectronics Ltd. | Method of determining a measure of edge strength and focus |
| US20060029284A1 (en) * | 2004-08-07 | 2006-02-09 | Stmicroelectronics Ltd. | Method of determining a measure of edge strength and focus |
| US20060067388A1 (en) * | 2004-09-30 | 2006-03-30 | Hossein Sedarat | Methods and apparatuses for detecting impulse noise in a multi-carrier communication system |
| EP2767932A3 (en) * | 2008-03-24 | 2015-04-08 | Verint Systems Ltd. | Method and system for edge detection |
| US8200022B2 (en) * | 2008-03-24 | 2012-06-12 | Verint Systems Ltd. | Method and system for edge detection |
| US20120243793A1 (en) * | 2008-03-24 | 2012-09-27 | Verint Systems Ltd. | Method and system for edge detection |
| US8644617B2 (en) * | 2008-03-24 | 2014-02-04 | Verint Systems Ltd. | Method and system for edge detection |
| EP2105866A1 (en) * | 2008-03-24 | 2009-09-30 | Verint Systems Ltd. | Method and system for edge detection |
| US8965054B2 (en) | 2008-03-24 | 2015-02-24 | Verint Systems Ltd. | Method and system for edge detection |
| EP2767933A3 (en) * | 2008-03-24 | 2015-04-01 | Verint Systems Ltd. | Method and system for edge detection |
| US20090238466A1 (en) * | 2008-03-24 | 2009-09-24 | Oren Golan | Method and system for edge detection |
| US9036888B2 (en) * | 2012-04-30 | 2015-05-19 | General Electric Company | Systems and methods for performing quality review scoring of biomarkers and image analysis methods for biological tissue |
| US20130287283A1 (en) * | 2012-04-30 | 2013-10-31 | General Electric Company | Systems and methods for performing quality review scoring of biomarkers and image analysis methods for biological tissue |
| US9563963B2 (en) | 2013-03-11 | 2017-02-07 | Reeves Wireline Technologies Limited | Methods of and apparatuses for identifying geological characteristics in boreholes |
| GB2511744A (en) * | 2013-03-11 | 2014-09-17 | Reeves Wireline Tech Ltd | Methods of and apparatuses for identifying geological characteristics in boreholes |
| US9576374B2 (en) | 2013-03-11 | 2017-02-21 | Reeves Wireline Technologies Limited | Methods of and apparatuses for identifying geological characteristics in boreholes |
| US9704263B2 (en) | 2013-03-11 | 2017-07-11 | Reeves Wireline Technologies Limited | Methods of and apparatuses for identifying geological characteristics in boreholes |
| GB2573075A (en) * | 2013-03-11 | 2019-10-23 | Reeves Wireline Tech Ltd | Method of and apparatuses for identifying geological characteristics |
| GB2573075B (en) * | 2013-03-11 | 2020-05-20 | Reeves Wireline Tech Ltd | Methods of and apparatuses for identifying geological characteristics in boreholes |
| GB2511744B (en) * | 2013-03-11 | 2020-05-20 | Reeves Wireline Tech Ltd | Methods of and apparatuses for identifying geological characteristics in boreholes |
| CN106999132A (en) * | 2014-12-03 | 2017-08-01 | 皇家飞利浦有限公司 | Device and method for the signal compensation in medical X-ray images |
| US20170325774A1 (en) * | 2014-12-03 | 2017-11-16 | Koninklijke Philips N.V. | Device and method for signal compensation in medical x-ray images |
| US10470735B2 (en) * | 2014-12-03 | 2019-11-12 | Koninklijke Philips N.V. | Device and method for signal compensation in medical X-ray images |
| CN107341781A (en) * | 2017-07-20 | 2017-11-10 | 中国科学院电子学研究所 | Based on the SAR image correcting methods for improving the matching of phase equalization characteristic vector base map |
| CN110070519A (en) * | 2019-03-13 | 2019-07-30 | 西安电子科技大学 | Stitching image measuring method, image mosaic system based on phase equalization |
Also Published As
| Publication number | Publication date |
|---|---|
| US7227983B1 (en) | 2007-06-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7227983B1 (en) | Automated macromolecular crystal detection system and method | |
| Sharifi et al. | A classified and comparative study of edge detection algorithms | |
| Nicholson et al. | Automatic particle detection in electron microscopy | |
| US6983065B1 (en) | Method for extracting features from an image using oriented filters | |
| CN110472658B (en) | Hierarchical fusion and extraction method for multi-source detection of moving target | |
| EP3176751B1 (en) | Information processing device, information processing method, computer-readable recording medium, and inspection system | |
| US8457414B2 (en) | Detection of textural defects using a one class support vector machine | |
| EP0338677B1 (en) | Image processing method for shape recognition | |
| Bu et al. | Crack detection using a texture analysis-based technique for visual bridge inspection | |
| Yapi et al. | A learning-based approach for automatic defect detection in textile images | |
| Zhang et al. | Automatic classification of defects on the product surface in grinding and polishing | |
| Inoue et al. | Crack detection as a weakly-supervised problem: Towards achieving less annotation-intensive crack detectors | |
| Makaremi et al. | A new method for detecting texture defects based on modified local binary pattern | |
| Aliyu et al. | Segmentation and detection of sickle cell red blood image | |
| Xu et al. | A defect inspection for explosive cartridge using an improved visual attention and image-weighted eigenvalue | |
| Bulugu | Algorithm for license plate localization and recognition for tanzania car plate numbers | |
| Musoromy et al. | Edge detection comparison for license plate detection | |
| Chetverikov | Structural defects: General approach and application to textile inspection | |
| Hossen et al. | Vehicle license plate detection and tilt correction based on HSI color model and SUSAN corner detector | |
| US7292263B2 (en) | Robotic CCD microscope for enhanced crystal recognition | |
| Palakal et al. | Intelligent computational methods for corrosion damage assessment | |
| Talukder et al. | Multiscale Gabor wavelet fusion for edge detection in microscopy images | |
| CN108875703A (en) | The SAR image lines detection method converted using vector Radon | |
| Eichel et al. | Quantitative analysis of a moment-based edge operator | |
| CN112418241A (en) | Power equipment identification method based on infrared imaging technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: REGENTS OF THE UNIVERSITY OF CALIFORNIA, THE, CALI Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHRISTIAN, ALLEN T.;SEGELKE, BRENT;RUPP, BERNARD;AND OTHERS;REEL/FRAME:014541/0427;SIGNING DATES FROM 20030530 TO 20030613 |
|
| AS | Assignment |
Owner name: U.S. DEPARTMENT OF ENERGY, CALIFORNIA Free format text: CONFIRMATORY LICENSE;ASSIGNOR:REGENTS OF THE UNIVERSITY OF CALIFORNIA, THE;REEL/FRAME:014758/0841 Effective date: 20030731 |
|
| AS | Assignment |
Owner name: LAWRENCE LIVERMORE NATIONAL SECURITY LLC, CALIFORN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:THE REGENTS OF THE UNIVERSITY OF CALIFORNIA;REEL/FRAME:021217/0050 Effective date: 20080623 |
|
| FEPP | Fee payment procedure |
Free format text: PAT HOLDER NO LONGER CLAIMS SMALL ENTITY STATUS, ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: STOL); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| FPAY | Fee payment |
Year of fee payment: 4 |
|
| REMI | Maintenance fee reminder mailed | ||
| LAPS | Lapse for failure to pay maintenance fees | ||
| STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
| FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20150605 |