AU2004202741B2 - Method and system for simultaneously imaging multiple views of a plant embryo - Google Patents
Method and system for simultaneously imaging multiple views of a plant embryo Download PDFInfo
- Publication number
- AU2004202741B2 AU2004202741B2 AU2004202741A AU2004202741A AU2004202741B2 AU 2004202741 B2 AU2004202741 B2 AU 2004202741B2 AU 2004202741 A AU2004202741 A AU 2004202741A AU 2004202741 A AU2004202741 A AU 2004202741A AU 2004202741 B2 AU2004202741 B2 AU 2004202741B2
- Authority
- AU
- Australia
- Prior art keywords
- embryo
- plant embryo
- camera
- view
- reflecting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 210000001161 mammalian embryo Anatomy 0.000 title claims description 170
- 238000003384 imaging method Methods 0.000 title claims description 53
- 238000000034 method Methods 0.000 title claims description 32
- 239000000463 material Substances 0.000 claims description 9
- 230000000392 somatic effect Effects 0.000 claims description 3
- 241000196324 Embryophyta Species 0.000 description 63
- 210000002257 embryonic structure Anatomy 0.000 description 21
- 230000035784 germination Effects 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 5
- 241000218631 Coniferophyta Species 0.000 description 4
- 239000002609 medium Substances 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 230000018109 developmental process Effects 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000010348 incorporation Methods 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 230000003595 spectral effect Effects 0.000 description 3
- 239000000126 substance Substances 0.000 description 3
- 238000004566 IR spectroscopy Methods 0.000 description 2
- 230000010432 cotyledon development Effects 0.000 description 2
- 230000013020 embryo development Effects 0.000 description 2
- 239000012869 germination medium Substances 0.000 description 2
- 230000035800 maturation Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000005305 organ development Effects 0.000 description 2
- 239000002689 soil Substances 0.000 description 2
- 230000030118 somatic embryogenesis Effects 0.000 description 2
- 238000004611 spectroscopical analysis Methods 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 238000004497 NIR spectroscopy Methods 0.000 description 1
- 238000001069 Raman spectroscopy Methods 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000002775 capsule Substances 0.000 description 1
- 150000001720 carbohydrates Chemical class 0.000 description 1
- 235000014633 carbohydrates Nutrition 0.000 description 1
- 238000003776 cleavage reaction Methods 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000012258 culturing Methods 0.000 description 1
- 238000010252 digital analysis Methods 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000012239 gene modification Methods 0.000 description 1
- 230000005017 genetic modification Effects 0.000 description 1
- 235000013617 genetically modified food Nutrition 0.000 description 1
- 239000005337 ground glass Substances 0.000 description 1
- 230000036433 growing body Effects 0.000 description 1
- 239000001963 growth medium Substances 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 150000002632 lipids Chemical class 0.000 description 1
- 239000002991 molded plastic Substances 0.000 description 1
- 230000000877 morphologic effect Effects 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 102000004169 proteins and genes Human genes 0.000 description 1
- 108090000623 proteins and genes Proteins 0.000 description 1
- 230000021749 root development Effects 0.000 description 1
- 230000007017 scission Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 241000894007 species Species 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/02—Viewing or reading apparatus
- G02B27/022—Viewing apparatus
-
- A—HUMAN NECESSITIES
- A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
- A01H—NEW PLANTS OR NON-TRANSGENIC PROCESSES FOR OBTAINING THEM; PLANT REPRODUCTION BY TISSUE CULTURE TECHNIQUES
- A01H4/00—Plant reproduction by tissue culture techniques ; Tissue culture techniques therefor
- A01H4/005—Methods for micropropagation; Vegetative plant propagation using cell or tissue culture techniques
- A01H4/006—Encapsulated embryos for plant reproduction, e.g. artificial seeds
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N2021/1765—Method using an image detector and processing of image signal
- G01N2021/177—Detector of the video camera type
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N2021/8466—Investigation of vegetal material, e.g. leaves, plants, fruits
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/06—Illumination; Optics
- G01N2201/063—Illuminating optical parts
- G01N2201/0634—Diffuse illumination
Landscapes
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Developmental Biology & Embryology (AREA)
- Cell Biology (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Biotechnology (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Environmental Sciences (AREA)
- Optics & Photonics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Botany (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Apparatus Associated With Microorganisms And Enzymes (AREA)
- Breeding Of Plants And Reproduction By Means Of Culturing (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Measuring Or Testing Involving Enzymes Or Micro-Organisms (AREA)
Description
i
AUSTRALIA
Patents Act COMPLETE SPECIFICATION
(ORIGINAL)
Class Int. Class Application Number: Lodged: Complete Specification Lodged: Accepted: Published: Priority Related Art: Name of Applicant: Weyerhaeuser Company Actual Inventor(s): Edwin Hirahara, Paul Roger Spencer Address for Service and Correspondence: PHILLIPS ORMONDE FITZPATRICK Patent and Trade Mark Attorneys 367 Collins Street Melbourne 3000 AUSTRALIA Invention Title: METHOD AND SYSTEM FOR SIMULTANEOUSLY IMAGING MULTIPLE VIEWS OF A PLANT
EMBRYO
Our Ref: 722139 POF Code: 19671/19671 The following statement is a full description of this invention, including the best method of performing it known to applicant(s): -1- 600ooeq i METHOD AND SYSTEM FOR SIMULTANEOUSLY IMAGING MULTIPLE VIEWS OF A PLANT EMBRYO FIELD OF THE INVENTION The invention is directed to imaging plant emlryos for determination of suitability for,germination or other treatment, and more particularly, to simultaneously imaging multiple views of a plant embryo so as to permit efficient mass selection of plant embryos suitable for incorporation into manufactured seeds.
BACKGROUND OF THE INVENTION Reproduction of selected plant varieties by tissue culture has been a commercial success for many years. The technique has enabled mass production of genetically identical selected ornamental plants, agricultural plants and forest species. The woody plants in this last group have perhaps posed the greatest challenges. Some success with conifers was achieved in the 1970s using organogenesis techniques wherein a bud, or other organ, was placed on a culture medium where it was ultimately replicated many times. The newly generated buds were placed on a different medium that induced root development. From there, the buds having roots were planted in soil.
While conifer organogenesis was a breakthrough, costs were high due to the large amount of handling needed. There was also some concern about possible genetic modification. It was a decade later before somatic embryogenesis achieved a sufficient success rate so as to become the predominant approach to conifer tissue culture. With somatic embryogenesis, an explant, usually a seed or seed embryo, is placed on an initiation medium where it multiplies into a multitude of genetically identical immature embryos. These can be held in culture for long periods and multiplied to bulk up a WEYE 4871 APP.DOC 1Aparticularly desirable clone. Ultimately, the immature embryos are placed on a development or maturation medium where they grow into somatic analogs of mature seed embryos. As used in the present description, a "somatic" embryo is a plant embryo developed by the laboratory culturing of totipotent plant cells or by induced cleavage polyembryogeny, as opposed to a zygotic embryo which is a plant embryo removed from a seed of the corresponding plant. These embryos are then individually selected and placed on a germination medium for further development. Alternatively, the embryos may be used in artificial seeds, known as manufactured seeds.
There is now a large body of general technical literature and a growing body of patent literature on embryogenesis of plants. Examples of procedures for conifer tissue culture are found in U.S. Patent Nos. 5,036,007 and 5,236,841 to Gupta et al.; 5,183,757 to Roberts; 5,464,769 to Attree et al.; and 5,563,061 to Gupta. Further, some examples of manufactured seeds can be found in U.S. Patent No. 5,701,699 to Carlson et al., the disclosure of which is hereby expressly incorporated by reference. Briefly, a typical manufactured seed is formed of a seed coat (or a capsule) fabricated from a variety of materials such as cellulosic materials, filled with a synthetic gametophyte (a germination medium), in which an embryo surrounded by a-tube-like restraint is received. After the manufactured seed is planted in the soil, the embryo inside the seed coat develops roots and eventually sheds the restraint al6ng with the seed coat during germination.
One of the more labor intensive and subjective steps in the embryogenesis procedure is the selection of individual embryos suitable for germination incorporation into manufactured seeds). The embryos harvested from the maturation medium may be present in a number of stages of maturity and development. Those that are most likely to successfully germinate into normal plants are preferentially selected using a number of visually evaluated screening criteria. Morphological features such as axial symmetry, cotyledon development, surface texture, color, and others are examined and applied as a pass/fail test before the embryos are passed on for germination. This is a skilled yet tedious manual labor that is time consuming and expensive. Further, it poses a major production bottleneck when the ultimate desired output will be in the millions of plants.
It has been proposed to use some form of instrumental image analysis for embryo selection to replace the visual evaluation described above. For example, PCT Application WEYE\24871 APP.DOC Serial No. PCT/US00/40720 (WO 01/13702 A2) discloses an embryo delivery system for manufactured seeds including an imaging camera, which acquires and digitally stores images of embryos. The images are then sent to a computer, which classifies the embryos according to their desirability likelihood to germinate and grow into normal plants) based on predetermined parameters (axial symmetry, cotyledon development, surface texture, color, etc.) using a classification method disclosed in PCT Application Serial No. PCT/US99/12128 (WO 99/63057).
Referring to FIGURE 1, to obtain sufficient information, typically three orthogonal views of an embryo 10 (typically of up to about 5 mm in length) are imaged using three separate cameras 11a, 11b, 11c, or moving a single camera into three separate positions. The three illustrated views are a top view, a side view, and an end view (viewing the cotyledon end 12 of the embryo 10 in FIGURE The disclosure of these two PCT applications is hereby expressly incorporated by reference.
While the instrumental imaging analysis could replace the costly manual labor required to classify embryos based on their desirability, mass classification of embryos, in particular for the purpose of mass production of manufactured seeds, would require further shortening of time and lessening of operation required to classify embryos. The present invention is directed to meeting this requirement.
It should be noted that the discussion of the background to the invention herein is included to explain the context of the invention. This is not to be taken as an admission that any of the material referred to was published, known or part of the common general knowledge as at the priority date of any of the claims.
SUMMARY OF THE INVENTION Viewed from one aspect, the present invention provides a method of simultaneously imaging multiple views of a plant embryo, including: providing a camera for receiving a first view of a plant embryo; providing a first reflecting surface for receiving and reflecting a second view of the plant embryo toward the camera; substantially enclosing the plant embryo to be imaged so as to provide diffuse lighting for the embryo; providing a non-specular background below the plant embryo to be imaged; and I 7spedes722139and.d oc using the camera, simultaneously imaging the first and second views of the plant embryo.
Viewed from another aspect, the present invention provides a plant embryo imaging system for simultaneously imaging multiple views of a plant embryo, including: a camera for receiving a first view of a plant embryo; a first reflecting surface for receiving and reflecting a second view of the plant embryo toward the camera; a second reflecting surface for receiving and reflecting a third view of the plant embryo toward the camera; an enclosure substantially enclosing the first and second reflecting surfaces and a plant embryo when the plant embryo is being imaged, wherein the interior surface of the enclosure includes a white diffuse reflecting material; and a platform for receiving a plant embryo, said platform being positioned so that the plant embryo is substantially inside of the enclosure when it is imaged and said platform including a non-specular background beneath the plant embryo when the plant embryo is being imaged; wherein the camera is used to simultaneously image the first, second, and third views of the plant embryo.
The invention provides a method of simultaneously imaging multiple views of a plant embryo. First, the method provides a camera for receiving a first view of a plant embryo the top view). Second, the method provides a first reflecting surface for receiving and reflecting a second view of the plant embryo the side view) toward the camera. Thus, using the camera, the method permits simultaneously imaging both the first and second views of the plant embryo. In one embodiment, the method further provides a second reflecting surface for receiving and reflecting a third view the end view) of the plant embryo toward the camera, so that the camera can simultaneously image the first, second, and third views of the plant embryo.
According to one aspect of the invention, the three views of a plant embryo are orthogonal to each other.
According to another aspect of the invention, the reflecting surfaces are provided in the form of reflecting prisms.
T:Spedes722139amd.doc According to another aspect of the invention, the reflecting surfaces are provided in the form of mirrors.
According to yet another aspect of the invention, a light source is provided adjacent to the plant embryo to illuminate the plant embryo during image acquisition.
Further, a cube-like enclosure, the interior surface of which is advantageously a white diffuse reflecting surface, may be provided to provide for diffuse lighting (substantially uniform illumination from all directions). The diffuse lighting arrangement eliminates shadows and prevents specular reflections from any wet or shiny areas on the surface of the embryo or from the interior surface of the enclosure. The enclosure also prevents undesirable light from reaching the image sensor of the camera. The enclosure including its various components is referred to as an "imaging cube." The invention also offers a system for simultaneously imaging multiple views of a plant embryo, including generally three elements: a camera for receiving a first view of a plant embryo; a first reflecting surface for receiving and reflecting a second view of the plant embryo toward the camera; and a second reflecting surface for receiving and reflecting a third view of the plant embryo toward the camera. In the system, the camera is used to simultaneously image the first, second, and third views of the plant embryo.
According to one aspect of the invention, the system of the present invention further includes a cube-like enclosure that is configured to substantially enclose the first and second reflecting surfaces and the embryo to be imaged, so as to provide diffuse lighting and to prevent undesirable light from reaching the image sensor of the camera.
In one embodiment, the cube includes generally three openings: first opening to transmit the multiple views of the embryo to the camera; a second opening for receiving light from a light source to illuminate the plant embryo inside the cube during image acquisition; and a third opening for receiving the plant embryo to be viewed, perhaps as placed on an elevatable platform. In operation, the platform is lowered and a plant embryo to be viewed is placed thereon. Thereafter, the platform carrying the embryo is elevated to be received within the third opening of the cube, so as to substantially enclose the embryo to be imaged within the cube.
One preferred embodiment of the platform includes a dark non-specular nonreflective surface area so as to provide a dark background and hence the maximum contrast for the top view image of the embryo. Also preferably, similar dark vertical WEYE\24871 APP.DOC -4surfaces may be provided opposite the first and second reflecting surfaces, respectively, to provide dark backgrounds for the side view and the end view.
As will be apparent to those skilled in the art, the present invention offers several significant advantages over the previous method of taking images of an embryo using three orthogonally arranged cameras. First, there is no need to orient the embryo when taking one image relative to the orientation of the other two images, since three views of the embryo are taken simultaneously (with their relative orientation being fixed due to the fixed relationship of the camera and the reflecting surfaces). Second, the time required to send the three views of an embryo to a computer for analysis is cut by two thirds because, according to the invention, a single image combining all three views of an embryo can be transmitted to the computer. Thus, the present invention substantially shortens the time and operation required to obtain multiple views of an embryo, which can then be used to classify the embryos based on their desirability (or germination vigor).
BRIEF DESCRIPTION OF THE DRAWINGS The foregoing aspects and many of the attendant advantages of this invention will become more readily appreciated as the same become better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein: FIGURE 1 illustrates a prior method of obtaining three orthogonal views of a plant embryo using three separate cameras that are arranged orthogonal to each other; 0 FIGURE 2 illustrates a method of obtaining three orthogonal views of a plant embryo using a single camera, according to the present invention; FIGURES 3A and 3B illustrate a system for simultaneously obtaining multiple views of a plant embryo according to the present invention, wherein, in FIGURE 3A a platform is lowered to load an embryo to be imaged thereon, while in FIGURE 3B the platform carrying the embryo is elevated into an imaging cube of the system; FIGURE 4A is a perspective view of the imaging cube of the system of FIGURES 3A and 3B, and FIGURE 4B is an exploded view of the same imaging cube; FIGURE 5 is a sample schematic image of an embryo, including three orthogonal views of the embryo that are taken simultaneously; FIGURE 6 schematically illustrates the positioning of a plant embryo to be imaged relative to two reflecting surfaces; and WEYE\24871 APP.DOC FIGURE 7 schematically illustrates arranging dark backgrounds for a plant embryo to provide the maximum contrast for the embryo image.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT FIGURE 2 schematically illustrates the method of the present invention for simultaneously imaging multiple views of a plant embryo. The method involves directly imaging a first view of a plant embryo 10 (the top view in FIGURE 2) on an image plane 18 of a camera; and using a first reflecting surface 14 to receive and reflect a second view of the embryo (the cotyledon end view in FIGURE 2) toward the image plane 18 of the same camera. Thus, an image combining both the first and second views the top and end views in the illustrated embodiment) can be taken. In one embodiment, the method further involves using a second reflecting surface 16 to receive and reflect a third view of the embryo (the side view in FIGURE 2) toward the image plane 18 of the same camera. According to this arrangement, a camera with the image plane 18 can simultaneously acquire the first view the top view) directly from the embryo 10, the second view the cotyledon end view) via the first reflecting surface 14, and the third view the side view) via the second reflecting surface 16. In other words, a single image taken at the image plane 18 includes three different views of an embryo.
As in this example, the first, second, and third views may be orthogonal to each other, though the angular relationship of the three views is not limited to an orthogonal arrangement. Also, in the illustrated embodiment, both the first and second reflecting surfaces 14 and 16 are provided as reflecting prisms, though any other optical elements that provide reflecting surfaces may be used, such as reflecting mirrors. If necessary, a suitable light source 20 (or 20) may be arranged to illuminate the embryo 10 during image acquisition.
Referring now to FIGURE 3A, one embodiment of the proposed system is disclosed. The system includes an imaging cube 22, a light source 20, and a camera 24, arranged on a suitable stand structure 25. Any light source 20 suitable for illuminating the plant embryo to be imaged may be used. In some situations, for example where an ambient light is sufficient for illuminating the plant embryo to be imaged, a light source may not be required. Also, any suitable camera 24 may be used, preferably a digital camera containing a charge-coupled device (CCD) linked to a digital storage device, so as WEYEN24871 APP.DOC to permit subsequent digital analysis of the embryo image for classification purposes.
Referring additionally to FIGURES 4A and 4B, in one embodiment, the imaging cube 22 includes two right-angle prisms 15 and 17, which provide the first and second reflecting surfaces 14 and 16, respectively. The prisms 15 and 17 are arranged on adhered to) slanted blocks 26 and 27, respectively, which in turn are secured to a base plate 28 via suitable fasteners (not shown) extending through holes 30 and 31. The holes 30 and 31 may be threaded, when threaded fasteners are used. The base plate 28 defines a central opening 29 which, after the slanted blocks 26 and 27 and the prisms 15 and 17 are secured to the base plate 28, provides a generally rectangular-shaped opening (see FIGURE 4A) for receiving a rectangular-shaped platform (or tray) carrying a plant embryo to be imaged, as will be more fully described below. A cube 35 including suitably arranged holes 32 are placed over the base plate 28, and fasteners (not shown) are placed extending through the holes 30 and holes 33 provided in the base plate 28 to complete the imaging cube 22. The cube 35 includes a camera viewing hole 37. As shown in FIGURE 4A, the imaging cube 22 is enclosed except for one open surface 39, which is to face the light source 20 for receiving embryo illuminating light. (See FIGURE 3A.) Alternatively, the surface 39 may be formed at least partially with a diffusing light transmissive material, such as ground glass, through which light from the light source 20 is received.
In one preferred embodiment, the interior surface of the cube 35 is formed as a white diffuse reflecting surface to provide diffuse lighting. Diffuse lighting (substantially uniform illumination from all directions) eliminates shadows and bright spots due to specular reflections from wet or shiny areas on the embryo surface or from the interior surface of the cube 35. Thus, diffuse lighting makes the resulting embryo image substantially free of shadows and specular reflections and therefore simpler to analyze.
The base plate 28 and the cube 35 may be formed of any suitable material, such as injection molded plastic. It should be understood that FIGURES 4A and 4B illustrate merely one embodiment of the imaging cube 22, and various other configurations of the imaging cube 22 (not limited to the illustrated cube shape) are possible. The particular shape and method of assembling each component/element of the imaging cube 22 the locations of fasteners) may vary according to each application, as will be apparent to those skilled in the art. In particular, the reflecting surfaces 14 and 16 may be provided WEYE\24871 APP.DOC by any suitable optical elements, as described above, and if provided in the form of reflecting prisms, may be provided by various prisms including roof prisms, dove prisms, pentagon prisms, etc., not limited to the illustrated right-angle prisms.
The camera viewing hole 37, provided on the illustrated top surface of the imaging cube 22, is for the camera 24 to view an embryo placed inside the imaging cube 22. (See FIGURE 3A for the relative positioning of the imaging cube 22 and the camera 24.) Referring additionally to FIGURE 5, a sample image 40 taken by the camera 24 includes three views of an embryo: an end view 41 received and reflected by the first reflecting surface 14 (or the first prism 15) toward the camera 24; a side view 42 received and reflected by the second reflecting surface 16 (or the second prism 17) toward the camera 24; and a top view 43 received directly by the camera 24. In the illustrated embodiment, the camera viewing hole 37 is generally L-shaped to correspond with the shape of the image 40 combining three orthogonal views of an embryo taken simultaneously, although the shape of the viewing hole 37 is not limited to this particular configuration. In the illustrated embodiment, the cube 35 with the camera viewing hole 37 and the base plate 28 are provided and configured so as to acquire three views of an embryo while providing diffuse illumination for the embryo. However, such an arrangement may not be necessary depending on a particular application. The cube and the base plate 28 also generally serve to protect the reflecting surfaces 14 and 16 from external elements that could damage or misalign the reflecting surfaces.
Referring to FIGURES 3A and 6, in one embodiment, an embryo 10 to be imaged is placed on a generally rectangular platform 45 coupled to an elevator actuator 47. The elevator actuator 47 may be driven and controlled by any suitable means, such as by an electric or hydraulic motor. Initially, the platform is lowered by the elevator actuator 47 relative to the imaging cube 22, and the embryo 10 to be imaged is placed on the Thereafter, referring to FIGURE 3B, the elevator actuator 47 raises the platform 45 carrying the embryo 10 until the platform 45 is generally received within the central opening 29 of the base plate 28 of the imaging cube 22. In this configuration, after the platform 45 carrying the embryo 10 is raised and received by the central opening 29 having a shape corresponding to the shape of the platform 45, the embryo is substantially enclosed within the imaging cube 22, except for the cube's open surface 39 facing the light source 20 and the camera viewing hole 37 for transmitting the WEYE24871 APP.DOC embryo image to the camera 24. Thus, this embodiment is advantageous in preventing any undesirable light not originating from the embryo 10 from reaching the camera 24.
To this end, the imaging cube 22, including the cube 35, the base plate 28, and the platform 45, may be formed of generally opaque material that blocks ambient light.
As specifically illustrated in FIGURE 6, preferably the platform 45 is configured to be raised above the lower edge portions 49 and 50 of the reflecting surfaces 14 and 16 so that a complete view of the embryo 10 can be received and reflected by the reflecting surfaces 14 and 16 without distortion. Further preferably, the edge portions 49 and 50 of the reflecting surfaces (the prisms in the illustrated embodiment) are rounded so as to permit obtaining a flat view of an embryo without any clipping. Still further, referring to FIGURE 7, in one preferred embodiment, the platform 45 includes a dark non-specular and non-reflective surface area 52 to provide the maximum contrast for the top view image of the embryo 10. Likewise, similarly dark and generally vertical background surfaces 54 may be provided, generally opposite the first and second reflecting surfaces 14 and 16 across the embryo 10, to provide the maximum contrast for the second and third views the side view and the end view) of the embryo image. In FIGURE7, only one vertical background surface 54 is shown to provide a dark background for the "end view" of the embryo The means for positioning an embryo for imaging is not limited to the combination of the platform 45 and the elevator actuator 47 described above. For example, an embryo to be imaged may be placed on a horizontally movable platform, or a two- or three-dimensionally movable platform, to be positioned relative to the camera 24 generally between the two reflecting surfaces 14 and 16. Alternatively, an embryo may be positioned for imaging using a mini-robotic pick and place systems, a suction-based pick and place systems pipettes), or even manually. It should be understood that the present invention is not limited to any particular means for positioning a plant embryo for imaging.
It should also be understood that the present invention is not limited to the particular embodiment discussed hereinabove for taking the end view and the side view of an embryo via two reflecting surfaces. For example, two reflecting surfaces may be used to take the top view and the side view, or the top view and the end view, of an embryo, while the third view is taken directly by the camera. Depending on which view WEYE24871 APP.DOC -9is to be taken directly by the camera, the relative placement of the camera 24 with respect to the imaging cube 22 may vary, and is not limited to the particular arrangement illustrated in FIGURE 3A. For example, the camera 24 may be placed generally horizontally adjacent to the imaging cube 22 so as to directly image either the end view or the side view of an embryo. Further alternatively, the arrangement of the light source relative to the imaging cube 22 is not limited to the arrangement illustrated in FIGURE 3A. For example, the light source 20 may be provided generally beneath the imaging cube 22 (as in the light source 20' in FIGURE though in such a case the bottom surface of the imaging cube 22 facing the light source 20 must be configured to permit transmission of the illuminating light. As a further example; in addition to the two reflecting surfaces 14 and 16, further reflecting surfaces may be used to simultaneously image two opposite side views (the right side view and the left side view) and/or two opposite end views (the cotyledon end view and the radicle end view) of an embryo. For example, if two side views and two end views, as well as the top view, are to be imaged simultaneously, two additional reflecting surfaces arranged generally opposite the first and second reflecting surfaces 14 and 16, respectively, will be used.
It should be understood that the present method and system for simultaneously imaging multiple views of an embryo can be applied in obtaining multiple sets of spectral data from an embryo regarding absorption, transmittance, or reflectance of electromagnetic radiation (not limited to visible light) by the embryo. For example, classification of embryos based on the analysis of spectral data collected from the embryos using IR spectroscopy was disclosed in PCT Application Serial No.
PCT/US99/12128 (WO 99/63057), discussed above. Spectroscopic analysis, including IR spectroscopy, NIR spectroscopy, and Raman spectroscopy, permits identification of chemical composition (surface chemistry) of an embryo. It is known that the embryo quality is related to gross chemical composition of the embryo or its parts, for example the amounts of water and storage compounds (proteins, lipids, carbohydrates, etc.).
Therefore, spectroscopic analysis may be used to classify embryos according to their desirability. Accordingly, as used in the present description, obtaining an image or imaging is not limited to obtaining a visible image of an embryo, and may include acquiring spectral data from an embryo (or its parts) to identify its chemical composition.
WEYE24871 APP.DOC In one embodiment, the system of the present invention including the camera 24 and the imaging cube 22 may be incorporated into an automated manufactured seed delivery/manufacturing line, as disclosed in PCT Application Serial No. PCT/US00/40720 (WO 01/13702 A2), discussed above. For example, the elevatable platform 45 may be incorporated along a conveyor belt for delivering embryos, so that an embryo, upon being placed on the platform, can be elevated into the imaging cube 22 for imaging and subsequent analysis. Alternatively, the imaging cube 22 may be arranged to be lowered to the conveyor belt for imaging an embryo carried on the conveyor.
As will be apparent to those skilled in the art, the present invention offers several significant advantages over the previous method of taking multiple images of an embryo to obtain multiple views of the embryo, using multiple cameras (or multiple positioning of a camera). First, there is no need to orient the embryo when taking one image relative to the orientation of the other image(s), since multiple views of the embryo are taken simultaneously, with their relative orientation being fixed due to the fixed relationship of the camera and the reflecting surface(s). Second, the time required to send the multiple views of an embryo to a computer for analysis is substantially reduced because, according to the present invention, a single image combining multiple views of an embryo can be transmitted to the computer at once. Thus, the present invention significantly shortens the time required to obtain multiple views of an embryo, which can then be used to classify the embryos based on their desirability (or germination vigor). Accordingly, the present invention is useful in mass selection of desirable embryos suitable for incorporation into manufactured seeds, and hence in mass production of manufactured seeds.
While the preferred embodiments of the invention have been illustrated and described, it will be appreciated that various changes can be made therein without departing from the spirit and scope of the invention.
wEY4871 APP.DOC 11-
Claims (19)
1. A method of simultaneously imaging multiple views of a plant embryo, including: providing a camera for receiving a first view of a plant embryo; providing a first reflecting surface for receiving and reflecting a second view of the plant embryo toward the camera; substantially enclosing the plant embryo to be imaged so as to provide diffuse lighting for the embryo; providing a non-specular background below the plant embryo to be imaged; and using the camera, simultaneously imaging the first and second views of the plant embryo.
2. The method of Claim 1, further including providing a second reflecting surface for receiving and reflecting a third view of the plant embryo toward the camera, wherein the camera is used to simultaneously image the first, second, and third views of the plant embryo.
3. The method of Claim 2, wherein at least two of the first, second, and third views are orthogonal to each other.
4. The method of Claim 2, wherein the first and second reflecting surfaces include reflecting prisms. The method of Claim 2, further including providing a third reflecting surface for receiving and reflecting a fourth view of the plant embryo toward the camera, wherein the fourth view includes a view of the embryo that is generally opposite to the second or third view of the embryo, and the camera is used to simultaneously image the first, second, third, and fourth views of the plant embryo.
T:ASpes722139amd.doc
6. The method of any one of the preceding claims, wherein the camera includes a digital camera.
7. The method of any one of the preceding claims, wherein the plant embryo includes a somatic embryo.
8. The method of any one of the preceding claims, further including providing a light source adjacent to the plant embryo to illuminate the plant embryo during image acquisition.
9. A plant embryo imaging system for simultaneously imaging multiple views of a plant embryo, including: a camera for receiving a first view of a plant embryo; a first reflecting surface for receiving and reflecting a second view of the plant embryo toward the camera; a second reflecting surface for receiving and reflecting a third view of the plant embryo toward the camera; an enclosure substantially enclosing the first and second reflecting surfaces and a plant embryo when the plant embryo is being imaged, wherein the interior surface of the enclosure includes a white diffuse reflecting material; and a platform for receiving a plant embryo, said platform being positioned so that the plant embryo is substantially inside of the enclosure when it is imaged and said platform includes a non-specular background beneath the plant embryo when the plant embryo is being imaged; wherein the camera is used to simultaneously image the first, second, and third views of the plant embryo.
The system of Claim 9, wherein at least two of the first, second, and third views of the embryo are orthogonal to each other.
11. The system of Claim 9 or 10, wherein the first and second reflecting surfaces include reflecting prisms. T:ASpces\722139amd doc
12. The system of Claim 9, 10 or 11, wherein the first and second reflecting surfaces include right-angle prisms.
13. The system of Claim 9 or 10, wherein the first and second reflecting surfaces include mirrors.
14. The system of any one of Claims 9 to 13, wherein the camera includes a digital camera.
15. The system of any one of Claims 9 to 14, further including: a third reflecting surface for receiving and reflecting a fourth view of the plant embryo toward the camera, the fourth view being generally opposite to the second view; and a fourth reflecting surface for receiving and reflecting a fifth view of the plant embryo toward the camera, the fifth view being generally opposite to the third view; wherein the camera is used to simultaneously image the first, second, third, fourth, and fifth views of the plant embryo.
16. The system of any one of Claims 9 to 15, further including a light source provided adjacent to the enclosure for illuminating the plant embryo during image acquisition.
17. The system of any one of Claims 9 to 16, wherein the enclosure defines a camera viewing hole for transmitting an image of the embryo to the camera; a surface for receiving light from the light source; and an opening for receiving the plant embryo to be imaged.
18. The system of Claim 17, wherein the surface for receiving light from the light source includes a surface at least partially formed of a diffusing light transmissive material. T: spedes\722139amd.doc
19. The system of any one of Claims 9 to 18, wherein the platform is a movable platform for carrying a plant embryo thereon, the platform being moved between a first position at which a plant embryo is placed on the platform and a second position at which the platform carrying the embryo is substantially received within the enclosure. The system of Claim 9, further including a background surface arranged generally perpendicularly to the non specular background of the platform to provide a background for the second or third view of the embryo. DATED: 19 May 2006 PHILLIPS ORMONDE FITZPATRICK Attorneys for: WEYERHAEUSER COMPANY 74ka; 9"'p 0 a~BPt~c T:\Species\722139amddoc
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US56070803P | 2003-06-30 | 2003-06-30 | |
| US60/560,708 | 2003-06-30 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| AU2004202741A1 AU2004202741A1 (en) | 2005-01-13 |
| AU2004202741B2 true AU2004202741B2 (en) | 2006-06-01 |
Family
ID=33435317
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| AU2004202741A Ceased AU2004202741B2 (en) | 2003-06-30 | 2004-06-22 | Method and system for simultaneously imaging multiple views of a plant embryo |
Country Status (9)
| Country | Link |
|---|---|
| US (1) | US7289646B2 (en) |
| EP (1) | EP1494008B1 (en) |
| CN (1) | CN100445691C (en) |
| AU (1) | AU2004202741B2 (en) |
| BR (1) | BRPI0402533A (en) |
| CA (1) | CA2471450C (en) |
| CL (1) | CL2004001618A1 (en) |
| NZ (1) | NZ533674A (en) |
| UY (1) | UY28394A1 (en) |
Families Citing this family (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040268446A1 (en) * | 2003-06-30 | 2004-12-30 | Brian Penttila | Method for classifying plant embryos using Raman spectroscopy |
| US7881502B2 (en) * | 2003-06-30 | 2011-02-01 | Weyerhaeuser Nr Company | Method and system for three-dimensionally imaging an apical dome of a plant embryo |
| US7570359B2 (en) * | 2004-02-09 | 2009-08-04 | John S. Fox | Illuminating and panoramically viewing a macroscopically-sized specimen along a single viewing axis at a single time |
| US7568309B2 (en) * | 2004-06-30 | 2009-08-04 | Weyerhaeuser Nr Company | Method and system for producing manufactured seeds |
| US8103331B2 (en) * | 2004-12-06 | 2012-01-24 | Cambridge Research & Instrumentation, Inc. | Systems and methods for in-vivo optical imaging and measurement |
| DE102006038161A1 (en) * | 2006-08-16 | 2008-02-28 | Siemens Ag | Imaging device for fluorescence imaging of e.g. mouse, has mirror arrangement with mirror for deflecting emission light from investigation region for image recording device such that images of investigation region are recordable |
| FR2907554B1 (en) * | 2006-10-24 | 2009-03-20 | Tiama Sa | OPTICAL INSPECTION STATION FOR DETECTING DEFECTS REFLECTING LIGHT |
| TWI401412B (en) * | 2009-11-13 | 2013-07-11 | Inst Information Industry | Automatic measurement system, method and recording medium for plant characteristics |
| DE202010002010U1 (en) * | 2010-02-05 | 2010-05-06 | Berthold Technologies Gmbh & Co. Kg | Measuring device for measuring bioluminescence, chemiluminescence or fluorescence of objects, irradiation device and measuring system |
| US9578797B2 (en) | 2010-03-26 | 2017-02-28 | Monsanto Technology Llc | Automated system for germination testing using optical imaging |
| US10094785B2 (en) | 2011-05-17 | 2018-10-09 | Gii Acquisition, Llc | Method and system for optically inspecting headed manufactured parts |
| US9697596B2 (en) | 2011-05-17 | 2017-07-04 | Gii Acquisition, Llc | Method and system for optically inspecting parts |
| US9047657B2 (en) * | 2011-05-17 | 2015-06-02 | Gii Acquisition, Lcc | Method and system for optically inspecting outer peripheral surfaces of parts |
| US10088431B2 (en) | 2011-05-17 | 2018-10-02 | Gii Acquisition, Llc | Method and system for optically inspecting headed manufactured parts |
| US9575013B2 (en) * | 2011-05-17 | 2017-02-21 | Gii Acquisition, Llc | Non-contact method and system for inspecting a manufactured part at an inspection station having a measurement axis |
| US8570504B2 (en) * | 2011-05-17 | 2013-10-29 | Gii Acquisition, Llc | Method and system for optically inspecting parts |
| WO2013001436A1 (en) * | 2011-06-27 | 2013-01-03 | Basf Plant Science Company Gmbh | Screening device for screening plant specimens |
| US8605149B2 (en) | 2011-07-19 | 2013-12-10 | Ball Horticultural Company | Seed classification using spectral analysis to determine existence of a seed structure |
| US9165189B2 (en) | 2011-07-19 | 2015-10-20 | Ball Horticultural Company | Seed holding device and seed classification system with seed holding device |
| CN103108155A (en) * | 2011-11-09 | 2013-05-15 | 财团法人资讯工业策进会 | Planting image capturing device and image capturing method thereof |
| US8731245B2 (en) * | 2012-03-07 | 2014-05-20 | Xerox Corporation | Multiple view transportation imaging systems |
| CN104166295A (en) * | 2014-08-22 | 2014-11-26 | 镇江瑞繁农艺有限公司 | Vegetable, melon and fruit testing photographing device |
| CN104521371A (en) * | 2014-12-09 | 2015-04-22 | 广西大学 | an incubator |
| CN110081824B (en) * | 2019-05-14 | 2021-04-02 | 宁波均普智能制造股份有限公司 | Device and method for detecting casing inner wall film cutting seam |
| CN110809937B (en) * | 2019-12-03 | 2021-01-29 | 中国农业大学 | Method for quantitatively analyzing growth characteristics of root plants based on delayed photography technology |
| CN111595240B (en) | 2020-06-15 | 2024-07-09 | 上海海洋大学 | Multi-view quick shooting device for cephalopod horniness jaw |
| EP4360445A4 (en) * | 2021-06-24 | 2024-12-11 | FUJIFILM Corporation | PLANT BREEDING METHOD AND PLANT BREEDING DEVICE |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4309094A (en) * | 1980-12-01 | 1982-01-05 | Bollen Paul C | Multi-angle photography |
| DE19716468A1 (en) * | 1997-04-21 | 1998-10-29 | Autronic Bildverarbeitung | Unit for surface inspection of wood specimen esp. for quality control-classification |
| US6122045A (en) * | 1997-10-28 | 2000-09-19 | Materials Technologies Corporation | Apparatus and method for viewing and inspecting a circumferential surface area of an object |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3515475A (en) * | 1966-12-30 | 1970-06-02 | House Of Coins Inc | Apparatus for viewing coins or the like |
| US4213684A (en) * | 1978-03-20 | 1980-07-22 | Nasa | System for forming a quadrifid image comprising angularly related fields of view of a three dimensional object |
| US5427593A (en) * | 1990-10-26 | 1995-06-27 | Weyerhaeuser Company | Analogs of botanic seed |
| US5659623A (en) * | 1995-03-17 | 1997-08-19 | Ball Horticultural Company | Method and apparatus for assessing the quality of a seed lot |
| WO1997032181A1 (en) * | 1996-03-01 | 1997-09-04 | Durand-Wayland, Inc. | Optical inspection apparatus and method for articles |
| AU3585497A (en) * | 1996-06-27 | 1998-01-14 | Weyerhaeuser Company | Fluid switch |
| US6750376B1 (en) * | 1997-02-05 | 2004-06-15 | Utah State University | Methods for producing apomictic plants |
| US5909285A (en) | 1997-05-05 | 1999-06-01 | Beaty; Elwin M. | Three dimensional inspection system |
| US6014451A (en) * | 1997-10-17 | 2000-01-11 | Pioneer Hi-Bred International, Inc. | Remote imaging system for plant diagnosis |
| NZ508961A (en) * | 1998-06-01 | 2002-10-25 | Weyerhaeuser Co | Methods for classification of somatic embryos |
| SG76564A1 (en) | 1998-11-30 | 2000-11-21 | Rahmonic Resources Pte Ltd | An apparatus and method to transport inspect and measure objects and surface details at high speeds |
| CA2381905C (en) * | 1999-08-23 | 2005-05-24 | Edwin Hirahara | An embryo delivery system for manufactured seeds |
-
2004
- 2004-06-04 US US10/861,076 patent/US7289646B2/en active Active
- 2004-06-17 CA CA2471450A patent/CA2471450C/en not_active Expired - Fee Related
- 2004-06-21 NZ NZ533674A patent/NZ533674A/en not_active IP Right Cessation
- 2004-06-22 AU AU2004202741A patent/AU2004202741B2/en not_active Ceased
- 2004-06-25 CL CL200401618A patent/CL2004001618A1/en unknown
- 2004-06-28 BR BR0402533-4A patent/BRPI0402533A/en not_active IP Right Cessation
- 2004-06-29 UY UY28394A patent/UY28394A1/en not_active Application Discontinuation
- 2004-06-29 EP EP04253894A patent/EP1494008B1/en not_active Expired - Lifetime
- 2004-06-30 CN CNB2004100619925A patent/CN100445691C/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4309094A (en) * | 1980-12-01 | 1982-01-05 | Bollen Paul C | Multi-angle photography |
| DE19716468A1 (en) * | 1997-04-21 | 1998-10-29 | Autronic Bildverarbeitung | Unit for surface inspection of wood specimen esp. for quality control-classification |
| US6122045A (en) * | 1997-10-28 | 2000-09-19 | Materials Technologies Corporation | Apparatus and method for viewing and inspecting a circumferential surface area of an object |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1575645A (en) | 2005-02-09 |
| UY28394A1 (en) | 2005-01-31 |
| NZ533674A (en) | 2005-12-23 |
| EP1494008B1 (en) | 2009-03-18 |
| CA2471450C (en) | 2010-07-20 |
| CA2471450A1 (en) | 2004-12-30 |
| CL2004001618A1 (en) | 2005-06-03 |
| CN100445691C (en) | 2008-12-24 |
| AU2004202741A1 (en) | 2005-01-13 |
| US7289646B2 (en) | 2007-10-30 |
| EP1494008A1 (en) | 2005-01-05 |
| US20040263957A1 (en) | 2004-12-30 |
| BRPI0402533A (en) | 2005-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2004202741B2 (en) | Method and system for simultaneously imaging multiple views of a plant embryo | |
| US7685767B2 (en) | Automated system and method for harvesting and multi-stage screening of plant embryos | |
| CN105717115B (en) | High-throughput Plant phenotypic analysis device and method based on optical image technology | |
| CN101384164B (en) | Method and apparatus to determine the start of flowering in plants | |
| MX2013014806A (en) | Screening device for screening plant specimens. | |
| US20240302281A1 (en) | Systems and methods for distinguishing fertile plant specimens from sterile plant specimens | |
| CA2471352C (en) | Method and system for three-dimensionally imaging an apical dome of a plant | |
| CA2047670A1 (en) | Method for identifying plants | |
| AU2004202742B2 (en) | Method for classifying plant embryos using raman spectroscopy | |
| Schuerger et al. | Canopy structure and imaging geometry may create unique problems during spectral reflectance measurements of crop canopies in bioregenerative advanced life support systems | |
| WO2025063848A1 (en) | Device and method for recording a plant or plant material for 3d reconstruction in time | |
| SHED | APPLICATION OF FLUORESCENCE |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FGA | Letters patent sealed or granted (standard patent) | ||
| MK14 | Patent ceased section 143(a) (annual fees not paid) or expired |