WO2016067456A1 - 画像処理方法および細胞分取方法 - Google Patents
画像処理方法および細胞分取方法 Download PDFInfo
- Publication number
- WO2016067456A1 WO2016067456A1 PCT/JP2014/079084 JP2014079084W WO2016067456A1 WO 2016067456 A1 WO2016067456 A1 WO 2016067456A1 JP 2014079084 W JP2014079084 W JP 2014079084W WO 2016067456 A1 WO2016067456 A1 WO 2016067456A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- chip
- divided
- pixel
- restored
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N1/00—Sampling; Preparing specimens for investigation
- G01N1/28—Preparing specimens for investigation including physical details of (bio-)chemical methods covered elsewhere, e.g. G01N33/50, C12Q
- G01N1/2813—Producing thin layers of samples on a substrate, e.g. smearing, spinning-on
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N1/00—Sampling; Preparing specimens for investigation
- G01N1/28—Preparing specimens for investigation including physical details of (bio-)chemical methods covered elsewhere, e.g. G01N33/50, C12Q
- G01N1/30—Staining; Impregnating ; Fixation; Dehydration; Multistep processes for preparing samples of tissue, cell or nucleic acid material and the like for analysis
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1429—Signal processing
- G01N15/1433—Signal processing using image recognition
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
- G06V20/693—Acquisition
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/01—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials specially adapted for biological cells, e.g. blood cells
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/149—Optical investigation techniques, e.g. flow cytometry specially adapted for sorting particles, e.g. by their size or optical properties
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N1/00—Sampling; Preparing specimens for investigation
- G01N1/28—Preparing specimens for investigation including physical details of (bio-)chemical methods covered elsewhere, e.g. G01N33/50, C12Q
- G01N1/2813—Producing thin layers of samples on a substrate, e.g. smearing, spinning-on
- G01N2001/282—Producing thin layers of samples on a substrate, e.g. smearing, spinning-on with mapping; Identification of areas; Spatial correlated pattern
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N2015/1006—Investigating individual particles for cytology
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
Definitions
- the present invention relates to an image processing method and a cell sorting method.
- the present invention has been made in view of the above-described circumstances, and an image processing method capable of easily specifying a desired chip even from a chip arrangement in which a large number of minute chips are arranged, and An object is to provide a cell sorting method.
- the present invention provides the following means.
- the chip obtained by dividing a substrate on which a section of biological tissue is attached into a large number of chips together with the section is arranged two-dimensionally with a gap between each other.
- the position information indicating which position of the chip corresponds to the chip in the chip array is attached to the individual pixels constituting the restored slice image as the attribute information. Has been. Therefore, it is possible to easily and accurately specify which chip in the divided slice image is the chip to be collected from the position information of the pixel at the position to be collected in the restored slice image. Then, by comparing the chip array image in the divided slice image with the actual chip array, a desired chip can be easily specified even from among a large number of minute chips.
- a color for correcting the color of an adjacent pixel across the boundary based on the color of a pixel in the vicinity of the pixel A correction step may be included.
- the boundary between the chip images tends to be noticeable due to burrs or the like generated along the dividing line when the substrate and the slice are divided. Therefore, by correcting the color of the pixel located at the boundary to the same or similar color as the color of the surrounding pixels, a more natural whole image of the segment before segmentation in which the boundary between the chip images is not conspicuous Can be restored.
- the image processing method according to any one of the above, a display step of displaying the restored slice image, and the restored slice image displayed in the display step collected from the slice
- a cell sorting method including a designation step for designating a position to be performed, and a collection step for collecting a chip from the chip array based on the position information attached to a pixel corresponding to the position designated in the designation step.
- the chip to be sampled can be easily specified from the actual chip array based on the position information of the pixel at the position specified in the specifying step. Can be collected in the collection step.
- the cell sorting system 1 is a system for collecting a specific region containing a desired cell from a section A of a biological tissue. As shown in FIG. 1, an inverted optical microscope 2 having a horizontal stage 10 is used. A punching unit 3 provided above the stage 10, an image processing device 4 for processing an image acquired by the optical microscope 2, a display unit 5, and a data bus 6 for connecting them together. .
- the section A used in the cell sorting system 1 is pasted on a thin substrate 7 such as a cover glass as shown in FIG. 2A.
- a thin substrate 7 such as a cover glass as shown in FIG. 2A.
- grooves 8 having a depth up to an intermediate position of the thickness dimension of the substrate 7 are formed in a lattice shape.
- the interval between adjacent grooves 8 is 0.2 mm to 2.0 mm, preferably 0.3 mm to 1.0 mm, and more preferably 0.3 mm to 0.5 mm.
- the back surface of the substrate 7 is adhered to a sheet 9 (for example, a sheet for dicing) having elasticity in the surface direction by an adhesive.
- a sheet 9 for example, a sheet for dicing
- the substrate 7 can be divided into a large number of small rectangular chips 7a along the grooves 8 as shown in FIG. 2B.
- the slice A on the substrate 7 is also divided into a large number of small pieces along the groove 8 together with the substrate 7.
- a chip array 70 composed of a large number of chips 7a arranged in a square with a gap is generated.
- the optical microscope 2 includes an objective lens 11 that magnifies and observes a specimen on the stage 10 and an imaging unit 12 such as a digital camera that photographs an image of the specimen acquired by the objective lens 11 below the stage 10. ing.
- the stage 10 has a window 10a penetrating in the vertical direction at a substantially central portion thereof. As shown in FIG. 1, the sheet 9 is placed on the stage 10 so that the chip array 70 is located in the window 10a and the surface on which the chip array 70 is formed faces downward. Thus, the chip array 70 can be observed from the lower side of the stage 10 with the objective lens 11, and an image of the chip array 70 acquired by the objective lens 11 can be taken by the imaging unit 12.
- the punching unit 3 includes a needle 13 and a holder 14 that holds the needle 13 with the needle tip 13a facing downward and is movable in the horizontal direction and the vertical direction.
- the needle tip 13a By moving the holder 14 in the horizontal direction, the needle tip 13a can be aligned with the tip 7a on the stage 10 in the horizontal direction. Further, when the holder 14 descends in the vertical direction, the back surface of the tip 7 a is pushed by the needle tip 13 a, and the tip 7 a can be peeled off and dropped from the sheet 9.
- the image processing apparatus 4 is a computer, for example, and includes a calculation unit 15 such as a CPU (Central Processing Unit) and a storage unit 16 such as a ROM (Read Only Memory) that stores an image processing program. . Further, the image processing device 4 includes an input device (not shown) such as a keyboard and a mouse for the user to input to the image processing device 4.
- a calculation unit 15 such as a CPU (Central Processing Unit)
- a storage unit 16 such as a ROM (Read Only Memory) that stores an image processing program.
- the image processing device 4 includes an input device (not shown) such as a keyboard and a mouse for the user to input to the image processing device 4.
- the image processing device 4 stores the divided section image P received from the optical microscope 2 in a temporary storage device (not shown) such as a RAM, and executes the image processing program stored in the storage unit 16 to thereby execute the divided section image.
- a restored slice image Q is generated from the image P, and the generated restored slice image Q is output to the display unit 5 for display.
- the cell sorting method includes an image acquisition step S1, a template creation step S2, a chip recognition step S3, an attribute information addition step S4, a restoration step S5, and a display.
- the process S6, the extraction position designation process (designation process) S7, and the collection process S8 are included.
- the image processing method according to the present invention corresponds to the image acquisition step S1 to the restoration step S5.
- the user observes the chip array 70 with the optical microscope 2, and captures the entire section A with the appropriate imaging magnification in which the entire section A is included in the field of view of the imaging section 12.
- the divided segment image P acquired by the imaging unit 12 is transmitted to the image processing device 4 via the data bus 6.
- arbitrary methods can be used for acquisition of the division
- the divided slice image P may be obtained by acquiring the partial images of the chip array 70 at a high magnification and appropriately joining the acquired partial images.
- the calculation unit 15 executes subsequent processing based on the actual size of one side of the chip 7a, the imaging magnification of the divided slice image P by the microscope 2, and the number of vertical and horizontal pixels of the divided slice image P.
- a template used in the chip recognition step S3 is created.
- the dimension of one side of the chip 7 a corresponds to the interval between the grooves 8, and is input to the image processing device 4 by the user via the input device and stored in the storage unit 16, for example.
- the imaging magnification of the microscope 2 and the number of vertical and horizontal pixels of the divided slice image P are acquired from the microscope 2 by the calculation unit 15 and stored in the storage unit 16, for example.
- the image processing device 4 calculates the actual size of the image per pixel of the divided slice image P from the photographing magnification of the microscope 2 and the number of vertical and horizontal pixels of the divided slice image P, and calculates the calculated image per pixel. From the actual size and the actual size of one side of the chip 7a, the number of pixels corresponding to one side of one chip 7a is calculated. Then, the image processing apparatus 4 creates a rectangular template having one side made up of the calculated number of pixels.
- the calculation unit 15 reads the segmented segment image P from the temporary storage device, performs pattern matching between the template and the segmented segment image P, and has a high correlation with the template in the segmented segment image P.
- a region having the same is recognized as a chip region R.
- pattern matching by using a template having a shape substantially congruent with the image of each chip 7a in the divided slice image P, images of rectangular dust or the like having different sizes other than the image of the chip 7a The erroneous recognition as R does not occur, and the image of the chip 7a in the divided slice image P can be recognized as the chip region R accurately and quickly.
- image processing such as binarization of gradation values, thinning, and contour extraction may be performed on the divided slice image P before pattern matching.
- the calculation unit 15 gives attribute information to all the pixels in the divided segment image P, and stores the attribute information in association with the pixels in the storage unit 16.
- the attribute information includes a flag (region information), an address (position coordinate), and a center coordinate of the chip region R.
- flags There are three types of flags, for example, “0”, “1”, and “2”.
- “1” is set, and the outermost pixel among the pixels constituting each chip region R is positioned.
- “2” is assigned to the pixels constituting the outline of the chip region R
- “0” is assigned to the pixels constituting the region other than the chip region R. Based on this flag, it is possible to determine to which region in each divided segment image P each pixel belongs.
- the address is information indicating the position of each chip region R in the image of the chip array 70 in the divided slice image P. For example, as shown in FIG. 4, the row number A, B, C,. , 2, 3,... The address is assigned to the pixel to which the flag “1” or “2” is attached. For example, in the example shown in FIG. 4, all the pixels included in the chip region R located at the upper left corner in the image of the chip array 70 are assigned the address “A1”.
- the center coordinates of the chip region R are the coordinates in the divided slice image P of the center position of the chip region R to which the pixel belongs.
- the center coordinates of the chip area R are calculated by the calculation unit 15 based on the coordinates of the pixel group constituting each chip area R.
- the calculation unit 15 re-creates the chip region R based on the attribute information given to each pixel so that the adjacent chip regions R come into contact with each other without any gaps. Perform placement. Specifically, first, the pixel with the flag “0” is deleted from the divided segment image P. Thereby, only the chip region R arranged with a gap remains. Next, paying attention to one chip region R among the plurality of chip regions R, the pixel with the flag “2” of the target chip region R, and the chip region R adjacent to the target chip region R The adjacent chip regions R are translated so that the pixels with the flag “2” are directly adjacent to each other. Thereby, the gap between the chip regions R is reduced.
- the generated restored slice image Q is output from the calculation unit 15 to the display unit 5, and the restored slice image Q is displayed on the display unit 5.
- the user observes the restored slice image Q on the display unit 5, and displays a desired position of the slice A in the restored slice image Q by using a user interface such as a touch panel (not shown). Use to specify.
- the calculation unit 15 Based on the address assigned to the pixel at the designated position, the calculation unit 15 identifies the chip area R including the pixel at the designated position among the chip areas R in the restored slice image Q, and is identified. The center coordinates of the chip region R are transmitted to the punching unit 3.
- the punching unit 3 calculates the center position of the tip 7a to be punched by the needle 13 from the center coordinates of the chip region R received from the calculation unit 15, and moves the needle 13 to the calculated center position.
- the needle 13 is moved downward in the horizontal direction.
- the chip 7 a corresponding to the chip region R at the position designated by the user with respect to the restored slice image Q on the display unit 5 is punched and dropped from the sheet 9.
- the dropped chip 7a is collected in a container (not shown) arranged in advance vertically below the stage 10.
- each pixel constituting the chip region R in the divided segment image P is assigned an address indicating which chip region R the pixel belongs to, and then the chip region.
- a restored slice image Q in which the entire image of the slice A is restored by connecting Rs together is generated.
- the address also corresponds to the position of each chip 7a in the actual chip array 70. Therefore, the chip 7a corresponding to the position designated by the user with respect to the restored slice image Q can be accurately and easily specified from the chip array 70 in which a large number of minute chips 7a are arranged based on the address. There is an advantage that you can.
- the desired chip 7a is automatically sampled from the chip array 70 based on the position specified by the user with respect to the restored slice image Q.
- the positioning of the needle 13 and the sampling of the tip 7a may be performed manually.
- the divided section image P is also displayed on the display unit 5, and the user can determine which chip area R in the divided section image P is the chip area R corresponding to the position specified in the punching position specifying step S7. Is performed on the segmented slice image P so that can be visually recognized. Since the image of the chip array 70 in the divided slice image P is an image of the actual chip array 70, the designated chip region R in the divided slice image P is any of the actual chip arrays 70. The user can easily identify whether it corresponds to the chip 7a.
- the color of the pixel located at the boundary between the adjacent chip regions R in the restored slice image Q is changed to the color of the neighboring pixel.
- a color correction step S9 for correcting based on the above may be further included.
- the display step S ⁇ b> 6 the color-corrected restored slice image Q ′ is displayed on the display unit 5.
- boundary pixels two pixels with a flag “2” are adjacent to the boundary between two adjacent chip regions R.
- the calculation unit 15 uses the colors of the two pairs of boundary pixels as the colors (hue, brightness, saturation) of pixels located on both sides in the arrangement direction of the two pairs of boundary pixels. Correct based on For example, the calculation unit 15 gives the boundary pixel the average color of the pixels on both sides of the pair of boundary pixels or the same color as the pixel on one side. The calculation unit 15 performs color correction in the same manner for all two pairs of boundary pixels located at the boundary between two adjacent chip regions R.
- the color of the restored slice image Q is locally corrected so that the color continues smoothly across the boundary.
- the restored slice image Q ′ in which the boundary of the chip region R is not conspicuous is obtained.
- the color correction may be performed not only on the boundary pixels but also on pixels near the boundary pixels as necessary.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Health & Medical Sciences (AREA)
- Analytical Chemistry (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Multimedia (AREA)
- Biochemistry (AREA)
- Human Computer Interaction (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Optics & Photonics (AREA)
- Signal Processing (AREA)
- Dispersion Chemistry (AREA)
- Image Processing (AREA)
- Sampling And Sample Adjustment (AREA)
- Measuring Or Testing Involving Enzymes Or Micro-Organisms (AREA)
- Micro-Organisms Or Cultivation Processes Thereof (AREA)
- Microscoopes, Condenser (AREA)
- Image Analysis (AREA)
- Investigating Or Analysing Biological Materials (AREA)
Abstract
Description
本発明は、上述した事情に鑑みてなされたものであって、多数の微小なチップが配列するチップ配列の中からであっても、所望のチップを容易に特定することができる画像処理方法および細胞分取方法を提供することを目的とする。
本発明の第1の態様は、生体組織の切片が貼り付けられた基板を前記切片と一緒に多数のチップに分割して得られた、前記チップ同士が隙間を空けて2次元的に配列するチップ配列の画像を処理する画像処理方法であって、前記チップ配列を撮影して、分割された前記切片の全体を含む分割切片画像を取得する画像取得工程と、該画像取得工程において取得された前記分割切片画像から、前記チップの像を認識するチップ認識工程と、該チップ認識工程において認識された前記チップの像を構成する画素の各々に対し、その画素が属するチップの像の前記チップ配列の像における位置情報を含む属性情報を付与する属性情報付与工程と、該属性情報付与工程において前記属性情報を付与された画素からなる前記チップの像同士を1つに繋ぎ合わせることによって、前記分割された切片の像が1つに繋ぎ合わされた復元切片画像を生成する復元工程とを含む画像処理方法である。
復元切片画像において、チップの像間の境界は、基板および切片を分割する際に分割線に沿って生じるバリ等に起因して目立ちやすい。したがって、境界に位置する画素の色を、その周囲の画素の色と同一のまたは類似の色に補正することによって、チップの像間の境界が目立たない、より自然な分割前の切片の全体像を復元することができる。
このようにすることで、復元画像を簡単な処理で生成することができる。
本発明の第2の態様によれば、指定工程において指定された位置の画素の位置情報に基づき、実際のチップ配列の中から採取すべきチップを容易に特定することができ、特定されたチップを採取工程において採取することができる。
まず、本実施形態に係る細胞分取方法を実施するための細胞分取システム1について説明する。
本実施形態に係る細胞分取方法は、図3に示されるように、画像取得工程S1と、テンプレート作成工程S2と、チップ認識工程S3と、属性情報付与工程S4と、復元工程S5と、表示工程S6と、抜き位置指定工程(指定工程)S7と、採取工程S8とを含む。
本発明に係る画像処理方法は、画像取得工程S1から復元工程S5に相当する。
なお、画像取得工程S1における分割切片画像Pの取得には、任意の方法を用いることができる。例えば、チップ配列70の部分画像を高倍率で取得し、取得された複数の部分画像を適切に繋ぎ合わせることによって、分割切片画像Pを得てもよい。
テンプレート作成工程S2において、演算部15は、チップ7aの1辺の実寸法と、顕微鏡2による分割切片画像Pの撮影倍率と、分割切片画像Pの縦横の画素数とに基づいて、この後のチップ認識工程S3において使用するテンプレートを作成する。チップ7aの1辺の寸法は、溝8の間隔に相当し、例えば、ユーザによって入力装置を介して画像処理装置4に入力され、記憶部16に記憶される。顕微鏡2の撮影倍率および分割切片画像Pの縦横の画素数は、例えば、演算部15によって顕微鏡2から取得されて記憶部16に記憶される。
具体的には、まず、フラグ「0」が付されている画素を分割切片画像Pから削除する。これにより、隙間を空けて配列するチップ領域Rのみが残る。次に、複数のチップ領域Rの中の1つのチップ領域Rに注目し、該注目するチップ領域Rのフラグ「2」が付された画素と、注目するチップ領域Rに隣接するチップ領域Rのフラグ「2」が付された画素とが直接隣接するように、隣接するチップ領域Rを平行移動させる。これにより、チップ領域R間の隙間を詰める。注目するチップ領域Rを変更しながら、隣接するチップ領域Rの平行移動を繰り返すことによって、図5に示されるように、隙間なく1つに繋がった切片Aの全体像を含む復元切片画像Qが得られる。復元切片画像Qを構成する各画素には、上述したフラグ「1」または「2」と、アドレスと、チップ領域Rの中心座標とが、属性情報として付されている。
次に、抜き位置指定工程S7において、ユーザは、表示部5上の復元切片画像Qを観察し、復元切片画像Q内の切片Aの所望の位置を、例えば図示しないタッチパネルのようなユーザインタフェースを用いて指定する。演算部15は、指定された位置の画素に付されているアドレスに基づき、復元切片画像Q内のチップ領域Rのうち、指定された位置の画素を含むチップ領域Rを特定し、特定されたチップ領域Rの中心座標を打ち抜き部3に送信する。
この場合には、表示部5に分割切片画像Pも表示し、打ち抜き位置指定工程S7において指定された位置に対応するチップ領域Rが分割切片画像P内のいずれのチップ領域Rであるかをユーザが視覚的に認識できるような処理を分割切片画像Pに対して行う。分割切片画像P内のチップ配列70の像は、実際のチップ配列70を撮影したものであるので、分割切片画像P内の指定されたチップ領域Rが、実際のチップ配列70の中のいずれのチップ7aに対応しているかを、ユーザは容易に識別することができる。
2 光学顕微鏡
3 打ち抜き部
4 画像処理装置
5 表示部
6 データバス
7 基板
7a チップ
70 チップ配列
8 溝
9 シート
10 ステージ
10a 窓
11 対物レンズ
12 撮像部
13 針
13a 針先
14 ホルダ
15 演算部
16 記憶部
A 切片
P 分割切片画像
Q 復元切片画像
S1 画像取得工程
S2 テンプレート作成工程
S3 チップ認識工程
S4 属性情報付与工程
S5 復元工程
S6 表示工程
S7 抜き位置指定工程(指定工程)
S8 採取工程
S9 色補正工程
Claims (4)
- 生体組織の切片が貼り付けられた基板を前記切片と一緒に多数のチップに分割して得られた、前記チップ同士が隙間を空けて2次元的に配列するチップ配列の画像を処理する画像処理方法であって、
前記チップ配列を撮影して、分割された前記切片の全体を含む分割切片画像を取得する画像取得工程と、
該画像取得工程において取得された前記分割切片画像から、前記チップの像を認識するチップ認識工程と、
該チップ認識工程において認識された前記チップの像を構成する画素の各々に対し、その画素が属するチップの像の前記チップ配列の像における位置情報を含む属性情報を付与する属性情報付与工程と、
該属性情報付与工程において前記属性情報を付与された画素からなる前記チップの像同士を1つに繋ぎ合わせることによって、前記分割された切片の像が1つに繋ぎ合わされた復元切片画像を生成する復元工程とを含む画像処理方法。 - 前記復元切片画像内の隣接する前記チップの像の境界において、該境界を挟んで隣接する画素の色を、当該画素の近傍の画素の色に基づいて補正する色補正工程を含む請求項1に記載の画像処理方法。
- 前記属性情報付与工程において、前記分割切片画像を構成する全ての画素に対して、前記チップの像を構成する画素であるか否かを示す領域情報を前記属性情報としてさらに付与し、
前記復元工程において、前記領域情報に基づいて前記チップの像を構成しない画素を削除し、残された前記チップの像を構成する画素同士を1つに繋ぎ合わせることによって、前記復元切片画像を生成する請求項1または請求項2に記載の画像処理方法。 - 請求項1から請求項3のいずれかに記載の画像処理方法と、
前記復元切片画像を表示する表示工程と、
該表示工程において表示された前記復元切片画像に対して、前記切片から採取すべき位置を指定する指定工程と、
該指定工程において指定された位置に対応する画素に付された前記位置情報に基づき、前記チップ配列からチップを採取する採取工程とを含む細胞分取方法。
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE112014006941.8T DE112014006941T5 (de) | 2014-10-31 | 2014-10-31 | Bildverarbeitungsverfahren und Zellsortierungsverfahren |
| PCT/JP2014/079084 WO2016067456A1 (ja) | 2014-10-31 | 2014-10-31 | 画像処理方法および細胞分取方法 |
| JP2016556161A JPWO2016067456A1 (ja) | 2014-10-31 | 2014-10-31 | 画像処理方法および細胞分取方法 |
| CN201480083173.2A CN107076650A (zh) | 2014-10-31 | 2014-10-31 | 图像处理方法以及细胞分取方法 |
| US15/497,985 US20170227448A1 (en) | 2014-10-31 | 2017-04-26 | Image-processing method and cell-sorting method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2014/079084 WO2016067456A1 (ja) | 2014-10-31 | 2014-10-31 | 画像処理方法および細胞分取方法 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/497,985 Continuation US20170227448A1 (en) | 2014-10-31 | 2017-04-26 | Image-processing method and cell-sorting method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016067456A1 true WO2016067456A1 (ja) | 2016-05-06 |
Family
ID=55856838
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2014/079084 Ceased WO2016067456A1 (ja) | 2014-10-31 | 2014-10-31 | 画像処理方法および細胞分取方法 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20170227448A1 (ja) |
| JP (1) | JPWO2016067456A1 (ja) |
| CN (1) | CN107076650A (ja) |
| DE (1) | DE112014006941T5 (ja) |
| WO (1) | WO2016067456A1 (ja) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2019070716A (ja) * | 2017-10-06 | 2019-05-09 | 株式会社ニコン | 位置を決定する装置、方法、およびプログラム、画像を表示する装置、方法、およびプログラム |
| WO2022107435A1 (ja) * | 2020-11-20 | 2022-05-27 | コニカミノルタ株式会社 | 画像解析方法、画像解析システム及びプログラム |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111179264B (zh) * | 2020-01-10 | 2023-10-03 | 中国人民解放军总医院 | 标本的复原图制作方法、装置、标本处理系统、电子设备 |
| JP7437610B2 (ja) * | 2020-05-15 | 2024-02-26 | オムロン株式会社 | 画像検査装置、画像検査方法及び学習済みモデル生成装置 |
| CN113096043B (zh) * | 2021-04-09 | 2023-02-17 | 杭州睿胜软件有限公司 | 图像处理方法及装置、电子设备和存储介质 |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007121837A (ja) * | 2005-10-31 | 2007-05-17 | Olympus Corp | 顕微鏡システム |
| JP2010016695A (ja) * | 2008-07-04 | 2010-01-21 | Nikon Corp | 電子カメラおよび画像処理プログラム |
| WO2011149009A1 (ja) * | 2010-05-28 | 2011-12-01 | オリンパス株式会社 | 細胞分取装置、細胞分取システムおよび細胞分取方法 |
| WO2012066827A1 (ja) * | 2010-11-19 | 2012-05-24 | オリンパス株式会社 | 生体試料調製方法 |
| JP2013020475A (ja) * | 2011-07-12 | 2013-01-31 | Sony Corp | 情報処理装置、情報処理方法、及びプログラム |
| WO2013077337A1 (ja) * | 2011-11-25 | 2013-05-30 | オリンパス株式会社 | 組織分割装置、細胞分取装置、細胞分取システム、組織表示システム、基板、伸展部材、組織分割方法および細胞分取方法 |
| JP2013174709A (ja) * | 2012-02-24 | 2013-09-05 | Olympus Corp | 顕微鏡装置およびバーチャル顕微鏡装置 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6466690C1 (en) * | 2000-12-19 | 2008-11-18 | Bacus Res Lab Inc | Method and apparatus for processing an image of a tissue sample microarray |
| US8014577B2 (en) * | 2007-01-29 | 2011-09-06 | Institut National D'optique | Micro-array analysis system and method thereof |
| US8340389B2 (en) * | 2008-11-26 | 2012-12-25 | Agilent Technologies, Inc. | Cellular- or sub-cellular-based visualization information using virtual stains |
| US10078778B2 (en) * | 2015-01-15 | 2018-09-18 | Massachusetts Institute Of Technology | Systems, methods, and apparatus for in vitro single-cell identification and recovery |
-
2014
- 2014-10-31 WO PCT/JP2014/079084 patent/WO2016067456A1/ja not_active Ceased
- 2014-10-31 JP JP2016556161A patent/JPWO2016067456A1/ja active Pending
- 2014-10-31 CN CN201480083173.2A patent/CN107076650A/zh active Pending
- 2014-10-31 DE DE112014006941.8T patent/DE112014006941T5/de not_active Withdrawn
-
2017
- 2017-04-26 US US15/497,985 patent/US20170227448A1/en not_active Abandoned
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007121837A (ja) * | 2005-10-31 | 2007-05-17 | Olympus Corp | 顕微鏡システム |
| JP2010016695A (ja) * | 2008-07-04 | 2010-01-21 | Nikon Corp | 電子カメラおよび画像処理プログラム |
| WO2011149009A1 (ja) * | 2010-05-28 | 2011-12-01 | オリンパス株式会社 | 細胞分取装置、細胞分取システムおよび細胞分取方法 |
| WO2012066827A1 (ja) * | 2010-11-19 | 2012-05-24 | オリンパス株式会社 | 生体試料調製方法 |
| JP2013020475A (ja) * | 2011-07-12 | 2013-01-31 | Sony Corp | 情報処理装置、情報処理方法、及びプログラム |
| WO2013077337A1 (ja) * | 2011-11-25 | 2013-05-30 | オリンパス株式会社 | 組織分割装置、細胞分取装置、細胞分取システム、組織表示システム、基板、伸展部材、組織分割方法および細胞分取方法 |
| JP2013174709A (ja) * | 2012-02-24 | 2013-09-05 | Olympus Corp | 顕微鏡装置およびバーチャル顕微鏡装置 |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2019070716A (ja) * | 2017-10-06 | 2019-05-09 | 株式会社ニコン | 位置を決定する装置、方法、およびプログラム、画像を表示する装置、方法、およびプログラム |
| JP7006111B2 (ja) | 2017-10-06 | 2022-01-24 | 株式会社ニコン | 位置を決定する装置、方法、およびプログラム、画像を表示する装置、方法、およびプログラム |
| WO2022107435A1 (ja) * | 2020-11-20 | 2022-05-27 | コニカミノルタ株式会社 | 画像解析方法、画像解析システム及びプログラム |
Also Published As
| Publication number | Publication date |
|---|---|
| US20170227448A1 (en) | 2017-08-10 |
| CN107076650A (zh) | 2017-08-18 |
| JPWO2016067456A1 (ja) | 2017-08-10 |
| DE112014006941T5 (de) | 2017-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9530204B2 (en) | Method of preparing biological specimen | |
| WO2016067456A1 (ja) | 画像処理方法および細胞分取方法 | |
| US10867443B2 (en) | Information transformation in digital pathology | |
| CN103999119A (zh) | 图像处理设备、图像处理系统、图像处理方法和程序 | |
| JP2018533116A5 (ja) | ||
| CN109643453B (zh) | 用于基于模板的图像分析的系统和方法 | |
| JP2019505836A5 (ja) | ||
| JP6799821B2 (ja) | 画像生成装置、画像生成方法及びプログラム | |
| US9214019B2 (en) | Method and system to digitize pathology specimens in a stepwise fashion for review | |
| JP2011039872A (ja) | 物品計数装置及び物品計数方法 | |
| US20230215010A1 (en) | Information processing apparatus, information processing method, program, and information processing system | |
| CN115115755B (zh) | 基于数据处理的荧光三维成像方法及装置 | |
| JP5259348B2 (ja) | 高さ情報取得装置、高さ情報取得方法、及びプログラム | |
| JPWO2014132613A1 (ja) | 診断支援システム、診断支援方法及びそのプログラム | |
| CN119936015A (zh) | 一种芯片缺陷检测方法及设备 | |
| US20130215146A1 (en) | Image-drawing-data generation apparatus, method for generating image drawing data, and program | |
| JP2015031599A (ja) | 画像重ね合わせ方法 | |
| CN111091598A (zh) | 多光斑同步测量分析方法及装置 | |
| JP6202984B2 (ja) | 細胞分取方法 | |
| US11674889B2 (en) | Culture state determination based on direction-dependent image information | |
| US12051266B2 (en) | Information processing apparatus, information processing method, and storage medium | |
| CN108615235A (zh) | 一种对颞耳图像进行处理的方法及装置 | |
| JP2017083788A5 (ja) | 画像処理装置、画像処理方法及びプログラム | |
| US20190113459A1 (en) | Observation assistance device and fluorescence observation system | |
| KR20250093975A (ko) | 다중 깊이 카메라 기반 과일 부피 실시간 측정 장치 및 방법 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14904770 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 112014006941 Country of ref document: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2016556161 Country of ref document: JP Kind code of ref document: A |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14904770 Country of ref document: EP Kind code of ref document: A1 |