[go: up one dir, main page]

WO2015150320A1 - Segmentation de structures d'organes tubulaires - Google Patents

Segmentation de structures d'organes tubulaires Download PDF

Info

Publication number
WO2015150320A1
WO2015150320A1 PCT/EP2015/056882 EP2015056882W WO2015150320A1 WO 2015150320 A1 WO2015150320 A1 WO 2015150320A1 EP 2015056882 W EP2015056882 W EP 2015056882W WO 2015150320 A1 WO2015150320 A1 WO 2015150320A1
Authority
WO
WIPO (PCT)
Prior art keywords
cross
section
vessel
radius
bifurcation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2015/056882
Other languages
English (en)
Inventor
Rahul Prasanna KUMAR
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Universitetet i Oslo
Original Assignee
Universitetet i Oslo
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Universitetet i Oslo filed Critical Universitetet i Oslo
Publication of WO2015150320A1 publication Critical patent/WO2015150320A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/174—Segmentation; Edge detection involving the use of two or more images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/12—Edge-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30101—Blood vessel; Artery; Vein; Vascular
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30172—Centreline of tubular or elongated structure

Definitions

  • the present invention relates to a method for segmentation of tubular organ structures, such as fluid carrying vessels within the body, for example segmentation of blood vessels.
  • the method may be used to visualise or map the vessels within the body.
  • the invention also extends to an apparatus and a computer programme product for performing the method.
  • the human body contains several different types of blood vessels that constitute a network of arteries and veins. Visualization of these blood vessels is important for improving the planning and navigation in several interventional procedures. It is specifically relevant in catheter based procedures like stent graft positioning and valve replacement and also, in planning and navigation of laparoscopic liver resection.
  • Detailed images of these blood vessels are initially formed using computerized tomography (CT) and/or magnetic resonance (MR) depending on the part of the body and equipment available.
  • CT computerized tomography
  • MR magnetic resonance
  • centreline and radius information at different cross-sections of the blood vessel are also crucial for navigating the catheter.
  • the centreline of the blood vessels can be used as a guiding path for the catheter and radius information will help the interventionists in selecting the right valve or stent for the specific procedure.
  • the centreline extraction may also be useful for fast registration and update of the blood vessel models generated during the intervention. Even though other methods are available for registration, centreline based methods have proven to be fast.
  • the techniques used for blood vessel segmentation can also be used for visualisation and mapping of other tubular organ structures in the body, airways, nerve axons and so on.
  • the most common methods used today for blood vessel segmentation, and visualisation of other tubular organ structures in the body are based on either multi scale - space or model detection approaches. Both of these techniques require a large amount of processing time and/or put a large load on computer processing resources.
  • the Frangi vesselness method involves fitting a 3-D shape to the blood vessel based on a filtering process.
  • the Hessian matrix is used in an analysis of image data to determine the degree to which a tubular structure in the image matches an ideal tubular structure. This allows for an estimation of, and hence a
  • the Frangi method is often combined with thinning as described in T.-C. Lee, R. L. Kashyap, and C.-N. Chu, "Building skeleton models via 3-d medial surface axis thinning algorithms," CVGIP: Graphical Models and Image Processing, vol. 56, no. 6, pp. 462-478, 1994, and this combined method is typically referred to as Frangi and Lee.
  • US 2003/0056799 discloses one example of segmentation that uses the Frangi method. Cylinders are fitted in a cylindrical structure in order to understand the complete structure. The fitting is done by multiscale vesselness according to Frangi, with region growing. The method of US 2003/0056799 is considered to be relatively time consuming.
  • US 2007/0249912 is another example disclosure of the use of Frangi vesselness for vessel detection and vessel cross-section detection.
  • Seed points are used to identify image regions that are known to be within the vessel of interest.
  • the seed points are starting points for mapping of the vessel.
  • the vessel boundaries are detected using a watershed algorithm in 2D cross-section and the visualisation of the vessel is propagated along the course of the imaged vessel using statistical front propagation of the previous found output.
  • the present invention provides: a method for segmentation of tubular organ structures in three dimensional (3D) image data, the method comprising: extracting a two dimensional (2D) representation of a cross-section of the structure at the seed point; estimating a radius of the structure at the seed point; applying a circle structure enhancement filter to the two dimensional representation; thereby identifying a centre point of the structure at the seed point; extrapolating along a direction of the structure to find another point on the structure, which is defined as a new seed point; and repeating the method to thereby trace the direction and radius of the tubular organ structure.
  • 2D two dimensional
  • a circle structure enhancement filter also referenced herein as a 'circleness' filter, provides an efficient way to find a centre point of the 3D structure of the tubular organ based on a 2D representation of the cross-section.
  • the starting seed point may be provided by the user or it may be obtained via computer image recognition. Subsequent seed points, for propagation of the trace along the course of the structure in the body, are determined based on the previously calculated centre point of the structure and on the direction of the structure.
  • the direction of the structure for the starting seed point may be provided by the user or it may be obtained via computer image recognition. For subsequent seed points it is preferred for the direction to be based on the previous results.
  • the direction to find the next seed point could be based on extrapolation of a direction from the previous two or more seed points, for example based on a line fitted to the co-ordinates of prior seed points and extended.
  • the direction of the structure is determined in accordance with equation (1 ) below. Other techniques could also be used. What is important for the preferred method is that the previous centre points, determined by the circle structure enhancement filter, are used to estimate the position of the next seed point, and at this next seed point the circle structure enhancement filter is again used to find a new centre point.
  • the next seed point does not necessarily need to be close to the centre of the structure, provided that it remains within the extent of the structure in the next two dimensional representation.
  • the distance between seed points may be set by the user or adjusted automatically based on parameters of the structure. For example, the distance between seed points could be set based on the radius of the structure. This helps ensure that propagation of the structure proceeds at an appropriate 'resolution' give the size of the structure. In a preferred embodiment the distance between first and second seed points is the same as the radius at the first seed point.
  • the starting seed point is placed at the main trunk in a network of structures, i.e. before any branching of the structures.
  • the user may place multiple starting seed points, so that each network of structures can be traced.
  • the method may comprise determining eigenvalues and eigenvectors for the structure at the seed point by eigenanalysis to thereby find principle directions of curvature of the structure; and extracting the two dimensional (2D) representation of the cross-section of the structure at the seed point based on the results of the eigenanalysis.
  • the eigenvectors provided by this eigenanalysis may be used for finding the radius of the structure in the two dimensional representation.
  • the eigenanalysis at the seed point is preferably based on the three dimensional Hessian matrix combined with a Gaussian convolution for a scale varying with the width of the structure. In one example this is carried out based on equation (3) below.
  • an edge-detection filter such as a Canny edge detection filter, may be used in order to identify the edge of the structure. It is preferred to measure the width of the structure in at least two cross-directions, preferably more than two, and to take the largest dimension as the radius. This allows for elliptical shapes.
  • the circle structure enhancement filter is applied only to data identified as being within the structure. For example, this may be the data for the two dimensional representation that is within the edge of the structure. This further reduces the processing burden without any loss in accuracy.
  • the circle structure enhancement (circleness) filter may make use of an
  • a circle enhancement ratio is defined based on the two eigenvalues for the two dimensional representation, wherein the circle enhancement ratio is the modulus of the ratio of the sum of the eigenvalues divided by the difference between the two eigenvalues. This circle enhancement ratio will be larger for pixels at the centre of the cross-section of the structure than for pixels closer to the edge of the structure. The peak value of the circle enhancement ratio hence indicates a centre point for the structure.
  • the circle enhancement ratio is as shown in equation (5) below. This may be used in a circleness filter as shown in equation (6) below, with a first component of the equation providing a measurement of how circular the image is and a second component of the equation providing noise reduction by means of a 'structureness' term as in equation (7) below.
  • bifurcation analysis to reflect the fact that in a large proportion of cases bifurcations are the only form of split for a tubular organ structure, especially structures in the form of vessels such as blood vessels and airways.
  • the bifurcation analysis is not necessarily only for bifurcations and may also identify trifurcations and even divisions of a trunk of the tubular structure into greater numbers of branches.
  • the method determines that a splitting of the structure such as a bifurcation may be present and a bifurcation analysis is performed.
  • a significant increase in radius may be defined as a radius increase above a set threshold for a given distance between seed points, for example a radius increase of greater than the distance between the current seed point and the previous seed point, a radius increase of greater than 50% of the distance between the current seed point and the previous seed point, or an increase in radius of above 150% of the previous radius.
  • the method may alternatively or additionally determine that a bifurcation may be present by detecting an increase and decrease in radius in consecutive cross-sections.
  • Circularity may be defined as the ratio between the square of the perimeter length of the structure cross-section and it's area. A perfect circle has the maximum area for a given perimeter and hence gives the smallest ratio. A less circular shape will give a larger value.
  • the method may include calculating a circularity ratio and determining that a splitting of the structure is present when the circularity ratio is above a threshold value.
  • Radius variance may be defined as the variance in distance from a centre point to the perimeter of the cross-section.
  • the method may include determining radius variance and determining that a splitting of the structure is present when the radius variance exceeds a threshold value. Detection of a splitting of the structure may use circularity and radius variance in parallel, with a splitting being identified when one or both exceed a respective threshold value. As with the method above, when a splitting of the structure is detected then a bifurcation analysis is performed.
  • the bifurcation analysis may comprise determining multiple centre points for the structure at the point of bifurcation, such that subsequent propagation of the trace of the structure will have multiple seed points and can hence follow multiple paths.
  • the method may include reverting to non-bifurcation analysis, with only a single centre point being found for each path, when it has been determined that the bifurcation is complete. This may be, for example, when the two dimensional cross-section shows multiple distinct structures.
  • the multiple centre points may be determined by applying a circle structure enhancement (circleness) filter to identify multiple possible circle centres.
  • a circle structure enhancement (circleness) filter When the cross- section of the structure in the two dimensional representation is at a bifurcation or other split then the increase in radius will be an increase in maximum radius and, for a bifurcation typically the result will be an elliptical shape at the start of the bifurcation, progressing to a two-lobed shape (for example, a figure eight) and then eventually becoming two separate structures. A split into more than two branches will form a more complex three lobed shape.
  • a suitable circle structure enhancement (circleness) filter will produce multiple peak values indicative of multiple possible centre points. This then allows multiple seed points to be set for the next stage of propagation of the structure. For example, the two dimensional circle enhancement ratio described above may be applied, with the result being a mapping with multiple peaks of the ratio at multiple points spaced apart from the lobes of the structure cross-section.
  • the method may switch to a bifurcation analysis using three dimensional data and fitting three dimensional shapes to the data.
  • This increases the processing required, but it can provide advantages when the structure undergoes complex bifurcations (for example involving a reversal of direction for one branch after splitting) and/or where the structure splits into more than two branches. This can occur, for example, in the blood vessels of the human liver.
  • a 3D method can more effectively trace complicated splitting patterns since the 3D samples of the image can overlap.
  • the vesselness analysis could be any known technique, for example the commonly used Frangi method. It is preferred to use an enhanced 3D method developed by the current inventors, as described in detail in R. P. Kumar, F. Albregtsen, M. Reimers, T. Lang0, B. Edwin, and O. J. Elle, "3d multiscale vessel enhancement based centerline extraction of blood vessels," in SPIE Medical Imaging. International Society for Optics and Photonics, 2013, pp. 86 691X-86 691 X. It is of course important to understand that the current proposal differs significantly from the prior art in that the 3D analysis is applied only for bifurcations and ceases once the bifurcation has passed. In the prior art the 3D analysis is used for the whole structure, leading to significant disadvantages in processing time.
  • the method comprises a vesselness equation determined from an eigenanalysis, preferably based on the Hessian matrix and a Gaussian convolution, for example a vesselness equation as set out in equation (8) below. It is preferred for the vesselness equation to be modified by addition of a term for noise correction, for example as set out in equation (10) below.
  • a vesselness equation determined from an eigenanalysis, preferably based on the Hessian matrix and a Gaussian convolution, for example a vesselness equation as set out in equation (8) below. It is preferred for the vesselness equation to be modified by addition of a term for noise correction, for example as set out in equation (10) below.
  • the image data that is utilised in the above discussed method can be any suitable three dimensional image data, for example MR images, Computer Tomography (CT) images, Rotational angiography, Confocal Microscopy, Focal Modulation Microscopy, Optical Coherence Tomography (OCT) or three dimensional ultrasound images.
  • CT Computer Tomography
  • OCT Optical Coherence Tomography
  • the images can show the structures with sufficient contrast to the surrounding tissue, in order that the extent of the structures can be determined by edge detection or similar techniques.
  • the method is generally applicable to tubular organ structures that can be viewed in this type of image. It is envisaged that an important application will be segmentation of blood vessels, but the method could also be used for other fluid vessels, such as airways, urinary tracts and so on. It could also be used for other tubular organ structures, for example nerve axons. It is preferred for the method to be used as part of imaging of three dimensional networks of structures within the human or animal body.
  • the invention provides a computer programme product containing instructions that, when executed, will configure a data processing apparatus to perform the method of the first aspect and optionally any or all of the further method steps described above.
  • the invention provides a data processing apparatus configured to perform the method of the first aspect and optionally any or all of the further method steps described above.
  • Figure 1 is a flowchart showing a segmentation process
  • Figure 2 is a diagram illustrating a sequence of 2D cross-sections of a blood vessel as used for segmentation in the method described herein;
  • Figure 3 illustrates the sudden change in radius that occurs at a bifurcation
  • Figure 4 shows the eigenvalues along principle directions of a tubular structure using the notation adopted herein;
  • Figure 5 shows (a) a cross-section of a vessel at a seed point and (b) Canny output from the cross-section image, with width d1 and height d2;
  • Figure 6 shows (a) a 2D cross-section input image of a vessel and (b) output from a 'circleness' filter applied to the 2D cross-section as described herein;
  • Figure 7 shows (a) a 2D cross-section input image of a vessel at a bifurcation and (b)
  • Figure 8 shows: (a)(f)(k)(p)(u) Maximum intensity projection (MIP) images of input medical image, with circles representing the seed points, (b)(g)(l)(q)(v) MIP images of centrelines extracted using Frangi and Lee, (c)(h)(m)(r)(w) MIP images of centrelines extracted using an enhanced prior art 3D/vesselness method, (d)(i)(n)(s)(x) MIP images of centrelines extracted using the method described herein, and (e)(j)(o)(t)(y) 3D model visualizations of blood vessels segmented using this method;
  • Figure 9 is a plot showing mean and standard deviation of centre estimation error of the propose method for various vessel radii
  • Figure 10 shows the percentage of bifurcating vessels not detected at various bifurcation radii using the 3D bifurcation analysis described herein;
  • Figure 1 1 shows a workflow for another proposed segmentation process
  • Figure 12 is a vessel cross-section image indicating vessel cross vectors v 2 and v 3 as used in the process of Figure 1 1 ;
  • Figure 13 illustrates shape descriptor values at various cross-section images along a blood vessel
  • Figures 14(a) and 14(b) show intensity plots as follows: (a) top row: vessel trunk cross-section image and its 3D intensity plot, (a) bottom row: single scale circleness image of trunk cross-section image and its 3D intensity plot; (b) top row: vessel bifurcation cross- section image and its 3D intensity plot, and (b) bottom row: multi-scale circleness image of bifurcation cross-section image and its 3D intensity plot.
  • the methods described herein are based on local structure analysis within the connected regions of the tubular organ structures, which are blood vessels in the current examples. It will of course be appreciated that the same techniques are applicable to other tubular organ structures in the body or elsewhere: segmentation of a blood vessel is just one preferred use for the methods described herein. The methods require that the structures can be shown with sufficient contrast in images such as MR, CT or ultrasound images.
  • FIG. 1 One process is shown as a flow chart in Figure 1. This method is mainly divided into trunk analysis and bifurcation analysis. In the trunk analysis, the vessel is segmented using 2D cross-section analysis and in bifurcation analysis, the vessel is segmented using modified vesselness. The examples use angiogram images.
  • the proposed method is found to be on average more than twenty times faster than prior art multiscale (Frangi) vesselness with thinning and more than seven times faster than the inventors' own earlier method of blood vessel centreline extraction. Also, the centreline extraction was found to be highly accurate with a mean error of less than 1 mm on comparison to the corresponding geometric centres.
  • the preferred embodiments of the new method include blood vessel segmentation, centreline extraction and radius detection method, with the main aim of reducing the processing time by processing only the interested blood vessel regions of the image.
  • the method lets the user select the vessels that need to be segmented and the method is performed only within the limits of these vessels.
  • the basic strategy of the method is to trace the vessel starting from a user provided seed point and direction.
  • the tracing can continue to the end points of the continuous vessel or to the end of the image data, or it can of course be stopped by the user at some earlier point.
  • Figure 1 shows an overall process flow diagram of an algorithm for the method.
  • Figure 2 illustrates a visualisation of the method as applied to a blood vessel with a bifurcation
  • a direction seed is a point that the user initiates in the intended direction of tracking. The vector connecting the two points gives the tracking direction
  • T is the tracking direction
  • (x s , y s , z s ) is the seed point
  • (x d , y d , z d ) is direction seed
  • t is the unit vector along the tracking direction.
  • the algorithm finds the radius and the local threshold at the 2D cross-section of blood vessel at the seed point (see below).
  • the radius and local threshold is used in the trunk analysis for finding 2D cross-section of the blood vessel.
  • the centre, circleness output and next possible centre along the unit tracking direction of the blood vessel are calculated (see below). The next possible centre is then set as the new seed and added into the seed list.
  • the method can detect bifurcations working on the principle that there is a significant change in radius at the blood vessel bifurcation compared to the neighbouring blood vessel trunks, as shown in Figure 3, which is an illustration on sudden change in radius at the blood vessel bifurcation compared to radius at the blood vessel trunks, where D T1 , D T2 and D T3 are the diameters at different vessel trunks, and D B is the diameter at vessel bifurcation.
  • bifurcation analysis On detecting a significant change in radius, the process is passed into bifurcation analysis.
  • bifurcation analysis a 3D modified multi-scale vesselness is applied to the 3D volume around the bifurcation and the output is used to find new centres at the bifurcation (see below). These new centres are then passed into the seed list as new seeds to continue the loop and the algorithm loop is terminated when the new seed found, is outside the blood vessel.
  • the whole 3D segmented volume of the blood vessel is found by combining all the previously found circleness and vesselness outputs.
  • the circleness outputs include all the 2D circleness filtered images at each and every cross-section of the blood vessel trunk.
  • the vesselness outputs include 3D multi-scale vesselness filtered images at all the blood vessel bifurcations.
  • a neighbourhood around each 3D voxel position of the circleness output is also checked to see if the neighbouring positions are inside the vessel region and added into the final 3D blood vessel output. This eliminates the possible gaps on combining 2D cross-section outputs to form a 3D vessel output.
  • the 2D cross-section image of the blood vessel is determined at a seed point and the radius at that cross-section.
  • the blood vessel direction and vessel cross directions must be calculated.
  • the tracking direction t is set as the vessel direction and vessel cross directions are set as cross vectors of t.
  • calculation of vessel direction and vessel cross directions are needed.
  • Hessian H of the image I describes the second-order structure of local intensity variations at each voxel.
  • the derivative computation of the Hessian matrix is combined with Gaussian G(o) convolution, for a scale ⁇ which varies accordingly to the width of the blood vessel. For this purposes, previous radius is set as ⁇ .
  • the Hessian matrix H can be formulated as
  • ⁇ 1 is the eigenvalue along the direction of the vessel
  • ⁇ 2 and ⁇ 3 are the eigenvalues along the vessel cross section.
  • Their corresponding eigenvectors are v , v 2 , and v 3 . Accordingly, v is set as the new tracking direction or vessel direction, and v 2 and v 3 are set as the vessel cross directions.
  • Vessel cross directions, v 2 and v 3 are used to find an interpolated 2D blood vessel cross-section image at the seed point, similar to the one shown in Figure 5a.
  • An interpolated cross-section image is a more precise representation of the cross-section, rather than cross-section images from discrete locations of original image.
  • Calculating radius of the blood vessel at the cross-section requires determination the borders of the blood vessel. As the blood vessel intensity is different from that of its bordering pixels, the edges can be detected by a Canny edge detection filter, as shown in Figure 5b. Along the vessel cross directions, two lengths of the cross-section are found by propagating outwards from the seed point towards the boundaries. The radius is estimated from the largest length, so as to consider more elliptical shapes. An average of all the edge intensities provides the local threshold at that blood vessel cross-section.
  • the blood vessel trunk cross-sections are analysed to find the blood vessel cross-section filtered image and the centre of the cross-section for finding the next possible centre along the blood vessel.
  • the blood vessel cross-section filtered image is an image where the cross-section is enhanced, resulting in a Gaussian profile where the peak is the centre of the vessel cross-section.
  • a new circle structure enhancement filter or 'circleness' filter is formulated for getting a blood vessel cross-section enhanced image.
  • the circleness method is based on 2D eigenanalysis of 2D Hessian matrix obtained from the cross-section image. Similar to Eq. 3,
  • the eigenvalues 1 2 DI an d ⁇ -202 calculated from eigenanalysis of the two dimensional Hessian matrix H 2D are used for analysing the structural information of the cross-section image.
  • a 2 DI I ⁇ 2D2 I is formulated as
  • Figure 5a shows a 2D cross-section input image with blood vessel connected region; and Figure 5b shows the 'circleness' filter output of 2D cross-section image.
  • the circleness C is only applied at connected region inside the blood vessel cross-section. This eliminates the enhancement of possible neighbouring blood vessel cross- sections or other circle-like objects that fall within the 2D cross-section image.
  • Figure 6b shows an example of circleness filter applied to the blood vessel connected region of the 2D cross-section as shown in Figure 6a.
  • the circleness output gives a Gaussian-like profile, where the peak of the output is the centre of the blood vessel cross-section.
  • the next possible centre or the seed point for the next cross-section along the vessel direction of blood vessel is calculated using the local vessel direction.
  • the new seed is then saved into seed list to continue processing.
  • the algorithm moves to a bifurcation analysis.
  • a 3D structural analysis is performed to understand the different vessel tracks being bifurcated.
  • the use of a 3D analysis will of course require more data processing time than a 2D bifurcation analysis, as described below but this may be balanced by increases in accuracy.
  • a 3D analysis can produce results that are sufficiently more accurate to justify the extra processing burden, in some situations. For example, when there is a trifurcation or several bifurcations close together then the 2D approach may not have sufficient 'resolution' to correctly follow the vessel paths without user input. This is because there is inevitably a volume between each 2D 'slice' of the vessel that is not taken into account. With a 3D analysis each volume that is analysed can overlap, which means that all available data can be used.
  • V ⁇ °' if V ° ⁇ 0 ' (1 1 ) [ ⁇ ⁇ ⁇ ⁇ , othervise
  • a multiscale analysis is performed using a range of scales between o min and o max for detecting vessels of varying width.
  • the multiscale modified vesselness equation is
  • V mu i t i max amin ⁇ (J ⁇ (Jmax V ⁇ a) (12) where a max is half of the maximum length of bifurcation cross-section and a min is set less than one third of o max , to consider all possible vessel ranges.
  • Figure 7 shows (a) the 2D cross-section images at bifurcation input and (b) the corresponding modified vesselness output at the bifurcation cross-section.
  • an eigen analysis is performed using the Hessian matrix Eq. 3, to find the directions of the bifurcating vessels.
  • the vessel directions are then used to find the next possible centre or seed locations at each of the bifurcating vessels.
  • the new seeds are saved into the seed list and the algorithm loop continues until seeds go out of the connected blood vessels or outside the image region.
  • FIG. 8 shows a comparison of results obtained with Frangi and Lee, the earlier enhanced 3D method and the proposed method on the medical images.
  • Figure 8 also shows the blood vessel segmentation output from the proposed method for the different MR angiogram images. All methods were coded using C++ and ITK libraries (as described in L. Ibanez, W. Schroeder, L. Ng, and J. Cates, "The itk software guide,” 2003).
  • Table 1 shows the processing time for centreline extraction of blood vessels by different methods. All the images discussed have different image sizes and number of bifurcations, but have the same voxel size of 1 mm x 1 mm x 1 mm.
  • images 1-5 are medical images of blood vessels and images 6-8 are synthetic blood vessel-like images.
  • the proposed method is shown to be more than twenty times faster than the Frangi and Lee method and more than seven times faster than the earlier enhanced 3D method.
  • Image 1 384x384x82 386s 1 1 1 s 21 s
  • the evaluation of the centreline extracted using the proposed method was done against the geometric centre.
  • the geometric centre at each blood vessel cross-section was estimated by applying Hough circle detection and calculating the centre of the detected circle, which is the blood vessel cross-section (see, for an example, E. Davies, "A modified Hough scheme for general circle location," Pattern Recognition Letters, vol. 7, no. 1 , pp. 37- 43, 1988).
  • Figure 9 shows the mean and standard deviation of centre estimation error of the proposed method.
  • Figure 10 shows the percentage of bifurcating vessels not detected at various bifurcating vessel radius. The figure clearly shows that the accuracy of the algorithm in detecting bifurcation increase with increase in radius.
  • Figure 1 1 shows another possible method. This is similar but in place of 3D vesselness for the bifurcation analysis the method uses 2D circleness fitting multiple circles. There are some other differences as well, including an alternative way to detect the bifurcation. It will be appreciated that various elements of this second method, such as the bifurcation detection steps, could be used in place of the equivalent parts of the first method described above.
  • Figure 1 1 focuses on segmenting the 3D connected blood vessels by tracking its cross-sections from a user-initialized seed to the ends of the blood vessel.
  • the user initially initializes a seed point, a direction seed point and an approximate blood vessel cross-section radius at the seed point, for the proposed method to begin.
  • Figure 1 1 shows the workflow of the proposed method for segmenting the blood vessels by analysis and tracking of the blood vessel cross-section images.
  • the method is dived into four parts, namely, cross-section image, preprocessing for cross-section image analysis, bifurcation detection and circleness filter.
  • the first part describes how the cross-section image is calculated at a seed point and its corresponding cross-sections.
  • the second part describes all the preprocessing steps required for further cross-section analysis.
  • the third part describes how a cross-section is classified as a bifurcation.
  • the fourth and final part describes the novel circleness filter, which is used for circle enhancement and subsequent centerline extraction.
  • the tracking direction of the connected blood vessel of interest is estimated using the user-provided seed point and direction seed point.
  • the direction seed point used to specify the direction in which the blood vessel is to be segmented.
  • the tracking direction is the vector connecting the seed point and the direction seed point,
  • T x s - x d )l + y s - y d )j + (z s - z d )k (13)
  • i W ⁇ (14)
  • T is the tracking direction
  • (x s , y s , z s ) is the seed point
  • (x d , y d , z d ) is direction seed
  • t is the unit vector along the tracking direction.
  • the tracking direction is used only at the seed point to understand the direction of segmentation.
  • the tracking direction is set as the vessel direction of flow and its cross vectors are set as the approximate vectors representing the cross-section of the blood vessel.
  • an eigenanalysis of the Hessian matrix is calculated for precise information of the vessel cross-section vectors.
  • Eigen analysis can geometrically interpret the second order derivatives of an image at each point.
  • the second order differential quantity for a volume / (x, y, z) with a Gaussian convolution g a (x,y,z), is given by the indefinite Hessian matrix,
  • ⁇ is the scale parameter set according to the radius of the blood vessel.
  • the user defined initial radius is set as the ⁇
  • the previous cross-section radius is set as the ⁇ .
  • eigenvalues of Hessian matrix H be ⁇ 1 , ⁇ 2 and ⁇ 3 , and their respective normalized eigenvectors be represented by v , v 2 and v 3 .
  • the eigenvector v 1 represents the vessel direction
  • the eigenvectors v 2 and v 3 represent the vessel cross-section vectors.
  • These vessel cross-section vectors are used to create the vessel cross-section image as shown in Figure 12. The vessel cross-section image is found by interpolating at discrete set of points along the 2D plane represented by the two cross vectors, v 2 and v 3 .
  • the first and foremost step is to find the border of the vessel cross-section. This is found by applying a Canny edge detection filter on the cross-section image, as the blood vessel intensity is different from that of its surroundings. 2D Gaussian smoothing filter is applied at the beginning of the Canny filter to smooth out noise, where the variance is proportional to the square of previous radius or the initial user-set radius.
  • Figure 5 shows the border of a blood vessel cross-section after applying the canny edge detection method. Each border pixel obtained through canny represents the discrete border contour of the vessel cross-section.
  • the center candidate is a possible center pixel at a cross-section
  • each of the vessel cross-section images is checked to determine if it is a bifurcation.
  • the contour of vessel bifurcation cross-section is very different from the contour of the vessel trunk cross-section.
  • Figure 13 shows the difference in the shape of the vessel cross-sections between trunk and bifurcation.
  • Circularity is a measure of compactness of a structure or how circular a given contour is. It can be defined as
  • Circularity P 2 /A (17) where P is the Perimeter of the vessel cross-section shape and A is the area of vessel cross-section.
  • Radius variance is the variance in distance from the center candidate to the border points or vessel cross-section contour.
  • B (n) represent the boundary contour points and cp be the candidate center point.
  • D the set of distances from the center to the boundary contour points.
  • Fig. 13 illustrates how the shape descriptor values change as the cross-section changes from vessel trunk to the vessel bifurcation.
  • the sudden change in the shape descriptors resembles the change in vessel cross-section border, signifying bifurcation.
  • the process goes forward in enhancing the structure accordingly and finding the center of cross-section.
  • a novel circleness filter is implemented enhancing circular-near images in the image and provide a good Gaussian profile for the output intensity.
  • the filter adopts the scale space approach with the possibility of performing the operation in single or multiscale approaches.
  • single scale approach is used to enhance the cross-section at vessel trunk and multiscale space approach is used to enhance the cross-section at vessel bifurcation.
  • the circleness filter or circle enhancement filter is based on 2D Eigen analysis on the 2D Hessian matrix computed at each pixel of the vessel cross-section image. Similar to Eq. 15, 2D Hessian matrix is,
  • I 2D is the vessel cross-section image
  • g 2Da is the 2D Gaussian filter
  • ⁇ is the scale parameter set according to the vessel cross-section radius, which is found at the preprocessing step.
  • ⁇ 2 ⁇ 1 and 2D2 be the eigenvalues from the 2D Hessian matrix. These eigenvalues are used to understand the structural information of at pixel of the cross-section image.
  • the circleness filter is formulated with the knowledge that both the eigenvalues will be high at the center of the cross-section as the cross-section is near circular in nature.
  • the circleness filter is applied only inside the vessel cross-section region.
  • the region of interest is determined by applying the local threshold found at the preprocessing step.
  • Figure 14(a) shows the single scale circleness filter output on vessel trunk cross-section image.
  • the single peak obtained from the single scale circleness filter applied to vessel trunk cross-section is the center of that cross-section. Moving along the vessel direction v from the current center, the next possible center or the next center candidate for the next cross-section is found at the vessel trunk.
  • multiscale circleness filter is applied. This allows determination of multiple peaks, where each corresponds to a bifurcating vessel.
  • the multiscale circleness is formulated as,
  • o min is the minimum radius and o max is the maximum radius.
  • o max is set as the radius of the current cross-section calculated at the preprocessing step and a min is set as one-third value of a max .
  • Figure 14(b) shows the multiscale circleness filter output with multiple centers at the vessel bifurcation cross-section image, where each center corresponds to a different bifurcating vessel. Each of the centers found at the bifurcation cross-section is set as a new seed for the whole process to start again.
  • the immediate surrounding 3D neighborhood is also checked and added as part of the vessel, if they fall within the local vessel threshold. This helps in reducing the gaps that might be caused by processing 2D slices along a 3D blood vessel.
  • the vessel cross-section tracking finally stops, when the newly found center candidate falls outside the connected blood vessel region.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Image Processing (AREA)

Abstract

L'invention se rapporte à un procédé pour la segmentation de structures d'organes tubulaires en données d'images tridimensionnelles (3D), qui comprend : l'extraction d'une représentation bidimensionnelle (2D) de la coupe transversale de la structure au point-graine ; l'estimation du rayon de la structure au point-graine ; l'application d'un filtre d'accentuation de structure circulaire sur la représentation bidimensionnelle ; l'identification, grâce à ce qui précède, du point central de la structure au point-graine ; l'extrapolation dans une direction de la structure afin de trouver un autre point sur la structure, qui devient un nouveau point-graine ; et la réexécution du procédé pour déterminer ainsi la direction et le rayon de la structure. Le procédé peut servir à segmenter des vaisseaux sanguins au moyen de données d'images obtenues par IRM, CT ou ultrasons.
PCT/EP2015/056882 2014-04-01 2015-03-30 Segmentation de structures d'organes tubulaires Ceased WO2015150320A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1405837.4 2014-04-01
GBGB1405837.4A GB201405837D0 (en) 2014-04-01 2014-04-01 Segmentation of tubular organ structures

Publications (1)

Publication Number Publication Date
WO2015150320A1 true WO2015150320A1 (fr) 2015-10-08

Family

ID=50737802

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2015/056882 Ceased WO2015150320A1 (fr) 2014-04-01 2015-03-30 Segmentation de structures d'organes tubulaires

Country Status (2)

Country Link
GB (1) GB201405837D0 (fr)
WO (1) WO2015150320A1 (fr)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106875375A (zh) * 2016-12-28 2017-06-20 浙江工业大学 基于管状特征增强滤波和脊线跟踪的三维血管中轴线提取方法
WO2018081607A3 (fr) * 2016-10-27 2018-08-09 General Electric Company Procédés pour systèmes de génération de modèles multidimensionnels virtuels à l'aide d'une analyse d'image
CN109993729A (zh) * 2019-03-20 2019-07-09 北京理工大学 血管跟踪方法及装置
CN111738981A (zh) * 2020-05-26 2020-10-02 中国人民解放军海军军医大学第三附属医院 对4-d时序肝脏ct图像数据进行血管分割的方法
US11024100B2 (en) 2016-08-10 2021-06-01 Ucl Business Ltd Method and apparatus for transforming physical measurement data of a biological organ
CN114514558A (zh) * 2019-08-26 2022-05-17 皇家飞利浦有限公司 分割管状特征

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5699799A (en) * 1996-03-26 1997-12-23 Siemens Corporate Research, Inc. Automatic determination of the curved axis of a 3-D tube-shaped object in image volume

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5699799A (en) * 1996-03-26 1997-12-23 Siemens Corporate Research, Inc. Automatic determination of the curved axis of a 3-D tube-shaped object in image volume

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
FRANGI A F ET AL: "Multiscale vessel enhancement filtering", MULTISCALE VESSEL ENHANCEMENT FILTERING,, 1 January 1998 (1998-01-01), pages 130 - 137, XP002674999, ISBN: 3-540-65136-5 *
KUMAR RAHUL PRASANNA ET AL: "Three-Dimensional Blood Vessel Segmentation and Centerline Extraction based on Two-Dimensional Cross-Section Analysis", ANNALS OF BIOMEDICAL ENGINEERING, PERGAMON PRESS, OXFORD, GB, vol. 43, no. 5, 15 November 2014 (2014-11-15), pages 1223 - 1234, XP035494743, ISSN: 0090-6964, [retrieved on 20141115], DOI: 10.1007/S10439-014-1184-4 *
RAHUL P. KUMAR ET AL: "3D multiscale vessel enhancement based centerline extraction of blood vessels", PROCEEDINGS OF SPIE, vol. 8669, 13 March 2013 (2013-03-13), pages 86691X, XP055209000, ISSN: 0277-786X, DOI: 10.1117/12.2006779 *
YANG JINZHU ET AL: "An Algorithm for Circle Filter Based Multi Scale Application for Enhancement of Pulmonary Nodules", BIOINFORMATICS AND BIOMEDICAL ENGINEERING, 2008. ICBBE 2008. THE 2ND INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 16 May 2008 (2008-05-16), pages 2663 - 2668, XP031267884, ISBN: 978-1-4244-1747-6 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11024100B2 (en) 2016-08-10 2021-06-01 Ucl Business Ltd Method and apparatus for transforming physical measurement data of a biological organ
WO2018081607A3 (fr) * 2016-10-27 2018-08-09 General Electric Company Procédés pour systèmes de génération de modèles multidimensionnels virtuels à l'aide d'une analyse d'image
US10740651B2 (en) 2016-10-27 2020-08-11 General Electric Company Methods of systems of generating virtual multi-dimensional models using image analysis
CN106875375A (zh) * 2016-12-28 2017-06-20 浙江工业大学 基于管状特征增强滤波和脊线跟踪的三维血管中轴线提取方法
CN106875375B (zh) * 2016-12-28 2019-07-30 浙江工业大学 一种基于管状特征跟踪的三维血管中轴线提取方法
CN109993729A (zh) * 2019-03-20 2019-07-09 北京理工大学 血管跟踪方法及装置
CN114514558A (zh) * 2019-08-26 2022-05-17 皇家飞利浦有限公司 分割管状特征
CN111738981A (zh) * 2020-05-26 2020-10-02 中国人民解放军海军军医大学第三附属医院 对4-d时序肝脏ct图像数据进行血管分割的方法

Also Published As

Publication number Publication date
GB201405837D0 (en) 2014-05-14

Similar Documents

Publication Publication Date Title
CN111095354B (zh) 经改进的3-d血管树表面重构
Aylward et al. Initialization, noise, singularities, and scale in height ridge traversal for tubular object centerline extraction
Li et al. Vessels as 4-D curves: Global minimal 4-D paths to extract 3-D tubular surfaces and centerlines
Wang et al. A broadly applicable 3-D neuron tracing method based on open-curve snake
JP4950071B2 (ja) ３次元医療画像からの肺動脈樹の自動抽出の方法
Cheng et al. Accurate vessel segmentation with constrained B-snake
JP6776283B2 (ja) 血管のセグメンテーションの方法および装置
WO2015150320A1 (fr) Segmentation de structures d'organes tubulaires
CN109478327B (zh) 用于在任意视场计算断层摄影血管造影（cta）中自动检测全身动脉的方法
Wu et al. Segmentation and reconstruction of vascular structures for 3D real-time simulation
Babin et al. Skeletonization method for vessel delineation of arteriovenous malformation
JP6458166B2 (ja) 医用画像処理方法及び装置及びシステム及びプログラム
CN120107601B (zh) 三维肝胆管、肝动脉、门静脉及肝静脉图像分割方法及系统
CN119359930B (zh) 基于脑血管影像分割的脑血管三维模型构建方法及系统
US9390549B2 (en) Shape data generation method and apparatus
Bauer et al. Extracting curve skeletons from gray value images for virtual endoscopy
Czajkowska et al. Skeleton graph matching vs. maximum weight cliques aorta registration techniques
Zhao et al. Deep feature regression (DFR) for 3D vessel segmentation
Hichem et al. 3D model reconstruction of blood vessels in the retina with tubular structure
Alom et al. Automatic slice growing method based 3D reconstruction of liver with its vessels
Drechsler et al. Semi‐Automatic Anatomical Tree Matching for Landmark‐Based Elastic Registration of Liver Volumes
CN120107514B (zh) 基于流域分析的多级血管网络重建与分段方法
Macedo et al. Vessel centerline tracking in CTA and MRA images using hough transform
Blumenfeld et al. A centerline-based algorithm for estimation of blood vessels radii from 3D raster images
Beck et al. Robust model-based centerline extraction of vessels in CTA data

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15741865

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase
122 Ep: pct application non-entry in european phase

Ref document number: 15741865

Country of ref document: EP

Kind code of ref document: A1