WO2024079732A1 - Method and system for accelerating magnetic resonance imaging - Google Patents
Method and system for accelerating magnetic resonance imaging Download PDFInfo
- Publication number
- WO2024079732A1 WO2024079732A1 PCT/IL2023/051069 IL2023051069W WO2024079732A1 WO 2024079732 A1 WO2024079732 A1 WO 2024079732A1 IL 2023051069 W IL2023051069 W IL 2023051069W WO 2024079732 A1 WO2024079732 A1 WO 2024079732A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- acquisition
- mri
- image
- anisotropic
- elements
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
- A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
- A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/54—Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
- G01R33/56—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
- G01R33/5608—Data processing and visualization specially adapted for MR, e.g. for feature analysis and pattern recognition on the basis of measured MR data, segmentation of measured MR data, edge contour detection on the basis of measured MR data, for enhancing measured MR data in terms of signal-to-noise ratio by means of noise filtering or apodization, for enhancing measured MR data in terms of resolution by means for deblurring, windowing, zero filling, or generation of gray-scaled images, colour-coded images or images displaying vectors instead of pixels
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/54—Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
- G01R33/56—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
- G01R33/561—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution by reduction of the scanning time, i.e. fast acquiring systems, e.g. using echo-planar pulse sequences
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/60—Image enhancement or restoration using machine learning, e.g. neural networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/4818—MR characterised by data acquisition along a specific k-space trajectory or by the temporal order of k-space coverage, e.g. centric or segmented coverage of k-space
- G01R33/4824—MR characterised by data acquisition along a specific k-space trajectory or by the temporal order of k-space coverage, e.g. centric or segmented coverage of k-space using a non-Cartesian trajectory
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/54—Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
- G01R33/56—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
- G01R33/5602—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution by filtering or weighting based on different relaxation times within the sample, e.g. T1 weighting using an inversion pulse
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10088—Magnetic resonance imaging [MRI]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30016—Brain
Definitions
- the present invention in some embodiments thereof, relates to magnetic resonance imaging and, more particularly, but not exclusively, to a method and a system for accelerating magnetic resonance imaging.
- Magnetic Resonance Imaging is a method to obtain an image representing the chemical and physical microscopic properties of materials, by utilizing a quantum mechanical phenomenon, named Nuclear Magnetic Resonance (NMR), in which a system of spins, placed in a magnetic field resonantly absorb energy, when applied with a certain frequency.
- NMR Nuclear Magnetic Resonance
- a nucleus can experience NMR only if its nuclear spin I does not vanish, i.e., the nucleus has at least one unpaired nucleon.
- a nucleus having a spin I is allowed to be in a discrete set of energy levels, the number of which is determined by I, and the separation of which is determined by the gyromagnetic ratio of the nucleus and by the magnetic field.
- the nucleus Under the influence of a small perturbation, manifested as a radiofrequency magnetic field, which rotates about the direction of a primary static magnetic field, the nucleus has a time dependent probability to experience a transition from one energy level to another. With a specific frequency of the rotating magnetic field, the transition probability may reach the value of unity. Hence at certain times, a transition is forced on the nucleus, even though the rotating magnetic field may be of small magnitude relative to the primary magnetic field. For an ensemble of spin I nuclei the transitions are realized through a change in the overall magnetization.
- T2 spin-lattice relaxation time
- T2 transverse relaxation time
- a static magnetic field having a predetermined gradient is applied on an object, thereby creating, at each region of the object, a unique magnetic field.
- the slice-selective gradient selects a specific slice or cross-section of the object. This gradient is applied along a direction in space, altering the strength of the magnetic field along that direction, leading to a variation in the resonance frequency of the nuclei within the slice.
- the frequency-encoding gradient is typically applied perpendicularly to the slice-selective gradient in order to distinguish the resonant frequencies of nuclei within the selected slice, allowing to determining the position of the signal along an axis in the image (known as the frequency-encoding axis, or the readout axis).
- the phase-encoding gradient provides additional spatial encoding along an axis that is known as the phase-encoding axis and that is perpendicular to both the slice- selective and frequency-encoding gradients.
- the phase-encoding gradient allows the MRI system to differentiate nuclei in the same frequency range along the phaseencoding axis.
- pulse sequences are applied to the object (e.g., a patient) to generate NMR signals and obtain information therefrom which is subsequently used to reconstruct images of the object.
- the above mentioned relaxation times and the density distribution of the nuclear spin are properties which vary from one normal tissue to the next, and from one diseased tissue to the next. These quantities are therefore responsible for contrast between tissues in various imaging techniques, hence permitting image segmentation.
- CS compressed sensing
- the present invention there is provided a method of magnetic resonance imaging (MRI).
- the method comprises: acquiring a first MRI scan having a first type of MR image contrast according to a first anisotropic acquisition matrix having less elements along a first direction than along a second direction, the first direction being a phaseencoding direction for the first MRI scan.
- the method also comprises acquiring a second MRI scan having a second type of MR image contrast according to a second anisotropic acquisition matrix having less elements along the second direction than along the first direction, the second direction being a phase-encoding direction for the second MRI scan.
- the method also comprises feeding a machine learning procedure trained to deblur MR images with input data describing the first and the second MRI scans, and receiving from an output of the machine learning procedure output data corresponding to a deblurred MR image.
- the method comprises, prior to the feeding, co-registering the first and the second MRI scans.
- the first and the second MRI scans are acquired, respectively, before and after administration of a contrast agent to the object.
- the first type of MR image contrast is different from the second type of MR image contrast
- each of the first and the second type of MR image contrasts is selected from the group consisting of a T1 -Weighted MR image contrast, a T2-Weighted MR image contrast, a Proton Density Weighted MR image contrast, a Fluid-Attenuated Inversion Recovery MR image contrast, a Diffusion-Weighted MR image contrast, and an Inversion Recovery MR image contrast.
- a number of elements of the first anisotropic acquisition matrix along the second direction equals a number of elements of the second anisotropic acquisition matrix along the first direction.
- a number of elements of the first anisotropic acquisition matrix along the first direction equals a number of elements of the second anisotropic acquisition matrix along the second direction.
- each of the first and the second anisotropic acquisition matrix are three-dimensional and comprise elements also along a third direction, the third direction being a phase-encoding direction.
- a number of elements in the second three- dimensional anisotropic acquisition matrix along the third direction is less than a number of elements in the first three-dimensional anisotropic acquisition matrix along the third direction, and wherein a number of elements in the first three-dimension anisotropic acquisition matrix along the second direction is less than a number of elements in the second three-dimension anisotropic acquisition matrix along the first second.
- each of the first and the second anisotropic acquisition matrices are three-dimensional and comprise elements also along a third direction
- the method comprises acquiring a third MRI scan having a third type of MR image contrast according to a third anisotropic three-dimensional acquisition matrix having fewest elements along the third direction among the first, the second and the third three dimensional acquisition matrices, and wherein the input data also describe the third MRI scan.
- the method comprises receiving from the machine learning procedure output data corresponding to two or more deblurred MR images, at least one deblurred MR image for each of the MR scan.
- the machine learning procedure comprises an artificial neural network, and wherein each of at least two of the branches has an anisotropic kernel which is enlarged along direction corresponding to a direction of a respective acquisition matrix along which the matrix has less elements.
- a method of MRI comprises: acquiring a first MRI scan having a first type of MR image contrast according to a first radial acquisition protocol, and acquiring a second MRI scan having a second type of MR image contrast according to a second radial acquisition protocol, wherein radial sampling lines describing the first radial acquisition protocol are interlaced with radial sampling lines describing the second radial acquisition protocol.
- the method also comprises feeding a machine learning procedure trained to deblur MR images with input data describing the first and the second MRI scans, and receiving from an output of the machine learning procedure output data corresponding to a deblurred MR image.
- the first and the second MRI scans are acquired, respectively, before and after administration of a contrast agent to the object.
- the first type of MR image contrast is different from the second type of MR image contrast
- each of the first and the second type of MR image contrasts is selected from the group consisting of a T1 -Weighted MR image contrast, a T2-Weighted MR image contrast, a Proton Density Weighted MR image contrast, a Fluid-Attenuated Inversion Recovery MR image contrast, a Diffusion-Weighted MR image contrast, and an Inversion Recovery MR image contrast.
- the method comprises receiving from the machine learning procedure output data corresponding to two or more deblurred MR images, at least one deblurred MR image for each of the MR scan.
- the method comprises acquiring at least one additional MRI scan having at least one respective type of MR image contrast according to a respective at least one additional radial acquisition protocol, wherein radial sampling lines describing each of the first, the second, and the at least one additional radial acquisition protocols, are all interlaced cyclically thereamongst, wherein the input data also describe the at least one additional MRI scan.
- a method of MRI comprises: acquiring a first MRI scan having a first type of MR image contrast according to a first spiral acquisition protocol, and acquiring a second MRI scan having a second type of MR image contrast according to a second spiral acquisition protocol, wherein spirals describing the first spiral acquisition protocol are interlaced with spirals describing the second spiral acquisition protocol.
- the method also comprises feeding a machine learning procedure trained to deblur MR images with input data describing the first and the second MRI scans, and receiving from an output of the machine learning procedure output data corresponding to a deblurred MR image.
- the first and the second MRI scans are acquired, respectively, before and after administration of a contrast agent to the object.
- the first type of MR image contrast is different from the second type of MR image contrast
- each of the first and the second type of MR image contrasts is selected from the group consisting of a T1 -Weighted MR image contrast, a T2-Weighted MR image contrast, a Proton Density Weighted MR image contrast, a Fluid-Attenuated Inversion Recovery MR image contrast, a Diffusion-Weighted MR image contrast, and an Inversion Recovery MR image contrast.
- method comprises receiving from the machine learning procedure output data corresponding to two or more deblurred MR images, at least one deblurred MR image for each of the MR scan.
- the machine learning procedure comprises a plurality of branches, each receiving all the input data but providing output data corresponding to one of the two or more deblurred MR images.
- the method comprises acquiring at least one additional MRI scan having at least one respective additional type of MR image contrast according to at least one respective additional spiral acquisition protocol, wherein spirals describing each of the first, the second, and the at least one additional spiral acquisition protocols, are all interlaced cyclically thereamongst, wherein the input data also describe the at least one additional MRI scan.
- the computer software product comprises a computer-readable medium in which program instructions are stored, which instructions, when read by an image processor, cause the data processor to receive input data, to feed a machine learning procedure trained to deblur MR images with the input data, and to receive from an output of the machine learning procedure output data corresponding to a deblurred MR image.
- the input data comprise data describing a first MRI scan having a first type of MR image contrast according to a first anisotropic acquisition matrix having less elements along a first direction than along a second direction, the first direction being a phaseencoding direction for the first MRI scan.
- the input data also comprise a second MRI scan having a second type of MR image contrast according to a second anisotropic acquisition matrix having less elements along the second direction than along the first direction, the second direction being a phase-encoding direction for the second MRI scan.
- a number of elements of the first anisotropic acquisition matrix along the second direction equals a number of elements of the second anisotropic acquisition matrix along the first direction.
- a number of elements of the first anisotropic acquisition matrix along the first direction equals a number of elements of the second anisotropic acquisition matrix along the second direction.
- each of the first and the second anisotropic acquisition matrix are three-dimensional and comprise elements also along a third direction, the third direction being a phase-encoding direction.
- a number of elements in the first three- dimensional anisotropic acquisition matrix along the third direction is less than a number of elements in the second three-dimensional anisotropic acquisition matrix along the third direction, and wherein a number of elements in the second three-dimension anisotropic acquisition matrix along the second direction is less than a number of elements in the first three-dimension anisotropic acquisition matrix along the first direction.
- a number of elements in the second three- dimensional anisotropic acquisition matrix along the third direction is less than a number of elements in the first three-dimensional anisotropic acquisition matrix along the third direction, and wherein a number of elements in the first three-dimension anisotropic acquisition matrix along the second direction is less than a number of elements in the second three-dimension anisotropic acquisition matrix along the second direction.
- each of the first and the second anisotropic acquisition matrices are three-dimensional and comprise elements also along a third direction
- the method comprises acquiring a third MRI scan having a third type of MR image contrast according to a third anisotropic three-dimensional acquisition matrix having fewest elements along the third direction among the first, the second and the third three dimensional acquisition matrices, and wherein the input data also describe the third MRI scan.
- the computer software product comprises a computer-readable medium in which program instructions are stored, which instructions, when read by an image processor, cause the data processor to receive input data, to feed a machine learning procedure trained to deblur MR images with the input data, and to receive from an output of the machine learning procedure output data corresponding to a deblurred MR image.
- the input data comprises data describing a first MRI scan having a first type of MR image contrast according to a first radial acquisition protocol, and a second MRI scan having a second type of MR image contrast according to a second radial acquisition protocol, wherein radial sampling lines describing the first radial acquisition protocol are interlaced with radial sampling lines describing the second radial acquisition protocol.
- the interlacing forms a radial pattern having a uniform angular spacing between adjacent radial sampling lines of the pattern.
- the computer software product comprises a computer-readable medium in which program instructions are stored, which instructions, when read by an image processor, cause the data processor to receive input data, to feed a machine learning procedure trained to deblur MR images with the input data, and to receive from an output of the machine learning procedure output data corresponding to a deblurred MR image.
- the input data comprises data describing a first MRI scan having a first type of MR image contrast according to a first spiral acquisition protocol, and a second MRI scan having a second type of MR image contrast according to a second spiral acquisition protocol, wherein spirals describing the first spiral acquisition protocol are interlaced with spirals describing the second spiral acquisition protocol.
- the interlacing forms a spiral pattern having a uniform spacing between adjacent spirals of the pattern.
- a magnetic resonance imaging (MRI) system for imaging an object.
- the system comprises an MRI scanner configured for scanning the object to provide MRI scans, and an image processor configured for executing the method as delineated above and optionally and preferably as further detailed below.
- Implementation of the method and/or system of embodiments of the invention can involve performing or completing selected tasks manually, automatically, or a combination thereof. Moreover, according to actual instrumentation and equipment of embodiments of the method and/or system of the invention, several selected tasks could be implemented by hardware, by software or by firmware or by a combination thereof using an operating system.
- a data processor such as a computing platform for executing a plurality of instructions.
- the data processor includes a volatile memory for storing instructions and/or data and/or a non-volatile storage, for example, a magnetic hard-disk and/or removable media, for storing instructions and/or data.
- a network connection is provided as well.
- a display and/or a user input device such as a keyboard or mouse are optionally provided as well.
- FIGs. 1A-C are flowchart diagrams describing methods suitable for magnetic resonance imaging (MRI), according to some embodiments of the present invention
- FIGs. 2A-D are schematic illustrations showing examples of a grid suitable for use according to some embodiments of the present invention.
- FIG. 3 is a schematic illustration of an MR scanner system for imaging an object, according to some embodiments of the present invention.
- FIGs. 4A-C are schematic illustrations of a registration process, which can be employed according to some embodiments of the present invention.
- FIG. 5 is a schematic illustration of a machine learning procedure, according to some embodiments of the present invention.
- FIG. 6 is a schematic illustration of a branched machine learning procedure, according to some embodiments of the present invention.
- FIG. 7 is a collection of MR images as obtained in experiments performed according to some embodiments of the present invention.
- FIG. 8 is another collection of MR images as obtained in experiments performed according to some embodiments of the present invention.
- FIGs. 9 A and 9B show quantitative performance comparison in terms of peak signal-to- noise ratio (FIG. 9A) and Structural Similarity index (FIG. 9B), for T1 weighted scans following administration of a contrast agent, as obtained in experiments performed according to some embodiments of the present invention;
- FIGs. 10A and 10B show quantitative performance comparison in terms of peak signal-to- noise ratio (FIG. 9A) and Structural Similarity index (FIG. 9B), for T1 weighted scans without contrast agent, as obtained in experiments performed according to some embodiments of the present invention
- FIG. 11 is a schematic illustration of three different phase-encoding directions which can be used in three-dimensional MRI, according to some embodiments of the present invention.
- FIG. 12 is a schematic illustration of a machine learning procedure which can be used when MRI acceleration is executed along more than two axes, according to some embodiments of the present invention
- FIG. 13 is a schematic illustration of a branched machine learning procedure which can be used when MRI acceleration is executed along more than two axes, according to some embodiments of the present invention
- FIGs.l4A and 14B are schematic illustrations describing MRI acceleration for a radial grid, according to some embodiments of the present invention.
- FIG.14C is a schematic illustration describing MRI acceleration for a spiral grid, according to some embodiments of the present invention.
- the present invention in some embodiments thereof, relates to magnetic resonance imaging and, more particularly, but not exclusively, to a method and a system for accelerating magnetic resonance imaging.
- FIGs. 1A-C are flowchart diagrams describing methods suitable for magnetic resonance imaging (MRI), according to some embodiments of the present invention. It is to be understood that, unless otherwise defined, the operations described hereinbelow can be executed either contemporaneously or sequentially in many combinations or orders of execution. Specifically, the ordering of the flowchart diagrams is not to be considered as limiting. For example, two or more operations, appearing in the following description or in the flowchart diagrams in a particular order, can be executed in a different order (e.g., a reverse order) or substantially contemporaneously. Additionally, several operations described below are optional and may not be executed.
- MRI magnetic resonance imaging
- At least part of the operations described herein can be implemented by a data processing system, e.g., a dedicated circuitry or a general purpose processor, configured for executing the operations described below. At least part of the operations can be implemented by a cloudcomputing facility at a remote location.
- a data processing system e.g., a dedicated circuitry or a general purpose processor, configured for executing the operations described below.
- At least part of the operations can be implemented by a cloudcomputing facility at a remote location.
- Computer programs implementing the method of the present embodiments can commonly be distributed to users by a communication network or on a distribution medium such as, but not limited to, a floppy disk, a CD-ROM, a flash memory device and a portable hard drive. From the communication network or distribution medium, the computer programs can be copied to a hard disk or a similar intermediate storage medium. The computer programs can be run by loading the code instructions either from their distribution medium or their intermediate storage medium into the execution memory of the computer, configuring the computer to act in accordance with the method of this invention. During operation, the computer can store in a memory data structures or values obtained by intermediate calculations and pull these data structures or values for use in subsequent operation. All these operations are well-known to those skilled in the art of computer systems.
- Processer circuit such as a DSP, microcontroller, FPGA, ASIC, etc., or any other conventional and/or dedicated computing system.
- the method of the present embodiments can be embodied in many forms. For example, it can be embodied in on a tangible medium such as a computer for performing the method operations. It can be embodied on a computer readable medium, comprising computer readable instructions for carrying out the method operations. In can also be embodied in electronic device having digital computer capabilities arranged to run the computer program on the tangible medium or execute the instruction on a computer readable medium.
- Selected operations of the method optionally and preferably can be executed by a magnetic resonance (MR) scanner having a controller configured for activating a radiofrequency transmitter system for generating a pulse sequence, and a gradient assembly for generating gradient fields, including a slice-selective gradient, a frequency-encoding gradient, and a phase-encoding gradient.
- the MR scanner also comprises an acquisition system for acquiring MR signals responsively to the pulse sequence generated by the radiofrequency transmitter system.
- the method of the present embodiments is particularly useful for MRI of objects such as an organ or a full body of a living human or animal, but embodiments in which the method is used for MRI of a non-living object are also contemplated.
- the method begins at 10 and optionally and preferably continues to 11 at which a slice of the object is selected.
- This can be done by the controller of the MR system that can select the slice by generating a gradient field that ensures that only nuclei in the selected slice are in phase and contribute to the MR signal, while nuclei outside the slice are out of phase and contribute less or not at all.
- operation 11 is optional and that in some embodiments of the present invention it is not executed. For example, when it is desired to construct a two-dimensional MR image there is no need to apply slice selection.
- a first MRI scan having a first type of MR image contrast is acquired by the MR scanner.
- types of MR image contrast suitable for use according to some embodiments of the present invention include, without limitation, a Tl-Weighted (T1W) MR image contrast, a T2-Weighted (T2W) MR image contrast, a Proton Density (PD) Weighted MR image contrast, a Fluid-Attenuated Inversion Recovery (FLAIR) MR image contrast, a Diffusion-Weighted MR image contrast, and an Inversion Recovery (IR) MR image contrast.
- the first MRI scan is acquired by transmitting to the object a first pulsesequence and receiving from the object an MR signal in response to this pulse-sequence.
- the acquisition of the first MRI scan is according to a first acquisition matrix.
- the acquisition matrix can be a two-dimensional matrix or a three-dimensional matrix.
- the matrix comprises a plurality of matrix-elements arranged along a first direction and a second direction. In embodiments in which the acquisition matrix is three-dimensional its matrix-elements are arranged also along a third direction.
- the matrix is two-dimensional one of the directions of the matrix is a phase-encoding direction and the other direction is a readout or frequency-encoding direction.
- the matrix is three-dimensional, there are typically two phase-encoding directions and one readout direction.
- the MR scanner scans the object according to the acquisition matrix such that when one moves along a phase-encoding direction each element of the matrix corresponds to a different phase shift in the MR signal allowing to differentiate nuclei within the same frequency bin along this direction, and when one moves along a frequency-encoding direction each element of the matrix corresponds to a different bin of resonance frequencies for the same phase shift of the MR signal.
- the first direction of the acquisition matrix is referred to below as “direction x”
- the second direction of the acquisition matrix is referred to below as “direction y”
- the third direction of the acquisition matrix is referred to below as “direction z.”
- the acquisition matrix is preferably defined over a space known as "the k-space" of the MRI.
- the k-space represents spatial frequencies rather than physical locations. In a k-space, coordinate values that are smaller in their absolute value correspond to lower spatial frequencies (and therefore to lower resolution) than coordinate values that are higher in their absolute value.
- the acquisition matrix represents a discretization of a Cartesian k-space over a grid that includes a plurality of discrete grid cells (each corresponding to one matrix-element of the acquisition matrix), where the positions of the grid cells are determined by the strength and timing of the applied gradients.
- an MR image can be reconstructed by a mathematical transform called a Fourier transform, which converts the data from the spatial frequency domain of the k-space into the spatial domain of the image space.
- a Fourier transform which converts the data from the spatial frequency domain of the k-space into the spatial domain of the image space. While the acquisition matrix defined above represents a discretization of the k- space over a Cartesian system of coordinates, use of Cartesian system of coordinates is not necessary, since, as will be explained hereinunder, it may be desired to acquire MR scans also over a non-cartesian k-space grid.
- FIGs. 2A-D illustrates examples of a grid 30 suitable for use according to some embodiments of the present invention.
- the cells 32 of grid 30 represent the discretization of the space over which the grid is defined. For clarity of presentation a plurality of cells 32 of grid 30 are only shown in FIG. 2A, whereas in each of FIGs. 2B-D only one representative cell 32 is illustrated.
- FIGs. 2A and 2B illustrate examples in which the grid is a Cartesian grid, in which case the grid can be defined over two (FIG. 2A) or three (FIG. 2B) orthogonal axes, respectively corresponding to a two-dimensional grid and three-dimensional grid.
- the cells 32 in FIG. 2A represent the matrix-elements of an acquisition matrix when the matrix is a two-dimensional matrix
- the cells 32 (only one is illustrated) in FIG. 2B represent the matrix-elements of an acquisition matrix when the matrix is a three-dimensional matrix.
- FIGs. 2C and 2D illustrate examples in which the grid 30 is a non-Cartesian grid, in which case the grid 30 can be defined over a plurality of directions that are not necessarily orthogonal to each other and are not necessarily straight.
- FIG. 2C illustrates an example of a two-dimensional radial grid
- FIG. 2D illustrates an example of a two-dimensional spiral grid.
- the skilled person, provided with the details described herein would appreciate that three-dimensional versions of the grid types shown in FIGs. 2C and 2D can also be employed.
- the radial grid in FIG. 2C has a plurality of non-parallel radial directions k r , wherein an azimuthal coordinate k ⁇ p is defined along circular lines perpendicular to the radial axes, so that for a given distance from the origin, along any of the radial directions, the azimuthal coordinate varies from 0 to 2%.
- the spiral grid FIG. 2D
- there is no need to define radial directions k r although these can be defined as illustrated in FIG. 2D) because each cell can be defined by means of a single coordinate value cp.
- Non-Cartesian grids such as, but not limited to, a barycentric grid, elliptic grid, hyperbolic grid, etc., are also contemplated in some embodiments of the present invention.
- the first acquisition matrix is anisotropic.
- the matrix is "anisotropic" in the sense that the number of elements are not the same in all the directions. For example, in the first acquisition matrix, there are less elements along direction x than along the direction y.
- the first MRI scan is acquired while employing phase-encoding along direction x.
- the first acquisition matrix is a two- dimensional matrix
- the first MRI scan is acquired while employing frequency encoding along direction y. It is appreciated that in the two-dimensional case, the density of phase-encoding is lower than the density of frequency encoding because there are less matrix-elements along direction x.
- the case in which the first acquisition matrix is a three-dimensional matrix is explained in greater detail hereinunder.
- the acquisition time of the first MRI scan is accelerated compared to the acquisition time that would have been required had the numbers of matrix-elements been the highest along all directions.
- the reduced number of elements along one or more of the directions there is a loss of information along these directions, resulting in a blurring of the corresponding MR image along the respective direction(s) in the image space.
- the MRI scan is therefore referred to in FIG. 1A as a "blurred" to indicate the aforementioned information loss.
- this loss of information can be compensated by acquiring one or more additional blurred MRI scans.
- the method optionally and preferably loops back to 11 for selecting another slice of the object, and repeating the acquisition 12 for the newly selected slice. This loop can continue until the acquisition is completed for all the slices of the object.
- operation 11 is not executed, there is no need to loop back from 12 and the method continues as further detailed hereinbelow.
- the method continues to 13 at which a detectable dose of an MR contrast agent is administered to the subject.
- the method can begin while the subject already has the contrast agent in his or her vasculature, in which case operation 13 is not executed.
- the method can be executed in its entirety without the use of contrast agent, in which case operation 13 is also not executed.
- the administered contrast agent can be of any type that enhances the contrast among different materials in the imaged object, e.g., by changing one or more of the relaxation times Ti, T2, T2*.
- the MR contrast agent can be either a positive or a negative MRI contract agent.
- positive MR contract agent refers to an agent which increases the signal relative to nearby materials
- negative MR contract agent refers to an agent which decreases the signal relative to nearby materials
- the magnetic properties of the MR contrast agent can be of any type. More specifically, the MRI contrast agent comprises a magnetic material which can be paramagnetic, superparamagnetic or ferromagnetic material.
- MR contrast agents suitable for the present embodiments include, without limitation, gadolinium (Gd), dysprosium (Dy), chromium (Cr), iron (Fe), and manganese (Mn), more preferably Gd, Mn, and Fe, and most preferably Gd.
- Operation 13 when executed, can be executed before or after operations 11 and 12.
- the method optionally and preferably re-execute 11 to select a slice. This operation is only executed in cases in which operation 11 is executed before 12. Otherwise, this operation can be skipped.
- a second MRI scan is acquired by the MR scanner according to a second acquisition matrix, which is different from the first acquisition matrix.
- the second MRI scan is arranged over a grid of coordinates of the same type as the grid of coordinate over which the first MRI scan is arranged.
- the first MRI scan is acquired by scanning a two-dimensional Cartesian k-space grid
- the second MRI scan is also acquired by scanning a two-dimensional Cartesian k-space grid
- the first MRI scan is acquired by scanning a three-dimensional Cartesian k-space grid
- the second MRI scan is also acquired by scanning a three-dimensional Cartesian k-space grid.
- the second MRI scan has a second type of MR image contrast.
- the second type of MR image contrast can be any of the aforementioned types of MR image contrast.
- the type of image contrast can be achieved by a judicious construction of the pulse sequence to be generated by the radiofrequency transmitter system of the MR scanner, and so the second MRI scan is typically acquired by transmitting to the object a second pulse-sequence and receiving from the object an MR signal in response to this pulse-sequence.
- At least one of the acquisition conditions is preferably different among operations 12 and 14.
- This difference can be in terms of the contrast agent that may or may not be present in the object, and/or in terms of the type of MR image contrast that is selected by means of the pulse sequence applied before the acquisition. These two types of differences are referred to collectively as difference in the modality of the MRI.
- operation 13 When operation 13 is employed, and when operation 12 is executed before operation 13, the contrast agent is not present in the object during operation 12 but is present in the object during operation 14, and so the first and second MR image contrasts can, but not necessarily, be of the same type.
- both the first and the second MRI scans can be T1W MRI scans, or T2W MRI scans and so no, except that the first MRI scan is acquired without the presence of contrast agent in the object, and the second MRI scan is acquired with the presence of contrast agent in the object.
- the first and second MR image contrasts are of different types.
- the first MRI scan can be a T1W MRI scan
- the second MRI scan can be a T2W MRI scan, and so on.
- the second MRI scan is also blurred in the sense that it was acquired by a second acquisition matrix which is anisotropic.
- the second acquisition matrix has less elements along direction y than along direction x, and the second MRI scan is acquired while employing phase-encoding along direction y.
- the second acquisition matrix is a two-dimensional matrix the second MRI scan is acquired while employing frequency encoding along direction x.
- the density of phase-encoding is lower than the density of frequency encoding, except that for the second MRI scan the phase-encoding and frequency encoding directions are swapped relative to these directions in the first MRI scan.
- any possible combination of two different directions among x, y, z (namely, any of the pairs: x-y, x-z, y-z, z-x, z-y, y-x) can be selected such that the first direction of the pair has less elements in the first matrix than in the second matrix whereas the second direction of said pair has less elements in the second matrix than in the first matrix, where the first and second directions are phase encoding direction in the first and second acquisition matrices, respectively
- the method optionally and preferably loops back to 11 for selecting another slice of the object, and repeating the acquisition 14 for the newly selected slice. This loop can continue until the acquisition is completed for all the slices of the object. This operation is only executed in cases in which operation 11 is executed before 12. Otherwise, this operation can be skipped.
- the first and second acquisition matrices are three-dimensional matrices, defined over the directions x, y, and z.
- the matrices can be used for the acquisition of 3D MRI. This can be done in more than one way.
- the z direction of each of the first and second acquisition matrices is a phase-encoding direction, so that for each of the first and second MRI scans there are two phase-encoding directions (directions x and z in the first MRI scan, and directions y and z in the second MRI scan).
- the remaining direction as the case may be (direction y in the first MRI scan, and direction x in the second MRI scan) is a frequency encoding direction.
- the number of matrix-elements along direction z is less for the first acquisition matrix than for the second acquisition matrix. This corresponds to a case in which the extent of blurring along direction z is higher for the first MRI scan than for the second MRI scan.
- the number of elements in the second matrix along direction y is less than the number of elements in the first matrix along direction y.
- the number of elements in the second matrix along direction x is less than the number of elements in the first matrix along direction x.
- the number of matrix-elements along direction z can be less for the second acquisition matrix than for the first acquisition matrix, corresponding to a case in which the extent of blurring along direction z is higher for the second MRI scan than for the first MRI scan.
- the number of elements in the first matrix along direction y is less than a number of elements in the second matrix along direction y.
- the number of elements in the first matrix along direction x is less than the number of elements in the second matrix along direction x.
- Another way to provide accelerated 3D MRI is by acquiring an additional (third) MRI scan without reducing the number of elements along the z direction in the first and/or second acquisition matrices.
- the first MRI scan is acquired while employing phase-encoding along the x direction and also along one of the directions z and y, and while employing frequency-encoding along the other one of the directions z and y.
- the second MRI scan is acquired while employing phaseencoding along the y direction and also along one of the directions x and z, and while employing frequency-encoding along the other one of the directions x and z.
- the method can re- execute 11 following the execution of 14 to select a slice. Again, this operation can be skipped, unless operation 11 is executed before 12.
- the method can then proceed to 15, at which a third MRI scan is acquired by the MR scanner according to a third acquisition matrix, which is different from the first and the second acquisition matrices, wherein each of the first, second, and third acquisition matrices is a three-dimensional matrix.
- the third MRI scan has a third type of MR image contrast.
- the third type of MR image contrast can be any of the aforementioned types of MR image contrast.
- the modalities of the MRI are preferably different among operations 12, 14, and 15, as further detailed hereinabove. It is to be understood that while in the above description and in FIG. 1A the (optional) administration 13 of contrast agent is before the second acquisition 14, the present embodiments contemplate implementation in which contrast agent administration is executed after the second acquisition 14 and before the third acquisition 15. In this case, to ensure different modalities during the acquisitions, the first and second type of MR image contrast preferably differ, and the third type of MR image contrast can, but not necessarily, be the same as the first or the second types of MR image contrast.
- the third MRI scan is also blurred. This is achieved by making the third acquisition matrix anisotropic.
- the direction or axes along which there are less matrix-elements in the third acquisition matrix is preferably complementary to the directions along which there are less matrix-elements in the other two acquisition matrices. Specifically, when the number of elements along direction x is less for the first matrix than for the other two matrices, and the number of elements along direction y is less for the second matrix than for the other two acquisition matrices, the number of elements along direction z is less for the third matrix than for the other two matrices.
- the third MRI scan is acquired while employing phaseencoding along direction z.
- An additional phase-encoding can also be employed along one of the directions x and y, and a frequency encoding can be employed along the other one of the directions x and y.
- the respective acquisition matrix has less elements along at least one of the directions for which phase-encoding is applied than along any readout direction.
- the number of matrix-elements along any direction other than a direction along which the number of elements is minimal is the same among the different matrices.
- the number of elements of the first acquisition matrix along the y direction can be the same as the number of elements of the second acquisition matrix along the x direction.
- the method can acquire, for this selected set, two or more blurred MRI scans, wherein for each scan a different type of MR image contrast is selected.
- the method continues to 16 at which a Fourier transform is applied to the data that represent the blurred MRI scans so as to convert the data from the spatial frequency domain of the k-space into the spatial domain of the image space.
- a Fourier transform is applied.
- FFT Fast Fourier Transform
- the method proceeds to 17 at which the method co-register all the grids over which the blurred MRI scans are arranged.
- This can be done by any technique known in the art including, without limitation, at least one of: spatial co- registration, multimodal co-registration, atlas-based co-registration, longitudinal co-registration, motion correction, and deformable registration.
- the MR scanner preforms automatic co-registration, in which case it is not necessary to execute operation 17. Operation 17 can be executed before or after operation 16.
- the method proceeds to 18 at which a machine learning procedure that is trained to deblur MR images is fed with input data describing the blurred MRI scans.
- machine learning refers to a procedure embodied as a computer program configured to induce patterns, regularities, or rules from previously collected data to develop an appropriate response to future data, or describe the data in some meaningful way.
- machine learning procedures suitable for the present embodiments, include, without limitation, clustering, association rule algorithms, feature evaluation algorithms, subset selection algorithms, support vector machines, classification rules, cost-sensitive classifiers, vote algorithms, stacking algorithms, Bayesian networks, decision trees, neural networks (e.g., fully-connected neural network, convolutional neural network), instancebased algorithms, linear modeling algorithms, k- nearest neighbors (KNN) analysis, ensemble learning algorithms, probabilistic models, graphical models, logistic regression methods (including multinomial logistic regression methods), gradient ascent methods, singular value decomposition methods and principle component analysis.
- neural networks e.g., fully-connected neural network, convolutional neural network
- instancebased algorithms e.g., linear modeling algorithms, k- nearest neighbors (KNN) analysis
- ensemble learning algorithms e.g., probabilistic models, graphical models, logistic regression methods (including multinomial logistic regression methods), gradient ascent methods, singular value decomposition methods and principle component analysis.
- the machine learning procedure comprises an artificial neural network.
- Artificial neural networks are a class of algorithms based on a concept of inter-connected "neurons.”
- neurons contain data values, each of which affects the value of a connected neuron according to connections with pre-defined strengths, and whether the sum of connections to each particular neuron meets a pre-defined threshold.
- a neural network can decode the range information from the input information (for example, the image data itself or some transform, e.g., a complex cepstrum transform, thereof).
- these neurons are grouped into layers in order to make connections between groups more obvious and to each computation of values.
- Each layer of the network may have differing numbers of neurons, and these may or may not be related to particular qualities of the input data.
- each of the neurons in a particular layer is connected to and provides input value to those in the next layer. These input values are then summed and this sum compared to a bias, or threshold. If the value exceeds the threshold for a particular neuron, that neuron then holds a positive value which can be used as input to neurons in the next layer of neurons. This computation continues through the various layers of the neural network, until it reaches a final layer. At this point, the output of the neural network procedure can be read from the values in the final layer.
- convolutional neural networks operate by associating an array of values with each neuron, rather than a single value. The transformation of a neuron value for the subsequent layer is generalized from multiplication to convolution.
- the machine learning procedure is a convolutional neural network (CNN).
- the machine learning procedure is specific to the type of object being imaged.
- the machine learning procedure is a machine learning procedure that is trained specifically to deblur MR images of this particular organ
- the machine learning procedure is a machine learning procedure that is trained specifically to deblur MR images of such whole body of human or animal.
- the machine learning procedure is a machine learning procedure that is trained specifically to deblur MR images acquired by an MR scanner of a particular type that is used for acquiring the blur MRI scans.
- the input data that are fed to the machine learning procedure can be image-space data (i.e., after the application 17 of the Fourier transform), or k-space data (before the application of a Fourier transform).
- the Fourier transform 17 can be applied to the output data of the machine learning procedure, after this output data is received from the output of the machine learning procedure (operation 19, below).
- the machine learning procedure 200 has a single branch with a single input layer 202 that receives all the input data (see FIGs. 5 and 12).
- the machine learning procedure 200 has a plurality of branches 204a, 204b, with a respective input layer 202a, 202b, etc. for each branch (see FIGs. 6 and 13).
- Each of the input layers receives input data that describes one or the acquired blurred sets, but one or more of the hidden layers of each branch is connected to one or more of the layers (e.g., to the input layer) of the other branch.
- machine learning procedure 200 is an artificial neural network, in which each of at least two of branches 204a has an anisotropic kernel 206a, 206b (FIG. 6) which is enlarged along a direction corresponding to an axis along which the MRI acceleration is executed.
- the machine learning procedure can be trained according to some embodiments of the present invention by supervised training using a training dataset that can be prepared for the purpose of the training.
- a training dataset can include a plurality of MR images acquired without blurring and a respective plurality of blurred MRI scans, as further detailed hereinabove.
- the training dataset can be fed into a machine learning training program in a manner that each nonblurred image is used as a ground truth for a respective blurred image.
- the machine learning training program adjusts weights that are assigned to each component (e.g., neuron, layer, kernel, etc.) of the procedure, thus providing a trained machine learning procedure which can then be used without the need to re-train it.
- the training dataset include MR images acquired without blurring and blurred MRI scans, where at least a majority, more preferably all the images in the dataset, are images of the respective type of object.
- the training dataset include MR images acquired without blurring and MR images constructed from the blurred sets, where at least a majority, more preferably all the images in the dataset, are acquired by the respective type of MR scanner. Examples of such training are provided in the Examples section that follows.
- the method proceeds to 19 at which output data corresponding to one or more deblurred MR image(s) is received from an output of the machine learning procedure 200.
- the machine learning procedure 200 provides separate output for each part of the input data that corresponds to one of the blurred MRI scans. This provides deblurred MR image data for each of the MRI modalities that were employed while collecting the blurred MRI scans.
- the method optionally and preferably proceeds to 21 at which one or more MR images are displayed on a display device.
- FIG. IB is a flowchart diagram describing a method suitable for magnetic resonance imaging (MRI), in embodiments of the invention in which the acquisitions of MRI scans is over a radial grid, more preferably a radial k-space grid.
- MRI magnetic resonance imaging
- the method begins at 40 and optionally and preferably continues to 11 at which a slice of the object is selected, as further detailed hereinabove.
- operation 11 is optional and in some embodiments of the present invention it is not executed.
- the method continues to 42 at which a first MRI scan having a first type of MR image contrast is acquired by the MR scanner.
- the first type of MR image contrast can be any of the types of MR image contrast listed above with respect to method 10.
- the first MRI scan is acquired according to a first radial requisition protocol. With reference to FIG. 2C, this protocol comprises performing a scan along each of a plurality of radial sampling lines 52-1, 52-2, 52-3, etc.
- each of these radial sampling lines 52 is a readout line, wherein as one moves along a particular line 52 each cell 32 of the grid 30 corresponds to a different bin of resonance frequencies for the same phase shift of the MR signal, and wherein different radial sampling lines 52 correspond to different phase shifts in the MR signal.
- Lines 52 thus form a first radial pattern 54 (solid lines) over the k-space.
- the angular spacings 56 between adjacent lines 52 of pattern 54 are uniform over pattern 54.
- the method continues to 13 at which a detectable dose of an MR contrast agent is administered to the subject, as further detailed hereinabove.
- Operation 13 when executed, can be executed before or after operations 11 and 42.
- the method optionally and preferably re-execute 11 to select a slice. This operation is only executed in cases in which operation 11 is executed before 42. Otherwise, this operation can be skipped.
- a second MRI scan is acquired by the MR scanner.
- the second MRI scan is arranged over a grid of coordinates of the same type as the grid of coordinate over which the first MRI scan is arranged.
- the grid is a radial grid.
- the second image contrast can be any of the aforementioned types of MR image contrast.
- the modalities of the first and second MRI scans preferably differ, as further detailed hereinabove with respect to the first and second MRI scans acquired by method 10.
- the second MRI scan is acquired according to a second radial requisition protocol. Referring to FIG. 2C, this second protocol comprises performing a scan along each of a plurality of radial sampling lines 62-1, 62-2, 62-3, etc.
- each of the radial sampling lines 62 is preferably a readout line, wherein as one moves along a particular line 62 each cell 32 of the grid 30 corresponds to a different bin of resonance frequencies for the same phase shift of the MR signal, and wherein different radial sampling lines 62 correspond to different phase shifts in the MR signal.
- Lines 62 thus form a second radial pattern 64 (dashed lines) over the k-space.
- the angular spacings 66 between adjacent lines 62 of pattern 64 are uniform over pattern 64.
- the number of lines in pattern 64 equals the number of lines in pattern 54.
- the angular spacings 66 of pattern 64 equal the angular spacings 56 of pattern 54.
- the interlacing forms a radial pattern 60 (encompassing both the dashed lines and the solid lines in FUG. 2C) having a uniform angular spacing 68 between adjacent radial sampling lines of pattern 60.
- the first and second MRI scans acquired at 42 and 44 are referred to as "blurred” because each of angular spacings 56 and 66 is larger than the angular spacing 68, meaning that the phaseencoding density at each of these first and second MRI scans is less than the overall phase-encoding density of pattern 60.
- pattern 60 been used for the acquisition of a single MRI scan there would have been more phase-encoding information in this single MRI scan than in any of the actually acquired MRI scans.
- the re-execute 11 following the execution of 44 so as to select a slice. Again, this operation can be skipped, unless operation 11 is executed before 42.
- the method proceeds to 45, at which one or more additional MRI scans are acquired by the MR scanner according to respective one or more additional radial protocol(s), optionally with appropriate slicing operations as further detailed hereinabove.
- the additional radial protocol(s) are similar to the first and second radial protocols, mutatis mutandis, and are therefore not specifically shown in FIG. 2C for clarity of presentation. Exemplified additional protocols are described in the examples section that follow (see FIG. 14B).
- each of the additional protocol comprises performing a scan along each of a plurality of radial sampling lines, where each of the radial sampling lines is preferably a readout line, with different radial sampling lines corresponding to different phase shifts in the MR signal.
- the lines of each of the additional protocols form a radial pattern over the k-space, preferably with uniform angular spacings between adjacent lines of each pattern, and preferably with the same number of lines in each pattern and/or the same angular spacings among different radial patterns.
- the radial patterns are at angular offsets with respect to each other, and are therefore interlaced thereamongst.
- this interlacing forms an overall pattern in which the radial sampling lines of individual patterns form a cyclic sequence in the overall pattern. For example, when there are three individual patterns they are interlaced in a manner that as one completes a circle along the azimuthal direction k ⁇ p, the second sampling line is always crossed after the first sampling line and before the third sampling line.
- FIG 14B A representative example of a cyclical interlacing of radial lines for the case of four patterns is illustrated in FIG 14B.
- the method continues to 16 at which a Fourier transform is applied as further detailed hereinabove.
- the method proceeds to 17 at which the method co-register all the grids over which the blurred MRI scans are arranged, as further detailed hereinabove.
- the method then proceeds to 18 at which a machine learning procedure that is trained to deblur MR images is fed with input data describing the blurred MRI scans, to 19 at which output data corresponding to a one or more deblurred MR image(s) is received from an output of the machine learning procedure, and optionally to 21 at which one or more MR images are displayed on a display device.
- FIG. 1C is a flowchart diagram describing a method suitable for magnetic resonance imaging (MRI), in embodiments of the invention in which the acquisitions of MRI scans is over a spiral grid, more preferably a spiral k-space grid.
- MRI magnetic resonance imaging
- the method begins at 70 and optionally and preferably continues to 11 at which a slice of the object is selected, as further detailed hereinabove.
- operation 11 is optional and in some embodiments of the present invention it is not executed.
- the method continues to 72 at which a first MRI scan having a first type of MR image contrast is acquired by the MR scanner.
- the first type of MR image contrast can be any of the types of MR image contrast listed above with respect to method 10.
- the first MRI scan is acquired according to a first spiral requisition protocol. With reference to FIG. 2D, this protocol comprises performing a scan along each of a plurality of spiral sampling lines 82-1, 82-2, etc (only two spiral lines are illustrated for clarity of presentation, but the number of spiral lines can be larger than two).
- each of these spiral sampling lines 82 is a readout line, wherein as one moves along a particular line 82 each cell 32 of the grid 30 corresponds to a different bin of resonance frequencies for the same phase shift of the MR signal, and wherein different spiral sampling lines 82 correspond to different phase shifts in the MR signal.
- Lines 82 thus form a first spiral pattern 84 (solid lines) over the k-space.
- the radial spacings 86 between adjacent lines 82 of pattern 84 are uniform over pattern 84.
- the method continues to 13 at which a detectable dose of an MR contrast agent is administered to the subject, as further detailed hereinabove.
- Operation 13 when executed, can be executed before or after operations 11 and 72. Following the execution of 72 and optionally following the execution of 13, the method optionally and preferably re-execute 11 to select a slice. This operation is only executed in cases in which operation 11 is executed before 72. Otherwise, this operation can be skipped.
- a second MRI scan is acquired by the MR scanner.
- the second MRI scan is arranged over a grid of coordinates of the same type as the grid of coordinate over which the first MRI scan is arranged.
- the grid is a spiral grid.
- the second image contrast can be any of the aforementioned types of MR image contrast.
- the modalities of the first and second MRI scans preferably differ, as further detailed hereinabove with respect to the first and second MRI scans acquired by method 10.
- the second MRI scan is acquired according to a second spiral requisition protocol. Referring to FIG. 2D, this second protocol comprises performing a scan along each of a plurality of spiral sampling lines 92-1, 92-2, etc.
- each of the spiral sampling lines 92 is preferably a readout line, wherein as one moves along a particular line 92 each cell 32 of the grid 30 corresponds to a different bin of resonance frequencies for the same phase shift of the MR signal, and wherein different spiral sampling lines 92 correspond to different phase shifts in the MR signal.
- Lines 92 thus form a second spiral pattern 94 (dashed lines) over the k-space.
- the radial spacings 96 between adjacent lines 92 of pattern 94 are uniform over pattern 94.
- the number of lines in pattern 94 equals the number of lines in pattern 84.
- the angular spacings 96 of pattern 94 equal the angular spacings 86 of pattern 84.
- the spiral sampling lines 82 that describe the first spiral acquisition protocol (and that belong to pattern 84) are interlaced with the spiral sampling lines 92 that describe the second spiral acquisition protocol (and that belong to pattern 94).
- the interlacing forms a spiral pattern 60 (encompassing both the dashed lines and the solid lines in FUG. 2D) having a uniform angular spacing 98 between adjacent spiral sampling lines of pattern 90.
- the first and second MRI scans acquired at 72 and 74 are referred to as "blurred" because each of radial spacings 86 and 96 is larger than the angular spacing 98, meaning that the phaseencoding density at each of these first and second MRI scans is less than the overall phase-encoding density of pattern 90.
- pattern 90 been used for the acquisition of a single MRI scan there would have been more phase-encoding information in this single MRI scan than in any of the actually acquired MRI scans.
- the re-execute 11 following the execution of 74 so as to select a slice. Again, this operation can be skipped, unless operation 11 is executed before 72.
- the method proceeds to 75, at which one or more additional MRI scans are acquired by the MR scanner according to respective one or more additional spiral protocol(s), optionally with appropriate slicing operations as further detailed hereinabove.
- the additional spiral protocol(s) are similar to the first and second spiral protocols, mutatis mutandis, and are therefore not specifically shown in FIG. 2D for clarity of presentation.
- Each of the additional protocols comprises performing a scan along each of a plurality of spiral sampling lines, where each of the spiral sampling lines is preferably a readout line, with different spiral sampling lines corresponding to different phase shifts in the MR signal.
- the lines of each of the additional protocols form a spiral pattern over the k-space, preferably with uniform angular spacings between adjacent lines of each pattern, and preferably with the same number of lines in each pattern and/or the same angular spacings among different spiral patterns.
- FIG 14C illustrates a representative example an overall pattern 90 that is formed by cyclical interlacing of a first pattern (long dashed lines), a second pattern (short dashed lines) and a third pattern (solid lines).
- the method continues to 16 at which a Fourier transform is applied as further detailed hereinabove.
- the method proceeds to 17 at which the method co-register all the grids over which the blurred MRI scans are arranged, as further detailed hereinabove.
- the method then proceeds to 18 at which a machine learning procedure that is trained to deblur MR images is fed with input data describing the blurred MRI scans, to 19 at which output data corresponding to a one or more deblurred MR image(s) is received from an output of the machine learning procedure, and optionally to 21 at which one or more MR images are displayed on a display device.
- FIG. 3 is a schematic illustration of an MR scanner system 100 for imaging an object 102, according to some embodiments of the present invention.
- Object can be a full body of a human or an animal, or an organ thereof, or a non-living (e.g., artificial) object.
- System 100 comprises a static magnet system 104 which generates a substantially homogeneous and stationary magnetic field Bo in the longitudinal direction, a gradient assembly 106 which generates instantaneous magnetic field gradient pulses to form a non-uniform superimposed magnetic field, and a radiofrequency transmitter system 108 which generates and transmits radiofrequency pulses to body 102.
- System 100 further comprises an acquisition system 110 which acquires MRI scans from the body, and a control system 112 which is configured for implementing a pulse sequence.
- control system 112 is configured for allowing the operator to select between pulse sequences of different MRI modalities, as further detailed hereinabove.
- Control system 112 is also configured to control acquisition system 110 such that MRI scans are sequentially acquired.
- system 100 further comprises an image producing system 114 which produces MR images from the signals.
- Image producing system 114 optionally and preferably implements a Fourier transform so as to transform k- space data into an array of image data.
- Console 120 can include a keyboard, control panel a display, and the like.
- Console 120 can include or it can communicate with a data processor 122.
- Gradient pulses and/or radiofrequency pulses can be generated by a generator module 124 which is typically a part of control system 112.
- Generator module 124 produces data which indicates the timing, strength and shape of the radiofrequency pulses which are to be produced, and the timing of and length of the data acquisition window.
- Gradient assembly 106 typically comprises G x , G y and G z coils each producing the magnetic field gradients used for position encoding of the acquired signals.
- Radiofrequency transmitter system 108 is typically a resonator which is used both for transmitting the radiofrequency signals and for sensing the resulting MR signals radiated by the excited nuclei in object 102.
- the sensed MR signals can be demodulated, filtered, digitized etc. in acquisition system 110 or control system 112.
- Data processor 122 is preferably configured for receiving the signals from control system
- compositions, method or structure may include additional ingredients, steps and/or parts, but only if the additional ingredients, steps and/or parts do not materially alter the basic and novel characteristics of the claimed composition, method or structure.
- a compound or “at least one compound” may include a plurality of compounds, including mixtures thereof.
- range format is merely for convenience and brevity and should not be construed as an inflexible limitation on the scope of the invention. Accordingly, the description of a range should be considered to have specifically disclosed all the possible subranges as well as individual numerical values within that range. For example, description of a range such as from 1 to 6 should be considered to have specifically disclosed subranges such as from 1 to 3, from 1 to 4, from 1 to 5, from 2 to 4, from 2 to 6, from 3 to 6 etc., as well as individual numbers within that range, for example, 1, 2, 3, 4, 5, and 6. This applies regardless of the breadth of the range.
- a numerical range is indicated herein, it is meant to include any cited numeral (fractional or integral) within the indicated range.
- the phrases “ranging/ranges between” a first indicate number and a second indicate number and “ranging/ranges from” a first indicate number “to” a second indicate number are used herein interchangeably and are meant to include the first and second indicated numbers and all the fractional and integral numerals therebetween.
- This example describes a neural approach that jointly deblurs scan pairs acquired with mutually orthogonal phase-encoding directions. This leverages the complementarity of the respective phase encoded information as blur directions are also mutually orthogonal between the scans in the pair.
- This Example also described an architecture that is trained end-to-end and that is applied to T1W scan pairs consisting of one scan with contrast media injection (CMI), and one without CMI.
- CMI contrast media injection
- Qualitative and quantitative validation is provided against state-of-the-art deblurring methods, for an acceleration factor of four beyond compressed sensing acceleration. The method described herein outperforms the compared methods.
- raw data samples are used to fill the k-space. These are discrete data points placed on a finite grid in k-space.
- samples are acquired along the phase-encoding direction in a line-by-line ordering, with acquisition duration affected by the phase-encoding rather than the frequency encoding (readout) direction [4] .
- CS compressed sensing
- Tsiligianni proposes a convolutional network that uses a high resolution (HR) scan of one (source) modality to super-resolve an image of a different (target) modality.
- HR high resolution
- Xiang et al [29] present a Unet-based architecture that uses HR T1W scans to reconstruct under-sampled T2W scans.
- Zhou et al [32] also use T1W as prior to reconstruct T2W scans. They use a recurrent network where each block is comprised of both k-space restoration network and image restoration network.
- Iwamoto et al [9] use synthesized scans, down-sample them to create blurred versions, and use a high quality scan in another modality to learn deblurring.
- the resulting network is used to enhance an LR scan in one modality using an HR guidance scan in another modality.
- MRI deblurring is closely related to natural image enhancement problems such as superresolution [17, 23] and deblurring [16]. They resemble in their definition as inverse problems and in the applicable deep learning architectures, providing an additional comparison basis to SOTA methods [16].
- Kupyn et al [16] present a GAN architecture that uses a conditional GAN with a perceptual loss incorporated in its loss function components. This is a follow up work of [15] reaching SOTA results.
- One difference between medical and natural image enhancement is that while in the latter a photo-realistic eye -pleasing result is usually sought, in medical image analysis details must be correctly restored to preserve diagnostic value.
- This Example describes an end-to-end framework for deblurring accelerated multi-modal MRI scans.
- An advantage of the technique of the present embodiments is that it provides a joint deblurring scheme for Low Resolution (LR) MRI scans of different modalities.
- Another advantage of the technique of the present embodiments is that it provides better deblurring results in comparison to single-modality methods.
- each entry in the dataset consists of four brain MRI scans of the same patient: two pairs of LR and HR scans, one pair with a contrast media injection (CMI) and one without CMI, where the phase-encoding direction is changed between the two LR scans.
- CMI contrast media injection
- Image registration is the alignment of two or more images into the same coordinate system.
- the image transformed into another coordinate system is referred to below as the moving image and the image remaining in its original coordinate system is referred to below as the fixed image.
- Image registration is employed in many medical imaging applications, as it helps to establish correspondence between scans taken at different times, of different subjects, with different modalities.
- registration is a pre-processing step consisting of several elements. Firstly, a 3D rigid-body registration between each LR-HR pair is performed. Unlike researches based on synthetic data, movements of the patient between the two scans are also addressed, otherwise the accuracy of LR-HR pairing may be reduced and may lead to inferior deblurring results.
- Brain atlases are useful in many medical applications. Brain MRI atlases are a collection of MRI scans collected from several different individuals. These scans are averaged while incorporating statistical knowledge in a voxel- wise, regional, or global manner. In this example registration to atlas was added, as it allows for more consistency within the entire dataset and not only scan-wise. As brains of several different subjects were registered, 3D anisotropic scaling and 3D rigid transformation was calculated. In this Example, only the parameters of the rigid transformation were applied. The reason is that while registering, interpolation is applied so it is desired to avoid unnecessary deformation to the signal. The machine learning procedure that was employed in this example was an artificial neural network that was trained on images registered to atlas. Once the deblurred images were obtained the inverse transformation was applied to return into the original image space.
- the atlas used in this example is composed of unbiased averages of 152 T1 -weighted MRI scans from the ICBM study [3, 5, 6].
- the registration process is visualized in FIGs. 4A-C, illustrating 3D registration to the atlas.
- FIG. 4A illustrates registration of HR scan to ER scan
- FIG. 4B illustrates registration of contrasted scans to non-contrasted scans
- FIG. 4C illustrates registration of all four registered scans to the atlas.
- the machine learning procedure used in this example is an artificial neural network which in this example is a fully convolutional neural network, and which is referred to below as a Multi- Modal MRI Deblurring Network (MMMD-Net).
- the network receives, as input data, two LR MRI scans of two different modalities, each blurred in a different axial direction (x or y) and outputs a deblurred version of both images.
- the network contains two branches.
- FIG. 5 illustrates the branch architecture. Its input is two registered scans of the two different modalities, stacked one on top of the other. It outputs a deblurred version of the top input scan.
- the branch architecture was fully convolutional architecture with 9 convolution layers, 64 filters followed by a ReLU activation function in each layer.
- the architecture illustrated in FIG. 5 can also be used as a non-branched neural network, with an input layer 202 and an output layer 208 that provide image data of a deblurred scan.
- FIG. 6 illustrates the architecture of the MMMD-Net.
- the anisotropic kernels were selected to be enlarged in the phase-encoding direction, so as to take advantage of the prior knowledge regarding the blur direction [21].
- Residual Learning [7] is useful in various image enhancement problems such as deblurring, super-resolution and denoising. With residual learning the network learns the difference between the restored and original images rather than learning the restored image itself. For image enhancement tasks learning the difference is desirable as it promotes similarity between the input and the output images. (EQ. i)
- y is the reconstructed image
- x is the input (in this example the LR image)
- F(x; 0) is a function that represents the learned residual mapping.
- the network is trained using a multi-component loss function.
- Pixel- wise loss such as LI or MSE
- GSE ground truth
- Perceptual loss used in image transformation tasks [10] is based on the differences between high-level features of the image, rather than between pixel values. Pretrained convolutional neural networks are often used in order to extract these high-level features.
- a pre-trained VGG-16 network [26] was used as a feature extractor. Both the HR image and the output image are fed into the VGG model, where features are extracted from multiple layers. The LI distance is calculated between each pair of extracted features. Eventually the mean is taken to form the final ⁇ perceptual loss component.
- Layer 0 refers to the VGG-16 input, which in the present Example is the HR and deblurred output images. Its contribution to the sum is in fact the pixel-wise LI distance between the HR and deblurred output images.
- the other layers are numbered according to the sequential model numbering in the Torchvision pre-trained VGG-16 model.
- SSIM Structure Similarity index
- the loss expression (EQ. 2) is calculated per branch, and the network’s total loss is the sum of the two.
- multi-modality MRI is the acquisition of two scan types, T1W scans and T1W CMI-enhanced scans. Both brain scans are commonly acquired in diagnostic practice. Thus, the following scans were acquired: Two HR scans, with acquisition matrix (2D Cartesian k-space sampling) size of 240 x 240, and two complementary LR sagittal scans.
- One LR sagittal scans was a T1W scan with a 240 x 60 acquisition matrix, resulting from reduction by a factor of 4 in the phase-encoding direction. This reduction translates into an acceleration factor of 4. In the image domain, the acceleration leads to strong blur artifacts along the x axis.
- the other LR sagittal scan was a T1W CMI-enhanced scan with a 60 x 240 acquisition matrix and the same acceleration factor. This time, the phase-encoding direction is swapped, such that in the image domain, the acceleration leads to strong blur artifacts along the y axis.
- the scanner firmware presented the reconstructed HR and LR scans as 512 x 512 x 170 voxel sets.
- FIG. 7 demonstrates that unlike the method of the present embodiments, all conventional methods struggled to restore details originating from CMI.
- the images generated by DAGAN demonstrate no such details.
- ADMR-Net has mostly failed to restore them as well.
- the attempt to restore the CMI-contrast details resulted in strong artifacts.
- the MMMD-Net described was able to restore CMI-contrast details in different areas of the brain.
- the method of the present embodiments was able to restore fine structural details of the brain and to achieve superior results in this aspect as well.
- FIG. 8 also demonstrates the superior performance of the method of the present embodiments. With DAGAN the results are still blurred and have strong patchy looking artifacts.
- ADMR-Net provides a rather blurry result as well. DeblurGAN produced artifacts in some of the patches along with blurred regions especially noticeable in detailed small regions.
- FIGs. 9A-B and 10A-B are presented per modality and per performance index.
- FIG. 9A shows PSNR index in T1W MRI scans with CMI
- FIG. 9B shows SSIM index in T1W MRI scans with CMI
- FIG. 10A shows PSNR index in T1W scans
- FIG. 10B shows SSIM index in T1W scans.
- FIGs. 9A-10B shows nine bar quintets.
- the leftmost bar corresponds to the results for LR
- the second from left bar corresponds to the method of the present embodiments
- the next bar corresponds to ADMR-Net
- the next bar corresponds to DeblurGANv2
- the fifth bar corresponds to DAGAN.
- the method of the present embodiments scored the highest PSNR and SSIM values for both modalities compared to all other methods.
- the LR images obtained the lowest scores in all but one case.
- This example presented a fully convolutional neural network for jointly deblurring multimodal brain MRI scans.
- the network was applied to multi-modal brain scans, where the modalities are T1W with and without CMI.
- the scans were acquired with phase-encoding directions orthogonal between the two modalities, and with an acceleration factor of 4 along the phase-encoding directions.
- HR and LR For training and validation, a unique dataset of actual T1W brain scans with various medical conditions was assembled, with four scans per subject: HR and LR, with and without CMI where the phase-encoding direction is switched.
- Experimental results reveal superior deblurring performance with respect to conventional single-modality methods, both visually and in terms of the PSNR and SSIM indices. These results demonstrate substantial MRI acceleration, allowing higher MRI throughput, lower costs and better accessibility to MRI.
- MRI images can be acquired in a two-dimensional slice-by-slice manner, or alternatively using three-dimensional (3D) acquisition techniques that allow volumetric imaging of an entire region of interest in a single scan.
- 3D MRI acquisition thin contiguous slices can be retrospectively reconstructed in any orientation. This improves spatial resolution and reduces partial volume effects compared to conventional 2D scanning.
- 3D MRI data can also be reformatted for multi-planar analyses or projections.
- Advantages of 3D MRI acquisition include higher signal- to-noise ratios, improved spatial resolution, and reduced scanning times. It is recognized that 3D MRI is more demanding on time consumption.
- phase-encoding is applied along two orthogonal directions (e.g., x and y), while frequency encoding is applied in the third (e.g., z) direction. This allows for volumetric scanning of the entire region of interest.
- TACQ NEX*N x *N y *TR
- N x and N y are the number of points in the phase-encoding matrix.
- NEX is the number of excitations upon the signal being averaged.
- TR is the repetition time between two successive pulses.
- the total scan time is proportional to the resolution in each direction as well as the TR. 3D MRI acquires the entire volume in a single shot, enabling high-resolution isotropic imaging. It is appreciated, however, that the long acquisition time can lead to greater motion artifacts and patient discomfort.
- the primary factor determining 3D MRI acquisition time is the number of phase-encoding steps N x and N y , which set the spatial resolution. Reducing either N x or N y reduces the total scan duration. However, simply decreasing N x or N y using standard sampling leads to under- sampling artifacts in the reconstructed images, including aliasing and reduced signal-to-noise ratio.
- under- sampling techniques can be employed.
- Conventional parallel imaging methods like GRAPPA and SENSE allow for reducing phase-encoding steps by taking advantage of multi-coil spatial information.
- Conventional compressed sensing techniques exploits sparsity and successfully reconstructs MRI from randomly under-sampled k-space data.
- This Example describes a scheme optimized for multi- sequence 3D MRI acquisition protocols (multiple 3D scans with different contrast properties acquired during an imaging session).
- This scheme can be used in combination with the acceleration technique, e.g. compressed sensing.
- the technique described herein allows under-sampled acquisition that reduces the scan time by decrementing the phase-encoding steps in alternating directions for successive contrasts.
- each scan is acquired in k-space defined by common orthogonal directions p, q, r.
- the acquisition matrix size for each scan is set, according to some embodiments of the present invention, as follows (see also FIG. 11): * Q ‘ 7?
- P, Q, and R are the number of k-space samples acquired along each direction p, q, r, respectively, for a reference (not acquired in practice) full-resolution scan.
- the acquired blurred images constitute a multi-channel 3D volume with channels corresponding to each of the acquired contrasts (e.g., T1 -weighted, T2-weighted, and T1 -FLAIR). Since blur is along a different direction in each acquired scan, this multi-channel input contains complementary information from the different scan contrasts which can be leveraged by the deblurring neural network.
- deblurring architectures Two examples are considered in this example. These include (i) a single neural network with multiple output channels corresponding to each input contrast, which is optimized together through shared weights (FIG. 12), and (ii) a multi-branch neural network with separate branches for each contrast and hence separate weights (FIG. 13).
- the technique can be used also when there are two MRI scans (e.g., a Tl-weighted MRI scan and a T2- weighted MRI scan, or a Tl-weighted MRI scan and a T1 -FLAIR MRI scan).
- acceleration can be applied along any two of the three orthogonal k-space directions p, q, r.
- acceleration may be applied along p and q, along p and r, along q and r. All combinations and permutations of accelerating two directions for the two scan acquisition schemes can be employed. This provides flexibility to choose which two directions to accelerate based on the orientation of the anatomy and application. The two directions along which acceleration is applied can be chosen to minimize artifacts for the target anatomy.
- the acceleration factor / can be set independently for each accelerated scan direction corresponding to p, q, r.
- Unequal acceleration factors provide flexibility to balance image resolution, acquisition time, and artifacts in each direction .
- a perceptual loss can be embedded in the network (see EQ. 5, below) with pre-trained weights from a model that used the same MRI sequences, the weights of the pre-trained feature extraction network are held fixed, while the MRI reconstruction network is trained to minimize the perceptual loss. This guides the network to produce reconstructions that reside in a similar feature space to the fully sampled reference images.
- the perceptual loss provides a supplementary training signal alongside pixel-wise losses, resulting in images that appear more realistic to human visual perception.
- the concept described above for accelerating cartesian k- space sampling scheme in 2 or 3D can also be utilized to non-cartesian acquisition schemes, such as, but not limited to, radial k- space sampling or spiral k-space sampling.
- the k-space is sampled sequentially by a set of straight lines, each passing through the k-space origin with a different slope (FIG. 14A).
- a uniform angular distribution of the k- space radial sampling lines result in an angular shift of 360/N degrees between adjacent radial sampling lines.
- n>2 accelerated MRI scans are acquired.
- the MRI scans are "accelerated” because they contain less radial sampling lines then they would have contained, had a single MRI scan was acquired.
- each MRI scan is acquired along N/n radial sampling lines, with an equal angular shift between each radius of the same MRI scan equal to 360/(n-N) degrees. This provides n sets of N/n radial sampling lines.
- the radial sampling lines of the sets are angularly- shifted from each other in the k-space in order to obtain a sampling pattern of N radial sampling lines, with an angular shift of 360/N degrees between adjacent radial sampling lines, except that the radial sampling lines of different MRI scan are interlaced thereamongst, as illustrated in FIG. 14B.
- a set of N/4 radial lines sample the k-space radially for each MRI scan, with an equal angular shift between each radius of the same set equal to 360/(4N) degrees.
- the 4 sets of radial sampling lines are angularly- shifted from each other in the k-space in order to obtain a sampling pattern of N radial sampling lines, with an angular shift of 360/N degrees between adjacent radial sampling lines, except that the radial sampling lines of different MRI scan are interlaced thereamongst, as illustrated in FIG. 14B.
- n>2 four accelerated MRI scans e.g., T1W, T2W, T1FLAIR, T2FLAIR
- a set of N/4 radial lines sample the k-space radially for each MRI scan, with an equal angular shift between each radius of the same set equal to 360/(4N) degrees.
- the 4 sets of radial sampling lines are angularly- shifted from each other in the k-space in order to obtain a sampling pattern of N radial sampling lines, with an angular shift of 360/N degrees between adjacent radial sampling lines, except that the radial sampling lines of different MRI scan are interlaced thereamongst, as illustrated in FIG. 14B.
- consecutive radial sampling lines are associated to a cyclic sequence along the azimuthal direction of the four MRI scans, e.g., T1W - T2W - T1 FLAIR - T2 FLAIR - T1W - T2W - T1 FLAIR - T2 FLAIR -...-T1W - T2W - T1 FLAIR - T2 FLAIR...
- FIG. 14C The situation is similar in the case of spiral MR acquisition, except that instead of a plurality of interlaced radial sampling lines shown in FIG. 14B, there is a plurality of interlaced spiral sampling lines shown in FIG. 14C.
- the illustration in FIG. 14C corresponds to three MRI scans of different modalities.
- the sampling pattern 90 includes consecutive spiral sampling lines forming a cyclic sequence along the radial direction, e.g., T1W - T2W - T1 FLAIR - T1W - T2W - T1 FLAIR -...-T1W - T2W - T1 FLAIR and so on.
- the resulting accelerated scans can be jointly processed using neural networks as described herein to obtain enhanced scans.
- the de-blurring can be performed either by applying the networks to the accelerated scans after transformation (by Fourier transform) to the image space as was done implicitly for the cartesian case, or, by applying the networks directly in the k-space, before the projection onto the image space by the Fourier transform.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- General Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Signal Processing (AREA)
- Radiology & Medical Imaging (AREA)
- Evolutionary Computation (AREA)
- Mathematical Physics (AREA)
- High Energy & Nuclear Physics (AREA)
- Software Systems (AREA)
- Surgery (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Pathology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- General Engineering & Computer Science (AREA)
- Psychiatry (AREA)
- Physiology (AREA)
- Fuzzy Systems (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
Abstract
Description
Claims
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23876909.5A EP4601535A1 (en) | 2022-10-11 | 2023-10-11 | Method and system for accelerating magnetic resonance imaging |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US202263415015P | 2022-10-11 | 2022-10-11 | |
| US63/415,015 | 2022-10-11 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024079732A1 true WO2024079732A1 (en) | 2024-04-18 |
Family
ID=90668921
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IL2023/051069 Ceased WO2024079732A1 (en) | 2022-10-11 | 2023-10-11 | Method and system for accelerating magnetic resonance imaging |
Country Status (2)
| Country | Link |
|---|---|
| EP (1) | EP4601535A1 (en) |
| WO (1) | WO2024079732A1 (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2098990A1 (en) * | 2008-03-04 | 2009-09-09 | Carestream Health, Inc. | Method for enhanced voxel resolution in MRI image |
| US20220058438A1 (en) * | 2018-09-14 | 2022-02-24 | The Johns Hopkins University | Machine learning processing of contiguous slice image data |
-
2023
- 2023-10-11 WO PCT/IL2023/051069 patent/WO2024079732A1/en not_active Ceased
- 2023-10-11 EP EP23876909.5A patent/EP4601535A1/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2098990A1 (en) * | 2008-03-04 | 2009-09-09 | Carestream Health, Inc. | Method for enhanced voxel resolution in MRI image |
| US20220058438A1 (en) * | 2018-09-14 | 2022-02-24 | The Johns Hopkins University | Machine learning processing of contiguous slice image data |
Non-Patent Citations (2)
| Title |
|---|
| BENOIT SCHERRER, GHOLIPOUR ALI, WARFIELD SIMON K.: "Super-resolution reconstruction to increase the spatial resolution of diffusion weighted images from orthogonal anisotropic acquisitions", MEDICAL IMAGE ANALYSIS, OXFORD UNIVERSITY PRESS, OXOFRD, GB, vol. 16, no. 7, 1 October 2012 (2012-10-01), GB , pages 1465 - 1476, XP055588128, ISSN: 1361-8415, DOI: 10.1016/j.media.2012.05.003 * |
| MAYBERG MAYA; GREEN MICHAEL; VASSERMAN MARK; RAICHMAN DOMINIQUE; BELENKY EUGENIA; WOLF MICHAEL; SHROT SHAI; KIRYATI NAHUM; KONEN E: "Anisotropic neural deblurring for MRI acceleration", INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, SPRINGER, DE, vol. 17, no. 2, 3 December 2021 (2021-12-03), DE , pages 315 - 327, XP037673293, ISSN: 1861-6410, DOI: 10.1007/s11548-021-02535-6 * |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4601535A1 (en) | 2025-08-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9766316B2 (en) | Magnetic resonance imaging device and quantitative susceptibility mapping method | |
| Bhushan et al. | Correcting susceptibility-induced distortion in diffusion-weighted MRI using constrained nonrigid registration | |
| CN106981051B (en) | System and method for motion resolved MRI | |
| US20240362835A1 (en) | Quasi-newton mri deep learning reconstruction | |
| US20230380714A1 (en) | Method and system for low-field mri denoising with a deep complex-valued convolutional neural network | |
| WO2016001853A1 (en) | Image reconstruction for mri using multiplexed sensitivity-encoding | |
| Jiang et al. | Respiratory motion correction in abdominal MRI using a densely connected U-Net with GAN-guided training | |
| Dai et al. | Distortion-free diffusion imaging using self-navigated Cartesian Echo-planar time resolved acquisition and joint magnitude and phase constrained reconstruction | |
| Wang et al. | Multi-parametric molecular imaging of the brain using optimized multi-TE subspace MRSI | |
| Cheng et al. | Compressed sensing: from research to clinical practice with data-driven learning | |
| Sui et al. | Gradient-guided isotropic MRI reconstruction from anisotropic acquisitions | |
| US20250148601A1 (en) | Simulating structures in images | |
| WO2024079732A1 (en) | Method and system for accelerating magnetic resonance imaging | |
| US20250005715A1 (en) | Methods, apparatuses, systems and computer-readable mediums for correcting echo planar imaging artifacts | |
| WO2024006944A1 (en) | Methods and systems for super-resolution with progressive sub-voxel up-sampling | |
| Mayberg et al. | Anisotropic neural deblurring for MRI acceleration | |
| Cheema et al. | Transformer-based arterial spin labeling perfusion MRI denoising | |
| Vu et al. | DREAMER: Rapid and Simultaneous Multiple Contrast Magnetic Resonance Imaging of Solid and Soft Tissue | |
| US20230360210A1 (en) | Method for generating a subject-specific map of a tissue property | |
| Hong et al. | Multifold acceleration of diffusion MRI via slice-interleaved diffusion encoding (SIDE) | |
| Martín González | Parallelization and deep learning techniques for the registration and reconstruction of dynamic cardiac magnetic resonance imaging | |
| Dolui et al. | Reconstruction of HARDI using compressed sensing and its application to contrast HARDI | |
| Connolly | Predicting primary diffusion directions in white matter from T₁-weighted magnetic resonance images | |
| Rotman et al. | A Novel Approach for Correcting Multiple Discrete Rigid In-Plane Motions Artefacts in MRI Scans | |
| Arefeen et al. | A Generative Diffusion Model to Solve Inverse Problems for Robust in-NICU Neonatal MRI |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23876909 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023876909 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2023876909 Country of ref document: EP Effective date: 20250512 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2023876909 Country of ref document: EP |