[go: up one dir, main page]

WO2024252413A1 - Detection system for alzheimer's disease using brain structural and/or functional magnetic resonance image processing and machine learning techniques - Google Patents

Detection system for alzheimer's disease using brain structural and/or functional magnetic resonance image processing and machine learning techniques Download PDF

Info

Publication number
WO2024252413A1
WO2024252413A1 PCT/IN2024/050632 IN2024050632W WO2024252413A1 WO 2024252413 A1 WO2024252413 A1 WO 2024252413A1 IN 2024050632 W IN2024050632 W IN 2024050632W WO 2024252413 A1 WO2024252413 A1 WO 2024252413A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
images
mri
disease
alzheimer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/IN2024/050632
Other languages
French (fr)
Inventor
Saikat CHAKRABARTI
Subhrangshu DAS
Priyanka PANIGRAHI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Council of Scientific and Industrial Research CSIR
Original Assignee
Council of Scientific and Industrial Research CSIR
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Council of Scientific and Industrial Research CSIR filed Critical Council of Scientific and Industrial Research CSIR
Publication of WO2024252413A1 publication Critical patent/WO2024252413A1/en
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/40ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/044Recurrent networks, e.g. Hopfield networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/084Backpropagation, e.g. using gradient descent
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10088Magnetic resonance imaging [MRI]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20076Probabilistic image processing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30016Brain

Definitions

  • the present invention relates to a detection system that utilizes image processing, machine learning, and statistical analysis to detect structural and functional changes that appear in the human brain during the early and late stages of Alzheimer’s disease.
  • the system is capable of processing and analyzing both brain structural MRI (sMRI) and functional MRI (fMRI) data where deep learning techniques such as convoluted neural network (CNN) algorithms were trained and tested to distinguish AD patients from normal cohorts.
  • sMRI brain structural MRI
  • fMRI functional MRI
  • CNN convoluted neural network
  • the detection analysis package is embedded within a system comprising one computer processor unit, memory, and storage media to execute and store the programs and subsequent results thereon.
  • Brain MRI analysis is one of the most active fields in the medical image analysis community. For the last couple of decades, a vast number of researches have come up with accurate extraction of quantitative measures from brain MRI data. These studies showed that there is scope to develop automatic classifier to identify AD or mild cognitive impairment (MCI) and apply a more quantitative approach both in dementia research and in clinical practice.
  • MCI mild cognitive impairment
  • ML machine learning
  • DWT discrete wavelet transform
  • PCA principal component analysis
  • FCM Fuzzy C-Means
  • RF Random Forest
  • KNN K-nearest neighbor
  • SVM support vector machine
  • CNN convolutional neural network
  • CC corpus callosum
  • 2D two-dimensional
  • SVM support vector machine
  • tools and techniques were developed for automatic identification followed by segmentation of corpus callosum (CC) using the publicly available Alzheimer’s Disease Neuroimaging Initiative (ADNI) data from a large number of AD patient and healthy cohorts.
  • US11151717B2 discloses a method implementing image processing and machine learning techniques through utilization of structural MR images and PET image data for AD diagnosis.
  • the system uses as inputs both functional positron emission tomography and structural magnetic resonance imaging data, reconstructs a model of the patient's cortex, uses machine learning techniques to generate probabilities for mild cognitive impairments for local cortical regions, uses machine learning techniques to fuse the local diagnoses to generate a global diagnosis based on each imaging modality, then uses machine learning techniques to fuse the modality - specific global diagnoses to generate a final global diagnosis.
  • the methodology of the present invention is different from the above-mentioned invention.
  • the present invention utilizes whole -brain MR imaging (MRI & fMRI) to distinguish AD patients from the normal cohorts.
  • the present invention does not require any supervision. It uses combinations of deep learning (CNN) protocols/models to distinguish AD patients from normal cohorts.
  • CNN deep learning protocol/models to distinguish AD patients from normal cohorts.
  • the present invention is applicable to varying degrees of AD, i.e., from mild to moderate and up to severe Alzheimer’s disease.
  • Patent application number CN112767374A relates to an MRI-based Alzheimer disease focus region semantic segmentation algorithm, and belongs to the field of computer vision and medical image processing.
  • This method utilizes a semantic segmentation algorithm for a focus region of Alzheimer's disease based on MRI and takes a general semantic segmentation network as a basic frame, strengthens feature expression and attention to salient features, and extracts features aiming at focus regions with different scales so as to more accurately determine the position of each focus region.
  • This method uses U-net network framework.
  • the limitations of U-Net include low accuracy, low precision, and a cumbersome detection process, which can affect training and accuracy.
  • the present invention is much more exhaustive and sophisticated. Combination structural and functional MRI data processing and analysis aid the present invention in obtaining higher efficacy. It is a reasonably rapid method of detection of AD which gives results within 15-30 minutes.
  • the present invention produces excellent efficacy with 90% or more accuracy for both testing and validation cohort-based benchmarking analyses.
  • the main objective of the current invention is to detect and diagnose AD and/or MCI patients through computer-aided MR image processing and subsequent analysis using a deep learning based classification and prediction system comprising of trained models generated from large scale AD patients and healthy control cohorts via exhaustive feature extraction and trainingtesting experiments, instructions/package to process query MRI data, testing of query data with respect to the trained models, prediction module to portray the probable diagnosis of the query data embedded within a hardware system comprising one standard computer processor unit, memory and storage media to execute and store the programs and subsequent results thereon.
  • Another objective of the invention is to utilize both sMRI and fMRI data capable of capturing the structural and functional anomalies that may appear during early and late stages of the AD/MCI disease progression. Implementation of this embedded system to be synced with the clinically used MRI/fMRI machines
  • the present invention processes whole brain slices from axial, sagittal, and coronal views of the given sMRI and/or fMRI data and further extracts features to feed into a deep learning-based CNN module to calculate the AD/healthy probability of each slice.
  • Another objective of the invention is to implement statistical analysis to diagnose the AD status of the given MRI sample based on the AD probability computed from three different views of the sMRI and/or fMRI data.
  • Another objective of the invention is to develop the AD detection analysis system comprising one computer processor unit, memory and storage media to execute and store the programs and subsequent results thereon.
  • Another objective of the invention is to provide a graphical user interface (GUI) based user- interactive platform embedded within the detection system for prediction of the AD status of the query sample sMRI/fMRI data.
  • GUI graphical user interface
  • the present relates to a system (300) for detecting neurodegenerative disorder comprising; i) at least one computer processor unit (330); ii) at least one memory media (340); iii) one graphical user interface -based display unit (350); and iv) one storage medium (360).
  • the system analysing and predicting brain structural MRI slices data and functional MRI slices data followed by implementation, customization, and standardization of Convoluted Neural Network algorithms.
  • the present relates to a method (200) for predicting the functional MRI by the system of claim 1, wherein the method comprising the steps of;
  • ADNI Alzheimer’s Disease Neuroimaging Initiative
  • step (b) converting the functional MRI data of step (a) using data pre- processing module (220) into 2D images for the ease of handling the images and further pre-processing of the images;
  • step (c) extracting the 2D images of step (b) in three different views, i.e., axial, coronal, and sagittal, respectively;
  • step (d) extracting the pixel values of the 2D images of step (c) using file preparation module (230);
  • step (e) classifying the pixel images obtained in step (d) through Convoluted Neural Network module (240) using training-testing-validation protocol along with standardization of parameters and hyper-parameters followed by detailed standardization of Convoluted Neural Network module;
  • step (f) combining all standardization of step (b) to (e) by standalone hardware system (280) comprising one standard computer processor unit, memory, and storage media of claim 1 to predict the disease status in the prediction module (290).
  • the present invention relates to method (200) for predicting the functional MRI by the system of claim 1, wherein the method comprising the steps of;
  • ADNI Alzheimer’s Disease Neuroimaging Initiative
  • step (b) converting the functional MRI data of step (a) using data pre- processing module (220) into 2D images for the ease of handling the images and further pre-processing of the images;
  • step (c) extracting the 2D images of step (b) in three different views, i.e., axial, coronal, and sagittal, respectively;
  • step (d) extracting the pixel values of the 2D images of step (c) using file preparation module (230);
  • step (e) classifying the pixel images obtained in step (d) through Convoluted Neural Network module (240) using training-testing-validation protocol along with standardization of parameters and hyper-parameters followed by detailed standardization of Convoluted Neural Network module;
  • step (f) combining all standardization of step (b) to (e) by standalone hardware system (280) comprising one standard computer processor unit, memory, and storage media of claim 1 to predict the disease status in the prediction module (290).
  • AD Alzheimer’s disease
  • Magnetic Resonance Imaging sMRI Structural Magnetic Resonance Imaging
  • fMRI Functional Magnetic Resonance Imaging
  • ADNI Alzheimer’s Disease Neuroimaging Initiative
  • Fig. 1 Schematic overview of the approach and methods implemented in the system for sMRI- based analysis and prediction, as per an embodiment herein.
  • Fig. 2 Schematic overview of the approach and methods implemented in the system for fMRIbased analysis and prediction, as per an embodiment herein.
  • Fig. 3 Schematic diagram of the various components of the apparatus/device for detection of AD using sMRVfMRI data as input.
  • Fig. 4 Schematic representation of the detection device along with various input and output option.
  • Fig. 5 Flowchart of the prediction module where each sMRI and/or fMRI slice from three views are processed using all training models.
  • Fig. 6 Flowchart of the prediction module where all sMRI and/or fMRI slices from three views are processed using each training model.
  • the present invention aims to detect and diagnose AD and/or MCI patients through a computer-aided MR image processing and subsequent analysis using a deep learning based classification and prediction system comprising of trained models generated from large scale AD patients and healthy control cohorts via exhaustive feature extraction and trainingtesting experiments, instructions/package to process query MRI data, testing of query data with respect to the trained models, prediction module to portray the probable diagnosis of the query data embedded within a hardware system comprising one standard computer processor unit, memory and storage media to execute and store the programs and subsequent results thereon.
  • the system is composed of two independent yet complimentary diagnosing approaches where one part is capable of processing and analyzing brain structural MRI (sMRI) data followed by implementation, customization, and standardization of convoluted neural network (CNN) algorithms to distinguish AD patients from normal healthy cohorts.
  • sMRI brain structural MRI
  • CNN convoluted neural network
  • the present invention provides a description of AD detection using sMRI data (100).
  • Data collection module (110) depicts collection of sMRI data from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database consisting of 553 healthy and 1156 AD patients (severe AD: 53, moderate AD: 237, and mild AD: 866) followed by data pre-processing module (120), which converted all 3D data (NIFTI format) of the brain structural MR images into 2D slices for the ease of handling the images and further preprocessing of the images. 2D image slices were extracted in three different views, i.e., axial, coronal, and sagittal, respectively.
  • ADNI Alzheimer’s Disease Neuroimaging Initiative
  • the feature extraction and file preparation module (130) extract the pixel values of the images and uses them as features to perform machine learning -based classification.
  • Classification via k-fold training-testing and subsequent validation of the models using convoluted neural network (CNN) module (140) employs a subset of the AD and healthy cohorts for training-testing exercise, and the remaining samples were kept separated for a validation dataset.
  • CNN convoluted neural network
  • Model architecture A sequential model was used for this exercise.
  • the sequential model is a linear stack of layers. It can be first initialized and then layers can be added using various methods.
  • Conv2D is a 2-dimensional convolution layer, which performs spatial convolution over images. The parameters used are Filters, Kernel size, Activation, Kernel initializer, and Input shape.
  • MaxPooling2D is a max pooling operation for spatial data. The parameters used here are Pool size (2,2). Conv2D with 64 filters, 3 x 3 kernel size and Relu activation. MaxPooling2D with pool size (2,2). Conv2D with 128 filters, 3 x 3 kernel size and Relu activation. Flatten and dense layers were used with default parameters, Activation function (dense layer): Relu and Activation function (dense layer): Sigmoid.
  • the model was compiled using parameters such as Loss function, Adam optimizer and Performance metrics (e,g., accuracy and/or Fl score).
  • Model Summary Keras was used which appends an extra dimension for processing multiple batches to train multiple images in every step of a single Epoch. Convolution was performed using various size filters via Conv2D and Maxpooling2D. The flatten layer takes all the pixels along all channels and creates a ID vector (not considering batch size). Two dense layers were added having 128 and 2 units, respectively.
  • Standardization of hyper-parameters like epoch and batch-size Hyper-parameters like epoch and batch-size were standardized to train the dataset.
  • the batch-size is a hyper-parameter of gradient descent that controls the number of training samples to work through before the model's internal parameters are updated.
  • the number of epochs is a hyper-parameter of gradient descent that controls the number of complete passes through the training dataset. Multiple combinations of epoch and batch-size were used for training.
  • Table 1 provides performance values of training-testing and validation cohorts both in terms of slice-wise and patient predictions for the using AD vs. Healthy models.
  • fMRI data was utilized for AD detection (200).
  • Data collection module (210) depicts a collection of fMRI data from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database consisting of 170 healthy, 114 AD, and 170 MCI patients followed by data pre-processing module (220), which converted all 3D data (NIFTI format) of the brain functional MR images into 2D slices for the ease of handling the images and further pre-processing of the images.
  • 2D image slices were extracted in three different views, i.e., axial, coronal, and sagittal, respectively.
  • the feature extraction and file preparation module (230) extracts the pixel values of the images and use them as features to perform machine learning -based classification.
  • Classification via k-fold training-testing and subsequent validation of the models using convoluted neural network (CNN) module (240) employs a subset of the AD and healthy cohorts for training-testing exercise and remaining samples were kept separated for a validation dataset. Following sections depict the model architecture and summary properties (250).
  • CNN convoluted neural network
  • Model architecture Sequential model was used for this exercise using Conv2D 2-dimensional convolution layers. 3 Conv2D layers with Relu activation and two times MaxPooling were performed. Flatten and 2 dense layers were used with default parameters, Activation function (dense layer): Relu and Activation function (dense layer): Sigmoid.
  • Model Compilation of Model The model was compiled using parameters such as Loss function, Adam optimizer and Performance metrics (e,g., accuracy and/or Fl score).
  • Model Summary Keras was used which appends an extra dimension for processing multiple batches to train multiple images in every step of a single Epoch. Convolution was performed using various size filters via Conv2D and Maxpooling2D.
  • Fig. 1 shows an overview of the method 100 for implemented in the system for sMRI based analysis and prediction.
  • the process begins with structural MRI image collection and data processing (110) followed by image preprocessing and feature extraction steps (120 and 130).
  • Classification CNN module using training-testing-validation protocol along with standardization of parameters and hyper-parameters (140) whereas detailed standardization of the CNN modules are done in 150.
  • Step 160 combines all standardized and trained models via developing a standalone hardware system (180) comprising one standard computer processor unit, memory and storage media to execute and store the programs and subsequent results thereon, which could accept input data (170) and provide disease status outcome prediction in the prediction module (190).
  • Fig. 2 shows an overview of the method 200 implemented in the system for fMRI-based analysis and prediction.
  • the process begins with structural MRI image collection and data processing (210) followed by image preprocessing and feature extraction steps (220 and 230).
  • Step 260 combines all standardized and trained models via developing a standalone hardware system (280) comprising one standard computer processor unit, memory, and storage media to execute and store the programs and subsequent results thereon, which could accept input data (270) and provide disease status outcome prediction in the prediction module (290).
  • the invention provides a computer-aided, whole-brain structural/functional MR image analysis-based AD diagnostic system.
  • the system comprising: i) At least one computer processor for executing the instructions therein (330); ii) At least one memory unit (340), one GUI based display unit (350), one computer-readable storage medium (360) to store the instructions along with pre-compiled trained models for live prediction and/or detection; iii) Pre-computed, standardized, and trained models and dataset generated from brain sMRl/fMRI data and associated instructions for utilization of these models in detection of MR slices with probable AD/healthy signatures using CNN based deep learning methods (360), iv) A platform/system for input, query, brain sMRI/l'MRI data retrieval and real-time brain MR image pre-processing and processing (320), v) Programmable instructions to extract features from the query sample MR images (330, 340 and 360), vi) Programmable instructions compare and match the query brain MR image features with pre-existing
  • the invention provides the prototype of the AD detection device along with its input (410, 420, 430) and output (450, 460, and 470) options.
  • Sample MRI images from AD/MCI and/or healthy individuals are shown as examples.
  • MRI slices (410 and 420) from axial, coronal, and sagittal views can be used as input separately.
  • Various image processing modules embedded within the device perform pre-processing, processing, feature extraction, matrix generation, etc, and subsequently, the machine learning modules empowered by the CNN algorithm compare the input image slices against the pre-developed trained models derived from the MRI data from a large number of AD/MCI and healthy individuals.
  • the prediction output module (450) contains two independent strategies (460 and 470) for slice and sample prediction. Details of each strategy are presented in Fig. 5 and Fig. 6 (500 and 600), respectively.
  • the invention provides a detailed flowchart of the steps incorporated within the prediction module where each sMRI and/or fMRI slice from three views is processed using all training models.
  • AD/MCl/healthy like probability of the processed data extracted from each MRI slice (510) is estimated via classification and prediction against all the training models (520).
  • 530 and 540 provide two submodules where voting and average probability-based prediction of each slice is performed.
  • Sub-modules 550 and 560 deal with AD/MCI/healthy status prediction for the whole sample for three different views after consolidating prediction results from each slice.
  • the invention presents a detailed flowchart of the steps incorporated within the prediction module where all sMRI and/or fMRI slices from three views are processed using each training model at a time.
  • the whole sample (all slices) from each view is classified against each of the training model.
  • 630 and 640 provide two submodules where voting and average probability-based prediction of each model is performed.
  • Submodules 650 and 660 deal with AD/MCI/healthy status prediction for the whole sample for three different views after consolidating prediction results from each model
  • the present invention aims to detect and diagnose AD and/or MCI patients through a computer-aided MR image processing and subsequent analysis using a deep learningbased classification and prediction system comprising trained models generated from large-scale AD patients and healthy control cohorts via exhaustive feature extraction and training-testing experiments, instructions/package to process query MRI data, testing of query data with respect to the trained models, prediction module to portray the probable diagnosis of the query data embedded within a hardware system comprising one standard computer processor unit, memory and storage media to execute and store the programs and subsequent results thereon.
  • the system is composed of two independent yet complimentary diagnosing approaches where one part is capable of processing and analyzing brain structural MRI (sMRI) data followed by implementation, customization, and standardization of convoluted neural network (CNN) algorithms to distinguish AD patients from normal healthy cohorts.
  • this package processes, analyzes, and predicts AD/MCI status using functional MRI (fMRI) slices.
  • fMRI functional MRI
  • whole brain slices from axial, sagittal, and coronal views are processed, and brain pixel-based intensity features are fed into a deep learning-based CNN module to calculate the AD/healthy probability of each slice.
  • statistical analysis is employed to diagnose the AD status based on the AD probability computed from three different views.
  • This detection system uniquely offers to detect AD/MCI using both sMRI and fMRI data capable of capturing the structural and functional anomalies that may appear during early and late stages of the disease progression. Hence, this embedded system could easily be synced with the clinically used MRI/fMRI machines. This detection system can aid clinical diagnostics of AD and AD like symptoms in an efficient manner.
  • This detection system uniquely offers AD/MCI/healthy prediction status of each MRI slice from three different views (e.g., axial, coronal, and sagittal, respectively). This detection system provides AD/MCI/healthy status prediction for the whole sample for three different views after consolidating prediction results from each slice. This detection system uniquely offers multiple strategies based on different yet complimentary statistical analyses of the prediction.
  • the invention incorporates a prediction module where each sMRI and/or fMRI slice from three views is processed using all training models.
  • the invention presents a prediction module where all sMRI and/or fMRI slices from three views are processed using each training model at a time.
  • This detection system uniquely offers two submodules where voting and average probability-based prediction of each slice are performed.
  • This detection system contains highly enriched sMRI training models consisting of 15 All AD vs Healthy, 15 Mild vs Healthy, 15 Moderate vs Healthy, and 15 Severe vs Healthy models. All AD vs Healthy models contain data from 354 AD and 354 healthy samples, containing 84940 slices in each view (axial, coronal, and sagittal, respectively).
  • All Mild vs Healthy models contain data from 354 mild and 354 healthy samples, containing 135936 slices in axial and coronal view and 103368 slices in sagittal view. All Moderate vs Healthy models contain data from 151 moderate and 151 healthy samples, containing 57984 slices in axial and coronal view and 44092 slices in sagittal view. All Severe vs Healthy models contain data from 34 severe and 34 healthy samples, containing 13056 slices in axial and coronal view and 9928 slices in sagittal view.
  • This detection system contains highly enriched fMRI training models consisting of 300 AD vs Healthy and 300 MCI vs Healthy models. In each axial model, 73 and 108 demented and healthy samples containing 3504 and 5184 slices are present.
  • This detection system contains a graphical user interface (GUI) based user-interactive platform embedded within the detection system for prediction of the AD status of the query sample sMRI/l'MRI data. This detection system executes prediction for a given query MRI samples in a relatively faster time scale (within 25-30 minutes). This detection system could easily be synced with the clinically used MRI/fMRI machines. This detection system can aid clinical diagnostics of AD and AD like symptoms in an efficient manner.
  • GUI graphical user interface

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Data Mining & Analysis (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Biophysics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Databases & Information Systems (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Quality & Reliability (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)

Abstract

Early and accurate identification of dementia, such as Alzheimer's disease (AD) is of utmost importance. However, despite several decades of biomarker research, there is still no single diagnostic test or biomarker to definitively diagnose dementia and its underlying neurodegenerative disorder. A combination of structural MRI (fMRI) and functional MRI (fMRI) derived image analysis may provide the unique ability to capture the dynamic state of change in the degenerating brain. Hence, to capture the overall structural and functional anomalies of brain tissues caused by AD, an exhaustive combinatorial system has been developed using structural and/or functional MRI data followed by rigorous image processing and deep learning-based algorithms to diagnose AD and/or mild cognitive impairment (MCI) patients. Whole brain sMRI and fMRI slices are processed, and brain pixel-based intensity features are fed into a deep learning-based convoluted neural network (CNN) algorithm to calculate the AD/healthy probability of each MRI slice.

Description

DETECTION SYSTEM FOR ALZHEIMER’S DISEASE USING BRAIN STRUCTURAL AND/OR FUNCTIONAL MAGNETIC RESONANCE IMAGE PROCESSING AND MACHINE LEARNING TECHNIQUES
FIELD OF THE INVENTION
The present invention relates to a detection system that utilizes image processing, machine learning, and statistical analysis to detect structural and functional changes that appear in the human brain during the early and late stages of Alzheimer’s disease. In present invention the system is capable of processing and analyzing both brain structural MRI (sMRI) and functional MRI (fMRI) data where deep learning techniques such as convoluted neural network (CNN) algorithms were trained and tested to distinguish AD patients from normal cohorts.
The detection analysis package is embedded within a system comprising one computer processor unit, memory, and storage media to execute and store the programs and subsequent results thereon.
BACKGROUND OF THE INVENTION
A large body of research has shown that imaging techniques are most promising technologies to improve subclinical and early diagnosis of dementia. Brain MRI analysis is one of the most active fields in the medical image analysis community. For the last couple of decades, a vast number of researches have come up with accurate extraction of quantitative measures from brain MRI data. These studies showed that there is scope to develop automatic classifier to identify AD or mild cognitive impairment (MCI) and apply a more quantitative approach both in dementia research and in clinical practice.
Use of different machine learning (ML) algorithms in analyzing bio-medical images is quite common since last decade. Different ML algorithms e.g. discrete wavelet transform (DWT), (Wulandari et al., 2018) principal component analysis (PCA) (Lama et al., 2017, Aruchamy et al., 2020) have been used to identify significant features and K-Means, Fuzzy C-Means (FCM) (Kar and Majumder, 2019) for clustering where Random Forest (RF) (Ezzati et al., 2019, Moore et al., 2019), K-nearest neighbor (KNN) (Borgohain et al., 2021, Acharya et al., 2019), and support vector machine (SVM) (Uysal and Ozturk, 2019, Long et al., 2017) have been used for classifying data. But, among all ML, artificial neural network (ANN) and convolutional neural network (CNN) (Pan et al., 2020, Lin et al., 2018, Islam and Zhang, 2018, Folego et al., 2020, and Bae et al., 2020) have been found to be widely used for identifying biomarkers and classifying bio-medical images. The implementation of CNN involves steps like finding convoluted layer followed by max pooling in a repeated way using open-source python library and modules such as Tensorflow, Keras, Theano. However, these systems require powerful graphics and high speed processor and take comparatively more time and effort to standardize and develop optimized models for better prediction accuracy.
In one of the previous works, (Das et al., 2021) the applicants of the current application showed morphological changes of corpus callosum (CC) caused by AD can be captured from sMRI data and further be used as two-dimensional (2D) features to feed into a multivariate pattern analysis using statistical machine learning technique, support vector machine (SVM), which distinguished AD and MCI patients from healthy ones with very high accuracy. Further, tools and techniques were developed for automatic identification followed by segmentation of corpus callosum (CC) using the publicly available Alzheimer’s Disease Neuroimaging Initiative (ADNI) data from a large number of AD patient and healthy cohorts.
By reference to US Patent application number US11151717B2 discloses a method implementing image processing and machine learning techniques through utilization of structural MR images and PET image data for AD diagnosis. The system uses as inputs both functional positron emission tomography and structural magnetic resonance imaging data, reconstructs a model of the patient's cortex, uses machine learning techniques to generate probabilities for mild cognitive impairments for local cortical regions, uses machine learning techniques to fuse the local diagnoses to generate a global diagnosis based on each imaging modality, then uses machine learning techniques to fuse the modality - specific global diagnoses to generate a final global diagnosis.
The methodology of the present invention is different from the above-mentioned invention. The present invention utilizes whole -brain MR imaging (MRI & fMRI) to distinguish AD patients from the normal cohorts. The present invention does not require any supervision. It uses combinations of deep learning (CNN) protocols/models to distinguish AD patients from normal cohorts. The present invention is applicable to varying degrees of AD, i.e., from mild to moderate and up to severe Alzheimer’s disease.
By reference to CN Patent application number CN112767374A relates to an MRI-based Alzheimer disease focus region semantic segmentation algorithm, and belongs to the field of computer vision and medical image processing. This method utilizes a semantic segmentation algorithm for a focus region of Alzheimer's disease based on MRI and takes a general semantic segmentation network as a basic frame, strengthens feature expression and attention to salient features, and extracts features aiming at focus regions with different scales so as to more accurately determine the position of each focus region.
This method uses U-net network framework. The limitations of U-Net include low accuracy, low precision, and a cumbersome detection process, which can affect training and accuracy. The present invention is much more exhaustive and sophisticated. Combination structural and functional MRI data processing and analysis aid the present invention in obtaining higher efficacy. It is a reasonably rapid method of detection of AD which gives results within 15-30 minutes. The present invention produces excellent efficacy with 90% or more accuracy for both testing and validation cohort-based benchmarking analyses.
Effective utilization of both brain fMRI and sMRI data is relatively less explored. A combination of both functional and/or structural anomalies, if captured, can provide early but probable persistent signs of developing dementia. Most of the existing software/programs are not readily available, not technically amenable, and require equivalent multi-component third- party software packages and dependencies. A single platform that could process raw sMRI and fMRI data and extract features to identify structural and functional anomalies and subsequently utilize those features to train powerful machine learning systems to detect/diagnose AD is missing. In agreement with previous observations, it could be extrapolated that although many algorithms could differentiate AD from normal samples with satisfying accuracy, distinguishing the MCI from normal remains a major challenge.
OBJECTIVE OF THE INVENTION
The main objective of the current invention is to detect and diagnose AD and/or MCI patients through computer-aided MR image processing and subsequent analysis using a deep learning based classification and prediction system comprising of trained models generated from large scale AD patients and healthy control cohorts via exhaustive feature extraction and trainingtesting experiments, instructions/package to process query MRI data, testing of query data with respect to the trained models, prediction module to portray the probable diagnosis of the query data embedded within a hardware system comprising one standard computer processor unit, memory and storage media to execute and store the programs and subsequent results thereon. Another objective of the invention is to utilize both sMRI and fMRI data capable of capturing the structural and functional anomalies that may appear during early and late stages of the AD/MCI disease progression. Implementation of this embedded system to be synced with the clinically used MRI/fMRI machines
In another objective the present invention processes whole brain slices from axial, sagittal, and coronal views of the given sMRI and/or fMRI data and further extracts features to feed into a deep learning-based CNN module to calculate the AD/healthy probability of each slice.
Another objective of the invention is to implement statistical analysis to diagnose the AD status of the given MRI sample based on the AD probability computed from three different views of the sMRI and/or fMRI data.
Another objective of the invention is to develop the AD detection analysis system comprising one computer processor unit, memory and storage media to execute and store the programs and subsequent results thereon.
Another objective of the invention is to provide a graphical user interface (GUI) based user- interactive platform embedded within the detection system for prediction of the AD status of the query sample sMRI/fMRI data.
SUMMARY OF THE INVENTION
In one aspect, the present relates to a system (300) for detecting neurodegenerative disorder comprising; i) at least one computer processor unit (330); ii) at least one memory media (340); iii) one graphical user interface -based display unit (350); and iv) one storage medium (360). wherein the system analysing and predicting brain structural MRI slices data and functional MRI slices data followed by implementation, customization, and standardization of Convoluted Neural Network algorithms.
In another aspect, the present relates to a method (200) for predicting the functional MRI by the system of claim 1, wherein the method comprising the steps of;
(a) collecting (210) functional MRI data from Alzheimer’s Disease Neuroimaging Initiative (ADNI) database;
(b) converting the functional MRI data of step (a) using data pre- processing module (220) into 2D images for the ease of handling the images and further pre-processing of the images;
(c) extracting the 2D images of step (b) in three different views, i.e., axial, coronal, and sagittal, respectively;
(d) extracting the pixel values of the 2D images of step (c) using file preparation module (230);
(e) classifying the pixel images obtained in step (d) through Convoluted Neural Network module (240) using training-testing-validation protocol along with standardization of parameters and hyper-parameters followed by detailed standardization of Convoluted Neural Network module;
(f) combining all standardization of step (b) to (e) by standalone hardware system (280) comprising one standard computer processor unit, memory, and storage media of claim 1 to predict the disease status in the prediction module (290).
In one another aspect, the present invention relates to method (200) for predicting the functional MRI by the system of claim 1, wherein the method comprising the steps of;
(a) collecting (210) functional MRI data from Alzheimer’s Disease Neuroimaging Initiative (ADNI) database;
(b) converting the functional MRI data of step (a) using data pre- processing module (220) into 2D images for the ease of handling the images and further pre-processing of the images;
(c) extracting the 2D images of step (b) in three different views, i.e., axial, coronal, and sagittal, respectively;
(d) extracting the pixel values of the 2D images of step (c) using file preparation module (230);
(e) classifying the pixel images obtained in step (d) through Convoluted Neural Network module (240) using training-testing-validation protocol along with standardization of parameters and hyper-parameters followed by detailed standardization of Convoluted Neural Network module;
(f) combining all standardization of step (b) to (e) by standalone hardware system (280) comprising one standard computer processor unit, memory, and storage media of claim 1 to predict the disease status in the prediction module (290).
ABBREVATIONS
AD: Alzheimer’s disease
MCI: Mild cognitive impairment
MRI: Magnetic Resonance Imaging sMRI: Structural Magnetic Resonance Imaging fMRI: Functional Magnetic Resonance Imaging
CNN: Convoluted Neural Network
ADNI: Alzheimer’s Disease Neuroimaging Initiative
BRIEF DESCRIPTION OF DRAWINGS:
Fig. 1 : Schematic overview of the approach and methods implemented in the system for sMRI- based analysis and prediction, as per an embodiment herein.
Fig. 2: Schematic overview of the approach and methods implemented in the system for fMRIbased analysis and prediction, as per an embodiment herein.
Fig. 3 : Schematic diagram of the various components of the apparatus/device for detection of AD using sMRVfMRI data as input.
Fig. 4: Schematic representation of the detection device along with various input and output option.
Fig. 5 : Flowchart of the prediction module where each sMRI and/or fMRI slice from three views are processed using all training models.
Fig. 6: Flowchart of the prediction module where all sMRI and/or fMRI slices from three views are processed using each training model.
DETAILED DESCRIPTION OF THE INVENTION While the disclosure has been disclosed with reference to certain embodiments, it will be understood by those skilled in the art that various changes may be made, and equivalents may be substituted without departing from the scope of the invention. In addition, many modifications may be made to adapt to a particular situation or material to the teachings of the invention without departing from its scope.
In one embodiment the present invention aims to detect and diagnose AD and/or MCI patients through a computer-aided MR image processing and subsequent analysis using a deep learning based classification and prediction system comprising of trained models generated from large scale AD patients and healthy control cohorts via exhaustive feature extraction and trainingtesting experiments, instructions/package to process query MRI data, testing of query data with respect to the trained models, prediction module to portray the probable diagnosis of the query data embedded within a hardware system comprising one standard computer processor unit, memory and storage media to execute and store the programs and subsequent results thereon. In one embodiment, the system is composed of two independent yet complimentary diagnosing approaches where one part is capable of processing and analyzing brain structural MRI (sMRI) data followed by implementation, customization, and standardization of convoluted neural network (CNN) algorithms to distinguish AD patients from normal healthy cohorts.
In another embodiment, the present invention provides a description of AD detection using sMRI data (100). Data collection module (110) depicts collection of sMRI data from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database consisting of 553 healthy and 1156 AD patients (severe AD: 53, moderate AD: 237, and mild AD: 866) followed by data pre-processing module (120), which converted all 3D data (NIFTI format) of the brain structural MR images into 2D slices for the ease of handling the images and further preprocessing of the images. 2D image slices were extracted in three different views, i.e., axial, coronal, and sagittal, respectively.
In another embodiment, the feature extraction and file preparation module (130) extract the pixel values of the images and uses them as features to perform machine learning -based classification. Classification via k-fold training-testing and subsequent validation of the models using convoluted neural network (CNN) module (140) employs a subset of the AD and healthy cohorts for training-testing exercise, and the remaining samples were kept separated for a validation dataset. The following sections depict the model architecture and summary properties (150).
Model architecture: A sequential model was used for this exercise. The sequential model is a linear stack of layers. It can be first initialized and then layers can be added using various methods. Conv2D is a 2-dimensional convolution layer, which performs spatial convolution over images. The parameters used are Filters, Kernel size, Activation, Kernel initializer, and Input shape. MaxPooling2D is a max pooling operation for spatial data. The parameters used here are Pool size (2,2). Conv2D with 64 filters, 3 x 3 kernel size and Relu activation. MaxPooling2D with pool size (2,2). Conv2D with 128 filters, 3 x 3 kernel size and Relu activation. Flatten and dense layers were used with default parameters, Activation function (dense layer): Relu and Activation function (dense layer): Sigmoid.
Compilation of Model: The model was compiled using parameters such as Loss function, Adam optimizer and Performance metrics (e,g., accuracy and/or Fl score).
Model Summary: Keras was used which appends an extra dimension for processing multiple batches to train multiple images in every step of a single Epoch. Convolution was performed using various size filters via Conv2D and Maxpooling2D. The flatten layer takes all the pixels along all channels and creates a ID vector (not considering batch size). Two dense layers were added having 128 and 2 units, respectively.
Standardization of hyper-parameters like epoch and batch-size: Hyper-parameters like epoch and batch-size were standardized to train the dataset. The batch-size is a hyper-parameter of gradient descent that controls the number of training samples to work through before the model's internal parameters are updated. The number of epochs is a hyper-parameter of gradient descent that controls the number of complete passes through the training dataset. Multiple combinations of epoch and batch-size were used for training. Table 1 provides performance values of training-testing and validation cohorts both in terms of slice-wise and patient predictions for the using AD vs. Healthy models. Table 1: Performance of All AD vs Healthy models using sMRI data
Figure imgf000010_0001
In another embodiment of the system, fMRI data was utilized for AD detection (200). Data collection module (210) depicts a collection of fMRI data from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database consisting of 170 healthy, 114 AD, and 170 MCI patients followed by data pre-processing module (220), which converted all 3D data (NIFTI format) of the brain functional MR images into 2D slices for the ease of handling the images and further pre-processing of the images. 2D image slices were extracted in three different views, i.e., axial, coronal, and sagittal, respectively.
In another embodiment, the feature extraction and file preparation module (230) extracts the pixel values of the images and use them as features to perform machine learning -based classification.
Classification via k-fold training-testing and subsequent validation of the models using convoluted neural network (CNN) module (240) employs a subset of the AD and healthy cohorts for training-testing exercise and remaining samples were kept separated for a validation dataset. Following sections depict the model architecture and summary properties (250).
Model architecture: Sequential model was used for this exercise using Conv2D 2-dimensional convolution layers. 3 Conv2D layers with Relu activation and two times MaxPooling were performed. Flatten and 2 dense layers were used with default parameters, Activation function (dense layer): Relu and Activation function (dense layer): Sigmoid.
Compilation of Model: The model was compiled using parameters such as Loss function, Adam optimizer and Performance metrics (e,g., accuracy and/or Fl score). Model Summary: Keras was used which appends an extra dimension for processing multiple batches to train multiple images in every step of a single Epoch. Convolution was performed using various size filters via Conv2D and Maxpooling2D.
Rigorous standardization of the hyper-parameter combinations was done in order to obtain optimum combinations of epoch and batch-size for training. Exhaustive benchmarking using testing and separate validation datasets was carried out. Table 2 provides performance values of training-testing and validation cohorts both in terms of slice-wise and patient-wise predictions for all AD vs. Healthy models.
Table 2: Performance of AD vs Healthy models using fMRI data
Figure imgf000011_0001
In another embodiment, Fig. 1 shows an overview of the method 100 for implemented in the system for sMRI based analysis and prediction. The process begins with structural MRI image collection and data processing (110) followed by image preprocessing and feature extraction steps (120 and 130). Classification CNN module using training-testing-validation protocol along with standardization of parameters and hyper-parameters (140) whereas detailed standardization of the CNN modules are done in 150. Step 160 combines all standardized and trained models via developing a standalone hardware system (180) comprising one standard computer processor unit, memory and storage media to execute and store the programs and subsequent results thereon, which could accept input data (170) and provide disease status outcome prediction in the prediction module (190).
In another embodiment, Fig. 2 shows an overview of the method 200 implemented in the system for fMRI-based analysis and prediction. The process begins with structural MRI image collection and data processing (210) followed by image preprocessing and feature extraction steps (220 and 230). Classification of CNN module using training-testing-validation protocol along with standardization of parameters and hyper-parameters (240), whereas detailed standardization of the CNN modules is done in 250. Step 260 combines all standardized and trained models via developing a standalone hardware system (280) comprising one standard computer processor unit, memory, and storage media to execute and store the programs and subsequent results thereon, which could accept input data (270) and provide disease status outcome prediction in the prediction module (290).
In another embodiment (Fig. 3, 300), the invention provides a computer-aided, whole-brain structural/functional MR image analysis-based AD diagnostic system. The system comprising: i) At least one computer processor for executing the instructions therein (330); ii) At least one memory unit (340), one GUI based display unit (350), one computer-readable storage medium (360) to store the instructions along with pre-compiled trained models for live prediction and/or detection; iii) Pre-computed, standardized, and trained models and dataset generated from brain sMRl/fMRI data and associated instructions for utilization of these models in detection of MR slices with probable AD/healthy signatures using CNN based deep learning methods (360), iv) A platform/system for input, query, brain sMRI/l'MRI data retrieval and real-time brain MR image pre-processing and processing (320), v) Programmable instructions to extract features from the query sample MR images (330, 340 and 360), vi) Programmable instructions compare and match the query brain MR image features with pre-existing, pre-computed, standardized, and trained models via invoking CNN methodologies (330, 340, and 360), vii) Programmable instructions to execute statistical analysis and predict the AD status of the query sample (330, 340, 350, and 360), viii) Algorithmic and programmable instructions to execute statistical analysis and predict the healthy or AD status of the query sample (350, 370 and 380).
In another embodiment (Fig. 4, 400), the invention provides the prototype of the AD detection device along with its input (410, 420, 430) and output (450, 460, and 470) options. Sample MRI images from AD/MCI and/or healthy individuals are shown as examples. MRI slices (410 and 420) from axial, coronal, and sagittal views can be used as input separately. Various image processing modules embedded within the device perform pre-processing, processing, feature extraction, matrix generation, etc, and subsequently, the machine learning modules empowered by the CNN algorithm compare the input image slices against the pre-developed trained models derived from the MRI data from a large number of AD/MCI and healthy individuals. The prediction output module (450) contains two independent strategies (460 and 470) for slice and sample prediction. Details of each strategy are presented in Fig. 5 and Fig. 6 (500 and 600), respectively.
In another embodiment (Fig. 5, 500), the invention provides a detailed flowchart of the steps incorporated within the prediction module where each sMRI and/or fMRI slice from three views is processed using all training models. Here, AD/MCl/healthy like probability of the processed data extracted from each MRI slice (510) is estimated via classification and prediction against all the training models (520). 530 and 540 provide two submodules where voting and average probability-based prediction of each slice is performed. Sub-modules 550 and 560 deal with AD/MCI/healthy status prediction for the whole sample for three different views after consolidating prediction results from each slice.
In another embodiment (Fig. 6, 600), the invention presents a detailed flowchart of the steps incorporated within the prediction module where all sMRI and/or fMRI slices from three views are processed using each training model at a time. Here, the whole sample (all slices) from each view is classified against each of the training model. 630 and 640 provide two submodules where voting and average probability-based prediction of each model is performed. Submodules 650 and 660 deal with AD/MCI/healthy status prediction for the whole sample for three different views after consolidating prediction results from each model
ADVANTAGES
1. The present invention aims to detect and diagnose AD and/or MCI patients through a computer-aided MR image processing and subsequent analysis using a deep learningbased classification and prediction system comprising trained models generated from large-scale AD patients and healthy control cohorts via exhaustive feature extraction and training-testing experiments, instructions/package to process query MRI data, testing of query data with respect to the trained models, prediction module to portray the probable diagnosis of the query data embedded within a hardware system comprising one standard computer processor unit, memory and storage media to execute and store the programs and subsequent results thereon.
2. The system is composed of two independent yet complimentary diagnosing approaches where one part is capable of processing and analyzing brain structural MRI (sMRI) data followed by implementation, customization, and standardization of convoluted neural network (CNN) algorithms to distinguish AD patients from normal healthy cohorts. In the other part, this package processes, analyzes, and predicts AD/MCI status using functional MRI (fMRI) slices. In this case, whole brain slices from axial, sagittal, and coronal views are processed, and brain pixel-based intensity features are fed into a deep learning-based CNN module to calculate the AD/healthy probability of each slice. Further, statistical analysis is employed to diagnose the AD status based on the AD probability computed from three different views. This detection system uniquely offers to detect AD/MCI using both sMRI and fMRI data capable of capturing the structural and functional anomalies that may appear during early and late stages of the disease progression. Hence, this embedded system could easily be synced with the clinically used MRI/fMRI machines. This detection system can aid clinical diagnostics of AD and AD like symptoms in an efficient manner. This detection system uniquely offers AD/MCI/healthy prediction status of each MRI slice from three different views (e.g., axial, coronal, and sagittal, respectively). This detection system provides AD/MCI/healthy status prediction for the whole sample for three different views after consolidating prediction results from each slice. This detection system uniquely offers multiple strategies based on different yet complimentary statistical analyses of the prediction. In one embodiment, the invention incorporates a prediction module where each sMRI and/or fMRI slice from three views is processed using all training models. In another embodiment, the invention presents a prediction module where all sMRI and/or fMRI slices from three views are processed using each training model at a time. This detection system uniquely offers two submodules where voting and average probability-based prediction of each slice are performed. This detection system contains highly enriched sMRI training models consisting of 15 All AD vs Healthy, 15 Mild vs Healthy, 15 Moderate vs Healthy, and 15 Severe vs Healthy models. All AD vs Healthy models contain data from 354 AD and 354 healthy samples, containing 84940 slices in each view (axial, coronal, and sagittal, respectively). All Mild vs Healthy models contain data from 354 mild and 354 healthy samples, containing 135936 slices in axial and coronal view and 103368 slices in sagittal view. All Moderate vs Healthy models contain data from 151 moderate and 151 healthy samples, containing 57984 slices in axial and coronal view and 44092 slices in sagittal view. All Severe vs Healthy models contain data from 34 severe and 34 healthy samples, containing 13056 slices in axial and coronal view and 9928 slices in sagittal view. This detection system contains highly enriched fMRI training models consisting of 300 AD vs Healthy and 300 MCI vs Healthy models. In each axial model, 73 and 108 demented and healthy samples containing 3504 and 5184 slices are present. In each coronal model, 73 and 108 demented and healthy samples containing 4672 and 6912 slices are present. In each sagittal model, 73 and 108 demented and healthy samples containing 4672 and 6912 slices are present. Prediction accuracies of sMRI models are excellent as testified through exhaustive benchmarking using separate test and validation datasets. Prediction accuracies of fMRI models are excellent as testified through exhaustive benchmarking using separate test and validation datasets. This detection system contains a graphical user interface (GUI) based user-interactive platform embedded within the detection system for prediction of the AD status of the query sample sMRI/l'MRI data. This detection system executes prediction for a given query MRI samples in a relatively faster time scale (within 25-30 minutes). This detection system could easily be synced with the clinically used MRI/fMRI machines. This detection system can aid clinical diagnostics of AD and AD like symptoms in an efficient manner.

Claims

WE CLAIM
1. A system (300) for detecting neurodegenerative disorder comprising; i) at least one computer processor unit (330); ii) at least one memory media (340); iii) one graphical user interface -based display unit (350); and iv) one storage medium (360). wherein the system analysing and predicting brain structural MRI slices data and functional
MRI slices data followed by implementation, customization, and standardization of Convoluted Neural Network algorithms wherein the brain structural MRI slices data and functional MRI slices data are selected from axial, sagittal, and coronal views.
2. The system as claimed in claim 1, wherein the neurodegenerative disorder is selected from Alzheimer’s disease and mild cognitive impairment.
3. The system as claimed in claim 1, wherein the graphical user interface is embedded within the system for prediction of the Alzheimer’s disease status of the query sample structural MRI and/or functional MRI data.
4. A method (100) for predicting the structural MRI by the system of claim 1, wherein the method comprising the steps of;
(a) collecting (110) structural MRI data from Alzheimer’s Disease Neuroimaging Initiative (ADNI) database;
(b) converting the structural MRI data of step (a) using data pre- processing module (120) into 2D images for the ease of handling the images and further pre-processing of the images;
(c) extracting the 2D images of step (b) in three different views, i.e., axial, coronal, and sagittal, respectively;
(d) extracting the pixel values of the 2D images of step (c) using file preparation module (130);
(e) classifying the pixel images obtained in step (d) through Convoluted Neural Network module (140) using training-testing-validation protocol along with standardization of parameters and hyper-parameters followed by detailed standardization of Convoluted Neural Network module;
(f) combining all standardization of step (b) to (e) by standalone hardware system (180) comprising one standard computer processor unit, memory and storage media of claim 1 to predict the disease status in the prediction module (190).
5. A method (200) for predicting the functional MRI by the system of claim 1, wherein the method comprising the steps of;
(a) collecting (210) functional MRI data from Alzheimer’s Disease Neuroimaging Initiative (ADNI) database;
(b) converting the functional MRI data of step (a) using data pre- processing module (220) into 2D images for the ease of handling the images and further pre-processing of the images;
(c) extracting the 2D images of step (b) in three different views, i.e., axial, coronal, and sagittal, respectively;
(d) extracting the pixel values of the 2D images of step (c) using file preparation module (230);
(e) classifying the pixel images obtained in step (d) through Convoluted Neural Network module (240) using training-testing-validation protocol along with standardization of parameters and hyper-parameters followed by detailed standardization of Convoluted Neural Network module;
(f) combining all standardization of step (b) to (e) by standalone hardware system (280) comprising one standard computer processor unit, memory, and storage media of claim 1 to predict the disease status in the prediction module (290).
6. The method as claimed in claim 4 and 5 wherein the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database comprising the data of healthy individuals, Alzheimer’s Disease and mild cognitive impairment patients.
7. The method as claimed in claim 4 and 5, wherein the method including severe, moderate, and mild Alzheimer’s Disease detection.
PCT/IN2024/050632 2023-06-09 2024-05-29 Detection system for alzheimer's disease using brain structural and/or functional magnetic resonance image processing and machine learning techniques Pending WO2024252413A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN202311039559 2023-06-09
IN202311039559 2023-06-09

Publications (1)

Publication Number Publication Date
WO2024252413A1 true WO2024252413A1 (en) 2024-12-12

Family

ID=93795246

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IN2024/050632 Pending WO2024252413A1 (en) 2023-06-09 2024-05-29 Detection system for alzheimer's disease using brain structural and/or functional magnetic resonance image processing and machine learning techniques

Country Status (1)

Country Link
WO (1) WO2024252413A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120107250A (en) * 2025-05-07 2025-06-06 复影(上海)医疗科技有限公司 AD early diagnosis method, system, medium and equipment based on deep learning
CN120339207A (en) * 2025-03-28 2025-07-18 太原理工大学 A diagnostic method for Alzheimer's disease based on contrastive learning and Mamba

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101929965B1 (en) * 2017-11-01 2018-12-17 가천대학교 산학협력단 Method for diagnosis of alzheimer's disease based on structural mri images using relm and pca features and the apparatus thereof
CN111932522A (en) * 2020-08-14 2020-11-13 中国科学院心理研究所 Alzheimer's disease classifier based on brain imaging big data deep learning
US20240090822A1 (en) * 2022-09-14 2024-03-21 Penny MacDonald Diagnosis,staging and prognosis of neurodegenerative disorders using mri

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101929965B1 (en) * 2017-11-01 2018-12-17 가천대학교 산학협력단 Method for diagnosis of alzheimer's disease based on structural mri images using relm and pca features and the apparatus thereof
CN111932522A (en) * 2020-08-14 2020-11-13 中国科学院心理研究所 Alzheimer's disease classifier based on brain imaging big data deep learning
US20240090822A1 (en) * 2022-09-14 2024-03-21 Penny MacDonald Diagnosis,staging and prognosis of neurodegenerative disorders using mri

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120339207A (en) * 2025-03-28 2025-07-18 太原理工大学 A diagnostic method for Alzheimer's disease based on contrastive learning and Mamba
CN120107250A (en) * 2025-05-07 2025-06-06 复影(上海)医疗科技有限公司 AD early diagnosis method, system, medium and equipment based on deep learning

Similar Documents

Publication Publication Date Title
Basheera et al. Convolution neural network–based Alzheimer's disease classification using hybrid enhanced independent component analysis based segmented gray matter of T2 weighted magnetic resonance imaging with clinical valuation
Kazemi et al. A deep learning pipeline to classify different stages of Alzheimer's disease from fMRI data
Baskar et al. An efficient classification approach for detection of Alzheimer’s disease from biomedical imaging modalities
Yang et al. Diagnosis of Parkinson’s disease based on 3D ResNet: The frontal lobe is crucial
Yaqub et al. DeepLabV3, IBCO-based ALCResNet: A fully automated classification, and grading system for brain tumor
WO2024252413A1 (en) Detection system for alzheimer's disease using brain structural and/or functional magnetic resonance image processing and machine learning techniques
Özbay et al. Brain tumor detection with mRMR-based multimodal fusion of deep learning from MR images using Grad-CAM
Meena et al. Original Research Article An improved convolutional neural network-based model for detecting brain tumors from augmented MRI images
Parveen et al. Detection and classification of pneumonia in chest X-ray images by supervised learning
Priyadharshini et al. Artificial intelligence assisted improved design to predict brain tumor on earlier stages using deep learning principle
Matlani BiLSTM-ANN: early diagnosis of Alzheimer’s disease using hybrid deep learning algorithms
Özbay et al. An NCA-based hybrid CNN model for classification of Alzheimer’s disease on Grad-CAM-enhanced brain MRI images
Ye et al. MAD-Former: a traceable interpretability model for Alzheimer's disease recognition based on multi-patch attention
Mantha et al. A transfer learning method for brain tumor classification using efficientnet-b3 model
Abdullah et al. Deep-Ensemble Learning Models for the Detection and Classification of Eye Diseases Based on Engineering Feature Extraction with Efficientb6 and Densnet169.
Pallawi et al. Study of Alzheimer’s disease brain impairment and methods for its early diagnosis: a comprehensive survey
Mirchandani et al. Comparing the architecture and performance of alexnet faster r-cnn and yolov4 in the multiclass classification of alzheimer brain mri scans
Qiao et al. A fusion of multi-view 2D and 3D convolution neural network based MRI for Alzheimer’s disease diagnosis
Ashar et al. Classification of Magnetic Resonance Imaging (MRI) scans for brain tumor using improved EfficientNet architecture and transfer learning
Ahad et al. Dvs: Blood cancer detection using novel cnn-based ensemble approach
Srinivasan et al. Enhancing brain tumor diagnosis with substructure aware graph neural networks and fuzzy linguistic segmentation
Wijerathna et al. Brain tumor detection using image processing
Abd Hamid et al. Incorporating attention mechanism in enhancing classification of alzheimer’s disease
AV et al. CNN-Mobilenetv2-Deep Learning-Based Alzheimer’s Disease Prediction and Classification
Bhatia et al. A proposed stratification approach for MRI images

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24818931

Country of ref document: EP

Kind code of ref document: A1