[go: up one dir, main page]

WO2007029012A1 - Classement de donnees de mouvement dans des categories - Google Patents

Classement de donnees de mouvement dans des categories Download PDF

Info

Publication number
WO2007029012A1
WO2007029012A1 PCT/GB2006/003336 GB2006003336W WO2007029012A1 WO 2007029012 A1 WO2007029012 A1 WO 2007029012A1 GB 2006003336 W GB2006003336 W GB 2006003336W WO 2007029012 A1 WO2007029012 A1 WO 2007029012A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
classification model
movement
category
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/GB2006/003336
Other languages
English (en)
Inventor
Lars Adde
Øyvind STAVDAHL
Gabriela Espinosa Porragas
Pál Renton BERGE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NTNU Technology Transfer AS
Original Assignee
NTNU Technology Transfer AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NTNU Technology Transfer AS filed Critical NTNU Technology Transfer AS
Publication of WO2007029012A1 publication Critical patent/WO2007029012A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition

Definitions

  • the present invention relates to categorising data relating to the movement of a living subject. More specifically, the invention may be applied to categorising movement data indicative of medical conditions, such as Cerebral Palsy (CP).
  • CP Cerebral Palsy
  • CP is a non-progressive motor impairment syndrome secondary to lesions or anomalies of the brain arising in the early ages of development.
  • the type of motor impairment is divided into different categories according to which functions or body parts that are affected.
  • the seriousness of CP differs from almost invisible disability to a serious handicap. Cerebral palsy affects approximately 1 in 500 infants.
  • the risk of CP is highest in extremely premature infants (birth weight less than 1 kg and/or gestational age less than 28 weeks).
  • a diagnosis of CP is often not established until the age of 12-18 months and some of the mildest forms may still not be diagnosed before the age of four.
  • a number of techniques have been used to assess the brain at an early age.
  • the techniques vary from clinically based methods requiring no equipment, such as various forms of neurological assessments tests, to sophisticated technical assessments, such as brain imaging (ultrasound, computer tomography and magnetic resonance imaging) and neurophysiologic tests, including electroencephalograms (EEG) and visual or sensory evoked potentials (VEP and SEP).
  • EEG electroencephalograms
  • VEP visual or sensory evoked potentials
  • GM 'general movements'
  • Observation of an infant's GM by a clinician has been used to estimate whether or not the infant has CP.
  • GMA 'general movement assessment technique'
  • the movement of an infant is video-recorded and then the movement patterns are observed by a doctor, physiotherapist, etc. Observation and classification of such movement patterns may predict later neurological outcomes such as CP as early as 3-5 months post term. In research settings, this method has resulted in a diagnosis of CP with a sensitivity and specificity of around 93%.
  • parameter data for babies which have already been classified by a physician are used to select optimum parameter combinations. For example, five optimum parameters are selected using cluster analysis based on Euclidian distances. In order to estimate whether a baby is likely to have CP, these five parameters are measured for the baby, and it is then determined whether they are within the range of the standard deviation for the norm collective in respect of each parameter. Depending on the number of parameters within or outside the standard deviation, classification is effected.
  • a second method using quadratic discriminant analysis with eight parameters and a cost function is also disclosed.
  • the parameters are measured for a baby, and the values are compared with parameter set values for babies that have already been classified.
  • the baby being tested is classified according to the classification of the 'known' parameter set showing the greatest similarity with the parameter data of the test baby. In other words, this method looks for the 'nearest neighbour' parameter set.
  • the present invention provides a method of categorising data derived from the movements of a living subject, comprising: processing the data to extract information; and classifying the extracted information into one of a plurality of categories using a classification model; wherein the classification model is trained using data derived from the movements of other subjects whose category is known.
  • the extracted information relates (albeit indirectly) to patterns of movement which may, or may not, be readily recognisable to a human observer.
  • the invention does not involve or require these patterns to be defined or recognised as such.
  • the method is not dependent on particular human-defined parameters. Instead, information is simply extracted from the movement data in order to categorise data.
  • the present invention can take into account movement phenomena that are otherwise incomprehensible to humans (or at least not readily recognisable or describable), for example because they involve complex inter-relationships of the movements of a plurality of limbs.
  • Such a method can be used to categorise movement data of infants according to whether or not they have, or are susceptible to, CP.
  • movement data may be categorised as 'normal', 'CP' or 'at risk 1 .
  • the invention is not restricted to categorising movement data to determine whether an infant has CP, and is in fact suitable for categorising any sort of movement data.
  • the method could be used to examine whiplash injuries, Parkinson's disease and ADHD. In the case of detecting CP in an infant, it is data relating to the spontaneous movements that should be used in the categorisation process.
  • the categorisation process takes place during 6-20 weeks post-term (46-60 weeks postmenstrual age), or more preferably 5-10 weeks post-term. This is the time during which spontaneous movement can best be used to detect CP.
  • the information extracted from such data and used in the categorisation relates to patterns in the signals from the spontaneous movements.
  • movement data is used both in the categorisation process and for training the model. Movement data for use in both these stages can be collected and processed in a similar way. Normally, the training data will be processed in the same manner as the movement data that is to be classified.
  • movement data includes data of how different parts of the subject's body are moving over time.
  • Movement data can be collected in any known way.
  • electromagnetic sensors can be connected to different parts of the body, and the data fed to a tracking system.
  • the subject may be videoed with a video camera, and the data analysed using image-processing software to determine the movement of different parts of the body. Two or three-dimensional movement data may be collected.
  • the data may correspond to more dimensions, for example three linear dimensions (x, y, z) and, say, three axes of rotation. If a simple system is desired, two-dimensional data can be collected using only one camera. Alternatively, a more complex system using more than one video camera may be used to provide movement data in three dimensions. Data reduction to two dimensions may form part of the data pre-processing. In one embodiment, reflective elements are attached to different parts of the body, to assist in tracking movement. Preferably, when training a model/categorising data to determine CP status, the movements of the ends of the limbs are monitored in particular, since this gives a good representation of the spontaneous movement. Movement data may be used in real-time to perform categorisation or to create the model, or alternatively it may be stored in a database and used at a later date.
  • the movement signal will be sampled at regular time intervals and it is this sampled signal that forms raw movement data to be processed. For example, if the signal is sampled at 25Hz, every 40ms a sample will be recorded.
  • Raw movement data may be pre-processed before the information is extracted. This can comprise a number of stages. Firstly, a 'region of interest' in the data may be extracted. For example, in the case of assessing CP, data collected when the infant is crying or playing is not useful, and consequently should be excluded. Regions of interest may be selected automatically, for example by a computer, or manually by a user.
  • the movement data may be subject to principle component analysis (PCA), in order to reduce the data set to its most important components, thereby selectively retaining the most important data.
  • PCA principle component analysis
  • two principal components are chosen and calculated over time, although a greater number, such as three or four or more can be used. It will be appreciated that using a greater number of components increases complexity and the amount of processing power used.
  • Time frequency decomposition may be carried out on the movement data, whether PCA has been performed or not, although it is clearly preferable for it to be applied to the output from the PCA.
  • time frequency representation is performed for each principal component, in order to determine the amount of each frequency present in the signal over time. Any or all of the above pre-processing stages are preferably carried out before the data is processed to extract information.
  • Entropy may be calculated for the time frequency representation of each principal component.
  • the Holder exponent may be evaluated.
  • These methods essentially extract patterns, or complexity in the signal. This information is then used to train the model/classify data.
  • the present inventors have discovered another type of information that can be extracted and used to train the model/classify data. This is a vector of 'period length'. In order to find this, the signal is divided into windows of equal size, so that each window contains a number of signal samples. For each window, the number of samples ⁇ : between the time the signal changes its sign are counted. This number of samples is called 'period length 1 . Typically, in each window the signal might cross the zero line several times, thus several values of x will be obtained.
  • the vector X of period length is found by detrending the signal by subtracting from each sample the average signal value of a region centred around the current sample, creating a vector of the number of samples between consecutive zero-crossings of the detrended signal, using the vector of the number of samples to compute a vector of local periodicity using a sliding window, thresholding the vector of local periodicity, and calculating the sum of all local periodicity.
  • This vector measures contain information about the movement that depends on the CP status of the subject, and as such can be used to train a model/classify data according to CP status.
  • 'period length 1 information is not limited to use in the context of CP, it can be used when training a model/classifying data for other purposes as well.
  • more than one method is used to extract information from the data, and all the information is used to train the model/classify data.
  • the classification model may be any suitable model capable of being trained.
  • the model comprises an algorithm that can be trained using machine- learning techniques.
  • Suitable algorithms include linear/nonlinear discriminant analysis algorithms, decision trees, clustering algorithms and neural networks such as Fuzzy ARTMap.
  • Statistical models can be used to find a probability distribution that can discriminate between children with CP and those without CP.
  • the trainable algorithms can 'learn' how to classify data using training data (input signals), i.e. data for which the classification (category) is already known.
  • Such training data may be 'marked' with the known category.
  • a database is provided containing the known category of each training input signal, and this is interrogated as necessary during the training process to find the correct category for a certain piece of data.
  • the 'known' category of the movement data may be found in any way, but is preferably found by obtaining movement data from a population and then waiting for a period of time, for example until the infants are around two years old, when it is normally clear which have CP. This is the most effective way of determining the 'correct' CP status of an infant.
  • an experienced clinician may use the GMA technique to estimate whether the infant has CP or not, thus averting the need to wait two years to determine the CP status.
  • training data may be used to estimate the model parameters.
  • the chosen algorithm is used in an initial state to classify data into a particular category according to the extracted information. This category is then compared with the known correct category for the data, and if the chosen category does not match the correct category, the parameters of the model are modified until the chosen category matches the correct category.
  • the accuracy of the classification model may be tested using a test dataset of movement data, for which the correct category is already known. (A sub-set of the training data is preferably not used for the training process and instead forms the test dataset.) The sensitivity and specificity may be evaluated, and the confidence interval may be determined.
  • a number of different sets of training movement data are used to create different classification models, and the model which provides the best test results is chosen.
  • a combination of a number of models is used.
  • the classification model will become more refined as datasets from more children whose CP status is known is used to train the model.
  • the trained algorithm can be used to classify further data for which the category is not known. For example, if a discriminant analysis algorithm is used, the result will be a trained discriminant analysis algorithm that can then be used to classify data.
  • the method of creating a classification model for categorising data relating to the movement of a living subject is considered as an invention in its own right.
  • the present invention provides a method of creating a classification model for categorising data derived from the movements of a living subject into one of a plurality of categories, comprising: providing a set of data derived from a population of subjects whose category is known; processing the data to extract information; and using this information to train a classification model.
  • a computer may be programmed to receive movement data, process the movement data and categorise it using the classification model.
  • the computer may also be programmed to train the classification model.
  • a program may be provided with two modes: training mode and production mode. In the training mode, data is received and processed to train the algorithm, and in the production mode new data is received and is categorised according to the so-trained algorithm.
  • the classification algorithm may be trained separately.
  • the invention also provides a method of training a classification algorithm for categorising data relating to the movement of a living subject, comprising: using the classification algorithm to classify movement data into a particular category according to information extracted from the movement data; comparing the chosen category with a known correct category for the data; and if the chosen category does not match the correct category, modifying the classification algorithm until the chosen category matches the correct category.
  • the invention provides a method of creating a classification model for categorising data relating to the movement of a living subject, comprising: obtaining data corresponding to the movement of at least one part of the subject over time; performing time frequency decomposition of this data; processing movement data to extract patterns; and training a classification algorithm using this movement data; wherein the trained classification algorithm forms the classification model.
  • patterns is used herein to encompass measures or features such as periodicity or entropy as discussed above.
  • the invention also extends to a classification model created according to any of the methods described above.
  • the present invention also provides a method of categorising data relating to the movement of a living subject, comprising: creating a classification model according to one of the methods described above; and categorising new data using the classification algorithm. Also provided is a method of categorising data relating to the movement of a living subject, comprising: processing movement data to extract information/patterns from the signal; and classifying the data into a particular category according to the extracted information, using a classification model created as described above.
  • the invention also extends to apparatus configured to carry out any of the methods described above.
  • Another aspect of the invention provides an apparatus for categorising data derived from the movements of a living subject, comprising: a processor for processing the data to extract information; and a classifier for classifying the extracted information into one of a plurality of categories using a classification model; wherein the classification model comprises a classification algorithm trained using data derived from the movements of other subjects whose category is known.
  • the processor can be any suitable means for processing data, and the classifier is any suitable means for classifying data. Preferably both of these are implemented as a computer program.
  • the invention provides an apparatus for creating a classification model for categorising data relating to the movement of a living subject, comprising: a means for processing movement data to extract patterns in the signal; and a means for training the classification model using the processed data.
  • the classification algorithm comprises a classification model.
  • the invention provides an apparatus for creating a classification model for categorising data relating to the movement of a living subject, comprising: a means for processing movement data to extract patterns in the signal; and a means for training the classification algorithm using the processed data; wherein the trained classification algorithm forms the classification model.
  • said means for processing and said means for training are computer programs.
  • the apparatus is configured to operate in accordance with any of the methods described above.
  • the invention provides a software product comprising instructions which when executed by a computer cause the computer to process data relating to the movements of a living subject in order to extract information, and classify the extracted information into one of a plurality of categories using a classification model; wherein the classification model has been trained using data derived from the movements of other subjects whose category is known.
  • the invention provides a software product comprising instructions which when executed by a computer cause the computer to process a set of movement data derived from a population of subjects whose category is known; extract information from this data; and use this information to train a classification model for categorising data relating to the movement of a living subject.
  • a software product comprising instructions which when executed by a computer cause the computer to train a classification model and use a classification model to classify data according to a user's requirements, as described previously.
  • the software product may be a physical data carrier, or it may comprise signals transmitted from a remote location.
  • the invention provides a method of manufacturing a software product which is in the form of a physical carrier, comprising storing on the data carrier instructions which when executed by a computer cause the computer to process data relating to the movements of a living subject in order to extract information, and classify the extracted information into one of a plurality of categories using a classification model; wherein the classification model has been trained using data derived from the movements of other subjects whose category is known.
  • a method of manufacturing a software product which is in the form of a physical carrier, comprising storing on the data carrier instructions which when executed by a computer cause the computer to process a set of movement data derived from a population of subjects whose category is known; extract information from this data; and use this information to train a classification model for categorising data relating to the movement of a living subject.
  • the invention provides a method of providing a software product to a remote location by means of transmitting data to a computer at that remote location, the data comprising instructions which when executed by the computer cause the computer to process data relating to the movements of a living subject in order to extract information, and classify the extracted information into one of a plurality of categories using a classification model; wherein the classification model has been trained using data derived from the movements of other subjects whose category is known.
  • the invention provides a method of providing a software product to a remote location by means of transmitting data to a computer at that remote location, the data comprising instructions which when executed by the computer cause the computer to process a set of movement data derived from a population of subjects whose category is known; extract information from this data; and use this information to train a classification model for categorising data relating to the movement of a living subject.
  • the invention further extends to a method of diagnosing cerebral palsy (or another neurological condition) using the methods and/or apparatus discussed above. It will be appreciated that the preferred features described in relation to particular aspects above may also be applicable to other aspects. Further, it will be appreciated that the various features described may be used in isolation or in combination with other preferred features.
  • Figure 1 is a schematic view of the elements of an apparatus for categorising movement data according to one embodiment of the invention
  • Figure 2 shows in more detail the elements of an apparatus for categorising movement data according to one embodiment of the invention
  • Figure 3 illustrates sensors attached to a subject's body
  • Figure 4 is a schematic view of the process of training a classification algorithm according to an embodiment of the invention.
  • Figure 5 illustrates the steps of processing movement data and extracting information, according to an embodiment of the invention
  • Figure 5 a illustrates a matrix of movement data
  • Figure 6a is a graph of first and second principal components v. time of the data signal from a sensor on a 'normal' patient.
  • Figure 6b is a graph of first and second principal components v. time of the data signal from a sensor on a patient having CP.
  • Figure 7 schematically shows the step of training a classification algorithm according to an embodiment of the invention.
  • Figure 7a schematically illustrates a principle of training a classification algorithm
  • Figure 8 schematically illustrates the Fuzzy ARTMAP algorithm
  • Figure 9 schematically illustrates the steps of training classification models according to an embodiment of the invention
  • Figure 10 shows a welcome screen of a computer program for categorising movement data, according to an embodiment of the invention
  • Figure 11 shows a system status check screen displayed by computer program for categorising movement data, according to an embodiment of the invention
  • Figure 12 shows a main menu displayed by a computer program for categorising movement data, according to an embodiment of the invention
  • Figure 13 shows an ID number input box displayed by a computer program for categorising movement data, according to an embodiment of the invention
  • Figure 14 shows a patient record displayed by a computer program for categorising movement data, according to an embodiment of the invention
  • Figure 15 shows recording information displayed by a computer program for categorising movement data, according to an embodiment of the invention
  • FIG. 16 shows video capture controls displayed by a computer program for categorising movement data, according to an embodiment of the invention
  • Figure 17 shows a region of interest editing screen displayed by a computer program for categorising movement data, according to an embodiment of the invention
  • Figure 18 shows the results of the categorisation displayed by a computer program for categorising movement data, according to an embodiment of the invention.
  • Figure 19 shows the detailed results of the categorisation displayed by a computer program for categorising movement data, according to an embodiment of the invention.
  • Figure 1 schematically illustrates different elements of an apparatus 1 for categorizing movement data according to one embodiment of the invention.
  • the apparatus 1 comprises an input device 5 connected to a CP detection unit 8 which is connected to display 11.
  • CP detection unit 8 may also be connected to printer 12 (this is indicated by a dotted connection line).
  • Input device 5 collects movement data and provides this to CP detection unit
  • Unit 8 estimates whether the movement is suggestive of CP, and outputs the result to computer display 11 and/or printer 12.
  • a database 7 may be provided in which movement data of a subject is already stored.
  • the input device is a video camera combined with a motion tracking system.
  • Video camera 4 is pointed at mat 2 upon which an infant 3 is lying. The camera is typically raised about 105 cm above the level of the mat and is located near one end thereof, pointing down at the mat and inclined about 25 degrees from the vertical.
  • Video camera 4 is linked to a motion tracking system 6 connected to CP detection unit 8, which outputs results 10.
  • the video camera 4 collects two- dimensional video footage of the infant, and sends it to tracking system 6. This analyses the video footage using motion detection software in order to determine how the different parts of the infant are moving.
  • FIG 3 shows an alternative, second, embodiment where a camera is not used. Instead, electromagnetic sensors 8 are attached to key sites of movement and the output data is fed to the tracking system 6. Such sensors might monitor position, muscle activity or another kind of signal that provides information on relative movement.
  • the movement data output of the tracking system is input to the CP detection unit 8, which pre-processes the data, extracts information and classifies the movement data as represented by the extracted information into a particular category, for example, 'healthy', 'CP', or 'at risk'. The result is then output. Classification of the movement data is performed by a classification model which categorises the data using a trained classification algorithm.
  • the CP detection unit and results display are implemented as elements of a computer program running on a conventional computer, with which a user can interact to categorise movement data.
  • the GUI of the computer program is described later with reference to Figures 10-19.
  • FIG 4 is a schematic diagram illustrating the process of training a classification algorithm for categorizing data that is used in CP detection unit 8.
  • Movement data 20 is data relating to the movement of different parts of an infant. This is collected using the apparatus and methods described above in relation to categorizing movement data. It is collected in advance and then stored in a database, before being used to train a classification algorithm. The 'true' CP status of the infant is known, having been determined by waiting until the infant is about two years old, when it is normally clear whether an infant has CP or not.
  • the raw movement data 20 (sometimes called 'training data') is input to a processing module 21 shown in more detail in Figure 5 and 5a. The processed data is then used to train a classification model, as described in more detail below in relation to Figure 7.
  • FIG 5 illustrates the processing steps performed by processing module 21.
  • Raw movement data of an infant has been collected from six different sensors placed at different parts of the body. This data comprises the position of the sensor in three dimensions (x, y and z coordinates), over time.
  • a matrix 26 of such movement data is illustrated in Figure 5a.
  • This raw data has been selected according to a Region of Interest (ROI) in time, i.e. corresponding to when spontaneous movement is occurring, which is crucial in terms of CP assessment. For example, when the infant is crying or playing, the data at those times is not useful, and so falls outside the ROI and is not selected.
  • ROI has been selected manually by a human operator who has viewed the video of the infant.
  • PCA 27 principal component analysis (PCA) 27 is carried out on the movement data, in order to reduce the data matrix 26 to a matrix 28 of the principle components of the data, over time.
  • Temporal spectral decomposition is then carried out on the principal components, using time frequency representation 29, to find the amount of each frequency present in each principal component at a given time, as shown in matrix 30. Fourier transforms may be used for this step.
  • Figure 6a is a graph showing how the first and second principal components of a raw data signal from a sensor placed on a 'normal' patient, i.e. one which does not have CP, vary over time.
  • Figure 6b is a graph showing the first and second principal components of a raw data signal from a sensor placed on a 1 CP' patient.
  • the entropy of the TFR is found for each principle component, using Renyi entropy.
  • other types of information are extracted, the common feature being that the information is related in some way to patterns of movement in the data.
  • the processing steps illustrated in Figure 5 are also performed by CP detection unit 8 on incoming test movement data from tracking system 6, during the categorisation process.
  • the output of the information extraction stage 31 together with the correct category of the data is then input to the classifier 32, that comprises a trainable classification algorithm, as shown in Figure 7.
  • the algorithm is trained using the output from the information extraction together with the desired output, i.e. the known CP status.
  • the result is a trained classification model.
  • FIG. 7a A general principle of training a model by supervised learning is shown in Figure 7a.
  • both the extracted information and the correct class (category) for each subject are stored in a database, and are retrieved when the classifier is to be trained.
  • Initial parameters of the 'learning algorithm' 22 e.g. the classification algorithm
  • Supervisor 27 processes the desired output so that it can be compared to the class chosen by learning algorithm 22 at step 25. If the class is not correct, then feedback 26 is provided to the algorithm and the internal parameters are changed. The process is repeated until the learning algorithm gives the correct result.
  • the output networks may contain 2 neurons. If the input pattern is indicative of normal CP status, one neuron should be active, if abnormal then the other should be active. Each time a normal pattern is presented, the output of the "normal” neuron is checked to see if it is correct, and the output of the "abnormal” neuron is also checked. If there are errors, the system learns to put those neurons in the right state.
  • the classification algorithm is a Fuzzy ARTMAP (FAM) artificial neural network, illustrated in Figure 8.
  • FAM Fuzzy ARTMAP
  • Figure 8 This is a known type of neural network, and is described in more detail, for example, in "Use of reliability measures to improve the performance of fuzzy ARTMAP network",
  • Fuzzy ARTMAP A neural network architecture for incremental supervised learning of analog multidimensional maps", IEEE Trans. Neural Networks, Vol. 3, No. 5, pp. 698-713, September 1992, Carpenter et al.; and 'A comparison of Fuzzy ARTMAP and Multilayer Perception for Handwritten Digit Recognition, Busque et al, citeseer.csail.mit.edu/busque97 comparison.html
  • a Fuzzy ART neural network is an unsupervised neural network capable of incremental learning.
  • Fuzzy ARTMAP on the other hand is a supervised learning network comprising two Fuzzy ART modules, ARTa and ARTb.
  • the two modules are interconnected through a single layer of weighted connections (called the 'Map' layer) between the 'F2' layers of the modules.
  • the layer Fl is the input layer ('hypothesis')
  • the layer F2 is the output/category layer.
  • ARTa the input
  • desired output i.e. the known class
  • Category formation takes place in both modules. This means that in each module, the input activates a search mechanism for a matching neuron in the F2 layer.
  • ARTa a neuron is selected according to the extracted information.
  • ARTb a neuron is selected according to the desired output.
  • a vigilance criterion is evaluated for each module. The vigilance criterion is a parameter representing how similar the input patterns need to be in order to be classified as belonging to the same category.
  • the vigilance criterion will generally be set to 1 in ARTb, so as to perfectly distinguish between the desired output vectors. This process in ARTb essentially 'encodes' the desired output information into a format that can be compared with the output of ARTa. The vigilance criterion of ARTa will vary during the learning process. If the vigilance criterions are not satisfied, then category formation is repeated until they are (shown as 'Reset' in Figure 8).
  • the selected neurons are then compared using the Map interconnections to determine whether the neuron selected by ARTa corresponds to the desired output presented to ARTb. If this is not satisfied, then the vigilance criterion of ARTa is increased and category formation is repeated, such that a different neuron is selected. When a correct match is found, the Map layer 'learns' the association between the input and the desired output by updating its weights, so it can correctly classify a similar input in the future.
  • ARTa When the trained classifier is used to classify new data, the extracted information is input to ARTa. ARTb is not used and learning is deactivated. ARTa selects an output neuron, the Map field associates a class with this selected neuron, and this chosen class is output from the classifier.
  • Movement data of a population of many different infants are used in order to train the classification algorithm in an optimum manner.
  • the classifier is then tested using additional movement data for which the correct CP status is known, and the results compared with the true status.
  • the sensitivity and specificity is commonly used to evaluate the results, wherein:
  • TP No. of 'true positives'
  • TN No. of 'true negatives'
  • FP No. of 'false positives'
  • the ratio of training data to testing data may be 8:2, i.e. given a set of raw movement data with known outcomes, 80% may be used for training and 20% may be used for testing.
  • outputs from different sensors may be used to provide input raw movement data for training the algorithm.
  • a number of different sensors are grouped into different sensor sets 41.
  • the data from each sensor set is separately used to train a classification algorithm (termed in this figure a 'learning algorithm') in the manner described above.
  • the result is a differently trained classification algorithm for each sensor set, which can be considered as different classifiers.
  • the model creation module 43 evaluates the different classifiers using test data, and chooses the one that performs best, hi fact, the chosen classifier may be a compound of different classifiers. In that case, when categorizing data, the chosen category will be that given the most 'votes' by the different classifiers.
  • the CP detection unit for categorising movement data described previously is implemented using a computer program, with which a user can interact to categorise the movement of infants and display the results.
  • Figures 10 to 19 illustrate an example of a GUI of a suitable computer program which takes movement data as its input, categorises this and then displays the output.
  • Figure 10 illustrates a welcome screen. Before the system starts, a system status check is performed to check various parameters, such as disk capacity, video camera (if used), position of subject in field of view etc. If the subject is outside the screen or one part of the body is outside the screen, a warning message may be given. This is shown in Figure 11.
  • Figure 12 illustrates a main menu for the system with various options
  • Figure 13 shows a box in which a patient's ID number can be input.
  • Figure 14 shows what a patient record may look like.
  • Figure 15 visualises the recording date as a particular time during the period of 5-10 weeks post term, the time during which spontaneous movement can be used to detect CP. The cursor should always be in the central zone, otherwise the interpretation of the result might be invalid.
  • the computer program is used to control the video capture, and this is shown in Figure 16.
  • the video is on the left, and the activity of different sensors in the centre. Any number of sensors can be displayed.
  • the elapsed time and recording length is given in the 'status' box.
  • the user can control the recording using the buttons in the 'control panel'.
  • Figure 17 is a view of the editing screen.
  • the user can choose to remove a part of the input data, for example if the infant is crying.
  • the desired data is termed the region of interest, and can be selected using the buttons in the 'ROI list' box.
  • Figure 18 is a screen showing the output of the CP detection process. The classification result shows the outcome both graphically and as text.
  • Figure 19 illustrates the 'detailed result' screen displayed by clicking the 'detailed result' tab of Figure 18.
  • a classification graph is given which represents two-dimensionally the position of the tested subject in the feature space. For the graph, two main features have been selected, for example entropy and periodicity.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

La présente invention concerne un procédé et un dispositif pour classer dans des catégories, des données de mouvement déduites des mouvements d'un être vivant, les données de mouvement étant traitées pour en extraire des d'informations, et les informations extraites étant classifiées dans l'une des catégories d'une pluralité, au moyen d'un modèle de classification qui a fait l'objet d'un apprentissage au moyen de données d'apprentissage déduites des mouvements d'autres individus dont la catégorie est connue. Les informations extraites concernent des motifs de mouvements qui peuvent ou non être facilement reconnaissables par un observateur humain. De cette manière, l'invention peut prendre en considération des phénomènes de mouvement qui sont sinon incompréhensibles des êtres humains (ou au moins difficilement reconnaissables et descriptibles), par exemple parce qu'ils impliquent des interdépendances complexes de mouvements d'une pluralité de membres. Le procédé et le dispositif de l'invention peuvent être utilisés pour classer dans des catégories, des données de mouvement d'enfants selon s'ils sont atteints ou non, ou susceptibles d'être atteints d'une infirmité motrice cérébrale.
PCT/GB2006/003336 2005-09-09 2006-09-11 Classement de donnees de mouvement dans des categories Ceased WO2007029012A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0518480.9 2005-09-09
GBGB0518480.9A GB0518480D0 (en) 2005-09-09 2005-09-09 Categorising movement data

Publications (1)

Publication Number Publication Date
WO2007029012A1 true WO2007029012A1 (fr) 2007-03-15

Family

ID=35221253

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2006/003336 Ceased WO2007029012A1 (fr) 2005-09-09 2006-09-11 Classement de donnees de mouvement dans des categories

Country Status (2)

Country Link
GB (1) GB0518480D0 (fr)
WO (1) WO2007029012A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011026001A3 (fr) * 2009-08-28 2011-06-03 Allen Joseph Selner Caractérisation d'une aptitude physique par analyse du mouvement
US8139822B2 (en) 2009-08-28 2012-03-20 Allen Joseph Selner Designation of a characteristic of a physical capability by motion analysis, systems and methods
WO2016038516A3 (fr) * 2014-09-09 2016-06-23 Novartis Ag Système et procédé d'analyse de tâche motrice
DE102020205434A1 (de) 2020-04-29 2021-11-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung eingetragener Verein Verfahren zur Ermittlung einer Entwicklung oder eines Entwicklungsstands eines Kleinkinds oder Säuglings

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
BISHOP C M: "NEURAL NETWORKS FOR PATTERN RECOGNITION, PASSAGE", NEURAL NETWORKS FOR PATTERN RECOGNITION, OXFORD : OXFORD UNIVERSITY PRESS, GB, 1995, pages 310 - 313, XP002412841, ISBN: 0-19-853864-2 *
BRUCE, EUGENE N.: "Biomedical Signal Processing and Signal Modeling", 2001, JOHN WILEY AND SONS, INC, USA, XP002412870 *
HAYES, MONSON H.: "Statistical Digital Signal Processing and Modeling", 1996, JOHN WILEY & SONS, INC., USA, XP002412843 *
MEINECKE L ET AL: "MOVEMENT ANALYSIS IN EARLY DIAGNOSIS OF A DEVELOPING SPASTICITY IN NEWBORNS WITH INFANTILE CEREBRAL PALSY", GAIT & POSTURE, ELSEVIER, vol. 18, no. SUPPL 2, 2003, pages S105, XP007901480, ISSN: 0966-6362 *
MEINECKE L ET AL: "procedurs for the classification of movement analysis data in early diagnosis of a developing spasticity in newborns with icp", GAIT & POSTURE, ELSEVIER, vol. 20 S, no. SUPPL 1, 2004, pages S110 - S111, XP007901479, ISSN: 0966-6362 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011026001A3 (fr) * 2009-08-28 2011-06-03 Allen Joseph Selner Caractérisation d'une aptitude physique par analyse du mouvement
US8139822B2 (en) 2009-08-28 2012-03-20 Allen Joseph Selner Designation of a characteristic of a physical capability by motion analysis, systems and methods
AU2010286471B2 (en) * 2009-08-28 2015-05-07 Allen Joseph Selner Characterizing a physical capability by motion analysis
WO2016038516A3 (fr) * 2014-09-09 2016-06-23 Novartis Ag Système et procédé d'analyse de tâche motrice
US10776423B2 (en) 2014-09-09 2020-09-15 Novartis Ag Motor task analysis system and method
DE102020205434A1 (de) 2020-04-29 2021-11-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung eingetragener Verein Verfahren zur Ermittlung einer Entwicklung oder eines Entwicklungsstands eines Kleinkinds oder Säuglings
WO2021219643A1 (fr) 2020-04-29 2021-11-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Procédé de détermination du développement ou de l'état de développement d'un petit enfant ou d'un nourrisson

Also Published As

Publication number Publication date
GB0518480D0 (en) 2005-10-19

Similar Documents

Publication Publication Date Title
Tawhid et al. Automatic and efficient framework for identifying multiple neurological disorders from EEG signals
Ali et al. Autism spectrum disorder classification on electroencephalogram signal using deep learning algorithm
US20200060604A1 (en) Systems and methods of automatic cough identification
CN114999646B (zh) 新生儿运动发育评估系统、方法、装置及存储介质
CN113729710A (zh) 一种融合多生理模态的实时注意力评估方法及系统
Rueangsirarak et al. Automatic musculoskeletal and neurological disorder diagnosis with relative joint displacement from human gait
US7409373B2 (en) Pattern analysis system and method
Das et al. Automated detection of heart valve diseases using stationary wavelet transform and attention-based hierarchical LSTM network
Manjur et al. Detecting autism spectrum disorder and attention deficit hyperactivity disorder using multimodal time-frequency analysis with machine learning using the electroretinogram from two flash strengths
CN110693510A (zh) 一种注意力缺陷多动障碍辅助诊断装置及其使用方法
Houssein et al. EEG signals classification for epileptic detection: a review
WO2013086615A1 (fr) Dispositif et méthode pour dépister la dysphagie congénitale
Alaskar et al. Prediction of Parkinson disease using gait signals
Xu et al. Deep convolutional neural network for detection of disorders of consciousness
WO2007029012A1 (fr) Classement de donnees de mouvement dans des categories
Lamani et al. A review on deep learning algorithms in the detection of autism spectrum disorder
Elumalai et al. Parkinson's disease detection and stage classification: quantitative gait evaluation through variational mode decomposition and DCNN architecture.
Jaffery et al. An automated system for the classification of bronchiolitis and bronchiectasis diseases using lung sound analysis
Priya et al. Improving the prediction accuracy of Parkinson’s Disease based on pattern techniques
Aljalal et al. Mild cognitive impairment detection from EEG signals using combination of EMD decomposition and machine learning
Hassanuzzaman et al. A deep learning model for recognizing pediatric congenital heart diseases using phonocardiogram signals
Pecundo et al. Amyotrophic lateral sclerosis and post-stroke orofacial impairment video-based multi-class classification
Jayanthy et al. Early detection of autism spectrum disorder using behavioral data EEG, MRI and Behavioral Data: A Review
Ru et al. Gait analysis and Machine learning algorithms to distinguish between Parkinson’s disease, amyotrophic lateral sclerosis, and Huntington’s disease
CN119650041B (zh) 一种基于脑功能连接组发育常模的注意缺陷多动障碍识别系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06779353

Country of ref document: EP

Kind code of ref document: A1