[go: up one dir, main page]

CN111434305A - Fetal electrocardiogram extraction system and method based on convolutional coding and decoding neural network - Google Patents

Fetal electrocardiogram extraction system and method based on convolutional coding and decoding neural network Download PDF

Info

Publication number
CN111434305A
CN111434305A CN201910036810.5A CN201910036810A CN111434305A CN 111434305 A CN111434305 A CN 111434305A CN 201910036810 A CN201910036810 A CN 201910036810A CN 111434305 A CN111434305 A CN 111434305A
Authority
CN
China
Prior art keywords
neural network
ecg
convolutional
layer
maternal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910036810.5A
Other languages
Chinese (zh)
Inventor
王国利
钟伟
郭雪梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sun Yat Sen University
Original Assignee
Sun Yat Sen University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sun Yat Sen University filed Critical Sun Yat Sen University
Priority to CN201910036810.5A priority Critical patent/CN111434305A/en
Publication of CN111434305A publication Critical patent/CN111434305A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/318Heart-related electrical modalities, e.g. electrocardiography [ECG]
    • A61B5/344Foetal cardiography
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physiology (AREA)
  • Psychiatry (AREA)
  • Signal Processing (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

本发明公开了一种基于卷积编解码神经网络的胎儿心电提取系统以及其方法,所述系统包括数据采集装置:用于采集真实的孕妇腹部电信号;母体心电成分估计装置:用于采用卷积编解码神经网络对孕妇腹部电信号中的母体心电成分进行预估,训练时将仿真腹部电信号作为神经网络的输入,仿真腹部电信号中的母体心电成分作为网络标签进行训练,测试时将真实的孕妇腹部电信号作为神经网络的输入,神经网络的输出为对腹部电信号中的预估的母体心电成分;胎儿心电成分提取装置:用于从采集到的孕妇腹部电信号中减去上述所得的母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分。所述方法包括数据预处理、预估母体心电成分和胎儿心电成分提取。通过本技术方案,能够有效提高胎儿心电提取的效率和准确率。

Figure 201910036810

The invention discloses a fetal electrocardiogram extraction system based on a convolutional coding and decoding neural network and a method thereof. The system comprises a data acquisition device: used to collect real abdominal electrical signals of pregnant women; a maternal electrocardiogram component estimation device: used for The convolutional codec neural network is used to estimate the maternal ECG component in the abdominal electrical signal of pregnant women. During training, the simulated abdominal electrical signal is used as the input of the neural network, and the maternal ECG component in the simulated abdominal electrical signal is used as the network label for training. , during the test, the real abdominal electrical signals of pregnant women are used as the input of the neural network, and the output of the neural network is the estimated maternal ECG components in the abdominal electrical signals; The maternal ECG component obtained above is subtracted from the electrical signal, thereby extracting the fetal ECG component in the abdominal electrical signal of the pregnant woman. The method includes data preprocessing, estimation of maternal ECG components and extraction of fetal ECG components. Through the technical solution, the efficiency and accuracy of fetal ECG extraction can be effectively improved.

Figure 201910036810

Description

基于卷积编解码神经网络的胎儿心电提取系统及方法Fetal ECG extraction system and method based on convolutional codec neural network

技术领域technical field

本发明涉及胎儿心电提取技术领域,尤其涉及一种基于卷积编解码神经网络的胎儿心电提取系统,进一步地,提供使用这种系统的方法。The invention relates to the technical field of fetal ECG extraction, in particular to a fetal ECG extraction system based on a convolutional codec neural network, and further provides a method for using the system.

背景技术Background technique

胎心监护是一种胎儿宫内监护的手段,能够实时地反映胎儿的生物物理活动情况,被广泛地应用于临床实践中。在降低围产儿死亡率中扮演着重要角色。围产儿死亡率在某种程度上反映了一个国家和地区的综合的经济发展和卫生医疗状况。Fetal heart rate monitoring is a means of fetal intrauterine monitoring, which can reflect the biophysical activity of the fetus in real time, and is widely used in clinical practice. plays an important role in reducing perinatal mortality. Perinatal mortality to some extent reflects the comprehensive economic development and health care conditions of a country and region.

胎儿心电信号不仅可以用于胎儿心率的计算,而且可以提供更多的形态上的信息,这些信息记录了胎儿心脏的动作情况,客观地反映了胎儿宫内生理活动的各种状态,医务人员可对胎儿的发育程度、位置、是否酸中毒或者心律失常等状况进行判断,从而得出胎儿当前的健康状况。提取胎儿心电信号的难点之一就是腹部电信号中包含有母亲的心电成分,母亲心电成分通常比胎儿具有更大的幅值,且母亲的心电成分与胎儿的心电成分在时域和频域都有重叠,因此,给胎儿心电的提取带来很大的干扰。因此从母体腹部的混合信号中提取出胎儿心电信号是一项富有挑战性的工作。The fetal ECG signal can not only be used to calculate the fetal heart rate, but also provide more morphological information, which records the movement of the fetal heart and objectively reflects the various states of the fetal intrauterine physiological activity. It can judge the developmental degree, position, acidosis or arrhythmia of the fetus, so as to obtain the current health status of the fetus. One of the difficulties in extracting the fetal ECG signal is that the abdominal electrical signal contains the mother's ECG component. The mother's ECG component usually has a larger amplitude than that of the fetus, and the mother's ECG component is at the same time as the fetal ECG component. Both the domain and the frequency domain overlap, therefore, it brings great interference to the extraction of fetal ECG. Therefore, it is a challenging task to extract fetal ECG signals from the mixed signals in the maternal abdomen.

发明内容SUMMARY OF THE INVENTION

为了克服现有技术的不足,本发明所解决的技术问题是提供一种基于卷积编解码神经网络的,能提高提取效率和准确率的胎儿心电提取系统,以及使用这种系统的方法。In order to overcome the deficiencies of the prior art, the technical problem solved by the present invention is to provide a fetal ECG extraction system based on a convolutional codec neural network, which can improve extraction efficiency and accuracy, and a method for using the system.

为解决上述第一个技术问题,本发明所采用的技术方案内容具体如下:In order to solve the above-mentioned first technical problem, the content of the technical solution adopted in the present invention is as follows:

基于卷积编解码神经网络的胎儿心电提取系统,包括以下装置:A fetal ECG extraction system based on convolutional codec neural network, including the following devices:

数据采集装置:用于采集真实的孕妇腹部电信号;Data acquisition device: used to collect real abdominal electrical signals of pregnant women;

母体心电成分估计装置:用于构建待训练的卷积编解码神经网络,在训练时,将仿真腹部电信号作为神经网络的输入,仿真腹部电信号中的母体心电成分作为网络标签对卷积编解码神经网络进行训练改变神经网络中的参数(即权重系数与偏差量),直至所述神经网络的误差完全收敛时才终止训练(误差完全收敛是指对得到的母体心电成分与已知的仿真腹部电信号中的母体心电成分作比较,直至没有误差或者误差处于合理范围内),并保存所有参数,得到训练好的卷积编解码神经网络单元。测量真实的孕妇腹部电信号时,将数据采集装置采集到的真实的单通道孕妇腹部电信号作为神经网络的输入代入到训练好的卷积编解码神经网络单元中,得到的神经网络的输出为对腹部电信号中的预估母体心电成分。Maternal ECG component estimation device: used to construct the convolutional codec neural network to be trained. During training, the simulated abdominal electrical signal is used as the input of the neural network, and the maternal ECG component in the simulated abdominal electrical signal is used as the network label for volume Integrate the encoder-decoder neural network for training and change the parameters in the neural network (ie, the weight coefficient and the amount of deviation), until the error of the neural network is completely converged and the training is terminated (the error is completely converged. Compare the maternal ECG components in the known simulated abdominal electrical signals until there is no error or the error is within a reasonable range), and save all parameters to obtain a trained convolutional codec neural network unit. When measuring the real abdominal electrical signals of pregnant women, the real single-channel pregnant abdominal electrical signals collected by the data acquisition device are substituted into the trained convolutional codec neural network unit as the input of the neural network, and the obtained output of the neural network is Estimated maternal ECG components in abdominal electrical signals.

其中,所述母体心电成分估计装置执行程序中的卷积编解码神经网络由多个卷积-反卷积模块和一个全连接模块串联组成;卷积-反卷积模块中的卷积层的卷积核大小为1×3、1×4或1×5。Wherein, the convolutional coding and decoding neural network in the execution program of the maternal ECG component estimation device is composed of multiple convolution-deconvolution modules and a fully connected module in series; the convolutional layer in the convolution-deconvolution module The convolution kernel size is 1×3, 1×4 or 1×5.

优选地,本技术方案通过采用梯度下降法和反向传播算法训练所述卷积编解码神经网络。所述仿真腹部电信号是根据现有的仿真数据库中的数据获取得到的,可将其分为训练集以及验证集。Preferably, in the technical solution, the convolutional encoder-decoder neural network is trained by using the gradient descent method and the back-propagation algorithm. The simulated abdominal electrical signal is obtained according to the data in the existing simulation database, and can be divided into a training set and a verification set.

当采用梯度下降法和反向传播算法训练所述卷积编解码神经网络时,正常运行时,首先通过将训练集的仿真孕妇腹部电信号经过预处理后输入到卷积编解码神经网络中,对卷积编解码神经网络进行训练,通过损失函数对母体心电成分做评估,再通过反向传播算法(梯度下降法),计算卷积神经网络中所有参数的梯度,并根据梯度变化(各个参数的导数)对所有参数进行更新,重新将训练集代入到卷积编解码神经网络中进行训练,直至完成迭代寻找到具有最小损失函数的模型时,保存所有参数将模型保留下来。当需要测试真实的孕妇腹部电信号时,调用卷积神经网络模型,将数据采集装置采集到的真实的孕妇腹部电信号预处理后输入到卷积编解码神经网络中,获取预估的母体心电成分,再用真实的采集到的孕妇腹部电信号中减去上述所得的预估母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分。When using the gradient descent method and the back-propagation algorithm to train the convolutional encoder-decoder neural network, during normal operation, the simulated pregnant abdominal electrical signals of the training set are preprocessed and input into the convolutional encoder-decoder neural network, Train the convolutional encoder-decoder neural network, evaluate the maternal ECG components through the loss function, and then calculate the gradient of all parameters in the convolutional neural network through the back-propagation algorithm (gradient descent method), and change according to the gradient (each Derivative of parameters) to update all parameters, re-substitute the training set into the convolutional encoder-decoder neural network for training, until the iteration is completed to find the model with the smallest loss function, save all parameters and keep the model. When it is necessary to test the real abdominal electrical signals of pregnant women, the convolutional neural network model is called, and the real abdominal electrical signals of pregnant women collected by the data acquisition device are preprocessed and input into the convolutional codec neural network to obtain the estimated maternal heart rate. Then, the estimated maternal ECG component obtained above is subtracted from the actual collected abdominal electrical signal of the pregnant woman, so as to extract the fetal ECG component in the abdominal electrical signal of the pregnant woman.

胎儿心电成分提取装置:用于从采集到的孕妇腹部电信号中减去上述所得的预估母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分。The device for extracting fetal ECG components is used to subtract the estimated maternal ECG components obtained above from the collected abdominal electrical signals of pregnant women, so as to extract the fetal ECG components in the abdominal electrical signals of pregnant women.

需要说明的是,为提高在检测过程中对胎儿心电提取的效率和准确率,发明人在本技术方案中提供了一种提取系统,方便操作者通过该系统实现信号处理,便于后续的检测和诊治。发明人在本技术方案中创新性地利用卷积编解码神经网络对孕妇腹部电信号中的母体心电成分进行预估,并将从采集到的孕妇腹部电信号中减去上述所得的母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分的方案,本系统分别设立数据采集装置、母体心电成分估计装置和胎儿心电成分提取装置实现上述过程。It should be noted that, in order to improve the efficiency and accuracy of fetal ECG extraction during the detection process, the inventor provides an extraction system in this technical solution, which is convenient for operators to realize signal processing through the system and facilitate subsequent detection. and diagnosis and treatment. In this technical solution, the inventor innovatively uses a convolutional coding and decoding neural network to estimate the maternal ECG components in the abdominal electrical signals of pregnant women, and subtracts the above-obtained maternal cardiac electrical signals from the collected abdominal electrical signals of pregnant women. The scheme of extracting the fetal ECG components in the abdominal electrical signals of pregnant women, the system separately sets up a data acquisition device, a maternal ECG component estimation device and a fetal ECG component extraction device to realize the above process.

需要说明的是,所述数据采集装置中还会将所述孕妇腹部电信号转换成数字信号,便于在数字设备如电脑上进行处理。It should be noted that, in the data acquisition device, the electrical signal of the pregnant woman's abdomen will also be converted into a digital signal, which is convenient for processing on a digital device such as a computer.

优选地,所述数据采集装置还执行以下程序:Preferably, the data acquisition device also executes the following procedures:

将所述孕妇腹部电信号通过放大和/或滤波等处理程序处理后,再通过A/D转换处理程序转换成数字信号。After the pregnant woman's abdominal electrical signal is processed by processing procedures such as amplification and/or filtering, it is then converted into a digital signal by an A/D conversion processing procedure.

更优选地,所述数据采集装置还执行以下程序:More preferably, the data acquisition device also executes the following procedures:

将所述数字信号裁剪成与卷积编解码神经网络输入相匹配的尺寸。优选地,数字信号裁剪后的尺寸为1×1000,其中的每个1×1的信号中的数值为某点的心电图数值(幅度),而1000有1000个点,每个点代表不同时间上的心电图中的数值(幅度)。Crop the digital signal to a size that matches the input of the convolutional codec neural network. Preferably, the cropped size of the digital signal is 1×1000, and the value in each 1×1 signal is the electrocardiogram value (amplitude) of a certain point, and 1000 has 1000 points, and each point represents a different time point. The value (amplitude) of the ECG.

通过裁剪成相匹配的尺寸大小,可以更有效率地执行下述利用卷积编解码神经网络的训练。By cropping to a matching size, the following training of neural networks using convolutional encoders and decoders can be performed more efficiently.

优选地,所述母体心电成分估计装置在训练过程时执行以下程序:Preferably, the device for estimating the maternal ECG components executes the following procedures during the training process:

使用开放全层网络参数更新的方式以及采用均方误差作为损失函数来训练网络模型。即本申请采用了反向传播算法(梯度下降法),计算时需要计算卷积神经网络中所有参数的梯度,并根据梯度变化(各个参数的导数)对所有参数进行更新。The network model is trained using an open full-layer network parameter update and using the mean squared error as the loss function. That is, the present application adopts the back-propagation algorithm (gradient descent method), and the gradient of all parameters in the convolutional neural network needs to be calculated during calculation, and all parameters are updated according to the gradient change (derivative of each parameter).

优选地,所述损失函数为:Preferably, the loss function is:

Figure BDA0001946178700000031
Figure BDA0001946178700000031

其中,M为训练的样本个数,

Figure BDA0001946178700000032
为网路输出的对母体心电成分的预估,X为网络标签,即仿真腹部电信号中的母体心电成分。采用此损失函数,可以完整而快速地学习到母体心电的特征。Among them, M is the number of training samples,
Figure BDA0001946178700000032
is the estimation of the maternal ECG component output by the network, and X is the network label, that is, the maternal ECG component in the simulated abdominal electrical signal. Using this loss function, the characteristics of the maternal ECG can be learned completely and quickly.

优选地,进行训练时,最大的迭代次数为10000次,学习率为0.0001。Preferably, during training, the maximum number of iterations is 10,000, and the learning rate is 0.0001.

优选地,所述母体心电成分估计装置执行程序中的卷积编解码神经网络由多个卷积-反卷积模块和一个全连接模块串联组成;Preferably, the convolutional coding and decoding neural network in the execution program of the maternal ECG component estimation device is composed of a plurality of convolution-deconvolution modules and a fully connected module in series;

其中,与输出层直接相连的全连接模块由一个或多个全连接层组成,与全连接模块相连的卷积-反卷积模块由一个卷积层,一个反卷积层和一个非线性层组成外,其他所有的卷积-反卷积模块均包含一个卷积层,一个反卷积层和两个非线性层;相邻两个卷积-反卷积模块之间采用的是直接连接的方式。优选地,非线性层的激活函数为tanh函数。优选地,所述卷积层的卷积核大小为1×3、1×4或1×5。保证卷积核相对合适,不会导致局部特征提取过多,也不会由于卷积核多大导致遗失一部分局部的特征。Among them, the fully-connected module directly connected to the output layer consists of one or more fully-connected layers, and the convolution-deconvolution module connected to the fully-connected module consists of a convolutional layer, a deconvolutional layer and a nonlinear layer In addition to the composition, all other convolution-deconvolution modules include one convolution layer, one deconvolution layer and two nonlinear layers; the two adjacent convolution-deconvolution modules are directly connected. The way. Preferably, the activation function of the nonlinear layer is a tanh function. Preferably, the size of the convolution kernel of the convolution layer is 1×3, 1×4 or 1×5. Ensure that the convolution kernel is relatively suitable, and will not cause too much local feature extraction, nor will some local features be lost due to the size of the convolution kernel.

需要说明的是,所述卷积编解码神经网络采用上述结构,可以有效地捕捉到母体心电的特征,加快网络训练的收敛速度,同时对于梯度弥散问题也有很好的效果。需要说明的是,通过相邻两个卷积-反卷积模块之间采用的是直接连接的方式,从而浅层的特征能传递到深层,进而保留更多的母体心电的细节特征,进一步提高效率和准确性。It should be noted that the convolutional encoding and decoding neural network adopts the above structure, which can effectively capture the characteristics of the maternal ECG, speed up the convergence speed of network training, and also has a good effect on the gradient dispersion problem. It should be noted that the direct connection method is adopted between two adjacent convolution-deconvolution modules, so that the features of the shallow layer can be transferred to the deep layer, thereby retaining more detailed features of the maternal ECG, and further Improve efficiency and accuracy.

优选地,所述系统还包括显示装置,用于将提取出的胎儿心电成分拼接成完整信号并进行显示。Preferably, the system further includes a display device for splicing the extracted fetal ECG components into a complete signal and displaying it.

需要说明的是,采用将信号裁剪成较短长度进行学习,学习完成后将网络输出拼接成完整信号的方式,可以使网络学习到更多的细节特征,提升胎儿心电提取的效果。It should be noted that the method of cutting the signal into a shorter length for learning and splicing the network output into a complete signal after the learning is completed can enable the network to learn more detailed features and improve the effect of fetal ECG extraction.

优选地,当开始训练前,网络的所有参数都被小随机数初始化。首先参数小则保护网络不会由于一开始权值过大而进入饱和状态,导致训练失败,其次随机化参数实现保证每次参数初始值不同,避免每次训练得到一样的参数。所述小随机数的数值范围为0-1之间。Preferably, all parameters of the network are initialized with small random numbers before starting training. First of all, if the parameters are small, the network will not be saturated due to too large weights at the beginning, resulting in training failure. Second, the randomization parameters are implemented to ensure that the initial values of the parameters are different each time, so as to avoid getting the same parameters for each training. The value range of the small random number is between 0-1.

为解决上述第二个技术问题,本发明所采用的技术方案内容具体如下:In order to solve the above-mentioned second technical problem, the content of the technical solution adopted in the present invention is as follows:

一种基于卷积编解码神经网络的胎儿心电提取方法,包括以下步骤:A method for extracting fetal ECG based on a convolutional codec neural network, comprising the following steps:

数据预处理:采集孕妇腹部电信号;Data preprocessing: collecting abdominal electrical signals of pregnant women;

母体心电成分估计:采用卷积编解码神经网络对孕妇腹部电信号中的母体心电成分进行预估,即训练时将仿真的腹部电信号作为神经网络的输入,仿真腹部电信号中的母体心电成分作为网络标签进行训练,测试时将真实的单通道孕妇腹部电信号作为神经网络的输入,神经网络的输出为对腹部电信号中的预估母体心电成分;Maternal ECG component estimation: The convolutional codec neural network is used to estimate the maternal ECG component in the abdominal electrical signal of pregnant women, that is, the simulated abdominal electrical signal is used as the input of the neural network during training to simulate the maternal electrical component in the abdominal electrical signal. The ECG component is used as a network label for training, and the real single-channel pregnant abdominal electrical signal is used as the input of the neural network during testing, and the output of the neural network is the estimated maternal ECG component in the abdominal electrical signal;

母体心电成分消除:从采集到的孕妇腹部电信号中减去上述所得的母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分。Elimination of maternal ECG components: The maternal ECG components obtained above are subtracted from the collected abdominal electrical signals of pregnant women, so as to extract fetal ECG components in the abdominal electrical signals of pregnant women.

为提高胎儿心电提取的效率和准确率,发明人在本技术方案中创新性地利用卷积编解码神经网络对孕妇腹部电信号中的母体心电成分进行预估,并将从采集到的孕妇腹部电信号中减去上述所得的母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分的方案。本技术方案中,采用卷积编解码神经网络,该技术具有较强的鲁棒性,在接触噪声、呼吸噪声等干扰情况下仍能提取出胎儿心电信号。而且,在胎儿信号与母亲信号之间的信噪比较低以及胎儿的QRS波与母体的QRS波有重叠时,本方法也有很好的表现。通过此技术手段,可以更大程度地排除相关噪音,使得提取更为准确,效率也更高。该项发明提取出的清晰的胎儿心电信号可提供胎儿心率等信息,具有重要的临床应用价值和可观的社会效益。In order to improve the efficiency and accuracy of fetal ECG extraction, the inventor innovatively uses a convolutional codec neural network in this technical solution to estimate the maternal ECG components in the abdominal electrical signals of pregnant women, and use the collected data to estimate the maternal ECG components. The scheme of subtracting the maternal ECG components obtained above from the abdominal electrical signals of pregnant women, thereby extracting the fetal ECG components in the abdominal electrical signals of pregnant women. In this technical solution, a convolutional codec neural network is used, which has strong robustness and can still extract fetal ECG signals under interference conditions such as contact noise and breathing noise. Furthermore, the method also performs well when the signal-to-noise ratio between the fetal signal and the maternal signal is low and when the fetal QRS complex overlaps with the maternal QRS complex. Through this technical means, the relevant noise can be excluded to a greater extent, so that the extraction is more accurate and the efficiency is higher. The clear fetal ECG signal extracted by the invention can provide information such as fetal heart rate, and has important clinical application value and considerable social benefit.

更优选地,包括放大和/或滤波等处理程序处理后,再通过A/D转换处理得到数字信号。More preferably, the digital signal is obtained through A/D conversion after processing including amplification and/or filtering.

进一步地,所述数据预处理步骤中还包括将所述数字信号裁剪成与卷积编解码神经网络输入相匹配的尺寸。Further, the data preprocessing step further includes trimming the digital signal to a size matching the input of the convolutional codec neural network.

优选地,所述母体心电成分估计中的训练方法是使用开放全层网络参数更新的方式以及采用均方误差作为损失函数来训练卷积编解码神经网络模型;Preferably, the training method in the estimation of the maternal ECG components is to use an open full-layer network parameter update method and use the mean square error as a loss function to train a convolutional encoder-decoder neural network model;

优选地,所述损失函数为:Preferably, the loss function is:

Figure BDA0001946178700000051
Figure BDA0001946178700000051

其中,M为训练的样本个数,

Figure BDA0001946178700000052
为网路输出的预估的母体心电成分,X为网络标签,即仿真腹部电信号中的母体心电成分。Among them, M is the number of training samples,
Figure BDA0001946178700000052
is the estimated maternal ECG component output by the network, and X is the network label, that is, the maternal ECG component in the simulated abdominal electrical signal.

优选地,所述母体心电成分估计装置中的卷积编解码神经网络由多个卷积-反卷积模块和一个全连接模块串联组成;Preferably, the convolutional coding and decoding neural network in the device for estimating maternal ECG components is composed of multiple convolution-deconvolution modules and a fully connected module in series;

其中,与输出层直接相连的全连接模块由一个或多个全连接层组成,与全连接模块相连的卷积-反卷积模块由一个卷积层,一个反卷积层和一个非线性层组成外,其他所有的卷积-反卷积模块均包含一个卷积层,一个反卷积层和两个非线性层;相邻两个卷积-反卷积模块之间采用的是直接连接的方式。Among them, the fully-connected module directly connected to the output layer consists of one or more fully-connected layers, and the convolution-deconvolution module connected to the fully-connected module consists of a convolutional layer, a deconvolutional layer and a nonlinear layer In addition to the composition, all other convolution-deconvolution modules include one convolution layer, one deconvolution layer and two nonlinear layers; the two adjacent convolution-deconvolution modules are directly connected. The way.

优选地,本技术方案通过采用梯度下降法和反向传播算法训练所述卷积编解码神经网络。Preferably, in the technical solution, the convolutional encoder-decoder neural network is trained by using the gradient descent method and the back-propagation algorithm.

优选地,所述方法还包括将提取出的胎儿心电成分拼接成完整信号并进行显示。Preferably, the method further comprises splicing the extracted fetal ECG components into a complete signal and displaying it.

与现有技术相比,本发明的有益效果在于:Compared with the prior art, the beneficial effects of the present invention are:

1、本发明基于卷积编解码神经网络的胎儿心电提取系统,采用卷积编解码神经网络,该技术具有较强的鲁棒性,在接触噪声、呼吸噪声等干扰情况下仍能提取出胎儿心电信号,可以更大程度地排除相关噪音,使得提取更为准确,效率也更高;1. The fetal ECG extraction system based on the convolutional coding and decoding neural network of the present invention adopts the convolutional coding and decoding neural network. The fetal ECG signal can eliminate relevant noise to a greater extent, making the extraction more accurate and more efficient;

2、本发明基于卷积编解码神经网络的胎儿心电提取系统,将信号裁剪成较短长度进行学习,学习完成后将网络输出拼接成完整信号的方式,可以使网络学习到更多的细节特征,提升胎儿心电提取的效果;2. The present invention is based on a fetal ECG extraction system based on a convolutional coding and decoding neural network. The signal is cut into a shorter length for learning, and the network output is spliced into a complete signal after the learning is completed, so that the network can learn more details. Features, improve the effect of fetal ECG extraction;

3、本发明基于卷积编解码神经网络的胎儿心电提取方法,应用上述系统执行相应过程,能实现提取目的。3. The fetal ECG extraction method based on the convolutional coding and decoding neural network of the present invention, and the above-mentioned system is used to execute the corresponding process, and the extraction purpose can be achieved.

上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,而可依照说明书的内容予以实施,并且为了让本发明的上述和其他目的、特征和优点能够更明显易懂,以下特举较佳实施例,并配合附图,详细说明如下。The above description is only an overview of the technical solutions of the present invention, in order to be able to understand the technical means of the present invention more clearly, it can be implemented according to the content of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand , the following specific preferred embodiments, and in conjunction with the accompanying drawings, are described in detail as follows.

附图说明Description of drawings

图1为本发明基于卷积编解码神经网络的胎儿心电提取方法一种较优选实施方式的流程框架示意图;Fig. 1 is a schematic diagram of the process frame of a preferred embodiment of a fetal ECG extraction method based on a convolutional codec neural network of the present invention;

图2为本发明方法中其中一种实施方式中训练时的一路仿真的腹部信号与对应的母体心电成分示意图;2 is a schematic diagram of a simulated abdominal signal and a corresponding maternal ECG component during training in one of the embodiments of the method of the present invention;

图3为根据本方法所得到的胎儿心电信号与对应的真实的腹部信号和网络输出的母体心电成分示意图;3 is a schematic diagram of the fetal ECG signal obtained according to the present method, the corresponding real abdominal signal and the maternal ECG component output by the network;

图4为卷积编解码神经网络的结构示意图。Figure 4 is a schematic diagram of the structure of a convolutional encoder-decoder neural network.

具体实施方式Detailed ways

为更进一步阐述本发明为达成预定发明目的所采取的技术手段及功效,以下结合附图及较佳实施例,对依据本发明的具体实施方式、结构、特征及其功效,详细说明如下:In order to further illustrate the technical means and effects adopted by the present invention to achieve the predetermined purpose of the invention, below in conjunction with the accompanying drawings and preferred embodiments, the specific embodiments, structures, features and effects according to the present invention are described in detail as follows:

实施例1(一种基于卷积编解码神经网络的胎儿心电提取系统)Embodiment 1 (a fetal ECG extraction system based on convolutional codec neural network)

一种基于卷积编解码神经网络的胎儿心电提取系统,包括以下装置:A fetal ECG extraction system based on a convolutional codec neural network, comprising the following devices:

数据采集装置:用于采集一路孕妇腹部电信号;Data acquisition device: used to collect a route of abdominal electrical signals of pregnant women;

母体心电成分估计装置:用于采用卷积编解码神经网络对孕妇腹部电信号中的母体心电成分进行预估,即训练时将仿真的腹部电信号作为神经网络的输入,仿真腹部电信号中的母体心电成分作为网络标签进行训练,得到训练好的卷积编解码神经网络;测量真实的胎儿心电成分时,将真实的单通道孕妇腹部电信号输入到训练好的卷积编解码神经网络中,通过训练好的卷积编解码神经网络得到真实的腹部电信号中的预估母体心电成分。;Maternal ECG component estimation device: It is used to estimate the maternal ECG component in the abdominal electrical signal of pregnant women by using the convolutional codec neural network, that is, the simulated abdominal electrical signal is used as the input of the neural network during training to simulate the abdominal electrical signal. The maternal ECG component is used as a network label for training, and a trained convolutional codec neural network is obtained; when measuring the real fetal ECG component, the real single-channel pregnant abdominal electrical signal is input into the trained convolutional codec. In the neural network, the estimated maternal ECG component in the real abdominal electrical signal is obtained through the trained convolutional encoder-decoder neural network. ;

胎儿心电成分提取装置:用于从采集到的孕妇腹部电信号中减去上述所得的母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分。The device for extracting fetal ECG components is used to subtract the maternal ECG components obtained above from the collected abdominal electrical signals of pregnant women, so as to extract the fetal ECG components in the abdominal electrical signals of pregnant women.

以上是本技术方案的基础实施方式。为提高在检测过程中对胎儿心电提取的效率和准确率,发明人在本技术方案中提供了一种提取系统,方便操作者通过该系统实现信号处理,便于后续的检测和诊治。发明人在本技术方案中创新性地利用卷积编解码神经网络对孕妇腹部电信号中的母体心电成分进行预估,并将从采集到的孕妇腹部电信号中减去上述所得的母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分的方案,本系统分别设立数据采集装置、母体心电成分估计装置和胎儿心电成分提取装置实现上述过程。所述数据采集装置中还会将所述孕妇腹部电信号转换成数字信号,便于在数字设备如电脑上进行处理。The above is the basic implementation of the technical solution. In order to improve the efficiency and accuracy of fetal ECG extraction in the detection process, the inventor provides an extraction system in this technical solution, which is convenient for operators to realize signal processing through the system and facilitate subsequent detection and diagnosis and treatment. In this technical solution, the inventor innovatively uses a convolutional coding and decoding neural network to estimate the maternal ECG components in the abdominal electrical signals of pregnant women, and subtracts the above-obtained maternal cardiac electrical signals from the collected abdominal electrical signals of pregnant women. The scheme of extracting the fetal ECG components in the abdominal electrical signals of pregnant women, the system separately sets up a data acquisition device, a maternal ECG component estimation device and a fetal ECG component extraction device to realize the above process. In the data acquisition device, the electrical signal of the pregnant woman's abdomen is also converted into a digital signal, which is convenient for processing on a digital device such as a computer.

在一些实施例中,所述数据采集装置还执行以下程序:In some embodiments, the data collection device further performs the following procedures:

将所述孕妇腹部电信号通过放大和/或滤波的处理程序处理后,再通过A/D转换程序将电信号转换成数字信号。After the electrical signal of the pregnant woman's abdomen is processed through a processing program of amplification and/or filtering, the electrical signal is converted into a digital signal through an A/D conversion program.

在一些实施例中,所述数据采集装置还执行以下程序:将所述数字信号裁剪成与卷积编解码神经网络输入相匹配的尺寸。通过裁剪成相匹配的尺寸,可以更有效率地执行下述利用卷积编解码神经网络的训练。In some embodiments, the data acquisition device further performs the procedure of cropping the digital signal to a size matching the input of the convolutional codec neural network. By cropping to a matching size, the following training of neural networks using convolutional encoders and decoders can be performed more efficiently.

在一些实施例中,所述母体心电成分估计装置对于训练过程采用时执行以下程序:使用开放全层网络参数更新的方式以及采用均方误差作为损失函数来训练网络模型。In some embodiments, the apparatus for estimating maternal ECG components performs the following procedure for the training process: using an open full-layer network parameter update manner and using mean square error as a loss function to train a network model.

在一些实施例中,所述损失函数为:In some embodiments, the loss function is:

Figure BDA0001946178700000071
Figure BDA0001946178700000071

其中,M为训练的样本个数,

Figure BDA0001946178700000072
为网路输出的对母体心电成分的预估,X为网络标签,即仿真腹部电信号中的母体心电成分。采用此损失函数,可以完整而快速地学习到母体心电的特征。Among them, M is the number of training samples,
Figure BDA0001946178700000072
is the estimation of the maternal ECG component output by the network, and X is the network label, that is, the maternal ECG component in the simulated abdominal electrical signal. Using this loss function, the characteristics of the maternal ECG can be learned completely and quickly.

在一些实施例中,所述母体心电成分估计装置执行程序中的卷积编解码神经网络由多个卷积-反卷积模块和一个全连接模块串联组成;其中,与输出层直接相连的全连接模块由一个或多个全连接层组成,与全连接模块相连的卷积-反卷积模块由一个卷积层,一个反卷积层和一个非线性层组成外,其他所有的卷积-反卷积模块均包含一个卷积层,一个反卷积层和两个非线性层;相邻两个卷积-反卷积模块之间采用的是直接连接的方式。所述卷积编解码神经网络采用上述结构,可以有效地捕捉到母体心电的特征,加快网络训练的收敛速度,同时对于梯度弥散问题也有很好的效果。需要说明的是,通过相邻两个卷积-反卷积模块之间采用的是直接连接的方式,从而浅层的特征能传递到深层,进而保留更多的母体心电的细节特征,进一步提高效率和准确性。In some embodiments, the convolutional codec neural network in the execution program of the device for estimating the maternal ECG component is composed of multiple convolution-deconvolution modules and a fully connected module in series; The fully-connected module consists of one or more fully-connected layers, and the convolution-deconvolution module connected to the fully-connected module consists of a convolutional layer, a deconvolutional layer and a nonlinear layer. All other convolutional layers -Deconvolution modules all contain one convolution layer, one deconvolution layer and two non-linear layers; two adjacent convolution-deconvolution modules are directly connected. The convolutional encoding and decoding neural network adopts the above structure, which can effectively capture the characteristics of the maternal electrocardiogram, accelerate the convergence speed of network training, and also has a good effect on the gradient dispersion problem. It should be noted that the direct connection method is adopted between two adjacent convolution-deconvolution modules, so that the features of the shallow layer can be transferred to the deep layer, thereby retaining more detailed features of the maternal ECG, and further Improve efficiency and accuracy.

优选地,数字信号裁剪后的尺寸为1×1000,其中的每个1×1的信号中的数值为某点的心电图数值(幅度),而1000有1000个点,每个点代表不同时间上的心电图中的数值(幅度)。而所述卷积层的卷积核大小为1×3、1×4或1×5,每个卷积层中的卷积核的个数为32、64或128,优选为64个。Preferably, the cropped size of the digital signal is 1×1000, and the value in each 1×1 signal is the electrocardiogram value (amplitude) of a certain point, and 1000 has 1000 points, and each point represents a different time point. The value (amplitude) of the ECG. The convolution kernel size of the convolution layer is 1×3, 1×4 or 1×5, and the number of convolution kernels in each convolution layer is 32, 64 or 128, preferably 64.

在其中一个实施例中,如图4所示,包括3个卷积-反卷积模块,即第一卷积-反卷积模块,第二卷积-反卷积模块以及第三卷积-反卷积模块,在第一卷积-反卷积模块中,将裁剪后的数字信号与卷积核卷积,卷积得到的矩阵再通过非线性层完成激活函数的计算,进行反卷积后,再通过非线性层完成激活函数的计算,而第一卷积-反卷积模块的输出可以作为第二卷积-反卷积模块或第三卷积-反卷积模块的输入,而第二卷积-反卷积模块的输出则可以作为第三卷积-反卷积模块的输入。最终第三卷积-反卷积模块的输出作为全连接层(dense)的输入,通过全连接层的处理得到最终输出的图像。在本实施例中,所述全连接层的神经元的个数为1000。In one of the embodiments, as shown in FIG. 4 , three convolution-deconvolution modules are included, namely the first convolution-deconvolution module, the second convolution-deconvolution module and the third convolution-deconvolution module. The deconvolution module, in the first convolution-deconvolution module, convolves the cropped digital signal with the convolution kernel, and the matrix obtained by the convolution then completes the calculation of the activation function through the nonlinear layer, and performs deconvolution After that, the calculation of the activation function is completed through the nonlinear layer, and the output of the first convolution-deconvolution module can be used as the input of the second convolution-deconvolution module or the third convolution-deconvolution module, while The output of the second convolution-deconvolution module can then be used as the input of the third convolution-deconvolution module. Finally, the output of the third convolution-deconvolution module is used as the input of the fully connected layer (dense), and the final output image is obtained through the processing of the fully connected layer. In this embodiment, the number of neurons in the fully connected layer is 1000.

在一些实施例中,所述系统还包括显示装置,用于将提取出的胎儿心电成分拼接成完整信号并进行显示。采用将信号裁剪成较短长度进行学习,学习完成后将网络输出拼接成完整信号的方式,可以使网络学习到更多的细节特征,提升胎儿心电提取的效果。In some embodiments, the system further includes a display device for splicing the extracted fetal ECG components into a complete signal and displaying it. The method of cutting the signal into a shorter length for learning, and splicing the network output into a complete signal after the learning is completed, can enable the network to learn more detailed features and improve the effect of fetal ECG extraction.

应理解正常运行时,首先通过将训练集和/或验证集的仿真孕妇腹部电信号经过预处理后输入到卷积编解码神经网络中,对卷积编解码神经网络进行训练,通过损失函数对母体心电成分做评估,再通过反向传播算法(梯度下降法),计算卷积神经网络中所有参数的梯度,并根据梯度变化(各个参数的导数)对所有参数进行更新,重新将训练集代入到卷积编解码神经网络中进行训练,直至完成迭代寻找到具有最小损失函数的模型时,保存所有参数将模型保留下来。当需要测试真实的孕妇腹部电信号时,调用卷积神经网络模型,将真实的孕妇腹部电信号预处理后输入到卷积编解码神经网络中,获取预估的母体心电成分,再用真实的采集到的孕妇腹部电信号中减去上述所得的预估母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分。It should be understood that during normal operation, the convolutional codec neural network is trained by first preprocessing the simulated pregnant abdominal electrical signals of the training set and/or the validation set and then inputting it into the convolutional codec neural network. The maternal ECG components are evaluated, and then the gradient of all parameters in the convolutional neural network is calculated through the back-propagation algorithm (gradient descent method), and all parameters are updated according to the gradient change (derivative of each parameter), and the training set is reset. Substitute it into the convolutional encoder-decoder neural network for training, until the model with the smallest loss function is found after iteration, save all parameters and keep the model. When it is necessary to test the real abdominal electrical signals of pregnant women, the convolutional neural network model is called, and the real abdominal electrical signals of pregnant women are preprocessed and input into the convolutional codec neural network to obtain the estimated maternal ECG components, and then use the real The estimated maternal ECG component obtained above is subtracted from the collected abdominal electrical signal of the pregnant woman, so as to extract the fetal ECG component in the abdominal electrical signal of the pregnant woman.

实施例2(一种基于卷积编解码神经网络的胎儿心电提取方法)Embodiment 2 (a kind of fetal ECG extraction method based on convolutional codec neural network)

如图1所示,本发明提供一种基于卷积编解码神经网络的胎儿心电提取方法,包括以下步骤:As shown in Figure 1, the present invention provides a method for extracting fetal ECG based on a convolutional codec neural network, comprising the following steps:

数据预处理:采集孕妇腹部电信号;Data preprocessing: collecting abdominal electrical signals of pregnant women;

母体心电成分估计:采用卷积编解码神经网络对孕妇腹部电信号中的母体心电成分进行预估,即训练时将仿真的腹部电信号作为神经网络的输入,仿真腹部电信号中的母体心电成分作为网络标签进行训练,测试时将真实的单通道孕妇腹部电信号作为神经网络的输入,神经网络的输出为对腹部电信号中的预估母体心电成分;Maternal ECG component estimation: The convolutional codec neural network is used to estimate the maternal ECG component in the abdominal electrical signal of pregnant women, that is, the simulated abdominal electrical signal is used as the input of the neural network during training to simulate the maternal electrical component in the abdominal electrical signal. The ECG component is used as a network label for training, and the real single-channel pregnant abdominal electrical signal is used as the input of the neural network during testing, and the output of the neural network is the estimated maternal ECG component in the abdominal electrical signal;

胎儿心电成分提取:从采集到的孕妇腹部电信号中减去上述所得的预估母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分。Extraction of fetal ECG components: The estimated maternal ECG components obtained above are subtracted from the collected abdominal electrical signals of pregnant women, thereby extracting fetal ECG components in the abdominal electrical signals of pregnant women.

以上是本发明的基础实施方式。在本技术方案中,为提高胎儿心电提取的效率和准确率,发明人在本技术方案中创新性地利用卷积编解码神经网络对孕妇腹部电信号中的母体心电成分进行预估,并将所采集的采集到的孕妇腹部电信号中减去上述所得的预估母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分的方案。采用卷积编解码神经网络,该技术具有较强的鲁棒性,在接触噪声、呼吸噪声等干扰情况下仍能提取出胎儿心电信号。而且,在胎儿信号与母亲信号之间的信噪比较低以及胎儿的QRS波与母体的QRS波有重叠时,该方法也有很好的表现。通过此技术手段,可以更大程度地排除相关噪音,使得提取更为准确,效率也更高。该项发明提取出的清晰的胎儿心电信号可提供胎儿心率等信息,具有重要的临床应用价值和可观的社会效益。The above is the basic embodiment of the present invention. In this technical solution, in order to improve the efficiency and accuracy of fetal ECG extraction, the inventor innovatively uses a convolutional codec neural network in this technical solution to estimate the maternal ECG components in the abdominal electrical signals of pregnant women, The plan of extracting the fetal ECG component in the abdominal electrical signal of the pregnant woman is obtained by subtracting the estimated maternal electrocardiographic component obtained above from the collected abdominal electrical signal of the pregnant woman. Convolutional codec neural network is used, which has strong robustness and can still extract fetal ECG signals under interference conditions such as contact noise and breathing noise. Furthermore, the method also performs well when the signal-to-noise ratio between fetal and maternal signals is low and when fetal and maternal QRS complexes overlap. Through this technical means, the relevant noise can be excluded to a greater extent, so that the extraction is more accurate and the efficiency is higher. The clear fetal ECG signal extracted by the invention can provide information such as fetal heart rate, and has important clinical application value and considerable social benefit.

实施例3(一种基于卷积编解码神经网络的胎儿心电提取方法)Embodiment 3 (a kind of fetal ECG extraction method based on convolutional codec neural network)

以下结合一具体实施方式来说明上述基础实施方式的实施过程。但此实施方式仅用于说明本技术方案,并不代表对本技术方案保护范围的限制。The implementation process of the above-mentioned basic implementation manner is described below with reference to a specific implementation manner. However, this embodiment is only used to illustrate the technical solution, and does not represent a limitation on the protection scope of the technical solution.

一种基于卷积编解码神经网络的胎儿心电提取方法,包括以下步骤:A method for extracting fetal ECG based on a convolutional codec neural network, comprising the following steps:

1)数据预处理:首先,如图3所示,使用电极在母体的腹部采集一路信号,采样频率为250Hz,再次,用通频带为0.5-100Hz的带通滤波器以及50Hz的陷波滤波器对信号进行滤波处理,其次,采用放大电路对信号进行放大并用模数转换电路将电信号转换为数字信号,最后,将滤波后的数据裁剪成固定尺寸(1×1000)。1) Data preprocessing: First, as shown in Figure 3, use electrodes to collect a signal in the abdomen of the mother with a sampling frequency of 250Hz, and again, use a bandpass filter with a passband of 0.5-100Hz and a notch filter with 50Hz The signal is filtered, and secondly, the signal is amplified by an amplifying circuit and converted into a digital signal by an analog-to-digital conversion circuit. Finally, the filtered data is cut into a fixed size (1×1000).

在更具体的优选实施方式中,将信号样本统一裁剪成固定的尺寸,该尺寸与方法中所采用的卷积编解码神经网络输入的尺寸相匹配(或者采集信号时直接采集对应尺寸的信号,如长度为2秒或4秒)。In a more specific preferred embodiment, the signal samples are uniformly cropped into a fixed size, and the size matches the size of the input of the convolutional codec neural network used in the method (or directly collects the signal of the corresponding size when collecting the signal, such as 2 seconds or 4 seconds in length).

2)母体心电成分估计:训练一个卷积编解码神经网络对孕妇腹部电信号中的母体心电成分进行预估。在一些优选实施方式中,采用单通道输入数据处理框架提取心电样本数据,随机打乱输入样本的顺序,以batch_size为64的大小输入样本数据。其中训练时将仿真的腹部电信号作为神经网络的输入,仿真腹部电信号中的母体心电成分作为网络标签进行训练,测试时将真实的单通道孕妇腹部电信号作为神经网络的输入,神经网络的输出为对腹部电信号中的预估的母体心电成分,如图3所示。2) Estimation of maternal ECG components: train a convolutional encoder-decoder neural network to estimate the maternal ECG components in the abdominal electrical signals of pregnant women. In some preferred embodiments, a single-channel input data processing framework is used to extract the ECG sample data, the order of the input samples is randomly disrupted, and the sample data is input with a batch_size of 64. In the training, the simulated abdominal electrical signal is used as the input of the neural network, the maternal ECG component in the simulated abdominal electrical signal is used as the network label for training, and the real single-channel pregnant abdominal electrical signal is used as the input of the neural network during testing. The output is the estimated maternal ECG component in the abdominal electrical signal, as shown in Figure 3.

在一些优选的实施方式中,采用卷积编解码神经网络为深度神经网络模型对孕妇腹部电信号中的母体心电成分进行预估。所采用的卷积编解码神经网络由5个卷积-反卷积模块和一个全连接模块串联组成;其中,与输出层直接相连的全连接模块由一个全连接层组成,与全连接模块相连的卷积-反卷积模块由一个卷积层,一个反卷积层和一个非线性层组成外,其他所有的卷积-反卷积模块均包含一个卷积层,一个反卷积层和两个非线性层;同时,在相邻两个卷积-反卷积模块之间采用了直接连接的方式,从而浅层的特征能传递到深层。In some preferred embodiments, a convolutional codec neural network is used as a deep neural network model to estimate the maternal ECG components in the abdominal electrical signals of pregnant women. The adopted convolutional encoder-decoder neural network is composed of 5 convolution-deconvolution modules and a fully connected module in series; among them, the fully connected module directly connected to the output layer consists of a fully connected layer, which is connected to the fully connected module. Except that the convolution-deconvolution module consists of a convolutional layer, a deconvolutional layer and a nonlinear layer, all other convolutional-deconvolutional modules consist of a convolutional layer, a deconvolutional layer and a non-linear layer. Two nonlinear layers; at the same time, a direct connection is adopted between two adjacent convolution-deconvolution modules, so that the features of the shallow layers can be transferred to the deep layers.

在一些优选的实施方式中,使用开放全层网络参数更新的方式以及采用均方误差作为损失函数来训练网络模型。In some preferred embodiments, the network model is trained using an open full-layer network parameter update approach and using mean squared error as a loss function.

在更具体的一些优选实施方式中,训练卷积编解码神经网络时采用开放全层网络参数更新的方式,采用均方误差作为损失函数,该函数表述为:In some more specific preferred embodiments, when training the convolutional codec neural network, the method of open full-layer network parameter update is adopted, and the mean square error is used as the loss function, and the function is expressed as:

Figure BDA0001946178700000101
Figure BDA0001946178700000101

其中,M为训练的样本个数,

Figure BDA0001946178700000102
为网路输出的预估的母体心电成分,X为网络标签,即仿真腹部电信号中的母体心电成分。Among them, M is the number of training samples,
Figure BDA0001946178700000102
is the estimated maternal ECG component output by the network, and X is the network label, that is, the maternal ECG component in the simulated abdominal electrical signal.

3)胎儿心电成分提取:从采集到的孕妇腹部电信号中减去腹部电信号中的预估的母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分。3) Extraction of fetal ECG components: subtracting the estimated maternal ECG components in the abdominal electrical signals from the collected abdominal electrical signals of pregnant women, so as to extract the fetal ECG components in the abdominal electrical signals of pregnant women.

更具体地,将由卷积编解码神经网络输出的预估的母体心电成分从采集到的腹部电信号中减去,剩下的部分则为胎儿心电成分,从而实现对母体腹部心电中胎儿心电成分的提取。More specifically, the estimated maternal ECG components output by the convolutional coding and decoding neural network are subtracted from the collected abdominal electrical signals, and the remaining part is the fetal ECG components, so as to realize the analysis of maternal abdominal ECG components. Extraction of fetal ECG components.

4)显示母体心电和胎儿心电:将提取出的胎儿心电成分拼接成完整信号,并将母体心电和胎儿心电进行显示,如图3所示。4) Display maternal ECG and fetal ECG: The extracted fetal ECG components are spliced into a complete signal, and the maternal ECG and fetal ECG are displayed, as shown in Figure 3.

为验证本发明的效果,申请人多次将测试集代入到训练好的卷积编解码神经网络中(此时卷积编解码神经网络如图4所示,其卷积核大小为1×3,卷积核的个数为64),得到以下数据:In order to verify the effect of the present invention, the applicant has repeatedly substituted the test set into the trained convolutional codec neural network (the convolutional codec neural network is shown in Figure 4 at this time, and its convolution kernel size is 1 × 3). , the number of convolution kernels is 64), and the following data are obtained:

mean SE(%)mean SE (%) mean PPV(%)mean PPV(%) mean F<sub>1</sub>(%)mean F<sub>1</sub>(%) 训练好的神经网络trained neural network 93.0893.08 91.2191.21 92.1392.13

其中,

Figure BDA0001946178700000111
TP是找对R峰(QRS峰的R峰)的数量,FN是漏掉R峰的数量,FP是找错R峰的数量,找到R峰的位置与真实的位置在50ms以内都算找对。in,
Figure BDA0001946178700000111
TP is the number of correct R peaks (the R peaks of QRS peaks), FN is the number of missing R peaks, FP is the number of wrong R peaks, and the position of the R peak found and the real position within 50ms are considered correct. .

上述实施方式仅为本发明的优选实施方式,不能以此来限定本发明保护的范围,本领域的技术人员在本发明的基础上所做的任何非实质性的变化及替换均属于本发明所要求保护的范围。The above-mentioned embodiments are only preferred embodiments of the present invention, and cannot be used to limit the scope of protection of the present invention. Any insubstantial changes and substitutions made by those skilled in the art on the basis of the present invention belong to the scope of the present invention. Scope of protection claimed.

Claims (10)

1.基于卷积编解码神经网络的胎儿心电提取系统,其特征在于,包括以下装置:1. the fetal electrocardiogram extraction system based on convolutional codec neural network, is characterized in that, comprises following device: 数据采集装置:用于采集孕妇腹部电信号;Data acquisition device: used to collect abdominal electrical signals of pregnant women; 母体心电成分估计装置:用于构建待训练的卷积编解码神经网络,根据仿真的孕妇腹部电信号对待训练的卷积编解码进行训练;在测量真实的胎儿心电成分时,将数据采集装置采集到的单通道孕妇腹部电信号输入到训练好的卷积编解码神经网络中,通过训练好的卷积编解码神经网络得到对真实的腹部电信号的预估母体心电成分;Maternal ECG component estimation device: used to construct the convolutional codec neural network to be trained, and train the convolutional codec to be trained according to the simulated abdominal electrical signals of pregnant women; when measuring the real fetal ECG components, the data collected The single-channel abdominal electrical signal of pregnant women collected by the device is input into the trained convolutional codec neural network, and the estimated maternal ECG component of the real abdominal electrical signal is obtained through the trained convolutional codec neural network; 胎儿心电成分提取装置:用于从采集到的孕妇腹部电信号中减去预估母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分;Device for extracting fetal ECG components: used to subtract the estimated maternal ECG components from the collected abdominal electrical signals of pregnant women, so as to extract the fetal ECG components in the abdominal electrical signals of pregnant women; 其中,所述母体心电成分估计装置执行程序中的卷积编解码神经网络由多个卷积-反卷积模块和一个全连接模块串联组成;卷积-反卷积模块中的卷积层的卷积核大小为1×3、1×4或1×5。Wherein, the convolutional coding and decoding neural network in the execution program of the maternal ECG component estimation device is composed of multiple convolution-deconvolution modules and a fully connected module in series; the convolutional layer in the convolution-deconvolution module The convolution kernel size is 1×3, 1×4 or 1×5. 2.如权利要求1所述的胎儿心电提取系统,其特征在于,所述数据采集装置还执行以下程序:2. The fetal ECG extraction system as claimed in claim 1, wherein the data acquisition device also executes the following procedures: 将所述孕妇腹部电信号通过放大和/或滤波的处理程序后,再通过AD转换程序将电信号转换成数字信号。After the electrical signal of the pregnant woman's abdomen is processed through amplification and/or filtering, the electrical signal is converted into a digital signal through an AD conversion program. 3.如权利要求2所述的胎儿心电提取系统,其特征在于,所述数据采集装置还执行以下程序:3. The fetal ECG extraction system as claimed in claim 2, wherein the data acquisition device also executes the following procedures: 将所述数字信号裁剪成与卷积编解码神经网络输入相匹配的尺寸。Crop the digital signal to a size that matches the input of the convolutional codec neural network. 4.如权利要求1所述的胎儿心电提取系统,其特征在于,所述母体心电成分估计装置在训练时采用的仿真腹部电信号由仿真的母体心电成分和仿真的胎儿心电成分以及一些噪声叠加组成。4 . The fetal ECG extraction system according to claim 1 , wherein the simulated abdominal electrical signal used by the maternal ECG component estimation device during training is composed of simulated maternal ECG components and simulated fetal ECG components. 5 . and some noise superposition. 5.如权利要求1所述的胎儿心电提取系统,其特征在于,所述母体心电成分估计装置对于训练过程执行以下程序:5. The fetal ECG extraction system according to claim 1, wherein the maternal ECG component estimation device performs the following procedures for the training process: 使用开放全层网络参数更新的方式以及采用均方误差作为损失函数来训练卷积解码神经网络;Using the open full-layer network parameter update method and using the mean square error as the loss function to train the convolutional decoding neural network; 优选地,采用梯度下降法和反向传播算法训练所述卷积编解码神经网络。Preferably, the convolutional encoder-decoder neural network is trained using a gradient descent method and a back-propagation algorithm. 6.如权利要求5所述的胎儿心电提取系统,其特征在于,所述损失函数为:6. The fetal ECG extraction system according to claim 5, wherein the loss function is:
Figure FDA0001946178690000021
Figure FDA0001946178690000021
其中,M为训练的样本个数,
Figure FDA0001946178690000022
为网路输出的预估的母体心电成分,X为网络标签,即仿真腹部电信号中的母体心电成分。
Among them, M is the number of training samples,
Figure FDA0001946178690000022
is the estimated maternal ECG component output by the network, and X is the network label, that is, the maternal ECG component in the simulated abdominal electrical signal.
7.如权利要求1所述的胎儿心电提取系统,其特征在于,所述全连接模块还与输出层直接相连,且所述全连接模块由一个或多个全连接层组成,与全连接模块相连的卷积-反卷积模块由一个卷积层,一个反卷积层和一个非线性层组成外,其他所有的卷积-反卷积模块均包含一个卷积层,一个反卷积层和两个非线性层;相邻两个卷积-反卷积模块之间采用的是直接连接的方式。7. The fetal ECG extraction system according to claim 1, wherein the fully connected module is also directly connected to the output layer, and the fully connected module is composed of one or more fully connected layers, which are connected to the fully connected layer. The convolution-deconvolution module connected to the module consists of a convolution layer, a deconvolution layer and a nonlinear layer. All other convolution-deconvolution modules include a convolution layer and a deconvolution layer. layer and two nonlinear layers; a direct connection is used between two adjacent convolution-deconvolution modules. 8.如权利要求1所述的胎儿心电提取系统,其特征在于,所述系统还包括显示装置,用于将提取出的胎儿心电成分拼接成完整信号并进行显示。8 . The fetal ECG extraction system according to claim 1 , wherein the system further comprises a display device for splicing the extracted fetal ECG components into a complete signal and displaying it. 9 . 9.基于卷积编解码神经网络的胎儿心电提取方法,其特征在于,包括以下步骤:9. The fetal ECG extraction method based on convolutional codec neural network, is characterized in that, comprises the following steps: 数据采集:采集一路孕妇腹部电信号;Data collection: collect all the abdominal electrical signals of pregnant women; 母体心电成分估计:构造待训练的卷积编解码神经网络并采用仿真腹部电信号对待训练的卷积编解码神经网络进行训练;测量真实的胎儿心电成分时,将真实的单通道孕妇腹部电信号输入到训练好的卷积编解码神经网络中,通过训练好的卷积编解码神经网络得到真实的腹部电信号中的预估母体心电成分。Maternal ECG component estimation: construct the convolutional codec neural network to be trained and use the simulated abdominal electrical signal to train the convolutional codec neural network to be trained; when measuring the real fetal ECG component, the real single-channel pregnant abdomen The electrical signal is input into the trained convolutional encoder-decoder neural network, and the estimated maternal ECG component in the real abdominal electrical signal is obtained through the trained convolutional encoder-decoder neural network. 胎儿心电成分提取:从采集到的孕妇腹部电信号中减去预估母体心电成分,从而提取出孕妇腹部电信号中的胎儿心电成分;Extraction of fetal ECG components: subtract the estimated maternal ECG components from the collected abdominal electrical signals of pregnant women, so as to extract the fetal ECG components in the abdominal electrical signals of pregnant women; 优选地,所述将所述孕妇腹部电信号转换成数字信号的过程包括放大和/或滤波处理程序以及A/D转换程序;Preferably, the process of converting the pregnant woman's abdominal electrical signal into a digital signal includes amplifying and/or filtering processing procedures and A/D conversion procedures; 更优选地,所述数据预处理步骤中还包括将所述数字信号裁剪成与卷积编解码神经网络输入相匹配的尺寸;More preferably, the data preprocessing step also includes trimming the digital signal into a size matching the input of the convolutional codec neural network; 优选地,所述母体心电成分估计中的训练方法是使用开放全层网络参数更新的方式以及采用均方误差作为损失函数来训练网络模型;Preferably, the training method in the estimation of the maternal ECG component is to use an open full-layer network parameter update method and use the mean square error as a loss function to train the network model; 优选地,所述母体心电成分估计中卷积编解码神经网络由多个卷积-反卷积模块和一个全连接模块串联组成;Preferably, the convolutional coding and decoding neural network in the estimation of the maternal ECG components is composed of a plurality of convolution-deconvolution modules and a fully connected module in series; 其中,与输出层直接相连的全连接模块由一个或多个全连接层组成,与全连接模块相连的卷积-反卷积模块由一个卷积层,一个反卷积层和一个非线性层组成外,其他所有的卷积-反卷积模块均包含一个卷积层,一个反卷积层和两个非线性层;相邻两个卷积-反卷积模块之间采用的是直接连接的方式。优选地,非线性层的激活函数为tanh函数。Among them, the fully-connected module directly connected to the output layer consists of one or more fully-connected layers, and the convolution-deconvolution module connected to the fully-connected module consists of a convolutional layer, a deconvolutional layer and a nonlinear layer In addition to the composition, all other convolution-deconvolution modules include one convolution layer, one deconvolution layer and two nonlinear layers; the two adjacent convolution-deconvolution modules are directly connected. The way. Preferably, the activation function of the nonlinear layer is a tanh function. 优选地,所述方法还包括将提取出的胎儿心电成分拼接成完整信号并进行显示;Preferably, the method further comprises splicing the extracted fetal ECG components into a complete signal and displaying it; 优选地,本技术方案通过采用梯度下降法和反向传播算法训练所述卷积编解码神经网络。Preferably, in the technical solution, the convolutional encoder-decoder neural network is trained by using the gradient descent method and the back-propagation algorithm. 10.根据权利要求9所述的胎儿心电提取方法,其特征在于,所述损失函数为:10. The fetal ECG extraction method according to claim 9, wherein the loss function is:
Figure FDA0001946178690000031
Figure FDA0001946178690000031
其中,M为训练的样本个数,
Figure FDA0001946178690000032
为网路输出的预估的母体心电成分,X为网络标签,即仿真腹部电信号中的母体心电成分。
Among them, M is the number of training samples,
Figure FDA0001946178690000032
is the estimated maternal ECG component output by the network, and X is the network label, that is, the maternal ECG component in the simulated abdominal electrical signal.
CN201910036810.5A 2019-01-15 2019-01-15 Fetal electrocardiogram extraction system and method based on convolutional coding and decoding neural network Pending CN111434305A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910036810.5A CN111434305A (en) 2019-01-15 2019-01-15 Fetal electrocardiogram extraction system and method based on convolutional coding and decoding neural network

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910036810.5A CN111434305A (en) 2019-01-15 2019-01-15 Fetal electrocardiogram extraction system and method based on convolutional coding and decoding neural network

Publications (1)

Publication Number Publication Date
CN111434305A true CN111434305A (en) 2020-07-21

Family

ID=71580830

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910036810.5A Pending CN111434305A (en) 2019-01-15 2019-01-15 Fetal electrocardiogram extraction system and method based on convolutional coding and decoding neural network

Country Status (1)

Country Link
CN (1) CN111434305A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114869292A (en) * 2022-06-09 2022-08-09 南方医科大学 Fetal electrocardiosignal extraction method, device, equipment and readable storage medium
WO2023064574A1 (en) * 2021-10-15 2023-04-20 Children's National Medical Center Development of a beat-to-beat fetal electrocardiogram

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005117692A2 (en) * 2004-05-28 2005-12-15 University Of Florida Research Foundation, Inc. Maternal-fetal monitoring system
JP2009160410A (en) * 2008-01-08 2009-07-23 General Electric Co <Ge> Method of fetal and maternal ecg identification across multiple epochs
CN107693004A (en) * 2017-09-05 2018-02-16 广东工业大学 Fetal ECG extraction and fetal heart frequency recognition methods based on hilbert conversion
CN108814585A (en) * 2018-05-03 2018-11-16 深圳竹信科技有限公司 ECG's data compression method, apparatus and computer readable storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005117692A2 (en) * 2004-05-28 2005-12-15 University Of Florida Research Foundation, Inc. Maternal-fetal monitoring system
JP2009160410A (en) * 2008-01-08 2009-07-23 General Electric Co <Ge> Method of fetal and maternal ecg identification across multiple epochs
CN107693004A (en) * 2017-09-05 2018-02-16 广东工业大学 Fetal ECG extraction and fetal heart frequency recognition methods based on hilbert conversion
CN108814585A (en) * 2018-05-03 2018-11-16 深圳竹信科技有限公司 ECG's data compression method, apparatus and computer readable storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023064574A1 (en) * 2021-10-15 2023-04-20 Children's National Medical Center Development of a beat-to-beat fetal electrocardiogram
CN114869292A (en) * 2022-06-09 2022-08-09 南方医科大学 Fetal electrocardiosignal extraction method, device, equipment and readable storage medium

Similar Documents

Publication Publication Date Title
US11529103B2 (en) Artificial intelligence self-learning-based automatic electrocardiography analysis method and apparatus
CN107714023B (en) Static electrocardiogram analysis method and device based on artificial intelligence self-learning
CN101972145B (en) Fetus electrocardio blind separation method based on relative sparsity of time domain of source signal
CN107203692A (en) The implementation method of atrial fibrillation detection based on depth convolutional neural networks
CN110403600A (en) Paroxysmal Atrial Fibrillation intelligent analysis method and system based on differential time scatter plot
CN107951485A (en) Ambulatory ECG analysis method and apparatus based on artificial intelligence self study
CN114901143A (en) System and method for reduced-lead electrocardiography diagnosis using deep neural networks and rule-based systems
CN104887220A (en) Method and system for extracting fetus electrocardiosignals from abdominal wall electrocardiosignals
CN111759345A (en) Heart valve abnormality analysis method, system and device based on convolutional neural network
CN110327055A (en) A kind of classification method of the heart impact signal based on higher-order spectrum and convolutional neural networks
CN115553784B (en) Coronary heart disease assessment method and system based on coupled analysis of electrocardiogram and heart sound signals
Liu et al. Systematic methods for fetal electrocardiographic analysis: Determining the fetal heart rate, RR interval and QT interval
CN110327034B (en) Tachycardia electrocardiogram screening method based on depth feature fusion network
CN109567792A (en) A kind of single channel abdomen record fetal electrocardiogram extracting method
CN111434305A (en) Fetal electrocardiogram extraction system and method based on convolutional coding and decoding neural network
CN110432897A (en) Fetal ECG extraction system and method based on residual error convolution encoding and decoding neural network
CN110327033A (en) A kind of screening method of the myocardial infarction electrocardiogram based on deep neural network
CN110537907B (en) An ECG Signal Compression and Recognition Method Based on Singular Value Decomposition
CN117297564A (en) A wearable pulse diagnosis bracelet system based on ECG photoelectric pressure pulse signal
CN115105085B (en) Classification method of twelve-lead electrocardiogram based on automatic deep convolution learning model
CN103876731B (en) A kind of fetal electrocardiogram signal extraction device and method
CN115590524A (en) Method and system for identifying QT interval prolongation based on convolutional neural network
CN115530754A (en) Epilepsy early warning method and device based on deep learning
CN110507299B (en) Heart rate signal detection device and method
Gupta et al. ECG signal analysis using emerging tools in current scenario of health informatics

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200721