CN112200836B - Multi-cell tracking method and system based on self-adjusting foraging behavior of ants - Google Patents
Multi-cell tracking method and system based on self-adjusting foraging behavior of ants Download PDFInfo
- Publication number
- CN112200836B CN112200836B CN202011040382.2A CN202011040382A CN112200836B CN 112200836 B CN112200836 B CN 112200836B CN 202011040382 A CN202011040382 A CN 202011040382A CN 112200836 B CN112200836 B CN 112200836B
- Authority
- CN
- China
- Prior art keywords
- ant
- pheromone
- ant colony
- group
- gaussian
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/004—Artificial life, i.e. computing arrangements simulating life
- G06N3/006—Artificial life, i.e. computing arrangements simulating life based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Biomedical Technology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Catching Or Destruction (AREA)
Abstract
Description
技术领域technical field
本发明属于多目标跟踪领域,更具体的涉及基于蚂蚁自调整觅食行为的多细胞跟踪系统。The invention belongs to the field of multi-target tracking, and more particularly relates to a multi-cell tracking system based on the self-adjusting foraging behavior of ants.
背景技术Background technique
细胞作为生物体基本的结构和功能单位,它的增殖、分化和迁移不仅是任何有机生命的胚胎发育、进化和生命维持必不可少的环节还与疾病的产生与发展有着不可分割的联系,例如,大部分癌症是由于癌细胞从初始的发病组织转移到周围健康组织而导致的癌症扩散。因此,对细胞行为分析的研究在很多领域都是非常有价值的。通过分析细胞运动的过程来获得细胞的形状、数目、速度、轨迹和生长周期等特征信息,可以对细胞进行定性和定量分析,可见,对细胞动力学行为的研究对诊断和治疗疾病、提高药物研制效率等都有着不可预估的重要意义。传统的人工跟踪仍然是实验室目前最常用的跟踪方法,但这种方法不仅耗时、容易出错,而且对研究人员的专业知识和临床经验要求高。因此细胞自动跟踪方法的研究成为了一个急需解决的问题。As the basic structural and functional unit of an organism, the proliferation, differentiation and migration of cells are not only an indispensable link in the embryonic development, evolution and life maintenance of any organic life, but also have an inseparable connection with the generation and development of diseases, such as , the majority of cancers are the spread of cancer due to the metastasis of cancer cells from the original diseased tissue to surrounding healthy tissue. Therefore, the study of cell behavior analysis is very valuable in many fields. By analyzing the process of cell movement, characteristic information such as cell shape, number, speed, trajectory and growth cycle can be obtained, and qualitative and quantitative analysis of cells can be carried out. Development efficiency and so on have unpredictable significance. Traditional manual tracking is still the most commonly used tracking method in laboratories, but this method is not only time-consuming and error-prone, but also requires a high degree of researcher expertise and clinical experience. Therefore, the research of automatic cell tracking method has become an urgent problem to be solved.
显微图像序列细胞的跟踪面临许多困难,比如低信噪比、细胞边界模糊、细胞变形,数目时变及细胞迁移运动的速度和方向突然改变,导致跟踪的失败等。近年来学者们提出的自动跟踪的方法大多数是针对特定数据,而且跟踪精度对细胞分割的结果依赖较强,对于复杂情形下细胞跟踪的精度不高。目前针对细胞图像序列中形变、运动特性各异及数目时变等细胞跟踪的研究理论和方法较少。本发明旨在解决形变、运动特性各异及数目时变等等多细胞跟踪难题,利用蚂蚁自调整觅食行为构建信息素场,最终实现复杂情形下多细胞的精确跟踪。The tracking of cells in microscopic image sequences faces many difficulties, such as low signal-to-noise ratio, blurred cell boundaries, cell deformation, time-varying numbers, and sudden changes in the speed and direction of cell migration, which lead to the failure of tracking. Most of the automatic tracking methods proposed by scholars in recent years are for specific data, and the tracking accuracy is strongly dependent on the results of cell segmentation, and the accuracy of cell tracking in complex situations is not high. At present, there are few research theories and methods for cell tracking such as deformation, different motion characteristics and time-varying number of cell image sequences. The invention aims to solve the problems of multi-cell tracking such as deformation, different motion characteristics and time-varying numbers, etc., and utilizes the self-adjusting foraging behavior of ants to construct a pheromone field, and finally realizes the accurate tracking of multi-cells in complex situations.
发明内容SUMMARY OF THE INVENTION
1、本发明的目的。1. Purpose of the present invention.
本发明为了解决现有技术中对于数目时变、变形、运动特性各异和近邻多细胞跟踪难题,提出了一种基于蚂蚁自调整觅食行为的多细胞跟踪系统。The invention proposes a multi-cell tracking system based on the self-adjusting foraging behavior of ants in order to solve the problems of time-varying number, deformation, different motion characteristics and multi-cell tracking of neighbors in the prior art.
2、本发明所采用的技术方案。2. The technical solution adopted in the present invention.
本发明公开了一种基于蚂蚁自调整觅食行为的多细胞跟踪方法,包括如下步骤:The invention discloses a multi-cell tracking method based on the self-adjusting foraging behavior of ants, comprising the following steps:
蚁群及信息素场双预测步骤,输入原始图像,基于前一帧蚁群及结果信息素场,利用高斯模型对当前帧蚁群及信息素场进行预测;The ant colony and pheromone field double prediction step, input the original image, and use the Gaussian model to predict the current frame ant colony and pheromone field based on the previous frame ant colony and the resulting pheromone field;
蚂蚁自调整觅食步骤,在基于指数形式的蚂蚁工作模式下利用三种策略,即限定蚁群觅食范围、蚁群重采样机制、蚁群觅食停止准则构建信息素场,实现形变、数目变化、运动状态不定和近邻细胞跟踪;Ants self-adjust their foraging steps, and use three strategies under the exponential-based ant work mode, namely, limited ant colony foraging range, ant colony resampling mechanism, and ant colony foraging stop criterion to construct a pheromone field to achieve deformation, number of Changes, variable motion, and neighbor cell tracking;
细胞状态估计步骤,基于结果信息素场和启发式函数计算每个子蚁群的存在概率,删除存在概率小于阈值的蚁群,融合相似蚁群并考虑存在概率大于阈值的蚁群进行多细胞状态估计;The cell state estimation step is to calculate the existence probability of each sub-ant colony based on the resulting pheromone field and heuristic function, delete the ant colonies whose existence probability is less than the threshold, fuse similar ant colonies and consider the ant colonies whose existence probability is greater than the threshold for multi-cell state estimation ;
其中蚂蚁自调整觅食步骤,具体为:The ants self-adjust foraging steps, specifically:
1)输入细胞图像序列,构建信息素场中的基于指数形式的蚂蚁工作模式;蚂蚁的觅食行为限定在规定范围内并根据概率选择邻域内像素进行搜索;假如第v组蚁群中的蚂蚁l处于像素(i′,j′)所在位置,考虑指数形式对变量的变化比较敏感,则该蚂蚁选择其可用邻域内某一像素(i,j)的概率为:1) Input the cell image sequence to construct the exponential-based ant working mode in the pheromone field; the foraging behavior of the ants is limited to a specified range and the pixels in the neighborhood are selected according to the probability to search; if the ants in the vth group of ants are l is at the position of the pixel (i', j'), considering that the exponential form is more sensitive to changes in variables, the probability of the ant selecting a pixel (i, j) in its available neighborhood is:
其中为第v组蚁群像素(i,j)上第t次迭代的信息素,ηi,j是像素(i,j)的启发式函数;α和β是信息素和启发式函数ηi,j之间的调节参数,Ω(i′,j′)是像素(i′,j′)的可用邻域集合;Ω(i′,j′)是限定蚂蚁觅食范围与像素(i′,j′)邻域的交集;in is the pheromone of the t-th iteration on the vth group of ant colony pixels (i, j), η i, j is the heuristic function of the pixel (i, j); α and β are the pheromone and the heuristic function η i,j , Ω(i′,j′) is the set of available neighborhoods for the pixel (i′,j′);Ω(i′,j′) is the limit of ant foraging The intersection of the range and the neighborhood of the pixel (i', j');
启发式函数ηi,j定义为其中ΔIi,j和ΔAi,j分别表示像素(i,j)邻域内的像素强度差分和平均值;λ是调节系数,决定ΔIi,j和ΔAi,j两个变量对启发式函数值的影响,定义为λ=Imean/Imax,其中Imean和Imax分别表示当前帧像素的平均强度和最大强度;γ和κ都是调节系数保证启发式函数值在区间[0,1]之间变化;如果图像背景的启发式函数值大于前景的,则γ=1,否则γ=2;同样如果启发式函数值大于1,则κ=1,否则,κ=0;The heuristic function η i,j is defined as where ΔI i,j and ΔA i,j represent the pixel intensity difference and average value in the neighborhood of pixel (i,j), respectively; λ is the adjustment coefficient, which determines the heuristic function of the two variables ΔI i,j and ΔA i,j The influence of the value is defined as λ=I mean /I max , where I mean and I max represent the average intensity and maximum intensity of the current frame pixel respectively; γ and κ are both adjustment coefficients to ensure that the heuristic function value is in the interval [0, 1 ]; if the heuristic function value of the image background is greater than that of the foreground, then γ=1, otherwise γ=2; also if the heuristic function value is greater than 1, then κ=1, otherwise, κ=0;
2)当所有蚂蚁完成搜索后,对像素(i,j)上的信息素量进行更新其中为第ν组蚁群第t次迭代在像素(i,j)上的信息素量,ρ(0<ρ<1)表示信息素残留系数,为第t-1次迭代蚂蚁l在像素(i,j)上释放的信息素量;2) When all ants complete the search, update the amount of pheromone on the pixel (i, j) in is the amount of pheromone on the pixel (i, j) in the t iteration of the νth group ant colony, ρ(0<ρ<1) represents the residual pheromone coefficient, is the amount of pheromone released by the ant l on the pixel (i, j) in the t-1th iteration;
3)当第v组蚁群中所有蚂蚁完成第t次迭代后,对第v组信息素场进行高斯拟合,得到第v组高斯信息素场,信息素变量服从均值为协方差为的高斯分布其中τ(ν)(t)为第t次迭代后第v组高斯信息素场,τ(t)表示信息素变量,和分别为第t次迭代后第v组高斯信息素场信息素量的均值及协方差;3) When all the ants in the vth group of ants complete the tth iteration, perform Gaussian fitting on the vth group pheromone field to obtain the vth group Gaussian pheromone field, and the pheromone variables obey the mean of The covariance is Gaussian distribution of where τ (ν) (t) is the v-th Gaussian pheromone field after the t-th iteration, and τ(t) represents the pheromone variable, and are the mean and covariance of the pheromone amount of the vth group of Gaussian pheromone field after the tth iteration;
4)计算第t次迭代后第ν组高斯信息素场和第t-1次迭代后第v组高斯信息素场之间的KL距离Dτ(t),如果Dτ(t)大于阈值ε,则对第t次迭代后第v组蚁群进行高斯重采样,得到高斯蚁群为第t+1次迭代第ν组蚁群的初始分布,其中x(v,l)(t+1)表示第t+1次迭代第ν组蚁群蚂蚁l的状态,而且x(v,l)(t+1)服从均值为协方差为的高斯分布,x(ν,l)(t+1):同时根据第t次迭代后第ν组高斯信息素场重构第y组蚁群在第t+1次迭代中的蚂蚁觅食范围;4) Calculate the KL distance D τ (t) between the ν-th Gaussian pheromone field after the t-th iteration and the v-th Gaussian pheromone field after the t-1-th iteration, if D τ (t) is greater than the threshold ε , then Gaussian resampling is performed on the vth group of ant colonies after the t-th iteration, and the Gaussian ant colony is obtained. is the initial distribution of the νth group ant colony at the t+1th iteration, where x (v, l) (t+1) represents the state of the νth group ant colony l at the t+1th iteration, and x (v, l) (t+1) obeys the mean The covariance is Gaussian distribution of , x (ν, l) (t+1): At the same time, according to the Gaussian pheromone field of the νth group after the tth iteration, the ant foraging range of the yth group of ants in the t+1th iteration is reconstructed;
5)继续上述步骤1)-4),直至Dτ(t)小于阈值ε,达到迭代终止条件。5) Continue the above steps 1)-4) until D τ (t) is less than the threshold ε and the iteration termination condition is reached.
优选的,所述蚁群及信息素场双预测步骤,其具体预测方式如下:Preferably, in the double prediction step of the ant colony and the pheromone field, the specific prediction method is as follows:
1)设定在第k-1帧有Nk-1个细胞,与细胞对应的蚁群及信息素场也有Nk-1个,第y(v=1,...,Nk-1)组蚁群包含M个蚂蚁,状态表示为服从均值为协方差为的高斯分布其中l表示蚂蚁,xk-1为第k-1帧蚂蚁状态变量,和分别为第k-1帧第y组蚁群蚂蚁状态变量的均值及协方差;第k-1帧第v组蚁群中蚂蚁l的状态预测到第k帧为其中F为状态转移矩阵,表示第k帧第v组蚁群中蚂蚁l的预测状态,服从均值为协方差为的高斯分布xk|k-1表示预测到第k帧的蚂蚁状态变量,其中“∑”表示求和运算,T表示矩阵转置;1) It is assumed that there are N k-1 cells in the k-1th frame, and there are also Nk-1 ant colonies and pheromone fields corresponding to the cells, and the yth (v=1,..., Nk-1 ) group ant colony contains M ants, and the state is expressed as obey the mean The covariance is Gaussian distribution of where l represents the ant, x k-1 is the ant state variable in the k-1th frame, and are the mean and covariance of the state variables of the ants in the yth group ant colony at the k-1th frame, respectively; the state of the ant l in the vth group ant colony at the k-1th frame It is predicted that the kth frame is where F is the state transition matrix, Represents the predicted state of ant l in the vth group of ant colonies in the kth frame, obeying the mean of The covariance is Gaussian distribution of x k|k-1 represents the state variable of the ant predicted to the kth frame, where "∑" represents the summation operation, T represents matrix transpose;
2)假定第k-1帧第ν组信息素场符合均值为协方差为的高斯分布则第y组信息素场预测到第k帧为其中,为第y组第k帧预测信息素场,τk|k-1表示第k帧信息素变量。2) Assume that the νth group pheromone field of the k-1th frame conforming to the mean The covariance is Gaussian distribution of Then the yth group pheromone field predicts the kth frame as in, Predict the pheromone field for the kth frame of the yth group, and τ k|k-1 represents the kth frame pheromone variable.
优选的,所述细胞状态估计步骤的具体方式如下:Preferably, the specific manner of the cell state estimation step is as follows:
1)计算存在概率r(v):当达到迭代终止条件,第ν组蚁群中所有蚂蚁完成移动后,形成信息素场τ(v),计算第v组蚁群的存在概率, 为第ν组信息素场像素上的信息素量,为像素上的启发式函数值,Γ(ν)为当前帧第ν组蚁群对应细胞轮廓内的像素集;1) Calculate the existence probability r (v) : when the iteration termination condition is reached, after all the ants in the νth group ant colony have completed their movement, a pheromone field τ (v) is formed, and the existence probability of the vth group ant colony is calculated, is the vth group of pheromone field pixels The amount of pheromone on the for pixels The heuristic function value on , Γ (ν) is the pixel set in the corresponding cell contour of the νth group ant colony in the current frame;
2)当第v组蚁群的存在概率大于预先设定的阈值,则保留第ν组蚁群,否则删除第ν组蚁群;2) When the existence probability of the vth group ant colony is greater than the preset threshold, then keep the nth group ant colony, otherwise delete the nth group ant colony;
3)融合空间相似蚁群后,进行细胞状态估计。3) After fusion of spatially similar ant colonies, cell state estimation is performed.
优选的,将第ν组蚁群的存在概率大于预先设定的阈值设为0.5。Preferably, the existence probability of the nth group of ant colonies is set to be greater than a preset threshold as 0.5.
本发明提出了一种多细胞跟踪系统,包括存储器和处理器,存储器存储有计算机程序,其特征在于;所述处理器执行所述计算机程序时实现所述的方法步骤。The invention provides a multi-cell tracking system, comprising a memory and a processor, wherein the memory stores a computer program, and is characterized in that the processor implements the method steps when executing the computer program.
3、本发明所具有的效果:3. Effects of the present invention:
1)本发明所提出的基于蚂蚁自调整觅食行为的多细胞跟踪系统,在基于指数形式的蚂蚁工作模式下利用三种策略,即,蚁群觅食范围限定、蚁群重采样机制、蚁群觅食停止准则,构建信息素场,能解决形变、运动特性各异、数目时变和近邻等多细胞跟踪问题取得了良好跟踪效果,适用范围较广;1) The multi-cell tracking system based on the self-adjusting foraging behavior of ants proposed by the present invention utilizes three strategies under the ant working mode based on the exponential form, namely, the limited foraging range of the ant colony, the resampling mechanism of the ant colony, the The group foraging stop criterion and the construction of a pheromone field can solve the multi-cell tracking problems such as deformation, different motion characteristics, time-varying number and neighbors, and have achieved good tracking results and have a wide range of applications;
2)本发明所设计的方法跟踪精度高;与基于信息素预测的蚁群多细胞跟踪算法,SMAL博士提出的粒子滤波器细胞跟踪方法及REZA教授提出的多贝努利滤波器及高斯混合PHD滤波器相比,精确率Precision(P),召回率Recall (R)和F1-测量都得到提升。2) The method designed by the present invention has high tracking accuracy; and the ant colony multi-cell tracking algorithm based on pheromone prediction, the particle filter cell tracking method proposed by Dr. SMAL and the multi-Bernoulli filter and Gaussian mixture PHD proposed by REZA Compared to filters, Precision (P), Recall (R) and F1-measures are all improved.
附图说明Description of drawings
下面结合附图和实施例对本发明进一步说明。The present invention will be further described below in conjunction with the accompanying drawings and embodiments.
图1为未考虑数据关联情况下基于蚂蚁自调整觅食行为的多细胞跟踪系统。Figure 1 shows a multicellular tracking system based on ants' self-adjusting foraging behavior without considering data association.
图2为序列1的3D跟踪结果。Figure 2 shows the 3D tracking results of
图3为序列2的3D跟踪结果。Figure 3 shows the 3D tracking results of sequence 2.
图4为限定蚁群觅食范围演化过程。Figure 4 shows the evolution process of the limited ant colony foraging range.
图5为迭代过程中高斯蚁群重采样演化过程。Figure 5 shows the evolution process of Gaussian ant colony resampling in the iterative process.
具体实施方式Detailed ways
如图1所示,输入细胞图像序列后,根据前一帧蚁群及其信息素场的迭代结果对当前帧进行预测,形成高斯蚁群及高斯信息素场;在基于指数形式的蚂蚁工作模式下利用三种策略,即,蚁群觅食范围限定、蚁群重采样机制、蚁群觅食停止准则构建信息素场;然后计算蚁群的存在概率并融合相似蚁群,考虑存在概率大于阈值的蚁群及相应高斯信息素场进行细胞状态提取,实现多细胞的精确跟踪。As shown in Figure 1, after inputting the cell image sequence, the current frame is predicted according to the iterative results of the ant colony and its pheromone field of the previous frame to form a Gaussian ant colony and a Gaussian pheromone field; in the exponential-based ant working mode Next, three strategies are used, namely, the ant colony foraging range limitation, the ant colony resampling mechanism, and the ant colony foraging stop criterion to construct the pheromone field; then the existence probability of the ant colony is calculated and similar ant colonies are fused, considering that the existence probability is greater than the threshold The ant colony and the corresponding Gaussian pheromone field are used for cell state extraction to achieve accurate tracking of multiple cells.
所述蚁群及信息素场双预测步骤中预测方式如下:The prediction method in the double prediction step of the ant colony and the pheromone field is as follows:
1)设定在第k-1帧有Nk-1个细胞,与细胞对应的蚁群及信息素场也有Nk-1个,第ν(v=1,...,Nk-1)组蚁群包含M个蚂蚁,状态表示为服从均值为协方差为的高斯分布其中l表示蚂蚁,xk-1为第k-1帧蚂蚁状态变量,和分别为第k-1帧第v组蚁群蚂蚁状态变量的均值及协方差。第k-1帧第ν组蚁群中蚂蚁l的状态预测到第k帧为其中F为状态转移矩阵,表示第k帧第ν组蚁群中蚂蚁l的预测状态,服从均值为协方差为的高斯分布xk|k-1表示预测到第k帧的蚂蚁状态变量,其中“∑”表示求和运算,T表示矩阵转置;1) It is assumed that there are N k-1 cells in the k-1th frame, and there are also N k-1 ant colonies and pheromone fields corresponding to the cells, and the νth (v=1,..., Nk-1 ) group ant colony contains M ants, and the state is expressed as obey the mean The covariance is Gaussian distribution of where l represents the ant, x k-1 is the ant state variable in the k-1th frame, and are the mean and covariance of the state variables of the ants in the vth group of ants in the k-1th frame, respectively. The state of ant l in the nth group ant colony at frame k-1 It is predicted that the kth frame is where F is the state transition matrix, Represents the predicted state of ant l in the νth group ant colony in the kth frame, obeying the mean of The covariance is Gaussian distribution of x k|k-1 represents the state variable of the ant predicted to the kth frame, where "∑" represents the summation operation, T represents matrix transpose;
2)假定第k-1帧第ν组信息素场符合均值为协方差为的高斯分布则第v组蚁群信息素场预测到第k帧为其中,为第ν组第k帧预测信息素场,τk|k-1表示第k帧信息素变量;2) Assume that the νth group pheromone field of the k-1th frame conforming to the mean The covariance is Gaussian distribution of Then the vth group ant colony pheromone field predicts the kth frame as in, is the predicted pheromone field for the kth frame of the νth group, and τ k|k-1 represents the kth frame pheromone variable;
所述蚂蚁自调整觅食步骤具体方式如下:The specific methods of the ants self-adjusting foraging steps are as follows:
1)输入细胞图像序列,构建信息素场中的基于指数形式的蚂蚁工作模式。蚂蚁的觅食行为限定在规定范围内并根据概率选择邻域内像素进行搜索。假如第v组蚁群中的蚂蚁l处于像素(i′,j′)所在位置,考虑指数形式对变量的变化比较敏感,则该蚂蚁选择其可用邻域内某一像素(i,j)的概率为:1) Input the cell image sequence, and construct the ant working mode based on the exponential form in the pheromone field. The foraging behavior of ants is limited to a specified range and the pixels in the neighborhood are selected according to the probability to search. If the ant l in the vth group ant colony is located at the position of the pixel (i', j'), considering that the exponential form is more sensitive to the change of variables, the probability of the ant selecting a pixel (i, j) in its available neighborhood for:
其中为第v组蚁群像素(i,j)上第t次迭代的信息素,ηi,j是像素(i,j)的启发式函数。α和β是信息素和启发式函数ηi,j之间的调节参数,Ω(i′,j′)是像素(i′,j′)的可用邻域集合;Ω(i′,j′)是限定蚂蚁觅食范围与像素(i′,j′)邻域的交集。in is the pheromone of the t-th iteration on the v-th group of ant colony pixels (i, j), and η i, j is the heuristic function of the pixel (i, j). Alpha and beta are pheromones and the heuristic function η i, j , Ω(i', j') is the set of available neighborhoods for the pixel (i', j');Ω(i',j') is the limited ant foraging The intersection of the range and the neighborhood of the pixel (i', j').
启发式函数ηi,j定义为其中ΔIi,j和ΔAi,j分别表示像素(i,j)邻域内的像素强度差分和平均值。λ是调节系数,决定ΔIi,j和ΔAi,j两个变量对启发式函数值的影响,定义为λ=Imean/Imax,其中Imean和Imax分别表示当前帧像素的平均强度和最大强度。γ和κ都是调节系数保证启发式函数值在区间[0,1]之间变化。如果图像背景的启发式函数值大于前景的,则γ=1,否则γ=2。同样如果启发式函数值大于1,则κ=1,否则,κ=0。The heuristic function η i,j is defined as where ΔI i,j and ΔA i,j represent the pixel intensity difference and average value in the neighborhood of pixel (i,j), respectively. λ is the adjustment coefficient, which determines the influence of the two variables ΔI i,j and ΔA i,j on the heuristic function value, which is defined as λ=I mean /I max , where I mean and I max represent the average intensity of the current frame pixel respectively and maximum strength. Both γ and κ are adjustment coefficients to ensure that the heuristic function value varies between the interval [0, 1]. If the value of the heuristic function for the background of the image is greater than that of the foreground, then γ=1, otherwise γ=2. Also if the heuristic function value is greater than 1, then κ=1, otherwise, κ=0.
2)当所有蚂蚁完成搜索后,对像素(i,j)上的信息素量进行更新其中为第y组蚁群第t次迭代在像素(i,j)上的信息素量,ρ(0<ρ<1)表示信息素残留系数,为第t-1次迭代蚂蚁l在像素(i,j)上释放的信息素量;2) When all ants complete the search, update the amount of pheromone on the pixel (i, j) in is the amount of pheromone on the pixel (i, j) in the t-th iteration of the y-th ant colony, ρ(0<ρ<1) represents the pheromone residual coefficient, is the amount of pheromone released by the ant l on the pixel (i, j) in the t-1th iteration;
3)当第ν组蚁群中所有蚂蚁完成第t次迭代后,对第ν组信息素场进行高斯拟合,得到第ν组高斯信息素场,信息素变量服从均值为协方差为的高斯分布其中τ(ν)(t)为第t次迭代后第v组高斯信息素场,τ(t)表示信息素变量,和分别为第t次迭代后第ν组高斯信息素场信息素量的均值及协方差;3) After all the ants in the νth group ant colony complete the t-th iteration, perform Gaussian fitting on the νth group pheromone field to obtain the νth group Gaussian pheromone field, and the pheromone variables obey the mean value. The covariance is Gaussian distribution of where τ (ν) (t) is the v-th Gaussian pheromone field after the t-th iteration, and τ(t) represents the pheromone variable, and are the mean and covariance of the pheromone amount of the νth group of Gaussian pheromone field after the t-th iteration;
4)计算第t次迭代后第ν组高斯信息素场和第t-1次迭代后第ν组高斯信息素场之间的KL距离Dτ(t),如果Dτ(t)大于阈值ε,则对第t次迭代后第ν组蚁群进行高斯重采样,得到高斯蚁群为第t+1次迭代第v组蚁群的初始分布,其中x(v,l)(t+1)表示第t+1次迭代第v组蚁群蚂蚁l的状态,而且x(v,j)(t+1)服从均值为协方差为的高斯分布,x(ν,l)(t+1):同时根据第t次迭代后第v组高斯信息素场重构第ν组蚁群在第t+1次迭代中的蚂蚁觅食范围;4) Calculate the KL distance D τ (t) between the ν-th Gaussian pheromone field after the t-th iteration and the ν-th Gaussian pheromone field after the t-1th iteration, if D τ (t) is greater than the threshold ε , then the Gaussian resampling is performed on the νth group ant colony after the t-th iteration, and the Gaussian ant colony is obtained. is the initial distribution of the vth group ant colony at the t+1th iteration, where x (v, l) (t+1) represents the state of the vth group ant colony l at the t+1th iteration, and x (v, j) (t+1) obeys the mean The covariance is Gaussian distribution of , x (ν, l) (t+1): At the same time, according to the Gaussian pheromone field of the vth group after the tth iteration, the ant foraging range of the νth group ant colony in the t+1th iteration is reconstructed;
5)继续上述步骤1)-4),直至Dτ(t)小于阈值ε,达到迭代终止条件。5) Continue the above steps 1)-4) until D τ (t) is less than the threshold ε and the iteration termination condition is reached.
所述细胞状态估计步骤的具体方式如下:The specific manner of the cell state estimation step is as follows:
1)计算存在概率r(v):当达到迭代终止条件,第v组蚁群中所有蚂蚁完成移动后,形成信息素场τ(v),计算第v组蚁群的存在概率, 为第v组信息素场像素上的信息素量,为像素上的启发式函数值,Γ(ν)为当前帧第ν组蚁群对应细胞轮廓内的像素集。1) Calculate the existence probability r (v) : when the iteration termination condition is reached, after all the ants in the vth group of ants have completed their movement, a pheromone field τ (v) is formed, and the existence probability of the vth group of ant colonies is calculated, is the vth group of pheromone field pixels The amount of pheromone on the for pixels On the heuristic function value, Γ (ν) is the pixel set in the contour of the corresponding cell of the νth group of ant colonies in the current frame.
2)当第ν组蚁群的存在概率大于预先设定的阈值(本发明中设为0.5),则保留第v组蚁群,否则删除第ν组蚁群;2) when the existence probability of the νth group ant colony is greater than the preset threshold (set as 0.5 in the present invention), then keep the vth group ant colony, otherwise delete the νth group ant colony;
3)融合空间相似蚁群后,进行细胞状态估计。3) After fusion of spatially similar ant colonies, cell state estimation is performed.
本发明经过蚁群及信息素场双预测步骤、蚂蚁自调整觅食步骤及细胞状态估计步骤的多细胞跟踪结果如下所示。The multi-cell tracking results of the present invention through the double prediction steps of the ant colony and the pheromone field, the ant self-adjusting foraging step and the cell state estimation step are as follows.
图1为基于蚂蚁自调整觅食行为的多细胞跟踪系统。图2为序列1的3D跟踪结果,图3为序列1的3D跟踪结果,可看出存在细胞出现、消失和细胞近邻等情况,都得到了可靠跟踪。图4为限定蚁群觅食范围演化过程,可看出随着迭代次数的增加蚁群觅食范围向细胞轮廓逼近。图5为迭代过程中高斯蚁群重采样演化过程。Figure 1 shows a multicellular tracking system based on ants' self-adjusting foraging behavior. Figure 2 shows the 3D tracking results of
本发明所设计的方法与基于信息素预测的蚁群多细胞跟踪算法,SMAL博士提出的粒子滤波器细胞跟踪方法及REZA教授提出的多贝努利滤波器及高斯混合PHD滤波器相比,精确度Precision(P),回波率Recall(R)和F1-测量都得到了提升,如表一和表二所示。Compared with the ant colony multi-cell tracking algorithm based on pheromone prediction, the particle filter cell tracking method proposed by Dr. SMAL, and the multi-Bernoulli filter and Gaussian mixture PHD filter proposed by REZA, the method designed in the present invention is more accurate. Degree Precision(P), Echo Rate Recall(R) and F1-measurement have all been improved, as shown in Tables 1 and 2.
表一 不同算法跟踪性能比较(序列1)Table 1 Tracking performance comparison of different algorithms (sequence 1)
表二 不同算法跟踪性能比较(序列2)Table 2 Tracking performance comparison of different algorithms (sequence 2)
综上所述,本发明技术方案可解决在数目时变、变形及运动特性各异时的多细胞跟踪问题。对细胞近距离交互、细胞进入或离开视图和细胞运动速度方向时变等情形,利用蚂蚁自调整觅食行为考虑三种策略,即,限定蚁群觅食范围、蚁群重采样机制、蚁群觅食停止准则构建信息素场,实现复杂情形下多细胞的精确跟踪。To sum up, the technical solution of the present invention can solve the problem of multi-cell tracking when the number is time-varying, the deformation and the motion characteristics are different. For the case of close cell interaction, cell entering or leaving the view, and time-varying direction of cell movement speed, three strategies are considered by using ants' self-adjusting foraging behavior, namely, limiting the foraging range of ant colonies, ant colony resampling mechanism, ant colony The foraging stop criterion constructs a pheromone field, enabling accurate tracking of multiple cells in complex situations.
Claims (5)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011040382.2A CN112200836B (en) | 2020-09-28 | 2020-09-28 | Multi-cell tracking method and system based on self-adjusting foraging behavior of ants |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011040382.2A CN112200836B (en) | 2020-09-28 | 2020-09-28 | Multi-cell tracking method and system based on self-adjusting foraging behavior of ants |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112200836A CN112200836A (en) | 2021-01-08 |
| CN112200836B true CN112200836B (en) | 2021-10-19 |
Family
ID=74006763
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011040382.2A Active CN112200836B (en) | 2020-09-28 | 2020-09-28 | Multi-cell tracking method and system based on self-adjusting foraging behavior of ants |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112200836B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116777850B (en) * | 2023-06-09 | 2025-12-19 | 长春理工大学 | Cell tracking technical method based on deep learning and ant colony algorithm |
| CN120013199B (en) * | 2025-04-14 | 2025-09-05 | 华南理工大学 | A scheduling optimization method and system based on shipbuilding |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102999922A (en) * | 2012-11-19 | 2013-03-27 | 常熟理工学院 | Multi-cell automatic tracking method and system based on plurality of task ant systems |
| CN107871156A (en) * | 2017-11-02 | 2018-04-03 | 常熟理工学院 | Ant colony multi-cell tracking system based on pheromone prediction |
| CN109118518A (en) * | 2018-07-24 | 2019-01-01 | 常熟理工学院 | Double-deck more bernoulli stochastic finite ant colony many cells trackings |
| CN109159127A (en) * | 2018-11-20 | 2019-01-08 | 广东工业大学 | A kind of double welding robot intelligence paths planning methods based on ant group algorithm |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8123720B2 (en) * | 2008-08-08 | 2012-02-28 | Neal Solomon | Intelligent medical device system dynamics for biological network regulation |
| FR3032532B1 (en) * | 2015-02-05 | 2020-02-28 | Services Petroliers Schlumberger | DERIVATION OF SEISMIC ATTRIBUTES FROM A GEOLOGICAL AGE PROPERTY RELATIVE FROM A VOLUME-BASED MODEL |
| WO2018217875A1 (en) * | 2017-05-23 | 2018-11-29 | Schlumberger Technology Corporation | Analogue facilitated seismic data interpretation system |
-
2020
- 2020-09-28 CN CN202011040382.2A patent/CN112200836B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102999922A (en) * | 2012-11-19 | 2013-03-27 | 常熟理工学院 | Multi-cell automatic tracking method and system based on plurality of task ant systems |
| CN107871156A (en) * | 2017-11-02 | 2018-04-03 | 常熟理工学院 | Ant colony multi-cell tracking system based on pheromone prediction |
| CN109118518A (en) * | 2018-07-24 | 2019-01-01 | 常熟理工学院 | Double-deck more bernoulli stochastic finite ant colony many cells trackings |
| CN109159127A (en) * | 2018-11-20 | 2019-01-08 | 广东工业大学 | A kind of double welding robot intelligence paths planning methods based on ant group algorithm |
Non-Patent Citations (3)
| Title |
|---|
| An Ant Colony Inspired Multi-Bernoulli;Benlian Xu et al;《IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS》;20200630;第24卷(第06期);第1703-1716页 * |
| 基于蚁群算法的移动机器人路径规划;刘雄 等;《计算机仿真》;20111130;第28卷(第11期);第185-188页 * |
| 自适应蚁群算法在多目标跟踪中的应用;林涛 等;《计算机仿真》;20140930;第31卷(第09期);第369-373页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112200836A (en) | 2021-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Clark et al. | Learning to solve nonlinear least squares for monocular stereo | |
| CN111178432B (en) | Weakly supervised fine-grained image classification method based on multi-branch neural network model | |
| Oliva et al. | Metaheuristic algorithms for image segmentation: theory and applications | |
| CN110197258B (en) | Neural network searching method, image processing device, neural network searching apparatus, image processing apparatus, and recording medium | |
| JP3404532B2 (en) | Optimal fitting parameter determining method and apparatus, and optimal fitting parameter determining program | |
| CN112200836B (en) | Multi-cell tracking method and system based on self-adjusting foraging behavior of ants | |
| CN107944410B (en) | A cross-domain facial feature parsing method based on convolutional neural network | |
| CN110264471A (en) | A kind of image partition method, device, storage medium and terminal device | |
| CN111476266A (en) | Non-equilibrium type leukocyte classification method based on transfer learning | |
| CN111366169B (en) | A Deterministic Path Planning Method for Mobile Robots | |
| CN116012840B (en) | Three-dimensional point cloud semantic segmentation labeling method based on active learning and semi-supervision | |
| CN109034231A (en) | The deficiency of data fuzzy clustering method of information feedback RBF network valuation | |
| Li et al. | Cflownets: Continuous control with generative flow networks | |
| CN114359298A (en) | Semi-supervised dynamic self-learning segmentation method for cardiac MRI | |
| CN119106740A (en) | Interpretable data-driven semiconductor silicon single crystal growth diameter prediction method | |
| CN103903072A (en) | High-dimensional multi-target set evolutionary optimization method based on preference of decision maker | |
| CN116775687A (en) | Time sequence prediction closed-loop framework based on digital-analog symbiosis | |
| CN119152193A (en) | YOLO target detection method and system based on differential architecture search | |
| CN114897922A (en) | Histopathology image segmentation method based on deep reinforcement learning | |
| Liang et al. | Comparison-based convolutional neural networks for cervical cell/clumps detection in the limited data scenario | |
| CN113052850B (en) | Distance regular level set and convolution neural network left ventricle MRI image segmentation method | |
| CN119963062B (en) | Intelligent control-based inorganic mineral fiber production system and method | |
| CN101739680A (en) | Method for partitioning medical volume data based on artificial endocrine-immune system | |
| CN119478469B (en) | End-to-end anchor point multi-view image clustering method under guidance of global principal component | |
| CN115205832A (en) | VGG 16-based multitask learning plant phenotype processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20210108 Assignee: Suzhou Yueya Biotechnology Co.,Ltd. Assignor: CHANGSHU INSTITUTE OF TECHNOLOGY|THE FIFTH PEOPLE'S HOSPITAL OF SUZHOU Contract record no.: X2023980036933 Denomination of invention: A Multicell Tracking Method and System Based on Ant Self Adjusting foraging Behavior Granted publication date: 20211019 License type: Common License Record date: 20230626 |
|
| EE01 | Entry into force of recordation of patent licensing contract | ||
| CP03 | Change of name, title or address |
Address after: 215500 Suzhou, Changshou City Province, South Ring Road No. 99, No., No. three Patentee after: Suzhou Institute of Technology Country or region after: China Patentee after: THE FIFTH PEOPLE'S HOSPITAL OF SUZHOU Address before: 215500 Suzhou, Changshou City Province, South Ring Road No. 99, No., No. three Patentee before: CHANGSHU INSTITUTE OF TECHNOLOGY Country or region before: China Patentee before: THE FIFTH PEOPLE'S HOSPITAL OF SUZHOU |
|
| CP03 | Change of name, title or address |