This site needs JavaScript to work properly. Please enable it to take advantage of the complete set of features!
Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

NIH NLM Logo
Log in
Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017 Nov;26(11):5395-5410.
doi: 10.1109/TIP.2017.2707803.

Piecewise-Stationary Motion Modeling and Iterative Smoothing to Track Heterogeneous Particle Motions in Dense Environments

Piecewise-Stationary Motion Modeling and Iterative Smoothing to Track Heterogeneous Particle Motions in Dense Environments

Philippe Roudot et al. IEEE Trans Image Process. 2017 Nov.

Abstract

One of the major challenges in multiple particle tracking is the capture of extremely heterogeneous movements of objects in crowded scenes. The presence of numerous assignment candidates in the expected range of particle motion makes the tracking ambiguous and induces false positives. Lowering the ambiguity by reducing the search range, on the other hand, is not an option, as this would increase the rate of false negatives. We propose here a piecewise-stationary motion model (PMM) for the particle transport along an iterative smoother that exploits recursive tracking in multiple rounds in forward and backward temporal directions. By fusing past and future information, our method, termed PMMS, can recover fast transitions from freely or confined diffusive to directed motions with linear time complexity. To avoid false positives, we complemented recursive tracking with a robust inline estimator of the search radius for assignment (a.k.a. gating), where past and future information are exploited using only two frames at each optimization step. We demonstrate the improvement of our technique on simulated data especially the impact of density, variation in frame to frame displacements, and motion switching probability. We evaluated our technique on the 2D particle tracking challenge dataset published by Chenouard et al. in 2014. Using high SNR to focus on motion modeling challenges, we show superior performance at high particle density. On biological applications, our algorithm allows us to quantify the extremely small percentage of motor-driven movements of fluorescent particles along microtubules in a dense field of unbound, diffusing particles. We also show with virus imaging that our algorithm can cope with a strong reduction in recording frame rate while keeping the same performance relative to methods relying on fast sampling.

PubMed Disclaimer

Figures

Fig. 1
Fig. 1
Challenges in tracking particles undergoing rapid motion type switches. A) After a phase of confined diffusion, the particle displays a fast directed motion before returning to a confined diffusion state. B) An IMM based algorithm cannot not retrieve the directed motion segment; only the Brownian segments are correctly tracked. Small red circles, particle detections. Yellow arrows, true association between detections. Purple arrows, true associations in a secondary trajectory. Red and Green segments, Directed and Brownian motion regime, respectively. Blue and Green circles, search radii estimated at each time point for the Directed and Brownian motion regimes, respectively. C) The u-track algorithm recovers part of the directed motion segment thanks to its Kalman filter initialization routine.
Fig. 2
Fig. 2
Challenges in tracking particles with heterogeneous motion in dense condition. A) The particle moves fast and then switches to confined Brownian motion. B) An IMM-based algorithm produces a correct track, switching to a Brownian motion scheme (yellow arrow). C) The u-track algorithm produces a false positive (purple arrow) due to the strong persistence of its directed prediction approach.
Fig. 3
Fig. 3
Our iterative smoothing approach on an example. Red links represent directed prediction selection, green link represent Brownian prediction and yellow represent predictions that coincide with the previous tracking round. A small displacement is easily retrieved during the first tracking round, it serves as a track initialization for the following track rounds.
Fig. 4
Fig. 4
Overview of tracking algorithm at round k + 1. For the sake of clarity, covariance matrix and Kalman filter variable updates are not indicated.
Fig. 5
Fig. 5
A) Range of simulated particle density. B) Example of simulated tracks with a particle density of 1 spots/μm2 (red (resp. yellow) segment: better likelihood with the current (resp. previous inverted) filtering round). C) Percentage of correct links as a function of density and motion type switching probability. Our method outperforms u-track by 15% in the most difficult case. D) True positive and false positive ratio on the same simulation with a density of 3 spots/μm2 comparing our method with u-track, u-track with an online process noise estimator and an IMM algorithm with forward-backward initialization.
Fig. 6
Fig. 6
Error in the estimation of the covariance matrix of the innovation as a function of the motion switching probability. Simulated data is used. Vesicle density is set to 3 spots/μm2. Our method is compared with the estimation of the covariance matrix of the innovation on the whole track up to time t (u-track) and an online and iterative though non adaptive variance estimation (u-track SR+).
Fig. 7
Fig. 7
Correct linking and false positive percentage function of the transition speed, density is set to 3 spots/μm2.
Fig. 8
Fig. 8
Correct linking and false positive percentage with respect to speed switching probability.
Fig. 9
Fig. 9
Average performances measured on the Vesicle dataset (Brownian diffusion), Microtubule dataset (directed displacement) and Receptor scenario (heterogeneous displacement) datasets provided in the MPT challenge (see text for definition of metrics).
Fig. 10
Fig. 10
Vimentin particle movements tracked by the PMMS algorithm. A) Control cell; occasional fast movements are highlighted with green arrows (scale bar is 1 μm). B) Cell after nocodazole treatment; nearly all fast movements are eliminated. C) A threshold for defining large movements is estimated using the 99.9 percentile of the estimated speed distribution. A t-test on 8 cells for each conditions gives a p-value of 0.0088 suggesting that nocodazole treatment effectively hinders fast movements.
Fig. 11
Fig. 11
Virus tracking inside the cell. Frame-rate is artificially reduced to test tracker robustness. A) Tracking results using the u-track method. B) Tracking results using the PMMS algorithm (scale bar is 1 μm. Longer tracks are due to lower frame rate and drag tails plotting but represent real tracks).
Fig. 12
Fig. 12
Percentage of correct link measured by the original u-track compared to IMM, a multi-frame MHT approach (Chenouard et al 2013) and our method with respect to frame-rate decimation factor.

References

    1. Bar-Shalom Y, Li XR, Kirubarajan T. Estimation with applications to tracking and navigation: theory algorithms and software. John Wiley & Sons; 2001. 04004.
    1. Kalaidzidis Y. Multiple objects tracking in fluorescence microscopy. Journal of mathematical biology. 2009;58(1–2):57–80. - PMC - PubMed
    1. Jaqaman K, Loerke D, Mettlen M, Kuwata H, Grinstein S, Schmid SL, Danuser G. Robust single-particle tracking in live-cell time-lapse sequences. Nature methods. 2008;5(8):695–702. 00278. - PMC - PubMed
    1. Serg A, Bertaux N, Rigneault H, Marguet D. Dynamic multiple-target tracing to probe spatiotemporal cartography of cell membranes. Nature Methods. 2008;5(8):687–694. 00152. - PubMed
    1. Godinez W, Rohr K. Tracking Multiple Particles in Fluorescence Time-Lapse Microscopy Images via Probabilistic Data Association. IEEE Transactions on Medical Imaging. 2015 Feb.34(2):415–432. - PubMed
Cite

AltStyle によって変換されたページ (->オリジナル) /