Skip to main content
Log in

Algorithm and Parallel Implementation of Particle Filtering and its Use in Waveform-Agile Sensing

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

Sequential Monte Carlo particle filters (PFs) are useful for estimating nonlinear non-Gaussian dynamic system parameters. As these algorithms are recursive, their real-time implementation can be computationally complex. In this paper, we analyze the bottlenecks in existing parallel PF algorithms, and propose a new approach that integrates parallel PFs with independent Metropolis–Hastings (PPF-IMH) resampling algorithms to improve root mean-squared estimation error (RMSE) performance. We implement the new PPF-IMH algorithm on a Xilinx Virtex-5 field programmable gate array (FPGA) platform. For a one-dimensional problem with 1,000 particles, the PPF-IMH architecture with four processing elements uses less than 5% of a Virtex-5 FPGA’s resource and takes 5.85 μs for one iteration. We also incorporate waveform-agile tracking techniques into the PPF-IMH algorithm. We demonstrate a significant performance improvement when the waveform is adaptively designed at each time step with 6.84 μs FPGA processing time per iteration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Miao, L., Zhang, J. J., Chakrabarti, C., & Papandreou-Suppappola, A. (2010). A new parallel implementation for particle filters and its application to adaptive waveform design. In IEEE workshop on signal processing systems, San Francisco, CA (pp. 19–24).

  2. Ristic, B., Arulampalam, S., & Gordon, N. J. (2004). Beyond the Kalman filter: Particle filters for tracking applications. Norwood, MA: Artech House Publishers.

    MATH  Google Scholar 

  3. Shi, Z.-G., Hong, S.-H., Chen, J.-M., Chen, K.-S., & Sun, Y.-X. (2008). Particle filter-based synchronization of chaotic Colpitts circuits combating AWGN channel distortion. Circuits, Systems and Signal Processing, 27(6), 833–845.

    Article  MATH  Google Scholar 

  4. Miao, L., Zhang, J. J., Chakrabarti, C., & Papandreou-Suppappola, A. (2010). Multiple sensor sequential tracking of neural activity: Algorithm and FPGA implementation. In Asilomar conference on signals, systems and computers (pp. 369–373).

  5. Kalman, R. E. (1960). A new approach to linear filtering and prediction problems. Transactions of the ASME, 82, 35–45.

    Google Scholar 

  6. Gordon, N. J., Salmon, D. J., & Smith, A. F. M. (1992). Novel approach to nonlinear/non-Gaussian Bayesian state estimation. In: IEE Proceedings in Radar and Signal Processing (Vol. 140, pp. 107–113).

  7. Arulampalam, M. S., Maskell, S., Gordon, N., & Clapp, T. (2002). A tutorial on particle filters for online nonlinear non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing, 50, 173–449.

    Article  Google Scholar 

  8. Doucet, A., Godsill, S., & Andrieu, C. (2000). On sequential Monte Carlo sampling methods for Bayesian filtering. Statistics and Computing, 10, 197–208.

    Article  Google Scholar 

  9. Kershaw, D. J., & Evans, R. J. (1994). Optimal waveform selection for tracking systems. IEEE Transactions on Information Theory, 40(5), 1536–1550.

    Article  MATH  Google Scholar 

  10. Sira, S. P., Papandreou-Suppappola, A., & Morrell, D. (2007). Dynamic configuration of time-varying waveforms for agile sensing and tracking in clutter. IEEE Transactions on Signal Processing, 55, 3207–3217.

    Article  MathSciNet  Google Scholar 

  11. Sira, S. P., Papandreou-Suppappola, A., & Morrell, D. (2009). Advances in waveform-agile sensing for tracking. San Rafael, CA: Morgan & Claypool Publishers.

    Google Scholar 

  12. Athalye, A., Bolić, M., Hong, S., & Djurić, P. M. (2004). Architectures and memory schemes for sampling and resampling in particle filters. In Digital signal processing workshop (Vol. 1, pp. 92–96).

  13. Athalye, A., Bolić, M., Hong, S., & Djurić, P. M. (2005). Generic hardware architectures for sampling and resampling in particle filters. EURASIP Journal of Applied Signal Processing, 17, 2888–2902.

    Article  Google Scholar 

  14. Bolić, M. (2004). Architectures for efficient implementation of particle filters. Ph.D. thesis, State University of New York at Stony Brook.

  15. Bolić, M., Djurić, P. M., & Hong, S. (2004). Resampling algorithms for particle filters: A computational complexity perspective. EURASIP Journal of Applied Signal Processing, 15, 2267–2277.

    Google Scholar 

  16. Bolić, M., Djurić, P. M., & Hong, S. (2005). Resampling algorithms and architectures for distributed particle filters. IEEE Transactions on Signal Processing, 7, 2442–2450.

    Google Scholar 

  17. Hong, S., Shi, Z., Chen, J., & Chen, K. (2008). Compact resampling algorithm and hardware architecture for particle filters. In IEEE international conference on communications, circuits and systems (Vol. 2, pp. 886–890).

  18. Hong, S., Shi, Z., Chen, J., & Chen, K. (2008). Novel roughening algorithm and hardware architecture for bearings-only tracking using particle filter. Journal of Electromagnetic Waves and Applications, 22, 411–422.

    Article  Google Scholar 

  19. Hong, S., Shi, Z., Chen, J., & Chen, K. (2010). A low-power memory-efficient resampling architecture for particle filters. Circuits, Systems and Signal Processing, 29(1), 155–167.

    Article  MATH  Google Scholar 

  20. Hong, S., Bolić, M., & Djurić, P. M. (2004). An efficient fixed-point implementation of residual resampling scheme for high-speed particle filters. IEEE Signal Processing Letters, 11(5), 482–485.

    Article  Google Scholar 

  21. Berzuini, C., Best, N. G., Gilks, W. R., & Larizza, C. (1997). Dynamic conditional independence models and Markov chain Monte Carlo methods. Journal of the American Statistical Association, 92, 1403–1412.

    Article  MathSciNet  Google Scholar 

  22. Sankaranarayanan, A. C., Chellappa, R., & Srivastava, A. (2005). Algorithmic and architectural design methodology for particle filters in hardware. In IEEE international conference on computer design (pp. 275–280).

  23. Sankaranarayanan, A. C., Srivastava, A., & Chellappa, R. (2008). Algorithmic and architectural optimizations for computationally efficient particle filtering. IEEE Transactions on Image Processing, 17(5), 737–748.

    Article  MathSciNet  Google Scholar 

  24. Manjunath, B. B., Williams, A. S., Chakrabarti, C., & Papandreou-Suppappola, A. (2008). Efficient mapping of advanced signal processing algorithms on multi-processor architectures. In IEEE workshop on signal processing systems (pp. 269–274).

  25. Robert, C. P., & Casella, G. (2004). Monte Carlo statistical methods (2nd ed.). New York: Springer.

    MATH  Google Scholar 

  26. Hong, S., Shi, Z., & Chen, K. (2009). Easy-hardware-implementation MMPF for maneuvering target tracking: Algorithm and architecture. Journal of Signal Processing Systems, 61, 1–5.

    Google Scholar 

  27. Tichavsky, P., Muravchik, C. H., & Nehorai, A. (1998). Posterior Cramer-Rao bounds for discrete-time nonlinear filtering. IEEE Transactions on Signal Processing, 46, 1386–1396.

    Article  Google Scholar 

  28. Zhang, J., Manjunath, B., Maalouli, G., Papandreou-Suppappola, A., & Morrell, D. (2008). Dynamic wave form design for target tracking using MIMO radar. In Asilomar conference on signals, systems and computers (pp. 31–35).

  29. Zhang, J., Ding, Q., Kay, S., Papandreou-Suppappola, A., & Rangaswamy, M. (2010). Agile multi-modal tracking with dependent measurements. In Asilomar conference on signals, systems and computers (pp. 1653–1657).

  30. Sira, S. P., Papandreou-Suppappola, A., & Morrell, D. (2005). Time-varying waveform selection and configuration for agile sensors in tracking applications. In IEEE international conference of acoustics, speech and signal processing (Vol. 5, pp. 881–884).

  31. Woodbury, M. A. (1950). Inverting modified matrices (Vol. 42, pp. 4). Princeton, NJ: Statistical Research Group, Princeton University.

    Google Scholar 

  32. van der Merwe, R., Doucet, A., de Freitas, J. F. G., & Wan, E. (2000). The unscented particle filter. In Advances in neural information processing systems, 13, 584–590.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lifeng Miao.

Additional information

This work was partly supported by NSF under Grant No. 0830799 and MURI Grant AFOSR FA9550-05-1-0443.

The parallel particle filter implementation was discussed in our 2010 IEEE Workshop on Signal Processing Systems paper [1]. This work also presents: the new algorithm and hardware implementation described in more detail (Section 3); the effect of the number of processing elements and number of groups in each processing element on the parallel particle filter algorithm performance (Sections 5.2 and 6.1); the waveform-agile sensing algorithm (Section 4.1), the waveform-agile tracking application (Section 4.2), and its hardware (FPGA) implementation (Section 4.3); new simulation and hardware implementation results on waveform-agile tracking (Sections 5.4 and 6.2).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Miao, L., Zhang, J.J., Chakrabarti, C. et al. Algorithm and Parallel Implementation of Particle Filtering and its Use in Waveform-Agile Sensing. J Sign Process Syst 65, 211–227 (2011). https://doi.org/10.1007/s11265-011-0601-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-011-0601-2

Keywords

Navigation