Skip to content
Open Access Published by De Gruyter Open Access December 27, 2013

Stochastic Diffusion Search Review

  • Mohammad Majid al-Rifaie EMAIL logo and John Mark Bishop

Abstract

Stochastic Diffusion Search, first incepted in 1989, belongs to the extended family of swarm intelligence algorithms. In contrast to many nature-inspired algorithms, stochastic diffusion search has a strong mathematical framework describing its behaviour and convergence. In addition to concisely exploring the algorithm in the context of natural swarm intelligence systems, this paper reviews various developments of the algorithm, which have been shown to perform well in a variety of application domains including continuous optimisation, implementation on hardware and medical imaging. This algorithm has also being utilised to argue the potential computational creativity of swarm intelligence systems through the two phases of exploration and exploitation.

References

[1] al-Rifaie MM (2011) D-Art 2011: When birds and ants set off to draw. 15th International Conference Information Visualisation (iV2011, London) & 8th International Conference Computer Graphics, Imaging and Visualization (cgiv2011, Singapore) - DIGITAL ART GALLERY Search in Google Scholar

[2] al-Rifaie MM (2012) Information sharing impact of stochastic diffusion search on population-based algorithms. PhD thesis, Goldsmiths, University of London 10.1007/s12293-012-0094-ySearch in Google Scholar

[3] al-Rifaie MM (2013) D-Art 2013: Swarmic sketches with swarmic attention. 17th International Conference Information Visualisation (iV2013, London, UK) & 10th International Conference Computer Graphics, Imaging and Visualization (cgiv2013, Macau, China) - DIGITAL ART GALLERY Search in Google Scholar

[4] al-Rifaie MM, Aber A (2012) Identifying metastasis in bone scans with stochastic diffusion search. In: Information Technology in Medicine and Education (ITME), IEEE, , URL http://dx.doi. org/10.1109/ITiME.2012.6291355 10.1109/ITiME.2012.6291355Search in Google Scholar

[5] al-Rifaie MM, Bishop M (2013) Swarm intelligence and weak artificial creativity. In: The Association for the Advancement of Artificial Intelligence (AAAI) 2013: Spring Symposium, Stanford University, Palo Alto, California, U.S.A., pp 14–19 Search in Google Scholar

[6] al-Rifaie MM, Bishop M (2013) Swarmic paintings and colour attention. In: Machado P, McDermott J, Carballal A (eds) Evolutionary and Biologically Inspired Music, Sound, Art and Design, Lecture Notes in Computer Science, vol 7834, Springer Berlin Heidelberg, pp 97–108, , URL http://dx.doi.org/10.1007/ 978-3-642-36955-1_9 10.1007/978-3-642-36955-1_9Search in Google Scholar

[7] al-Rifaie MM, Bishop M (2013) Swarmic sketches and attention mechanism. In: Machado P, McDermott J, Carballal A (eds) Evolutionary and Biologically Inspired Music, Sound, Art and Design, Lecture Notes in Computer Science, vol 7834, Springer Berlin Heidelberg, pp 85–96, , URL http://dx.doi.org/10.1007/ 978-3-642-36955-1_8 10.1007/978-3-642-36955-1_8Search in Google Scholar

[8] al-Rifaie MM, Aber A, Raisys R (2011) Swarming robots and possible medical applications. In: International Society for the Electronic Arts (ISEA 2011), Istanbul, Turkey Search in Google Scholar

[9] al-Rifaie MM, Bishop M, Aber A (2011) Creative or not? birds and ants draw with muscles. In: AISB 2011: Computing and Philosophy, University of York, York, U.K., pp 23–30, iSBN: 978-1- 908187-03-1 Search in Google Scholar

[10] al-Rifaie MM, Bishop M, Blackwell T (2011) An investigation into the use of swarm intelligence for an evolutionary algorithm optimisation. In: International Conference on Evolutionary Computation Theory and Application (ECTA 2011), IJCCI Search in Google Scholar

[11] al-Rifaie MM, Bishop MJ, Blackwell T (2011) An investigation into the merger of stochastic diffusion search and particle swarm optimisation. In: Proceedings of the 13th annual conference on Genetic and evolutionary computation, ACM, New York, NY, USA, GECCO ’11, pp 37–44, , URL http://doi.acm.org/10. 1145/2001576.2001583 10.1145/2001576.2001583Search in Google Scholar

[12] al-Rifaie MM, Aber A, Oudah AM (2012) Utilising stochastic diffusion search to identify metastasis in bone scans and microcalcifications on mammographs. In: Bioinformatics and Biomedicine (BIBM 2012), Multiscale Biomedical Imaging Analysis (MBIA2012), IEEE, pp 280–287, URL http://dx.doi. org/10.1109/BIBMW.2012.6470317 10.1109/BIBMW.2012.6470317Search in Google Scholar

[13] al-Rifaie MM, Bishop M, Blackwell T (2012) Information sharing impact of stochastic diffusion search on differential evolution algorithm. In: J. Memetic Computing, vol 4, Springer- Verlag, pp 327–338, , URL http://dx.doi.org/10.1007/ s12293-012-0094-y 10.1007/s12293-012-0094-ySearch in Google Scholar

[14] al-Rifaie MM, Bishop M, Caines S (2012) Creativity and autonomy in swarm intelligence systems. In: J. Cognitive Computation, vol 4, Springer-Verlag, pp 320–331, , URL http://dx.doi.org/10. 1007/s12559-012-9130-y 10.1007/s12559-012-9130-ySearch in Google Scholar

[15] al-Rifaie MM, Aber A, Oudah AM (2013) Ants intelligence framework; identifying traces of cancer. In The House of Commons, UK Parliment. SET for BRITAIN 2013. Poster exhibitions in Biological and Biomedical Science Search in Google Scholar

[16] Aleksander I, Stonham T (1979) Computers and digital techniques 2(1). Lect Notes Art Int 1562 pp 29–40 Search in Google Scholar

[17] Ashby W (1960) Design for a Brain. Chapman and Hall London 10.1007/978-94-015-1320-3Search in Google Scholar

[18] Back T (1996) Evolutionary Algorithms in Theory and Practice. New York: Oxford University Press 10.1093/oso/9780195099713.003.0007Search in Google Scholar

[19] Beattie P, Bishop J (1998) Self-localisation in the senario autonomous wheelchair. Journal of Intellingent and Robotic Systems 22:255–267 10.1023/A:1008033229660Search in Google Scholar

[20] el Beltagy MA, Keane AJ (2001) Evolutionary optimization for computationally expensive problems using gaussian processes. In: Proc. Int. Conf. on Artificial Intelligence’01, CSREA Press, pp 708–714 Search in Google Scholar

[21] Birchfield S (1998) Elliptical head tracking using intensity gradients and color histograms. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Citeseer, pp 232–237 10.1109/CVPR.1998.698614Search in Google Scholar

[22] Bishop J (1989) Anarchic techniques for pattern classification. PhD thesis, University of Reading, Reading, UK Search in Google Scholar

[23] Bishop J (1989) Stochastic searching networks. Proc. 1st IEE Conf. on Artificial Neural Networks, London, UK, pp 329–331 Search in Google Scholar

[24] Bishop J (2003) Coupled stochastic diffusion processes. In: Proc. School Conference for Annual Research Projects (SCARP), Reading, UK, pp 185–187 Search in Google Scholar

[25] Bishop J, Torr P (1992) The stochastic search network. In: Neural Networks for Images, Speech and Natural Language, Chapman & Hall, New York, pp 370–387 10.1007/978-94-011-2360-0_24Search in Google Scholar

[26] Bishop M, de Meyer K, Nasuto S (2002) Recruiting robots perform stochastic diffusion search. School Conference for Annual Research Projects (SCARP) Search in Google Scholar

[27] Bonabeau E, Dorigo M, Theraulaz G (1999) Swarm intelligence: from natural to artificial systems. Oxford University Press, USA 10.1093/oso/9780195131581.001.0001Search in Google Scholar

[28] Bonabeau E, Dorigo M, Theraulaz G (2000) Inspiration for optimization from social insect behaviour. Nature 406:3942 10.1038/35017500Search in Google Scholar

[29] Branke J, Schmidt C, Schmeck H (2001) Efficient fitness estimation in noisy environments. In Spector, L, ed: Genetic and Evolutionary Computation Conference, Morgan Kaufmann 10.1007/978-1-4615-0911-0_2Search in Google Scholar

[30] Browne C (2000) Hex Strategy: Making the right connections. AK Peters Wellesley Search in Google Scholar

[31] Cant R, Langensiepen C (2009) Methods for Automated Object Placement in Virtual Scenes. In: UKSim 2009: 11th International Conference on Computer Modelling and Simulation, IEEE, pp 431–436 10.1109/UKSIM.2009.69Search in Google Scholar

[32] Chadab R, Rettenmeyer C (1975) Mass recruitment by army ants. Science 188:1124–1125 10.1126/science.1215991Search in Google Scholar

[33] Christensen S, Oppacher F (2001) What can we learn from no free lunch? a first attempt to characterize the concept of a searchable function. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp 1219–1226 Search in Google Scholar

[34] Clerc M (2010) From theory to practice in particle swarm optimization. Handbook of Swarm Intelligence pp 3–36 Search in Google Scholar

[35] Coulter D, Ehlers E (2011) Cellular automata and immunity amplified stochastic diffusion search. In: Advances in Practical Multi- Agent Systems, Springer, pp 21–32 Search in Google Scholar

[36] Deneubourg J, Pasteels J, Verhaeghe J (1983) Probabilistic behaviour in ants: a strategy of errors? In: Journal of Theoretical Biology, Elsevier, vol 105, pp 259–271 10.1016/S0022-5193(83)80007-1Search in Google Scholar

[37] Digalakis J, Margaritis K (2002) An experimental study of benchmarking functions for evolutionary algorithms. International Journal 79:403–416 Search in Google Scholar

[38] Dorigo M (1992) Optimization, learning and natural algorithms. PhD thesis, Milano: Politecnico di Italy Search in Google Scholar

[39] Dorigo M, Maniezzo V, Colorni A (1991) Positive feedback as a search strategy. Dipartimento di Elettronica e Informatica, Politecnico di Search in Google Scholar

[40] Dorigo M, Caro GD, Gambardella LM (1999) Ant algorithms for discrete optimization. Artificial Life 5(2):137–172 10.1162/106454699568728Search in Google Scholar PubMed

[41] Evans M, Ferryman J (2005) Group stochastic search for object detection and tracking. Advanced Video and Signal Based Surveillance, 2005 AVSS 2005 IEEE Conference Search in Google Scholar

[42] Fan H, Hua Z, Li J, Yuan D (2004) Solving a shortest path problem by ant algorithm. In: Machine Learning and Cybernetics, 2004. Proceedings of 2004 International Conference on, vol 5, pp 3174–3177 vol.5, Search in Google Scholar

[43] Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24(6):381–395 Search in Google Scholar

[44] Fogel DB (1995) Evolutionary Computation: Toward a New Philosophy of Machine Intelligence. IEEE Press, Piscataway, NJ Search in Google Scholar

[45] Glover F, et al (1989) Tabu search-part i. ORSA journal on Computing 1(3):190–206 10.1287/ijoc.1.3.190Search in Google Scholar

[46] Goldberg DE (1989) Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley Longman Publishing Co., Inc. Boston, MA, USA Search in Google Scholar

[47] Goodman LJ, Fisher RC (1991) The Behaviour and Physiology of Bees. CAB International, Oxon, UK Search in Google Scholar

[48] Grech-Cini E (1995) Locating facial features. PhD thesis, University of Reading, Reading, UK Search in Google Scholar

[49] Hernandez-Carrascal A, Nasuto S (2008) A swarm intelligence method for feature tracking in amv derivation. Ninth International Wind Workshop Search in Google Scholar

[50] Hinton GF (1981) A parallel computation that assigns canonical object-based frames of reference. In: Proceedings of the 7th international joint conference on Artificial intelligence-Volume 2, Morgan Kaufmann Publishers Inc., pp 683–685 Search in Google Scholar

[51] Holland JH (1975) Adaptation in natural and artificial systems. Ann Arbor, MI, University of Michigan press Search in Google Scholar

[52] Holldobler B, Wilson EO (1990) The Ants. Springer-Verlag 10.1007/978-3-662-10306-7Search in Google Scholar

[53] Hughes R (2012) Stochastic diffusion search with reinforcement learning. In: Proc. School Conference for Annual Research Projects (SCARP), Reading, UK Search in Google Scholar

[54] Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. In: Soft Computing 9:3–12 10.1007/s00500-003-0328-5Search in Google Scholar

[55] Jin Y, Branke J (2005) Evolutionary optimization in uncertain environments-a survey. Evolutionary Computation, IEEE Transactions on 9(3):303–317 10.1109/TEVC.2005.846356Search in Google Scholar

[56] Jones D (2002) Constrained stochastic diffusion search. Proc School Conference for Annual Research Projects (SCARP) 2002, Reading, UK Search in Google Scholar

[57] Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the IEEE International Conference on Neural Networks, IEEE Service Center, Piscataway, NJ, vol IV, pp 1942–1948 10.1109/ICNN.1995.488968Search in Google Scholar

[58] Kemeny, J.G. & Snell, J.L., (1976), Finite Markov Chains, New York: Springer-Verlag. Search in Google Scholar

[59] Kennedy JF, Eberhart RC, Shi Y (2001) Swarm intelligence. Morgan Kaufmann Publishers, San Francisco ; London Search in Google Scholar

[60] Kirkpatric S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science 220(4598):671–680 10.1126/science.220.4598.671Search in Google Scholar PubMed

[61] Knuth DE (1973) The art of computer programming. Vol. 3, Sorting and Searching. Addison-Wesley Reading, MA Search in Google Scholar

[62] Krieger MJ, Billeter JB, Keller L (2000) Ant-like task allocation and recruitment in cooperative robots. Nature 406(6799):992–5 10.1038/35023164Search in Google Scholar PubMed

[63] Levins R (1969) Some demographic and genetic consequences of environmental heterogeneity for biological control. Bulletin of the ESA 15(3):237–240 10.1093/besa/15.3.237Search in Google Scholar

[64] Li SW, Zhang J (2012) Cellular sds algorithm for the rectilinear steiner minimum tree. In: Digital Manufacturing and Automation (ICDMA), 2012 Third International Conference on, IEEE, pp 272–276 Search in Google Scholar

[65] Liu Y, Ma L (2011) Stochastic diffusion search algorithm for quadratic knapsack problem. Control Theory & Applications 28(8):1140–1144 Search in Google Scholar

[66] McClelland JL, Rumelhart DE, Group PR, et al (1986) Parallel distributed processing. Explorations in the microstructure of cognition 2 10.7551/mitpress/5236.001.0001Search in Google Scholar

[67] de Meyer K (2000) Explorations in stochastic diffusion search: Soft- and hardware implementations of biologically inspired spiking neuron stochastic diffusion networks. Tech. Rep. KDM/ JMB/2000/1, University of Reading Search in Google Scholar

[68] de Meyer K (2000) Explorations in stochastic diffusion search: Soft-and hardware implementations of biologically inspired spiking neuron stochastic diffusion networks. Tech. rep., Technical Report KDM/JMB/2000 Search in Google Scholar

[69] de Meyer K (2003) Foundations of stochastic diffusion search. PhD thesis, PhD thesis, University of Reading, Reading, UK Search in Google Scholar

[70] de Meyer K, Bishop M, Nasuto S (2002) Small world effects in lattice stochastic diffusion search. In: Proc. ICANN 2002, Lecture Notes in Computer Science, 2415, Madrid, Spain, pp 147–152 10.1007/3-540-46084-5_25Search in Google Scholar

[71] de Meyer K, Bishop JM, Nasuto SJ (2003) Stochastic diffusion: Using recruitment for search. Evolvability and interaction: evolutionary substrates of communication, signalling, and perception in the dynamics of social complexity (ed P McOwan, K Dautenhahn & CL Nehaniv) Technical Report 393:60–65 Search in Google Scholar

[72] de Meyer K, Nasuto S, Bishop J (2006) Stochastic diffusion optimisation: the application of partial function evaluation and stochastic recruitment in swarm intelligence optimisation. Springer Verlag 2, Chapter 12 in Abraham, A. and Grosam, C. and Ramos, V. (eds), ”Swarm intelligence and data mining” Search in Google Scholar

[73] Miller MB, Bassler BL (2001) Quorum sensing in bacteria. Annual Reviews in Microbiology 55(1):165–199 Search in Google Scholar

[74] Mitchell M (1996) An introduction to genetic algorithms, 1996. MIT press Search in Google Scholar

[75] Moglich M, Maschwitz U, Holldobler B (1974) Tandem calling: A new kind of signal in ant communication. Science 186(4168):1046–1047 10.1126/science.186.4168.1046Search in Google Scholar

[76] Morciniec M, Rohwer R (1995) The n-tuple classifier: Too good to ignore. Tech. Rep. Technical Report NCRG/95/013 Search in Google Scholar

[77] Myatt D, Bishop J (2003) Data driven stochastic diffusion networks for robust high-dimensionality manifold estimation - more fun than you can shake a hyperplane at. In: Proc. School Conference for Annual Research Projects (SCARP), Reading, UK Search in Google Scholar

[78] Myatt D, Nasuto S, Bishop J (2006) Alternative recruitment strategies for stochastic diffusion search. Artificial Life X, Bloomington USA Search in Google Scholar

[79] Myatt DR, Bishop JM, Nasuto SJ (2004) Minimum stable convergence criteria for stochastic diffusion search. Electronics Letters 40(2):112–113 10.1049/el:20040096Search in Google Scholar

[80] Nasuto S, Bishop M (2007) Stabilizing swarm intelligence search via positive feedback resource allocation. In: Nature Inspired Cooperative Strategies for Optimization (NICSO), Springer Search in Google Scholar

[81] Nasuto SJ (1999) Resource allocation analysis of the stochastic diffusion search. PhD thesis, University of Reading, Reading, UK Search in Google Scholar

[82] Nasuto SJ, Bishop JM (1999) Convergence analysis of stochastic diffusion search. Parallel Algorithms and Applications 14(2) 10.1080/10637199808947380Search in Google Scholar

[83] Nasuto SJ, Bishop MJ (2002) Steady state resource allocation analysis of the stochastic diffusion search. Arxiv preprint cs/0202007 Search in Google Scholar

[84] Nasuto SJ, Bishop JM, Lauria S (1998) Time complexity analysis of stochastic diffusion search. Neural Computation NC98 Search in Google Scholar

[85] Nasuto SJ, Dautenhahn K, Bishop J (1999) Communication as an emergent methaphor for neuronal operation. Lect Notes Art Int 1562 pp 365–380 Search in Google Scholar

[86] Nircan A (2006) Stochastic diffusion search and voting methods. PhD thesis, Bogaziki University Search in Google Scholar

[87] Omran M, Moukadem I, al-Sharhan S, Kinawi M (2011) Stochastic diffusion search for continuous global optimization. International Conference on Swarm Intelligence (ICSI 2011), Cergy, France Search in Google Scholar

[88] Omran MG, Salman A (2012) Probabilistic stochastic diffusion search. In: Swarm Intelligence, Springer, pp 300–307 Search in Google Scholar

[89] Rubinstein RY, Kroese DP (2004) The cross-entropy method: a unified approach to combinatorial optimization, Monte-Carlo simulation and machine learning. Springer Verlag Search in Google Scholar

[90] Salamanos N, Lopatatzidis S, Vazirgiannis M, Thomas A (2010) Advertising network formation based on stochastic diffusion search and market equilibria. In: Proceedings of the 28th ACM International Conference on Design of Communication, ACM, pp 81–87 10.1145/1878450.1878464Search in Google Scholar

[91] Saxe JG, Lathen D, Chief B (1882) The Blind Man and the Elephant. The Poems of John Godfrey Saxe Search in Google Scholar

[92] Seeley TD (1995) The Wisdom of the Hive. Harvard University Press 10.4159/9780674043404Search in Google Scholar

[93] Storn R, Price K (1997) Differential evolution - a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11:341–359 10.1023/A:1008202821328Search in Google Scholar

[94] Summers R (1998) Stochastic diffusion search: A basis for a model of visual attention? Search in Google Scholar

[95] Tanay T, Bishop J, Nasuto S, Roesch E, Spencer M (2013) Stochastic diffusion search applied to trees: a swarm intelligence heuristic performing monte-carlo tree search. In: Proc AISB 2013, University of Exeter, UK Search in Google Scholar

[96] Tompa M (2000) Lecture notes on biological sequence analysis. Dept of Comp Sci and Eng, University of Washington, Seattle, Technical report Search in Google Scholar

[97] Whitaker R, Hurley S (2002) An agent based approach to site selection for wireless networks. In: 1st IEE Conf. on Artificial Neural Networks, ACM Press Proc ACM Symposium on Applied Computing, Madrid Spain 10.1145/508791.508902Search in Google Scholar

[98] Whitley D, Rana S, Dzubera J, Mathias KE (1996) Evaluating evolutionary algorithms. Artificial Intelligence 85(1-2):245–27610.1016/0004-3702(95)00124-7Search in Google Scholar

Published Online: 2013-12-27
Published in Print: 2013-12-27

This content is open access.

Downloaded on 23.4.2024 from https://www.degruyter.com/document/doi/10.2478/pjbr-2013-0021/html
Scroll to top button