Robust stochastic resonance for simple threshold neurons

Bart Kosko and Sanya Mitaim
Phys. Rev. E 70, 031911 – Published 27 September 2004

Abstract

Simulation and theoretical results show that memoryless threshold neurons benefit from small amounts of almost all types of additive noise and so produce the stochastic-resonance or SR effect. Input-output mutual information measures the performance of such threshold systems that use subthreshold signals. The SR result holds for all possible noise probability density functions with finite variance. The only constraint is that the noise mean must fall outside a “forbidden” threshold-related interval that the user can control—a new theorem shows that this condition is also necessary. A corollary and simulations show that the SR effect occurs for right-sided beta and Weibull noise as well. These SR results further hold for the entire uncountably infinite class of alpha-stable probability density functions. Alpha-stable noise densities have infinite variance and infinite higher-order moments and often model impulsive noise environments. The stable noise densities include the special case of symmetric bell-curve densities with thick tails such as the Cauchy probability density. The SR result for alpha-stable noise densities shows that the SR effect in threshold and thresholdlike systems is robust against occasional or even frequent violent fluctuations in noise. Regression analysis reveals both an exponential relationship for the optimal noise dispersion as a function of the alpha bell-curve tail thickness and an approximate linear relationship for the SR-maximal mutual information as a function of the alpha bell-curve tail thickness.

  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
1 More
  • Received 27 January 2003

DOI:https://doi.org/10.1103/PhysRevE.70.031911

©2004 American Physical Society

Authors & Affiliations

Bart Kosko1 and Sanya Mitaim2

  • 1Department of Electrical Engineering, Signal and Image Processing Institute, University of Southern California, Los Angeles, California 90089-2564, USA
  • 2Department of Electrical Engineering, Faculty of Engineering, Thammasat University, Pathumthani 12120, Thailand

Article Text (Subscription Required)

Click to Expand

References (Subscription Required)

Click to Expand
Issue

Vol. 70, Iss. 3 — September 2004

Reuse & Permissions
Access Options
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review E

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×