Extraction of unknown signals in arbitrary noise

Glenn Ierley and Alex Kostinski
Phys. Rev. E 103, 022130 – Published 18 February 2021

Abstract

We devise a general method to extract weak signals of unknown form, buried in noise of arbitrary distribution. Central to it is signal-noise decomposition in rank and time: only stationary white noise generates data with a jointly uniform rank-time probability distribution, U(1,N)×U(1,N), for N points in a data sequence. We show that rank, averaged across jointly indexed series of noisy data, tracks the underlying weak signal via a simple relation, for all noise distributions. We derive an exact analytic, distribution-independent form for the discrete covariance matrix of cumulative distributions for independent and identically distributed noise and employ its eigenfunctions to extract unknown signals from single time series.

  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Received 22 October 2020
  • Accepted 29 January 2021

DOI:https://doi.org/10.1103/PhysRevE.103.022130

©2021 American Physical Society

Physics Subject Headings (PhySH)

Statistical Physics & Thermodynamics

Authors & Affiliations

Glenn Ierley*

  • Department of Mathematical Sciences, Michigan Technological University 1400 Townsend Drive, Houghton, Michigan 49931, USA and Scripps Institution of Oceanography, UC San Diego, 9500 Gilman Drive, La Jolla, California 92093-0225, USA

Alex Kostinski

  • Department of Physics, Michigan Technological University 1400 Townsend Drive, Houghton, Michigan 49931, USA

  • *Emeritus, Scripps Institution of Oceanography; grierley@ucsd.edu
  • kostinsk@mtu.edu

Article Text (Subscription Required)

Click to Expand

References (Subscription Required)

Click to Expand
Issue

Vol. 103, Iss. 2 — February 2021

Reuse & Permissions
Access Options
CHORUS

Article Available via CHORUS

Download Accepted Manuscript
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review E

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×