Elsevier

Signal Processing

Volume 120, March 2016, Pages 236-248
Signal Processing

Sparsity-based correction of exponential artifacts

https://doi.org/10.1016/j.sigpro.2015.09.017Get rights and content

Highlights

  • We proposed a method to suppress piecewise exponential transient.

  • We proposed a method to suppress smooth protuberance transient.

  • We give mathematical proof of quadratic majorizer of smoothed penalty functions.

Abstract

This paper describes an exponential transient excision algorithm (ETEA). In biomedical time series analysis, e.g., in vivo neural recording and electrocorticography (ECoG), some measurement artifacts take the form of piecewise exponential transients. The proposed method is formulated as an unconstrained convex optimization problem, regularized by smoothed ℓ1-norm penalty function, which can be solved by majorization–minimization (MM) method. With a slight modification of the regularizer, ETEA can also suppress more irregular piecewise smooth artifacts, especially, ocular artifacts (OA) in electroencephalography (EEG) data. Examples of synthetic signal, EEG data, and ECoG data are presented to illustrate the proposed algorithms.

Introduction

This work is motivated by the problem of suppressing various types of artifacts in recordings of neural activity. In a recent study [25], typical artifacts in in vivo neural recordings are classified into four types (Type 0–3, see Section 2.2 and Figure 3 in [25]). This classification covers many artifacts in the scope of human brain activity recordings, e.g., electroencephalography (EEG) and electrocorticography (ECoG). In this paper, we consider the suppression of Type 0 and Type 1 artifacts. For the purpose of flexibility and generality, we redefine them in terms of morphological characteristics:

  • Type 0: a smooth protuberance that can be modeled as x^(t)=teαt, when tt0.

  • Type 1: an abrupt jump followed by an exponential decay that can be modeled as x^(t)=eαt, when tt0.

Fig. 1 shows examples of the two types of artifacts.We do not consider the other two types in this work because our previous works have addressed efficient algorithms to remove such artifacts. For instance, low-pass filtering/total variation denoising (LPF/TVD) [61] suppresses Type 2 artifacts (Fig. 1(c)), and lowpass filtering/compound sparse denoising (LPF/CSD) [60], [61] can remove sparse and blocky spikes (Type 3 shown in Fig. 1(d)).

The approach proposed in this paper is based on an optimization problem intended to capture the primary morphological characteristics of the artifacts using sparsity-inducing regularization. To formulate the problem, we model the observed time series asy(t)=f(t)+x(t)+w(t),where f is a lowpass signal, x is a piecewise smooth transient signal (i.e., Type 0 or Type 1 artifacts), and w is stationary white Gaussian noise. More specifically, f is assumed to be restricted to a certain range of low frequencies. In other words, H(f)0, where H is a high-pass filter. Note that in the signal model (1), conventional LTI filtering is not suitable to estimate either f or x from y, because component x, as a piecewise smooth signal comprised of transients, is not band limited.

In order to estimate the components, we combine LTI filtering with sparsity-based techniques. We formulate an optimization problem for both decomposition and denoising. A computationally efficient algorithm is derived to solve the optimization problem, based on the theory of majorization–minimization (MM) [15], [24], [36].

In addition, this paper specifies how to generate a smoothed penalty function and its majorizer from a non-smooth one, in order to overcome a numerical issue that arises when the penalty function is not differentiable.

Some recent works recover signals with transients by various algorithms. In [19], a slowly varying signal is modeled as a local polynomial and an optimization problem using Tikhonov regularization is formulated to capture it. In [47], the slowly varying trend is modeled as a higher-order sparse-derivative signal (e.g., the third-order derivative is sparse).

Instead of estimating the slowly varying component via regularization, the LPF/TVD method [61] estimates a lowpass component by LTI filtering and a piecewise constant component by optimization. In this case, an optimization problem is formulated to estimate the piecewise constant component. The approach proposed here uses a similar technique to recover the lowpass component, but in contrast to LPF/TVD, it is more general—the regularization is more flexible with a tunable parameter, so that LPF/TVD can be considered as a special case.

Another algorithm related to the approach taken in this paper is the transient artifact reduction algorithm (TARA) [60] which is utilized to suppress additive piecewise constant artifacts and spikes (similar to a hybrid of Type 2 and Type 3 artifacts). The approaches proposed in this work target different types of artifacts (Type 0 and Type 1) and applied in different applications.

The irregularity of Type 0 transients leads to a more complicated artifact removal problem, where the artifact are irregular fluctuations. A typical example in EEG is ocular artifacts (OA) caused by the blink and/or movement of eyes. To suppress OA, there are approaches based on empirical mode decomposition (EMD) [41], [42], [43], [69], and on independent component analysis (ICA) methods [1], [12], [20], [26], [37], [48]. The concept of spatial-frequency in acoustic analysis is also used to remove OA from multichannel signals [44], [64]. In this work, we present a new method to suppress ocular artifacts by proposing a specific model and using sparse optimization.

This paper adopts a regularizer inspired by the generalized 1-D total variation [27], wherein the derivative operator in conventional total variation regularizer is generalized to a recursive filter. The regularizers adopted in ETEA and second-order ETEA coincide with first-order and second-order cases of generalized 1-D total variation, respectively. Some differences to the problem discussed in [27] are as follows. Firstly, the signal model (1) allows a lowpass baseline as a component, hence, ETEA can be seen as a combination of conventional LTI filtering and generalized 1-D total variation. Secondly, we consider a formulation in terms of banded matrices, for computational efficiency. Thirdly, we give optimality conditions of the proposed problems, and use these conditions as a guide to set the regularization parameters.

Section snippets

Notation

We use bold uppercase letters for matrices, e.g., A and B, and bold lowercase letters for vectors, e.g., x and y. We use column vectors for one-dimensional series. For example, a vector xRN is written asx=[x(0),x(1),,x(N1)]Twhere [·]T denotes matrix transpose. The ℓ1-norm and squared ℓ2-norm of x are defined asx1n|x(n)|,x22nx2(n).The inverse transpose of a matrix is denoted as AT. The first-order difference operator D of size (N1)×N isD[111111].We use f(x;a) to denote a

Majorization of smoothed penalty function

When using sparse-regularized optimization to recover a signal, the ℓ1-norm is widely utilized. To further enhance sparsity, some methods use iteratively re-weighting procedures [4], [34], [45], [63], or a non-convex pseudo ℓp-norm (0<p<1), or a mixed-norm in the regularizer [5], [68], [66], [58], [33]. Other non-convex penalty functions can also be used. In [46] a logarithm penalty function is discussed (‘log’ function in Table 1), and in [59], an arctangent function is used (‘atan’ function

Exponential transient excision algorithm

To formulate the problem of exponential transient excision, we define R asR[r1r1r1].

The first-order derivative operator D is a special case of R with r=1. In this paper we restrict 0<r<1 to distinguish them. As a filter, R can be seen to be a first-order filter attenuating low frequencies, with a transfer functionR(z)1rz1.Driving the system R(z) with the step exponentialx(n)={0,n<n0,rnn0,nn0,produces an impulse δ(nn0) as an output. If input signal x is a step exponential with rate r

Higher-order ETEA

In the previous section, we have presented ETEA based on signal model (1), suitable for Type 1 artifacts, where the component x has discontinuous step exponential transients. Here we illustrate another version of ETEA based on signal model (1), where the component x models Type 0 artifacts.

First, we consider the operatorR2[r22r1r22r1r22r1],where R2R(N2)×N has three non-zero coefficients in each row. As a special case, when r=1, R2 is the second-order difference operator, and R2x1 is

Conclusion

This paper proposes a new algorithm for denoising and artifact removal for signals comprising artifacts arising in measured data, e.g., neural time-series recordings, using sparse optimization. The first algorithm, ETEA, assumes that the signal is composed of a lowpass signal and an exponential transients (Type 1). It is formulated as an optimization problem regularized by differentiable and smooth penalty function. The second algorithm is an extension of ETEA, using a higher-order recursive

Acknowledgments

The authors would like to thank Jonathan Viventi of the Department of Biomedical Engineering of Duke University, and Justin Blanco of the Electrical and Computer Engineering Department of United States Naval Academy, for providing the data and giving useful comments.

References (69)

  • X. Ning et al.

    ECG enhancement and QRS detection based on sparse derivatives

    Biomed. Signal Process. Control

    (2013)
  • A. Omidvarnia et al.

    A time-frequency based approach for generalized phase synchrony assessment in nonstationary multivariate signals

    Digit. Signal Process.

    (2013)
  • H. Sato et al.

    Wavelet analysis for detecting body-movement artifacts in optical topography signals

    NeuroImage

    (2006)
  • B. Tang et al.

    Method for eliminating mode mixing of empirical mode decomposition based on the revised blind source separation

    Signal Process.

    (2012)
  • X. Xie

    Illumination preprocessing for face images based on empirical mode decomposition

    Signal Process.

    (2014)
  • J. Yan et al.

    Improved Hilbert–Huang transform based weak signal detection methodology and its application on incipient fault diagnosis and ECG signal analysis

    Signal Process.

    (2014)
  • S. Yu et al.

    Compressed sensing of complex-valued data

    Signal Process.

    (2012)
  • F. Bach et al.

    Optimization with sparsity-inducing penalties

    Found. Trends Mach. Learn.

    (2012)
  • A. Beck et al.

    A fast iterative shrinkage-thresholding algorithm for linear inverse problems

    SIAM J. Imag. Sci.

    (2009)
  • E.J. Candès et al.

    Enhancing sparsity by reweighted l1 minimization

    J. Fourier Anal. Appl.

    (2008)
  • M. Cetin et al.

    Feature-enhanced synthetic aperture radar image formation based on nonquadratic regularization

    IEEE Trans. Image Process.

    (2001)
  • A. Chambolle et al.

    Nonlinear wavelet image processingvariational problems, compression, and noise removal through wavelet shrinkage

    IEEE Trans. Image Process.

    (1998)
  • A. Chambolle, V.R. Dossal, On the convergence of the iterates of FISTA, hal-01060130, September 2014,...
  • H.-C. Chang et al.

    Inter-trial analysis of post-movement beta activities in EEG signals using multivariate empirical mode decomposition

    IEEE Trans. Neural Syst. Rehabil. Eng.

    (2013)
  • P.-Y. Chen et al.

    Group-sparse signal denoisingnon-convex regularization, convex optimization

    IEEE Trans. Signal Process.

    (2014)
  • R.R. Coifman, D.L. Donoho, Translation-invariant denoising, in: A. Antoniadis (Ed.), Lecture Notes in Wavelets and...
  • J. Dammers et al.

    Integration of amplitude and phase statistics for complete artifact removal in independent components of neuromagnetic recordings

    IEEE Trans. Biomed. Eng.

    (2008)
  • S. Durand, J. Froment, Artifact free signal denoising with wavelets, in: Proceedings of ICASSP,...
  • S. Durand et al.

    Reconstruction of wavelet coefficients using total variation minimization

    SIAM J. Sci. Comput.

    (2003)
  • M. Figueiredo et al.

    Majorization–minimization algorithms for wavelet-based image restoration

    IEEE Trans. Image Process.

    (2007)
  • J.-J. Fuchs

    On sparse representations in arbitrary redundant bases

    IEEE Trans. Inf. Theory

    (2004)
  • H. Gao

    Wavelet shrinkage denoising using the non-negative garrote

    J. Comput. Graph. Stat.

    (1998)
  • C. Guerrero-Mosquera et al.

    Automatic removal of ocular artifacts using adaptive filtering and independent component analysis for electroencephalogram data

    IET Signal Process.

    (2012)
  • N.E. Huang, Z. Shen, S.R. Long, M.C. Wu, H.H. Shih, Q. Zheng, N.C. Yen, C.C. Tung, H.H. Liu, The empirical mode...
  • Cited by (0)

    View full text