Sparsity-based correction of exponential artifacts
Introduction
This work is motivated by the problem of suppressing various types of artifacts in recordings of neural activity. In a recent study [25], typical artifacts in in vivo neural recordings are classified into four types (Type 0–3, see Section 2.2 and Figure 3 in [25]). This classification covers many artifacts in the scope of human brain activity recordings, e.g., electroencephalography (EEG) and electrocorticography (ECoG). In this paper, we consider the suppression of Type 0 and Type 1 artifacts. For the purpose of flexibility and generality, we redefine them in terms of morphological characteristics:
- •
Type 0: a smooth protuberance that can be modeled as , when .
- •
Type 1: an abrupt jump followed by an exponential decay that can be modeled as , when .
The approach proposed in this paper is based on an optimization problem intended to capture the primary morphological characteristics of the artifacts using sparsity-inducing regularization. To formulate the problem, we model the observed time series aswhere f is a lowpass signal, x is a piecewise smooth transient signal (i.e., Type 0 or Type 1 artifacts), and w is stationary white Gaussian noise. More specifically, f is assumed to be restricted to a certain range of low frequencies. In other words, , where H is a high-pass filter. Note that in the signal model (1), conventional LTI filtering is not suitable to estimate either f or x from y, because component x, as a piecewise smooth signal comprised of transients, is not band limited.
In order to estimate the components, we combine LTI filtering with sparsity-based techniques. We formulate an optimization problem for both decomposition and denoising. A computationally efficient algorithm is derived to solve the optimization problem, based on the theory of majorization–minimization (MM) [15], [24], [36].
In addition, this paper specifies how to generate a smoothed penalty function and its majorizer from a non-smooth one, in order to overcome a numerical issue that arises when the penalty function is not differentiable.
Some recent works recover signals with transients by various algorithms. In [19], a slowly varying signal is modeled as a local polynomial and an optimization problem using Tikhonov regularization is formulated to capture it. In [47], the slowly varying trend is modeled as a higher-order sparse-derivative signal (e.g., the third-order derivative is sparse).
Instead of estimating the slowly varying component via regularization, the method [61] estimates a lowpass component by LTI filtering and a piecewise constant component by optimization. In this case, an optimization problem is formulated to estimate the piecewise constant component. The approach proposed here uses a similar technique to recover the lowpass component, but in contrast to , it is more general—the regularization is more flexible with a tunable parameter, so that can be considered as a special case.
Another algorithm related to the approach taken in this paper is the transient artifact reduction algorithm (TARA) [60] which is utilized to suppress additive piecewise constant artifacts and spikes (similar to a hybrid of Type 2 and Type 3 artifacts). The approaches proposed in this work target different types of artifacts (Type 0 and Type 1) and applied in different applications.
The irregularity of Type 0 transients leads to a more complicated artifact removal problem, where the artifact are irregular fluctuations. A typical example in EEG is ocular artifacts (OA) caused by the blink and/or movement of eyes. To suppress OA, there are approaches based on empirical mode decomposition (EMD) [41], [42], [43], [69], and on independent component analysis (ICA) methods [1], [12], [20], [26], [37], [48]. The concept of spatial-frequency in acoustic analysis is also used to remove OA from multichannel signals [44], [64]. In this work, we present a new method to suppress ocular artifacts by proposing a specific model and using sparse optimization.
This paper adopts a regularizer inspired by the generalized 1-D total variation [27], wherein the derivative operator in conventional total variation regularizer is generalized to a recursive filter. The regularizers adopted in and second-order coincide with first-order and second-order cases of generalized 1-D total variation, respectively. Some differences to the problem discussed in [27] are as follows. Firstly, the signal model (1) allows a lowpass baseline as a component, hence, can be seen as a combination of conventional LTI filtering and generalized 1-D total variation. Secondly, we consider a formulation in terms of banded matrices, for computational efficiency. Thirdly, we give optimality conditions of the proposed problems, and use these conditions as a guide to set the regularization parameters.
Section snippets
Notation
We use bold uppercase letters for matrices, e.g., A and B, and bold lowercase letters for vectors, e.g., x and y. We use column vectors for one-dimensional series. For example, a vector is written aswhere denotes matrix transpose. The ℓ1-norm and squared ℓ2-norm of x are defined asThe inverse transpose of a matrix is denoted as . The first-order difference operator D of size isWe use to denote a
Majorization of smoothed penalty function
When using sparse-regularized optimization to recover a signal, the ℓ1-norm is widely utilized. To further enhance sparsity, some methods use iteratively re-weighting procedures [4], [34], [45], [63], or a non-convex pseudo ℓp-norm , or a mixed-norm in the regularizer [5], [68], [66], [58], [33]. Other non-convex penalty functions can also be used. In [46] a logarithm penalty function is discussed (‘log’ function in Table 1), and in [59], an arctangent function is used (‘atan’ function
Exponential transient excision algorithm
To formulate the problem of exponential transient excision, we define R as
The first-order derivative operator D is a special case of R with r=1. In this paper we restrict to distinguish them. As a filter, R can be seen to be a first-order filter attenuating low frequencies, with a transfer functionDriving the system with the step exponentialproduces an impulse as an output. If input signal x is a step exponential with rate r
Higher-order ETEA
In the previous section, we have presented based on signal model (1), suitable for Type 1 artifacts, where the component x has discontinuous step exponential transients. Here we illustrate another version of based on signal model (1), where the component x models Type 0 artifacts.
First, we consider the operatorwhere has three non-zero coefficients in each row. As a special case, when r=1, R2 is the second-order difference operator, and is
Conclusion
This paper proposes a new algorithm for denoising and artifact removal for signals comprising artifacts arising in measured data, e.g., neural time-series recordings, using sparse optimization. The first algorithm, , assumes that the signal is composed of a lowpass signal and an exponential transients (Type 1). It is formulated as an optimization problem regularized by differentiable and smooth penalty function. The second algorithm is an extension of , using a higher-order recursive
Acknowledgments
The authors would like to thank Jonathan Viventi of the Department of Biomedical Engineering of Duke University, and Justin Blanco of the Electrical and Computer Engineering Department of United States Naval Academy, for providing the data and giving useful comments.
References (69)
- et al.
Employing spatially constrained ICA and wavelet denoising, for automatic removal of artifacts from multichannel EEG data
Signal Process.
(2012) - et al.
Using empirical mode decomposition for iris recognition
Comput. Stand. Interfaces
(2009) - et al.
Multivariate empirical mode decomposition and application to multichannel filtering
Signal Process.
(2011) - et al.
A balanced combination of Tikhonov and total variation regularizations for reconstruction of piecewise-smooth signals
Signal Process.
(2013) - et al.
Speech pitch determination based on Hilbert–Huang transform
Signal Process.
(2006) - et al.
Artifact characterization and removal for in vivo neural recording
J. Neurosci. Methods
(2014) Explicit formula for the inverse of a tridiagonal matrix by backward continued fractions
Appl. Math. Comput.
(2008)- et al.
The inverse of banded matrices
J. Comput. Appl. Math.
(2013) Sparse regression using mixed norms
Appl. Comput. Harmonic Anal.
(2009)- et al.
Artifact suppression from EEG signals using data adaptive time domain filtering
Neurocomputing
(2012)