An asynchronous parallel approach to sparse recovery

Abstract

Asynchronous parallel computing and sparse recovery are two areas that have received recent interest. Asynchronous algorithms are often studied to solve optimization problems where the cost function takes the form Σi=1^Mƒi(x), with a common assumption that each ƒi is sparse; that is, each ƒi acts only on a small number of components of x ∈ ℝⁿ. Sparse recovery problems, such as compressed sensing, can be formulated as optimization problems, however, the cost functions ƒi are dense with respect to the components of x, and instead the signal x is assumed to be sparse, meaning that it has only s non-zeros where s ≪ n. Here we address how one may use an asynchronous parallel architecture when the cost functions ƒi are not sparse in x, but rather the signal x is sparse. We propose an asynchronous parallel approach to sparse recovery via a stochastic greedy algorithm, where multiple processors asynchronously update a vector in shared memory containing information on the estimated signal support. We include numerical simulations that illustrate the potential benefits of our proposed asynchronous method.