Efficient convolutional sparse coding

Title: Efficient convolutional sparse coding

Computationally efficient algorithms may be applied for fast dictionary learning solving the convolutional sparse coding problem in the Fourier domain. More specifically, efficient convolutional sparse coding may be derived within an alternating direction method of multipliers (ADMM) framework that utilizes fast Fourier transforms (FFT) to solve the main linear system in the frequency domain. Such algorithms may enable a significant reduction in computational cost over conventional approaches by implementing a linear solver for the most critical and computationally expensive component of the conventional iterative algorithm. The theoretical computational cost of the algorithm may be reduced from O(M.sup.3N) to O(MN log N), where N is the dimensionality of the data and M is the number of elements in the dictionary. This significant improvement in efficiency may greatly increase the range of problems that can practically be addressed via convolutional sparse representations.

Inventors:: Wohlberg, Brendt

Issue Date:: 2017-06-20

OSTI Identifier:: 1364429

Assignee:: Los Alamos National Security, LLC LANL

Patent Number(s):: 9,684,951

Application Number:: 14/668,900

Contract Number:: AC52-06NA25396

Resource Relation:: Patent File Date: 2015 Mar 25

Research Org:: Los Alamos National Lab. (LANL), Los Alamos, NM (United States)

Sponsoring Org:: USDOE

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING

Full Text
View Full Text

Other works cited in this record:

System and method for audio data compression and decompression using discrete wavelet transform (DWT)
patent, March 2007

Huang, Gen Dow; Hsu, Charles
US Patent Document 7,196,641
URL: http://patft.uspto.gov/netacgi/nph-Parser?Sect2=PTO1&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=1&f=G&l=50&d=PALL&RefSrch=yes&Query=PN%2F7196641

Method and apparatus for distributed compressed sensing
patent, September 2007

Baraniuk, Richard G.; Baron, Dror Z.; Duarte, Marco F.
US Patent Document 7,271,747
URL: http://patft.uspto.gov/netacgi/nph-Parser?Sect2=PTO1&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=1&f=G&l=50&d=PALL&RefSrch=yes&Query=PN%2F7271747

Holographic data storage using oversampling and balanced codewords
patent, June 2011

Yoon, Pil-Sang; Kim, Hak-Sun; Hwang, Eui-Seok
US Patent Document 7,970,209
URL: http://patft.uspto.gov/netacgi/nph-Parser?Sect2=PTO1&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=1&f=G&l=50&d=PALL&RefSrch=yes&Query=PN%2F7970209

Systems and methods for resolution-invariant image representation
patent, September 2013

Wang, Jinjun; Zhu, Shenghuo; Gong, Yihong
US Patent Document 8,538,200
URL: http://patft.uspto.gov/netacgi/nph-Parser?Sect2=PTO1&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=1&f=G&l=50&d=PALL&RefSrch=yes&Query=PN%2F8538200

Method for recognizing shapes and system implementing said method
patent, April 2014

Mercier, David; Larue, Anthony
US Patent Document 8,693,765
URL: http://patft.uspto.gov/netacgi/nph-Parser?Sect2=PTO1&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=1&f=G&l=50&d=PALL&RefSrch=yes&Query=PN%2F8693765

Integrated circuit implementation of methods and apparatuses for monitoring occupancy of wideband GHz spectrum, and sensing respective frequency components of time-varying signals using sub-nyquist criterion signal sampling
patent, April 2016

Katabi, Dina; Salehi-Abari, Omid; Hamed, Ezzeldin
US Patent Document 9,313,072
URL: http://patft.uspto.gov/netacgi/nph-Parser?Sect2=PTO1&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=1&f=G&l=50&d=PALL&RefSrch=yes&Query=PN%2F9313072

Dictionary Learning with Large Step Gradient Descent for Sparse Representations
book, January 2012

Mailhé, Boris; Plumbley, Mark D.; Theis, Fabian
Latent Variable Analysis and Signal Separation, p. 231-238
DOI: 10.1007/978-3-642-28551-6_29

Alternating Direction Method with Self-Adaptive Penalty Parameters for Monotone Variational Inequalities
journal, August 2000

He, B. S.; Yang, H.; Wang, S. L.
Journal of Optimization Theory and Applications, Vol. 106, Issue 2, p. 337-356
DOI: 10.1023/A:1004603514434

Similar records in DOepatents and OSTI.GOV collections:

Classification of multispectral or hyperspectral satellite imagery using clustering of sparse approximations on sparse representations in learned dictionaries obtained using efficient convolutional sparse coding

Patent Moody, Daniela ; Wohlberg, Brendt

An approach for land cover classification, seasonal and yearly change detection and monitoring, and identification of changes in man-made features may use a clustering of sparse approximations (CoSA) on sparse representations in learned dictionaries. The learned dictionaries may be derived using efficient convolutional sparse coding to build multispectral or hyperspectral, multiresolution dictionaries that are adapted to regional satellite image data. Sparse image representations of images over the learned dictionaries may be used to perform unsupervised k-means clustering into land cover categories. The clustering process behaves as a classifier in detecting real variability. This approach may combine spectral and spatial texturalmore »« less
Full Text Available January 2018
Using convolutional decoding to improve time delay and phase estimation in digital communications

Patent Ormesher, Richard C ; Mason, John J

The time delay and/or phase of a communication signal received by a digital communication receiver can be estimated based on a convolutional decoding operation that the communication receiver performs on the received communication signal. If the original transmitted communication signal has been spread according to a spreading operation, a corresponding despreading operation can be integrated into the convolutional decoding operation.
Full Text Available January 2010
Method and apparatus for distinguishing actual sparse events from sparse event false alarms

Patent Spalding, Richard E. ; Grotbeck, Carter L.

Remote sensing method and apparatus wherein sparse optical events are distinguished from false events. "Ghost" images of actual optical phenomena are generated using an optical beam splitter and optics configured to direct split beams to a single sensor or segmented sensor. True optical signals are distinguished from false signals or noise based on whether the ghost image is presence or absent. The invention obviates the need for dual sensor systems to effect a false target detection capability, thus significantly reducing system complexity and cost.
Full Text Available January 2000
Priority coding for control room alarms

Patent Scarola, Kenneth ; Jamison, David S. ; Manazir, Richard M. ; Rescorl, Robert L. ; Harmon, Daryl L.

Indicating the priority of a spatially fixed, activated alarm tile on an alarm tile array by a shape coding at the tile, and preferably using the same shape coding wherever the same alarm condition is indicated elsewhere in the control room. The status of an alarm tile can change automatically or by operator acknowledgement, but tones and/or flashing cues continue to provide status information to the operator.
Full Text Available January 1994
Gene coding for the E1 endoglucanase

Patent Thomas, Steven R. ; Laymon, Robert A. ; Himmel, Michael E.

The gene encoding Acidothermus cellulolyticus E1 endoglucanase is cloned and expressed in heterologous microorganisms. A new modified E1 endoglucanase enzyme is produced along with variants of the gene and enzyme. The E1 endoglucanase is useful for hydrolyzing cellulose to sugars for simultaneous or later fermentation into alcohol.
Full Text Available January 1996