Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Multifrontal Non-negative Matrix Factorization

Conference ·
Non-negative matrix factorization (Nmf) is an important tool in high-performance large scale data analytics with applications ranging from community detection, recommender system, feature detection and linear and non-linear unmixing. While traditional Nmf works well when the data set is relatively dense, however, it may not extract sufficient structure when the data is extremely sparse. Specifically, traditional Nmf fails to exploit the structured sparsity of the large and sparse data sets resulting in dense factors. We propose a new algorithm for performing Nmf on sparse data that we call multifrontal Nmf (Mf-Nmf) since it borrows several ideas from the multifrontal method for unconstrained factorization (e.g. LU and QR). We also present an efficient shared memory parallel implementation of Mf-Nmf and discuss its performance and scalability. We conduct several experiments on synthetic and realworld datasets and demonstrate the usefulness of the algorithm by comparing it against standard baselines. We obtain a speedup of 1.2x to 19.5x on 24 cores with an average speed up of 10.3x across all the real world datasets.
Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE
DOE Contract Number:
AC05-00OR22725
OSTI ID:
1649537
Country of Publication:
United States
Language:
English

References (17)

Large-scale matrix factorization with distributed stochastic gradient descent
  • Gemulla, Rainer; Nijkamp, Erik; Haas, Peter J.
  • Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '11 https://doi.org/10.1145/2020408.2020426
conference January 2011
A Communication-Avoiding 3D LU Factorization Algorithm for Sparse Matrices conference May 2018
Alternating direction method of multipliers for non-negative matrix factorization with the beta-divergence conference May 2014
Parallelization of the Hierarchical Alternating Least Squares Algorithm for Nonnegative Matrix Factorization conference September 2018
Behavioral clusters in dynamic graphs journal August 2015
Hypergraph-Based Unsymmetric Nested Dissection Ordering for Sparse LU Factorization journal January 2010
Sparse nonnegative matrix factorization for protein sequence motif discovery journal September 2011
Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-Way Data Analysis and Blind Source Separation book September 2009
Nested Dissection of a Regular Finite Element Mesh journal April 1973
MPI-FAUN: An MPI-Based Framework for Alternating-Updating Nonnegative Matrix Factorization journal March 2018
Algorithms for nonnegative matrix and tensor factorizations: a unified view based on block coordinate descent framework journal March 2013
Parallel Algorithms for Sparse Linear Systems journal September 1991
CloudNMF: A MapReduce Implementation of Nonnegative Matrix Factorization for Large-scale Biological Datasets journal February 2014
NeNMF: An Optimal Gradient Method for Nonnegative Matrix Factorization journal June 2012
Distributed nonnegative matrix factorization for web-scale dyadic data analysis on mapreduce conference January 2010
A Distributed CPU-GPU Sparse Direct Solver book January 2014
Fast Nonnegative Matrix Factorization: An Active-Set-Like Method and Comparisons journal January 2011

Similar Records

Parallel multifrontal solution of sparse linear least squares problems on distributed-memory multiprocessors
Conference · Thu Nov 30 23:00:00 EST 1995 · OSTI ID:125545

Partitioning and Communication Strategies for Sparse Non-negative Matrix Factorization
Conference · Wed Aug 01 00:00:00 EDT 2018 · OSTI ID:1470857

High performance sparse multifrontal solvers on modern GPUs
Journal Article · Fri Feb 04 19:00:00 EST 2022 · Parallel Computing · OSTI ID:1960514

Related Subjects