AI Navigate

MM-algorithms for traditional and convex NMF with Tweedie and Negative Binomial cost functions and empirical evaluation

arXiv cs.LG / 3/11/2026

Tools & Practical UsageModels & Research

Key Points

  • The paper introduces a unified framework for traditional and convex Non-negative Matrix Factorization (NMF) that incorporates a broad class of distributional assumptions, such as Negative Binomial and Tweedie models, beyond the standard Gaussian or Poisson noise assumptions.
  • Using a Majorize-Minimisation approach, the authors derive multiplicative update rules for these models, including novel updates for convex NMF with Poisson and Negative Binomial cost functions.
  • The paper provides the first implementations of several convex NMF models and makes the code available through the R package nmfgenr, promoting practical usage.
  • Empirical evaluations on mutational and word count data demonstrate that the choice of noise model significantly impacts model fit and feature recovery, and confirm that convex NMF is an efficient, robust alternative when dealing with a large number of classes.

Computer Science > Machine Learning

arXiv:2603.09601 (cs)
[Submitted on 10 Mar 2026]

Title:MM-algorithms for traditional and convex NMF with Tweedie and Negative Binomial cost functions and empirical evaluation

View a PDF of the paper titled MM-algorithms for traditional and convex NMF with Tweedie and Negative Binomial cost functions and empirical evaluation, by Elisabeth Sommer James and 2 other authors
View PDF HTML (experimental)
Abstract:Non-negative matrix factorisation (NMF) is a widely used tool for unsupervised learning and feature extraction, with applications ranging from genomics to text analysis and signal processing. Standard formulations of NMF are typically derived under Gaussian or Poisson noise assumptions, which may be inadequate for data exhibiting overdispersion or other complex mean-variance relationships. In this paper, we develop a unified framework for both traditional and convex NMF under a broad class of distributional assumptions, including Negative Binomial and Tweedie models, where the connection between the Tweedie and the $\beta$-divergence is also highlighted. Using a Majorize-Minimisation approach, we derive multiplicative update rules for all considered models, and novel updates for convex NMF with Poisson and Negative Binomial cost functions. We provide a unified implementation of all considered models, including the first implementations of several convex NMF models. Empirical evaluations on mutational and word count data demonstrate that the choice of noise model critically affects model fit and feature recovery, and that convex NMF can provide an efficient and robust alternative to traditional NMF in scenarios where the number of classes is large. The code for our proposed updates is available in the R package nmfgenr and can be found at this https URL.
Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:2603.09601 [cs.LG]
  (or arXiv:2603.09601v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2603.09601
Focus to learn more
arXiv-issued DOI via DataCite

Submission history

From: Marta Pelizzola [view email]
[v1] Tue, 10 Mar 2026 12:46:25 UTC (29,505 KB)
Full-text links:

Access Paper:

    View a PDF of the paper titled MM-algorithms for traditional and convex NMF with Tweedie and Negative Binomial cost functions and empirical evaluation, by Elisabeth Sommer James and 2 other authors
  • View PDF
  • HTML (experimental)
  • TeX Source
Current browse context:
cs.LG
< prev   |   next >
Change to browse by:

References & Citations

export BibTeX citation Loading...

BibTeX formatted citation

×
Data provided by:

Bookmark

BibSonomy logo Reddit logo
Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
Links to Code Toggle
Papers with Code (What is Papers with Code?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos

Demos

Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers

Recommenders and Search Tools

Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
IArxiv recommender toggle
IArxiv Recommender (What is IArxiv?)
About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.