Muon and positron interactions and applications

Derniers papiers

• How Muon's Spectral Design Benefits Generalization: A Study on Imbalanced Data

  Bhavya Vasudeva, Puneesh Deora, Yize Zhao, Vatsal Sharan, Christos Thrampoulidis · 28 octobre 2025

  The growing adoption of spectrum-aware matrix-valued optimizers such as Muon and Shampoo in deep learning motivates a systematic study of their generalization properties and, in particular, when they might outperform competitive algorithms. We approach this question by introducing appropriate simpli…

• MARS-M: When Variance Reduction Meets Matrices

  Yifeng Liu, Angela Yuan, Quanquan Gu · 28 octobre 2025

  Matrix-based preconditioned optimizers, such as Muon, have recently been shown to be more efficient than scalar-based optimizers for training large-scale neural networks, including large language models (LLMs). On the other hand, recent benchmarks on optimizers for LLM pre-training have demonstrated…