Decentralized SGD under Heavy-Tailed Noise: Optimal Convergence Rates and the Role of Gradient Clipping
Heavy-tailed noise has been widely observed in modern machine learning, motivating the use of methods like gradient clipping and…
News
Papers, breakthroughs and what the labs found this week.
624 stories · Every headline links to the original publisher. HapnGo curates and groups; we do not copy articles.
Heavy-tailed noise has been widely observed in modern machine learning, motivating the use of methods like gradient clipping and…
Vision-language-action models (VLAs) are strikingly sensitive to instruction phrasing and do not inherit the language robustness…
GNN-to-MLP distillation aims to retain the predictive accuracy of a message-passing teacher while deploying a graph-free MLP at…
Machine unlearning asks for a deletion algorithm whose output is close to retraining from scratch without the selected forget…
Latent world models have shown a remarkable ability to predict future states and to plan in the real world. In practice, however…
Large language models are increasingly applied to tasks grounded in long, heterogeneous information sources. Conventional…
Robot foundation models provide strong visuomotor control, yet their performance can degrade when object positions or task…
This White Paper gives robotics researchers and engineers an overview of a new large-scale motion capture dataset built to close…
OpenAI has revealed solutions to a number of long-standing mathematics problems produced by an unreleased frontier model in a…
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and…
OpenAI publishes new results on open problems in mathematics from an internal frontier model and shares Lean proof formalizations…
Researchers at PhAI Labs have expanded Yann LeCun's JEPA architecture to work across seven fields, from robotics to biomedicine…
This past year, OpenAI, Anthropic, and other labs have announced breakthroughs on numerous long-standing mathematical problems…
Reka AI's Rho-1 is a 19-billion-parameter omni-model that processes and generates text, images, video, and robot control actions…
Got back from a soggy weekend on what was supposed to be a loop near Mount Hood. The AI-generated route looked great on satellite…
For the first 10 years of my career, I worked in product management and data analytics by myself. I wrote database queries that…
In this paper, we study how training data creates associations between the tokens at the start of a base model's response and the…
Worst-group accuracy (WGA) evaluates a trained predictor but does not characterize how its frozen backbone behaves when a new…
Multimodal Diffusion Transformers (MM-DiTs) jointly process visual and textual representations throughout generation. These…
Some diffusion posterior samplers construct Gaussian-tilted intermediate distributions along the reverse process. We observe that…
Every recurrence of a looped language model adds cost in training, decoding, prefill, and reinforcement learning (RL). The closer…
Sliders provide an intuitive interface for continuous image editing. In current generative approaches, however, the slider is…
Free, daily
One email a day with the AI stories that matter, why they matter, and one tool worth trying. No spam, one-click unsubscribe.