AI/ML arXiv cs.AI

The Geometry Behind Diffusion and Flow Matching: Gradient Flows and Geodesics in Wasserstein Space

This work, authored by Yian Yao and Weiwei Zhang and published on arXiv, establishes a unified geometric framework for understanding and unifying two prominent classes of generative models: diffusion models and flow matching models. The core contribution is the demonstration that both families of models can be viewed as operating on the Wasserstein space $\mathcal{P}_2(\mathbb{R}^d$), a space of probability measures equipped with the quadratic Wasserstein distance. This geometric perspective reveals a deep, previously unarticulated relationship between them.

The problem this paper tackles is the perceived divergence in theoretical underpinnings and practical implementations of diffusion and flow matching. While both are powerful generative techniques, their underlying formalisms appear distinct. Diffusion models are often explained through stochastic differential equations and denoising processes, while flow matching focuses on deterministic optimal transport paths. This work bridges this gap by showing that both are manifestations of fundamental geometric principles on the Wasserstein manifold. Specifically, diffusion models are framed as gradient flows of a KL divergence free energy, mirroring solutions to the Fokker-Planck equation, with implicit-Euler discretizations corresponding to the JKO scheme. In contrast, flow matching is shown to learn geodesics – minimum-action curves – within the same Wasserstein space, governed by the Benamou-Brenier formula.

The most crucial technical insights revolve around this dual variational principle. First, the gradient flow interpretation of diffusion models explains why the forward process moves along a free energy landscape, akin to an initial-value problem. Second, the geodesic interpretation of flow matching highlights its nature as a boundary-value problem, where generation follows a deterministic ODE along a straight line in Wasserstein space, promising efficient sampling. Finally, the unified framework reveals that while diffusion and flow matching traverse the same endpoints in probability space, they do so via fundamentally different geometric paths: one descending an energy gradient, the other traversing a shortest path. This work is intended for researchers and engineers in machine learning, particularly those working on generative models, probabilistic modeling, and optimal transport.

This geometric unification has significant implications. It enables a more principled understanding of existing models and could inspire novel hybrid approaches. For instance, insights from gradient flow dynamics might inform the design of more efficient flow matching algorithms, or the deterministic sampling of flow matching could be leveraged to accelerate diffusion model inference. Going forward, this work suggests a research trajectory focused on exploring the richer geometric properties of Wasserstein space for generative modeling, potentially leading to more interpretable, controllable, and sample-efficient generative architectures. The abstract indicates this is a foundational theoretical contribution, serving as a conceptual roadmap for future model development.

AI/ML arXiv cs.AI

Accelerating Disaggregated RL for Visual Generative LLMs with Diffusion-Based Parallelism and Trainer-Assisted Generation

This work introduces DigenRL, a disaggregated reinforcement learning (RL) framework engineered to accelerate the training of diffusion-based visual generative large language models (LLMs). The core contribution lies in addressing the inefficiencies inherent in current disaggregated RL systems for these complex models. The problem it solves is the bottleneck created by colocated rollout and training resources, which hinders flexible deployment and independent scaling of heterogeneous hardware. This gap is significant because while RL is a powerful post-training paradigm, its application to cutting-edge visual generative LLMs has been limited by computational overheads. The research is credited to Sijie Wang and a team of eight co-authors from unspecified institutions, and it is presented on arXiv in the Computer Science: Artificial Intelligence (cs.AI) category. This framework is primarily intended for researchers and engineers working on advanced generative AI, particularly those developing or fine-tuning large visual models using RL, and benefits from increased throughput and more efficient resource utilization.

Two pivotal technical innovations underpin DigenRL. First, the framework implements a generation-axis pipeline (GAP) and time-step parallelism (TSP). These mechanisms allow for finer-grained pipelining within the diffusion architecture, effectively overlapping rollout and training operations and reducing execution "bubbles"—periods of inactivity. Second, an elastic trainer-assisted generation (TAG) approach is introduced. This enables trainer GPUs, typically dedicated to optimization, to dynamically contribute to the generation process during rollouts. This synergistic utilization of resources further mitigates idle time and boosts overall efficiency. Experiments demonstrate substantial throughput improvements, achieving 1.56-2.10x gains over existing systems like veRL-Omni and GenRL on models such as HunyuanVideo-13B, Wan2.1-14B, FLUX.1-12B, and QwenImage-20B.

Moving forward, DigenRL offers a blueprint for scaling RL training for increasingly sophisticated visual generative LLMs. Its disaggregated and flexible architecture is poised to influence the design of future distributed training systems, facilitating more efficient adaptation and fine-tuning of multimodal foundation models. This work, based on an abstract, highlights a significant step towards making advanced RL techniques more practically accessible for the development of powerful generative AI.

AI/ML arXiv cs.AI

CompressKV: Semantic-Retrieval-Guided KV-Cache Compression for Resource-Efficient Long-Context LLM Inference

CompressKV, introduced by Xiaolin Lin and colleagues from various institutions, presents a novel framework for compressing Key-Value (KV) caches in large language models (LLMs) with extended context windows. The core contribution lies in a semantic-retrieval-guided approach to KV cache eviction, aiming to maintain high inference performance on resource-constrained hardware by minimizing memory footprint and decoding overhead. This work directly addresses the growing challenge of deploying long-context LLMs, where the KV cache becomes a significant bottleneck, often leading to performance degradation with standard heuristic eviction methods.

The authors' key innovation is the identification and utilization of "Semantic Retrieval Heads" (SRHs). Unlike previous methods that treat all attention heads uniformly, CompressKV posits that certain heads exhibit specialized roles, particularly in capturing crucial information from the prompt's initial and final tokens, as well as semantically important intermediate context. By analyzing these SRHs, CompressKV selectively retains KV pairs that are most semantically relevant, thus avoiding the eviction of critical tokens that would otherwise impact downstream generation quality. Furthermore, the framework incorporates an intelligent allocation of cache budgets across different layers based on offline estimations of layer-wise eviction error, further optimizing resource utilization.

This research is primarily intended for software engineers and researchers working on LLM deployment and optimization, particularly those grappling with inference costs for long-context models. The ability to achieve over 97% of full-cache performance with only 3% of the KV cache on benchmarks like LongBench, and maintaining 90% accuracy with a mere 0.7% storage on Needle-in-a-Haystack, demonstrates a significant improvement in the resource-performance trade-off. Going forward, CompressKV offers a promising avenue for enabling more efficient and accessible long-context LLM inference, potentially accelerating the adoption of these powerful models in a wider range of applications and hardware environments, and influencing future research in KV cache management and attention head analysis. The provided content is an abstract only.

AI/ML arXiv cs.AI

Matching Tasks to Objectives: Fine-Tuning and Prompt-Tuning Strategies for Encoder-Decoder Pre-trained Language Models

Aligning downstream tasks with the original pre-training objectives of encoder-decoder language models represents a critical optimization bottleneck in natural language processing. To resolve this mismatch, researchers Ahmad Pouramini and Hesham Faili introduced the Match Task to Objective (MTO) framework in a paper published in the journal Applied Intelligence. This work is designed for natural language processing researchers and machine learning engineers seeking to maximize the efficiency of encoder-decoder models, specifically targeting generation, question answering, and commonsense knowledge retrieval tasks where labeled data may be scarce.

The core innovation of the MTO framework lies in its automated methodology for identifying the optimal pre-training objective for a given target task and preparing related data for adaptation through unsupervised training. The framework operates on two primary technical mechanisms. First, it introduces automated data preparation pipelines that align the target task's structure with identified unsupervised pre-training objectives. Second, it utilizes novel template designs during the fine-tuning stage that structurally mirror the objective patterns established during pre-training and adaptation. Empirically, aligning these phases yields performance gains of over 120% in few-shot scenarios compared to conventional fine-tuning methods, while also outperforming baseline models on full-dataset tasks. Additionally, the authors extend this alignment principle to prompt-tuning methodologies, offering a structured approach to soft prompt engineering and optimization.

Going forward, this research establishes a systematic paradigm for model adaptation that moves beyond generic fine-tuning. By demonstrating that explicit objective alignment drastically reduces the data requirements for downstream task mastery, the MTO framework enables the deployment of highly specialized, resource-efficient models. This methodology is positioned to influence the development of future prompt-tuning libraries and automated training pipelines, particularly for domain-specific applications where data-scarce, few-shot learning is a necessity. Note that this analysis is based on the published abstract and bibliographic metadata of the research paper.

AI/ML arXiv cs.AI

OpenThoughts-Agent: Data Recipes for Agentic Models

The OpenThoughts-Agent (OT-Agent) project, authored by a large team including researchers from institutions like the University of Texas at Austin and Meta AI, and published on arXiv, introduces a fully open data curation pipeline for training agentic language models. This work directly addresses a critical gap in the field: the lack of standardized, generalizable training data for AI agents that can operate effectively across a wide range of tasks, unlike prior efforts focused on single benchmarks. The intended audience includes AI researchers, software engineers developing agentic systems, and anyone involved in the creation of broadly capable AI.

A central contribution is the systematic investigation of data curation stages through over 100 controlled ablation experiments. Key findings highlight the significant impact of task source diversity on agent performance. The project's core mechanism involves building a data pipeline that prioritizes varied task exemplars, moving beyond monolithic datasets. This approach results in a 100K-example training set that, when used to fine-tune Qwen3-32B, achieves a 44.8% average accuracy across seven agentic benchmarks, surpassing existing open models. Crucially, the released training data demonstrates strong scaling properties, outperforming alternatives at equivalent training sizes in compute-controlled settings. This research enables the development of more versatile and capable AI agents by providing a reproducible and extensible framework for data generation, potentially accelerating progress in areas requiring complex task execution and reasoning. The open release of the pipeline, datasets, and experimental results is poised to foster further community-driven advancements in agentic model training. The described work is based on the provided abstract only.

AI/ML arXiv cs.AI

Weight-Space Geometry of Offline Reasoning Training

This work, "Weight-Space Geometry of Offline Reasoning Training," by Aleksandr Nikolich, Igor Kiselev, Vladimir Platonov, and Karina Romanova, published on arXiv and accepted for ICML 2026 workshop, presents a novel analysis of the geometric properties of weight updates generated by various offline reinforcement learning (RL) methods. The problem it addresses is the prevalent practice of distilling reasoning capabilities from large language models (LLMs) into smaller student models using diverse offline RL algorithms like SFT, RFT, DFT, RIFT, Offline GRPO, and DPO. While these methods are often compared solely on downstream accuracy metrics, their underlying mechanistic differences and how they navigate the weight space remain largely unexplored. This research aims to bridge that gap by characterizing the geometry of these distinct training trajectories.

The intended audience consists of machine learning researchers and software engineers, particularly those working in natural language processing, reinforcement learning, and model distillation. The findings are beneficial for anyone seeking to understand the fundamental distinctions between different offline RL training strategies and to make informed choices for model optimization.

A key technical contribution is the systematic characterization of weight-space geometry. The authors employ several analytical tools, including cosine similarity to measure the alignment of weight deltas, principal-angle subspace analysis to identify shared or orthogonal directions, and Linear Mode Connectivity (LMC) and Centered Kernel Alignment (CKA) to probe the functional similarity of trained models. One significant observation is that Supervised Fine-Tuning (SFT), Reward-Focused Training (RFT), and Reward-Informed Fine-Tuning (RIFT) produce highly colinear weight updates and exhibit comparable downstream accuracy on GSM8K. In contrast, Decision Transformer (DFT) diverges more significantly in direction compared to reward-weighted methods, even when using identical data. Offline GRPO introduces a substantial component orthogonal to the SFT direction, indicating a more complex exploration of the weight space. Perhaps most notably, DPO is found to occupy a near-orthogonal subspace, exhibiting a mode-connectivity barrier and a significant drop in late-layer CKA.

This investigation enables a deeper understanding of how different optimization objectives translate into distinct weight-space dynamics during offline reasoning distillation. The divergence observed in DFT and DPO, and the unique exploration by Offline GRPO, suggest that these methods might be accessing different inductive biases or learning different functional representations. The successful application of geometric analysis provides a framework for future research to design more efficient and targeted distillation algorithms. The findings could influence the development of new methods that leverage specific geometric properties for improved performance, or guide hyperparameter tuning by revealing the distinct exploration strategies of various algorithms. This abstract-only submission leaves the full experimental details and broader implications for future exploration.

AI/ML arXiv cs.AI

AutoSpec: Safety Rule Evolution for LLM Agents via Inductive Logic Programming

The research paper "AutoSpec: Safety Rule Evolution for LLM Agents via Inductive Logic Programming," authored by Pingchuan Ma and colleagues from an undisclosed institution, presents a novel framework for automatically refining safety rules governing Large Language Model (LLM) agents. This work addresses a critical gap in LLM agent deployment: the inherent trade-off between interpretable, yet brittle, hand-crafted safety rules and the opaque nature of neural classifiers. Existing methods struggle to achieve both high precision and high recall without significant human oversight or sacrificing interpretability, which is crucial for safety-critical applications. AutoSpec aims to bridge this gap by evolving expert-designed rules into more robust and accurate policies.

The core contribution of AutoSpec lies in its counterexample-guided synthesis approach, augmented by Inductive Logic Programming (ILP). This iterative process begins with an initial set of expert rules and a stream of user-annotated execution traces (indicating safe or unsafe behavior). AutoSpec then identifies misclassified traces as counterexamples. Crucially, ILP is employed to analyze these counterexamples, efficiently learning discriminating predicates that differentiate false positives from false negatives. This enables the framework to intelligently propose edits to the existing rules, which are then verified. The key technical insight here is that ILP's ability to find patterns in logical predicates dramatically prunes the search space for rule evolution, avoiding brute-force methods.

The intended audience for this work comprises software engineers and researchers developing and deploying LLM agents, particularly in domains where safety and auditability are paramount. This includes developers of autonomous systems, AI safety researchers, and domain experts who need to ensure LLM agents operate within prescribed boundaries. The most important technical ideas revolve around the counterexample-guided synthesis loop, the integration of ILP for predicate discovery, and the iterative refinement of logical safety rules. The results demonstrate significant improvements, achieving high F1 scores (0.98 and 0.93 in tested domains) and substantial reductions in false positives, while maintaining high recall, all within a few iterations. The learned rules are also human-readable and generalizable.

Looking forward, AutoSpec enables the development of more dependable and auditable LLM agents. This approach could significantly influence the field of AI safety by providing a principled, automated mechanism for safety rule maintenance and adaptation. It paves the way for LLM agents that can be deployed with greater confidence, especially as they interact with complex and dynamic environments. The research, as presented in the abstract on arXiv (cs.AI), suggests a promising direction for robust LLM agent safety.

AI/ML arXiv cs.AI

Large-Language-Model Discovery of Quantum LDPC Codes through Structured Concept Evolution

Zidu Liu and Florian Marquardt of MIT introduce Structured Concept Evolution (SCE), a novel framework for discovering quantum low-density parity-check (qLDPC) codes, presented on arXiv (quant-ph). This work addresses the critical challenge of error correction in quantum computing, which is essential for achieving fault-tolerant quantum computers capable of outperforming classical machines. qLDPC codes offer a promising path towards this goal by balancing sparse parity checks with desirable code properties. SCE significantly advances code construction by integrating a large language model (LLM) with a specialized algebraic mutation grammar.

The core innovation lies in how SCE leverages the LLM. Instead of relying on the LLM for direct, from-scratch code design, SCE guides it to evolve structured concepts. These concepts are represented as algebraic specifications coupled with executable programs, enabling systematic and meaningful modifications. Hierarchical mutations operate on fundamental components such as group algebra, protograph geometry, and base spaces, allowing for the exploration of a vast design landscape. This approach, utilizing relatively lightweight models like GPT-5.4-mini and GPT-5.4-nano, has yielded a diverse collection of competitive code families. Notably, SCE discovered codes beyond standard constructions, including those over non-abelian groups and novel abelian designs.

This research is of particular interest to quantum information theorists, quantum algorithm designers, and software engineers involved in quantum error correction. The ability to discover new and improved qLDPC codes directly impacts the feasibility and performance of future quantum computers. The framework demonstrated the discovery of families with properties exceeding existing benchmarks and characterized their performance under realistic depolarizing noise with efficient decoding techniques like Belief Propagation combined with an Ordered Statistics Decoding (BP+OSD). Moving forward, SCE offers a potent paradigm for accelerating the discovery of complex quantum codes, potentially unlocking new frontiers in quantum computation and influencing the development of robust quantum hardware. This abstract-only information was derived from the provided arXiv abstract.

Hardware/Chips Synthesized Digest

Valve's SteamOS Expansion for Intel and Nvidia GPUs

Valve is expanding SteamOS hardware compatibility through partnerships with Intel and Nvidia. This initiative aims to integrate support for Intel Arc and a broader spectrum of Nvidia GPUs, extending beyond the current AMD-centric foundation of SteamOS. The expansion also targets third-party handheld gaming devices, exemplified by the MSI Claw, which utilizes Intel hardware.

Technically, this development is significant as it addresses a key limitation of SteamOS: its historically narrow hardware support. Broadening GPU compatibility, particularly to encompass Intel's integrated and discrete graphics solutions and a wider range of Nvidia silicon, directly increases the potential user base and device ecosystem for SteamOS. This requires substantial driver integration and validation work on Valve's part, likely involving upstream contributions to Mesa for Intel and coordinated efforts with Nvidia for their proprietary drivers.

The broader implications for the industry include potential increased competition in the PC operating system space, particularly for gaming-focused distributions. Enhanced compatibility could spur further innovation in PC handheld form factors and potentially influence consumer adoption of Linux-based gaming platforms. It also represents a strategic move to solidify the Steam Deck's software foundation as a more universally applicable gaming OS.

Software Engineering Lobste.rs

maestro: Lightweight, Linux-compatible kernel, written in Rust

Maestro Kernel Project Initiated

A new kernel project, codenamed Maestro, has been announced, aiming to provide a lightweight operating system kernel compatible with Linux. The core of Maestro is implemented in the Rust programming language, a departure from the C-dominant kernel development landscape.

The technical significance lies in leveraging Rust's memory safety guarantees. This offers potential for reduced kernel vulnerabilities stemming from memory-related errors, a common source of exploits in traditional C-based kernels. The "lightweight" design suggests a focus on minimal resource consumption and a reduced attack surface, potentially suitable for embedded systems, IoT devices, or specialized computing environments. Linux compatibility implies an effort to maintain user-space ABI compatibility, facilitating the execution of existing Linux applications and drivers.

Broader implications include a potential exploration of Rust's suitability for mainstream kernel development. While Rust has seen adoption in userspace and some components of Linux itself, a full kernel written in Rust represents a significant step. This could influence future kernel design paradigms, accelerate innovation in secure systems programming, and potentially attract developers with Rust expertise to systems-level development. The success of such a project could encourage further experimentation with alternative languages in critical operating system components.

Hardware/Chips Synthesized Digest

Valve Launches the Steam Machine Mini PC

Valve has released the Steam Machine, a Linux-based gaming PC targeting the living room market. Pricing for the device is positioned between $1,049 and $1,428. This hardware release represents an extension of Valve's existing product portfolio, which includes the Steam Deck.

From a technical perspective, the Steam Machine's reliance on a Linux operating system for a dedicated gaming PC is notable, aiming to provide an alternative to traditional Windows-based systems. The limited availability of the product has been explicitly attributed to critical RAM supply chain shortages and escalating vendor pricing pressures anticipated in 2026. This suggests potential systemic issues within the DDR5 or relevant RAM manufacturing sector, impacting production yields and cost projections for high-volume consumer electronics.

The broader implications for the PC gaming industry are twofold. Firstly, it reinforces the viability of Linux as a gaming platform, potentially driving further developer support and optimization for open-source operating systems in this segment. Secondly, the supply chain constraints highlight the fragility of hardware production and the impact of component scarcity on new product introductions and future pricing stability, irrespective of the platform. This event underscores the ongoing challenges in scaling hardware manufacturing in the current global economic environment.

Software Engineering Lobste.rs

Ultra: A from-scratch kernel that aims for full ABI compatibility with the Linux userland

Core Development

The Ultra project is a newly introduced, from-scratch kernel designed to achieve full Application Binary Interface (ABI) compatibility with the Linux userland. Rather than fork-modifying the existing monolithic Linux codebase or relying on hypervisor-based virtualization, Ultra implements the necessary system interfaces directly. This architecture allows it to run unmodified Linux binaries natively within a completely independent kernel environment.

Technical Significance

Replicating the Linux ABI from scratch is a formidable systems engineering challenge. The Linux kernel exposure surface includes hundreds of active system calls, complex signal-handling semantics, memory management behaviors, and virtual filesystems such as /proc and /sys.

Ultra’s clean-slate implementation decouples the vast Linux software ecosystem from the standard Linux kernel. This decoupling allows systems architects to experiment with alternative kernel designs—such as microkernel architectures, real-time schedulers, or specialized security models—without losing access to established GNU/Linux toolchains, libraries, and binaries. It shares conceptual goals with previous compatibility layers, such as Microsoft’s translation-based WSL1 or FreeBSD’s Linux emulation layer, but implements them as a foundational kernel design.

Industry Implications

In the broader industry, Ultra points toward a more modular future for operating systems. If the project achieves stable coverage of the Linux ABI, it could serve as a lightweight, highly auditable alternative for embedded systems, edge devices, and secure sandboxing environments. By eliminating the legacy footprint of the monolithic Linux kernel while retaining its application compatibility, Ultra offers a pathway to deploy specialized operating systems that do not require developers to rebuild or port existing software stacks.

AI/ML Synthesized Digest

Anthropic Launches Claude Tag for Slack

Anthropic has deployed Claude Tag, an AI agent for Slack, functioning as a persistent conversational participant. Key features include the ability to monitor discussions, infer organizational context and workflows from message content, and execute tasks autonomously.

Technically, Claude Tag's significance lies in its persistent state and contextual learning. Unlike stateless chatbots or single-task AI assistants, it is designed to maintain an understanding of ongoing team dynamics and project specificities. This implies a sophisticated natural language understanding (NLU) and context management architecture capable of processing and retaining information across multiple messages and conversations. The autonomous task execution capability suggests integration with task management systems or APIs, enabling it to act upon learned directives.

The introduction of such an agent has implications for enterprise collaboration and knowledge management. It raises questions regarding data privacy and security, especially concerning the ingestion of internal company communications. Furthermore, it signals a shift towards more integrated and context-aware AI assistants within digital workspaces, potentially impacting team productivity, information retrieval efficiency, and the nature of human-AI collaboration. Discussions around its efficacy and the methods of its learning process are expected to continue.

AI/ML Hacker News

Show HN: RLM-based local debugger for AI agent traces

This work introduces HALO, a system and methodology for building recursively self-improving AI agent harnesses. Developed by Context Labs and detailed in a Hacker News "Show HN" post, HALO addresses the critical challenge of identifying and rectifying systemic failure modes in complex AI agents, particularly those operating in production environments. The core contribution lies in its novel application of Retrieval-Augmented Language Models (RLMs) to analyze execution traces, enabling agents to learn from their past performance and iteratively enhance their reliability and efficiency. This is of significant importance to software engineers and researchers developing and deploying AI agents, filling a gap in current debugging and optimization toolchains which often struggle with the scale and emergent complexity of agentic behavior.

HALO's effectiveness stems from several key technical ideas. Firstly, it leverages OpenTelemetry-compatible tracing to capture detailed execution logs from agent harnesses. This standardized format allows for easy integration with existing observability platforms and provides a rich source of data. Secondly, the system employs a specialized RLM engine designed to process these traces. Unlike general-purpose LLMs, this RLM is optimized to analyze long trace sequences and identify common failure patterns, rather than overfitting to isolated errors. This leads to the generation of actionable reports that highlight systemic issues like high latency spans, retry storms, or common branching logic failures. Finally, HALO facilitates a closed-loop improvement process: reports from the RLM engine are fed to coding agents (e.g., Claude Code, Cursor) to automatically generate and apply code modifications to the agent harness, which is then redeployed, generating new traces for further analysis.

This iterative refinement process, powered by an RLM's specialized analytical capabilities, enables continuous optimization of AI agent performance. It allows for the automatic discovery and correction of subtle bugs and inefficiencies that might be missed by manual debugging. Going forward, HALO's approach has the potential to significantly influence the field of AI agent development by providing a robust framework for ensuring the reliability and scalability of AI systems. The methodology could become a standard practice for building and maintaining production-grade AI agents, leading to more stable, efficient, and trustworthy AI applications. The presented content appears to be primarily from a project README and abstract, not a formal research paper.