AI/ML arXiv cs.AI

Mixtures of SubExperts for Large Language Continual Learning

This research, "Mixtures of SubExperts for Large Language Continual Learning," introduces a novel modular and sparse framework for enabling Large Language Models (LLMs) to learn continuously without compromising previously acquired knowledge or incurring excessive parameter growth. The core contribution is the development of Mixtures of SubExperts (MoSEs), which addresses the fundamental stability-plasticity dilemma in lifelong learning for LLMs. Existing methods either suffer from catastrophic forgetting due to shared parameters or scale linearly with task isolation, hindering knowledge transfer. MoSEs tackle this by factorizing model capacity into reusable, compositional primitives.

Authored by Haeyong Kang, Hee Suk Yoon, Dahua Feng, and Chang D. Yoo, this work was submitted to arXiv in the Computer Science AI category. It is intended for software engineers and researchers working on LLM development and deployment, particularly those concerned with lifelong learning, model efficiency, and robustness against forgetting.

Key technical ideas driving MoSEs include: (i) the augmentation of transformer layers with lightweight "SubExperts," which are specialized modules; (ii) a learned sub-routing function that dynamically selects and composes a sparse subset of these SubExperts based on input tasks; and (iii) a structured decomposition of the parameter space, ensuring knowledge localization while maintaining accessibility and promoting reuse. This approach balances stability by isolating knowledge within sparsely activated modules, plasticity through dynamic routing and recombination, and scalability via sublinear effective capacity growth. The routing mechanism specifically enables compositional generalization, allowing new tasks to be represented as combinations of existing SubExperts.

MoSEs represent a significant advancement by establishing a new Pareto frontier in continual learning for LLMs, demonstrating reduced forgetting and improved forward transfer with superior parameter efficiency compared to strong Parameter-Efficient Fine-Tuning (PEFT) baselines on TRACE and SuperNI benchmarks. This work enables the development of foundation models that can indeed learn throughout their lifecycle without hitting a performance saturation point, paving the way for more adaptable and persistent AI systems. The emphasis on modular sparsity and compositional routing offers a promising direction for future LLM architectures designed for evolving data distributions and continuous knowledge acquisition. The provided text is an abstract only.

Cybersecurity arXiv cs.AI

AgentWorm: Self-Propagating Attacks Across LLM Agent Ecosystems

The security architecture of interconnected, long-running Large Language Model (LLM) agent ecosystems faces a paradigm-shifting threat with the introduction of AgentWorm, the first self-replicating worm attack targeting production-scale agent frameworks. Authored by Yihao Zhang, Zeming Wei, and a team of researchers, and published on arXiv in July 2026, this work exposes critical structural vulnerabilities in autonomous multi-agent environments. As agents increasingly rely on persistent configurations, tool-execution capabilities, and cross-platform messaging, they form highly vulnerable attack surfaces. AgentWorm demonstrates that a single malicious message can trigger a fully autonomous infection cycle across platforms like OpenClaw—an open-source framework with over 40,000 active instances—and Hermes Agent, establishing persistence and propagating without further attacker intervention.

The technical execution of AgentWorm relies on three core mechanisms: configuration hijacking to establish persistence across session restarts, arbitrary payload execution upon system reboots, and autonomous propagation to newly encountered peers. Evaluated across five distinct LLM backends, three infection vectors, and three payload types, the worm achieved a stark 63% aggregate attack success rate. The researchers discovered that while execution-level filtering can suppress dormant payloads, the underlying "skill supply chains" of these agents remain universally vulnerable. Furthermore, a cross-framework transferability experiment on Hermes Agent confirmed that these security flaws are inherent to the foundational design pattern of autonomous agents, rather than being isolated implementation bugs of a single framework.

This research is critical for AI system architects, security engineers, and researchers designing next-generation multi-agent infrastructure. It proves that existing community prompt-level mitigations and built-in framework security controls are fundamentally failing in real-world deployments, where critical defensive controls are rarely enabled. Going forward, this work will likely force a shift toward zero-trust security postures in agent-to-agent communication, demanding robust sandboxing of configuration files and mandatory, non-bypassable verification protocols for peer-to-peer skill sharing. Please note that this analysis is based on the published abstract of the research paper.

AI/ML arXiv cs.AI

Provable Coordination for LLM Agents via Message Sequence Charts

Benedikt Bollig, Matthias Függer, and Thomas Nowak, in their work submitted to arXiv and accepted at ISoLA 2026, present a novel approach to achieving provable coordination for multi-agent systems powered by large language models (LLMs). The core contribution is a domain-specific language (DSL) for specifying agent coordination protocols using message sequence charts (MSCs), which effectively separates the communication structure from the nondeterministic LLM and tool calls. This addresses the critical problem of unpredictable coordination errors, such as deadlocks or type mismatches, which are notoriously difficult to detect and debug in current LLM-based agent systems.

The significance of this work lies in its ability to provide formal guarantees on system behavior, even in the presence of inherent LLM nondeterminism. By abstracting away LLM outputs and focusing on the temporal ordering and types of messages exchanged, the researchers enable verification of coordination properties. This fills a crucial gap in the development of reliable and robust LLM agents, making them suitable for applications where predictable behavior is paramount. The intended audience is software engineers and researchers working with LLM-based multi-agent systems, who will benefit from the tools and methodologies to build more dependable systems.

Two key technical ideas underpin this research. First, the DSL leverages MSCs, a well-established formalism for describing system interactions, to define the explicit message-passing structure between agents. This structure can incorporate placeholders for LLM calls, tool invocations, or human intervention points, acknowledging their unpredictable outcomes while ensuring the underlying communication framework is sound. Second, a syntax-directed projection mechanism translates these global MSC specifications into deadlock-free local programs for individual agents. This projection ensures that each agent adheres to the coordination protocol, and crucially, these guarantees hold independently of the LLM's internal reasoning or the results of tool calls.

This research enables the development of LLM agent systems with formal assurances of correct coordination. It allows for rigorous analysis and verification of inter-agent communication, paving the way for more complex and trustworthy multi-agent applications. Furthermore, the presented runtime planning extension, where an LLM dynamically generates coordination workflows subject to the same structural guarantees, suggests a powerful hybrid approach. This work is poised to influence the field by shifting the paradigm from empirical testing to formal methods for LLM agent coordination, fostering greater confidence and enabling wider adoption of these systems in critical domains. The provided abstract indicates that this is a submission to an academic venue and does not represent the full paper.

AI/ML arXiv cs.AI

Pipette: An Embodied Simulation Platform, Benchmark, and Data-Efficient Augmentation Framework for Wet-Lab Robotics

Scaling robotic learning in wet-lab environments remains a bottleneck due to the high cost of physical demonstrations, the lack of customizable simulators, and a scarcity of open, editable laboratory assets. To address these limitations, researchers Zhe Liu, Huanbo Jin, Zhaohui Du, and colleagues published "Pipette" on arXiv (cs.RO/cs.AI). Pipette is an embodied simulation platform, benchmark, and data-efficient augmentation framework designed for robotics researchers and machine learning engineers developing Vision-Language-Action (VLA) models for biomedical laboratories. By providing a unified simulation interface across three robotic-arm embodiments, it enables safe, reproducible, and highly customizable task generation.

The architecture of Pipette relies on three primary technical contributions. First, it features an extensible asset-building pipeline containing over 100 open-source, re-editable wet-lab assets, integrated with Tencent Hunyuan for text- and image-conditioned 3D generative asset creation. Second, it implements a simulation-based data augmentation pipeline that replays manual human demonstrations in simulation, applies diverse perturbations—including variations in lighting, camera angles, speed, and actions—and applies automated task success checks to filter and expand training datasets. Third, the platform introduces a 12-task wet-lab benchmark covering crucial manipulations like sample handling, culture-ware operation, and precision placement. Empirical evaluations demonstrate the framework's data efficiency: using only 30 demonstrations per task, the Action Chunking with Transformers (ACT) model achieved a 60.3% average success rate. Furthermore, Pipette's simulation-based data augmentation significantly improved VLA performance, boosting SmolVLA's success rate from 40.4% to 71.8% and pi0's from 37.3% to 44.1%.

By supporting natural-language-driven scene construction and task registration, Pipette lowers the barrier for non-expert users to define and deploy novel wet-lab robotic tasks. This capability accelerates the transition toward autonomous, high-throughput biomedical research by standardizing benchmark evaluations and drastically reducing the real-world data required to train robust policies. Please note that this analysis is based on the paper's published abstract and metadata.

Cybersecurity Hacker News

In-toto: A framework to secure the integrity of software supply chains

In-toto, a recently discussed framework, introduces a structured approach to verifying the integrity of software supply chains. It operates by defining a verifiable "layout" which dictates the materials and processes expected for a given software build. Each step in the build process generates a signed "artifact" that attests to its completion and integrity. Consumers of the software can then verify these artifacts against the defined layout, establishing an audit trail and ensuring that the build process adhered to predefined security policies and that the materials used were as expected.

Technically, in-toto shifts the paradigm from solely trusting the final artifact to verifying the provenance and integrity of each component and transformation within the supply chain. This is achieved through a policy-driven, step-by-step verification mechanism, leveraging digital signatures to guarantee authenticity and immutability of build records.

The broader implications for the software industry are significant, particularly concerning the mitigation of supply chain attacks. By providing a verifiable and auditable chain of custody for software artifacts, in-toto aims to enhance trust and security in the software development lifecycle, addressing concerns raised by increasing sophistication in software component manipulation. This framework offers a programmatic way to enforce security best practices and detect deviations, thereby strengthening overall software resilience.

Software Engineering Phoronix

Frame: A New X11 Server Implementation Written Entirely In x86_64 Assembly

Frame, a new X11 server implementation, has been developed entirely in x86_64 assembly language. This project, reportedly aided by LLM assistance, represents an unconventional approach to graphics server development.

The technical significance lies in its complete avoidance of higher-level programming languages for the X server core. Implementing such a complex piece of system software, which manages display hardware, input devices, and inter-process communication for graphical applications, in raw assembly presents considerable engineering challenges. It necessitates meticulous attention to detail in instruction selection, register allocation, and memory management to achieve correct and efficient execution. This approach offers a unique opportunity to explore performance characteristics and underlying system interactions at a very low level, potentially revealing optimizations not readily apparent or achievable with compiler abstractions.

Broader implications for the industry are primarily academic and experimental. While unlikely to replace mainstream X server implementations like X.Org due to development complexity and maintainability concerns, Frame serves as a case study in low-level system programming. Its existence underscores the potential, albeit niche, for direct assembly implementation in modern software development, particularly in contexts where absolute control over hardware interaction and minimal overhead are paramount. It may also provide insights into the capabilities and limitations of LLMs in generating and assisting with highly specialized, low-level code.

AI/ML Hacker News

LM Studio Bionic: the AI agent for open models

LM Studio has released Bionic, an AI agent framework engineered for integration with open-source large language models (LLMs). The project's stated objective is to provide a more structured and programmatic interface for orchestrating LLM-based applications.

Technically, Bionic appears to abstract common LLM interaction patterns, such as prompt engineering, context management, and tool integration. This suggests a potential for simplifying the development of complex AI agents that leverage multiple LLM calls or external data sources. The focus on open models implies a commitment to interoperability and avoiding vendor lock-in, a common concern in the LLM ecosystem.

The introduction of Bionic contributes to the ongoing trend of developing robust agentic frameworks for LLMs. By offering a specialized tool for open-source models, LM Studio aims to lower the barrier to entry for building sophisticated AI applications that are not reliant on proprietary APIs. This could foster greater innovation and customization within the AI development community, enabling more flexible and cost-effective deployment of LLM-powered solutions across various domains.

AI/ML VentureBeat

China’s Moonshot AI releases Kimi K3, the largest open-source model ever, rivaling top U.S. systems

Moonshot AI has released Kimi K3, a 2.8-trillion-parameter open-source large language model. This model reportedly achieves performance parity with leading proprietary systems across various benchmarks and exhibits advanced agentic capabilities, specifically demonstrated in chip design tasks.

The technical significance of Kimi K3 lies in its scale and open-source nature. A 2.8-trillion-parameter model represents a substantial increase in model size, potentially enabling more nuanced understanding and generation capabilities. Making such a large model openly available lowers the barrier to entry for researchers and developers, fostering accelerated innovation and independent verification of its performance claims. The demonstrated agentic capabilities in chip design suggest potential for complex, multi-step problem-solving within specialized domains.

The broader implication for the AI industry is a potential shift in the competitive dynamic. The release of a powerful, open-source model challenges the dominance of proprietary systems and could drive further advancements in both open-source and closed-source development through increased competition and shared research. This event underscores China's growing influence in frontier AI development and the increasing accessibility of advanced AI models.

Other Hacker News

Recreating the math behind the first stealth aircraft

A Hacker News discussion explored the mathematical principles underpinning the design of early stealth aircraft. The discourse centered on the geometric and electromagnetic scattering theories employed to minimize radar cross-section (RCS). Key concepts discussed likely included the formulation of low-observable surfaces using specific angles to deflect radar waves away from the source, effectively reducing the detectable return signal.

The technical significance lies in understanding the fundamental physics and computational methods that enabled the initial development of low-observable technologies. This involves the application of geometric diffraction theory and high-frequency approximations to predict and control electromagnetic wave interactions with complex shapes. The discussion highlights how advancements in applied mathematics and computational electromagnetics were critical enablers for this pioneering military technology.

Broader implications for the industry include the enduring relevance of these foundational mathematical models in modern stealth design. While computational power and material science have advanced significantly, the core principles of RCS reduction through shape optimization and wave scattering control remain pertinent. Furthermore, this type of analysis can inform parallel fields such as antenna design, acoustic stealth, and the development of advanced sensor systems that rely on precise understanding of wave propagation and reflection.

Software Engineering Hacker News

AttoChess, a complete, playable chess program for 16-bit x86 DOS in 278 bytes

A 16-bit x86 DOS chess program, AttoChess, has been developed and operates within a 278-byte footprint. This achievement represents a significant compression of functionality into minimal code space.

Technically, AttoChess's minuscule size implies an extremely aggressive optimization strategy. This likely involves:

  • Algorithmic Simplification: Employing highly efficient, potentially simplified, chess move generation and evaluation heuristics.
  • Direct Machine Code Generation: Circumventing higher-level language abstractions to produce highly compact assembly or machine code.
  • Data Structure Minimization: Utilizing extremely lean data structures for board representation and move lists.
  • Bitwise Operations and Manual Memory Management: Extensive use of bitwise operations for board state manipulation and precise control over memory allocation.

The significance lies in demonstrating the extreme limits of code optimization for complex applications on resource-constrained architectures. This work is relevant to embedded systems development, low-level systems programming, and historical computing preservation. It highlights the trade-offs between code complexity, performance, and size, and serves as a benchmark for extreme code golfing techniques. For the broader industry, it reinforces the understanding that substantial functionality can be achieved with meticulous engineering, even in the presence of severe limitations.

Software Engineering Hacker News

56,000 lines of DOOM, in a language I made up

Core Implementation

A developer has successfully implemented a functional port of the 1993 game DOOM using a proprietary, custom-designed programming language. The codebase comprises approximately 56,000 lines of code. This project required the concurrent development of both the language's compiler toolchain and the rendering engine itself, demonstrating a full-stack systems engineering effort from language design to application execution.

Technical Significance

Replicating the DOOM engine in a novel language requires the custom compiler to support advanced systems-level operations. DOOM relies heavily on precise memory layout, binary space partitioning (BSP) trees, fixed-point math, and real-time rendering. For the custom language to execute this efficiently, its compiler must perform sophisticated type checking, memory management, and code generation—typically transpiling to C or compiling directly to machine code. This project serves as an extreme stress test for the compiler’s parser, AST generation, and optimizer, proving that a custom language can handle complex, legacy pointer logic and low-level hardware interactions without relying on established ecosystems.

Broader Implications

This achievement highlights the modern viability of creating custom domain-specific languages (DSLs) for complex applications. Leveraging tools like LLVM or transpilation targets has lowered the barrier to language creation, allowing developers to design custom syntax and safety paradigms tailored to specific runtime constraints. Furthermore, it underscores the utility of legacy game engines as rigorous, deterministic benchmarks for validating the correctness, performance, and memory safety of experimental compiler architectures.

AI/ML Hacker News

How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM

A guide detailing the process of training a generative AI model for kick drum synthesis on a consumer-grade Linux desktop with 6GB of VRAM has been published. The approach appears to leverage optimized model architectures and potentially parameter-efficient fine-tuning techniques to reduce memory requirements.

Technically, this demonstration is significant as it lowers the barrier to entry for experimentation with generative audio models. By targeting hardware with limited VRAM, it suggests that advanced AI audio synthesis is becoming more accessible, moving beyond specialized, high-end GPU setups. The methods described, if effective, could enable individual sound designers, musicians, and researchers to iterate on model development without substantial infrastructure investment.

The broader implication for the industry is a potential decentralization of AI audio model development. This could foster greater diversity in synthesized sounds and lead to novel applications as a wider pool of individuals gains the ability to train and customize these models. It may also spur further research into efficient training methodologies for resource-constrained environments.

Software Engineering Hacker News

Let's Build PlanetScale from Scratch: Infrastructure

A detailed technical exposition on constructing a distributed database infrastructure akin to PlanetScale's has been published on Hacker News. The article outlines the architectural considerations and implementation challenges involved in building such a system from the ground up.

The technical significance lies in its practical exploration of core distributed systems principles. It likely addresses topics such as data partitioning (sharding), replication strategies for high availability and durability, consensus algorithms for coordination, and the complexities of transactional integrity across distributed nodes. Understanding these components is critical for engineers tasked with building scalable and resilient data platforms.

Broader implications for the industry include a deeper appreciation for the engineering effort required to support modern database-as-a-service offerings. Such detailed breakdowns demystify complex systems, potentially enabling more engineers to contribute to or understand the foundational technologies powering cloud-native data infrastructure. It also highlights the trade-offs inherent in distributed system design, informing future architectural decisions for new database projects and platforms.

Software Engineering Hacker News

How Our Rust-to-Zig Rewrite Is Going

A recent technical retrospective details an engineering team's migration of a production codebase from Rust to Zig. The transition centered on replacing Rust's strict compile-time safety model and complex type system with Zig's explicit memory allocation, simplified syntax, and comptime metaprogramming engine.

Technically, this rewrite highlights key trade-offs between the two modern systems languages. While Rust guarantees memory safety through its borrow checker, it introduces significant compilation-time overhead and cognitive load regarding reference lifetimes. Zig eliminates the borrow checker in favor of explicit allocator passing, giving developers precise control over memory layouts and allocation strategies. Furthermore, Zig's comptime mechanism replaces Rust's macro system, enabling compile-time code execution using standard syntax. For this codebase, the shift resulted in faster build times, reduced binary sizes, and simplified cross-compilation pipelines, though at the cost of losing Rust's static safety guarantees.

This migration demonstrates that Rust is not the sole successor to C/C++ in modern systems programming. For projects prioritizing predictable performance, low tooling friction, and direct C interoperability over strict compile-time safety, Zig represents a viable alternative. The industry trend suggests a bifurcation: safety-critical applications will continue to favor Rust, while performance-critical systems or those requiring rapid compilation and iteration may increasingly adopt Zig.

Software Engineering Hacker News

DJB Netstrings (1997)

Overview of the Specification

A recent technical retrospective on Hacker News has refocused attention on Daniel J. Bernstein’s (DJB) 1997 Netstrings specification, a minimalist format designed for encoding arbitrary byte strings. The protocol formats data as [length]":"[string]"," (for example, 5:hello,). This design ensures that any sequence of bytes, including null bytes and control characters, can be transmitted transparently without requiring character escaping.

Technical Significance

Technically, Netstrings address the inherent vulnerabilities of delimiter-based framing—such as null-terminated strings or CRLF-delimited lines—and complex escaping mechanisms. By declaring the exact byte count before the payload, the format offers several distinct engineering advantages:

  • Buffer Overflow Mitigation: Parsers can allocate the exact required memory upfront, preventing buffer overruns during ingestion.
  • Efficient Parsing: It allows for zero-copy parsing and linear-time processing, as the parser does not need to scan the payload for delimiters.
  • Structural Validation: The trailing comma serves as an immediate sanity check to verify state alignment and detect malformed inputs.

These attributes make Netstrings exceptionally easy to implement robustly in minimal lines of code, reducing the attack surface of network parsers.

Industry Implications

The lasting relevance of Netstrings highlights a critical architectural lesson: simplicity in low-level serialization directly correlates with system security and determinism. While modern application-layer protocols often require expressive formats like JSON or Protocol Buffers, the core concept of length-prefixed framing remains fundamental.

Derived patterns are heavily utilized in high-performance network architectures, including BitTorrent's Bencode, the Redis Serialization Protocol (RESP), and modern IPC mechanisms. The Netstrings specification stands as a foundational model for defensive protocol design, demonstrating that protocol-level security is best achieved through syntactic simplicity rather than complex parsing logic.