8570 papers
This paper investigates the "diagonal sink" phenomenon in temporal attention mechanisms, where information degeneration causes a bias toward initial tokens, and proposes theoretical sensitivity bounds alongside effective regularization methods to mitigate this issue.
SWE-MiniSandbox is a lightweight, container-free framework that leverages kernel-level isolation and environment pre-caching to significantly reduce storage and setup overhead while maintaining performance comparable to traditional container-based pipelines for scaling reinforcement learning in software engineering agents.
This paper introduces MiDAS, an open-source, platform-agnostic system that enables non-invasive, time-synchronized multimodal data acquisition for robot-assisted minimally invasive surgery, validated by demonstrating that its external sensing approach achieves gesture recognition performance comparable to proprietary telemetry while releasing the first annotated dataset for hernia repair suturing.
This paper introduces AHSIV, an adaptive framework that addresses horizon-induced model ranking instability in demand forecasting by integrating horizon-aware error metrics, structural demand classification, and multi-objective optimization to provide robust, operationally coherent model selection for heterogeneous business environments.
GaiaFlow is a novel framework that achieves carbon-frugal search by integrating semantic-guided diffusion tuning, retrieval-guided Langevin dynamics, and adaptive efficiency protocols to balance high retrieval accuracy with significantly reduced environmental impact.
MolCrystalFlow is a novel flow-based generative model that predicts molecular crystal structures by disentangling intramolecular complexity from intermolecular packing through rigid body embeddings and Riemannian manifold representations, thereby outperforming existing methods and enabling data-driven discovery of periodic molecular crystals.
This paper demonstrates that while agentic workflows improve bug-fixing performance by decomposing tasks into short-context steps, current large language models fail to effectively reason over genuinely long contexts (e.g., 64k tokens), revealing a significant gap between nominal context length and usable reasoning capacity.
The paper proposes FLoRG, a federated fine-tuning framework that utilizes single low-rank Gram matrix aggregation and Procrustes alignment to eliminate aggregation errors and decomposition drift, thereby achieving superior downstream accuracy and significantly reduced communication overhead compared to existing state-of-the-art methods.
This paper introduces CoSiNE, a deep neural network-parameterized continuous-time Markov chain that bridges the gap between expressive deep learning and classical phylogenetic models to capture epistatic interactions in antibody evolution, thereby outperforming state-of-the-art language models in variant effect prediction and enabling efficient affinity optimization through a novel Guided Gillespie sampling scheme.
Through an autonomous AI-driven screening of 141 hypotheses, this study demonstrates that biological foundation models like scGPT and Geneformer learn genuine, shared geometric and topological structures in their internal representations that are biologically meaningful yet more localized to specific tissues like immune cells than previously assumed.
The paper introduces EMPO, a hybrid reinforcement learning framework that integrates memory-augmented on- and off-policy optimization to overcome exploration bottlenecks in LLM agents, achieving significant performance gains on benchmark tasks and demonstrating superior adaptability to out-of-distribution scenarios without parameter updates.
This paper reframes the modality collapse observed in multimodal LLMs as a mismatched decoding problem, demonstrating through information-theoretic analysis and empirical validation that the accessibility of non-text information is fundamentally limited by the decoder's training objective and scoring rule rather than the encoder's architecture or alignment.
This paper proposes a Coverage-Aware Web Crawling framework utilizing a Web--Knowledge--Web pipeline and ecological species-richness estimators to iteratively discover and map under-represented SME suppliers in specialized sectors, achieving superior precision and efficiency compared to baseline methods in the semiconductor equipment manufacturing industry.
This paper establishes a principled framework linking activation steering to weight updates, demonstrating that targeting post-block outputs achieves near-full fine-tuning accuracy with minimal parameters and that jointly adapting both spaces surpasses the performance limits of either method alone.
This paper proposes a reparameterized Tensor Ring functional decomposition that leverages Implicit Neural Representations and a structured basis combination to overcome the high-frequency modeling limitations of traditional methods, achieving superior performance in multi-dimensional data recovery tasks such as image inpainting and point cloud reconstruction.
This paper proposes a compact acoustic framework that combines multi-branch CNN feature extraction with an efficient Legendre Memory Unit (LMU) for temporal modeling and a calibrated posterior ensemble fusion strategy to achieve robust, real-time cross-domain infant cry classification despite limited annotations and strong domain shifts.
This paper introduces Whisper-RIR-Mega, a benchmark dataset pairing clean LibriSpeech utterances with real room impulse responses to evaluate and demonstrate the performance degradation of various Whisper models under reverberant conditions, while providing open-source resources for reproducible research on robust ASR.
This paper introduces RigidSSL, a rigidity-aware self-supervised learning framework that pretrains on static and dynamic protein structures using a bi-directional flow matching objective to jointly optimize geometric understanding and conformational dynamics, thereby significantly improving protein designability, novelty, and the modeling of realistic conformational ensembles.
mlx-vis is a Python library built on Apple's MLX framework that delivers GPU-accelerated dimensionality reduction, k-nearest neighbor graph construction, and Metal-based circle-splatting rendering for rapid visualization and animation on Apple Silicon devices.
This paper proposes "Traversal-as-Policy," a framework that distills sandboxed execution logs into verifiable Gated Behavior Trees to replace implicit LLM policies with explicit, state-conditioned macro traversals, thereby significantly improving success rates, eliminating safety violations, and reducing computational costs across diverse autonomous agent benchmarks.