Exploring Embedding Priors in Prompt-Tuning for Improved Interpretability and Control

This paper investigates the impact of embedding collapse in Prompt-Tuning by introducing embedding priors, revealing that models can effectively utilize embeddings from diverse activation regions and that distinct activation clusters exist for different task types, suggesting controllable posteriors could enhance interpretability and serve as a foundation for tasks like chain-of-thought distillation.

Sergey Sedov, Sumanth Bharadwaj Hachalli Karanam, Venu Gopal KadambaTue, 10 Ma🤖 cs.LG

From Pixels to Predicates: Learning Symbolic World Models via Pretrained Vision-Language Models

This paper proposes a method that leverages pretrained vision-language models to learn compact, abstract symbolic world models from limited visual demonstrations, enabling zero-shot generalization and long-horizon planning for complex robotic tasks across novel objects, environments, and goals.

Ashay Athalye, Nishanth Kumar, Tom Silver, Yichao Liang, Jiuguang Wang, Tomás Lozano-Pérez, Leslie Pack KaelblingTue, 10 Ma🤖 cs.LG

General Coded Computing in a Probabilistic Straggler Regime

This paper theoretically demonstrates that in distributed computing systems with probabilistic stragglers, the approximation errors of Berrut Approximate Coded Computing (BACC) and Learning Theoretic Coded Computing (LeTCC) schemes converge to zero at specific rates despite the average number of stragglers scaling with the total server count, a finding validated through experiments on various functions including deep neural networks.

Parsa Moradi, Mohammad Ali Maddah-AliTue, 10 Ma🤖 cs.LG

Controllable Sequence Editing for Biological and Clinical Trajectories

This paper introduces CLEF, a controllable sequence editing framework that learns temporal concepts to precisely target the timing and scope of interventions in longitudinal data, significantly outperforming state-of-the-art baselines in generating accurate and realistic counterfactual trajectories for biological and clinical applications.

Michelle M. Li, Kevin Li, Yasha Ektefaie, Ying Jin, Yepeng Huang, Shvat Messica, Tianxi Cai, Marinka ZitnikTue, 10 Ma🤖 cs.LG

Mitigating Unintended Memorization with LoRA in Federated Learning for LLMs

This paper demonstrates that integrating Low-Rank Adaptation (LoRA) into Federated Learning for Large Language Models significantly reduces unintended memorization of sensitive training data across diverse model sizes and domains, while maintaining performance and offering compatibility with other privacy-preserving techniques.

Thierry Bossy, Julien Vignoud, Tahseen Rabbani, Juan R. Troncoso Pastoriza, Martin JaggiTue, 10 Ma🤖 cs.LG

Active Advantage-Aligned Online Reinforcement Learning with Offline Data

This paper introduces A3RL, a novel framework that integrates offline and online reinforcement learning through a confidence-aware active advantage-aligned sampling strategy to dynamically prioritize high-value data, thereby overcoming challenges like catastrophic forgetting and improving sample efficiency to outperform existing methods.

Xuefeng Liu, Hung T. C. Le, Siyu Chen, Rick Stevens, Zhuoran Yang, Matthew R. Walter, Yuxin ChenTue, 10 Ma🤖 cs.LG

Language in the Flow of Time: Time-Series-Paired Texts Weaved into a Unified Temporal Narrative

This paper introduces Texts as Time Series (TaTS), a novel framework that leverages the periodic alignment between paired texts and time series data to enhance multimodal forecasting and imputation performance in existing numerical-only models without requiring architectural changes.

Zihao Li, Xiao Lin, Zhining Liu, Jiaru Zou, Ziwei Wu, Lecheng Zheng, Dongqi Fu, Yada Zhu, Hendrik Hamann, Hanghang Tong, Jingrui HeTue, 10 Ma🤖 cs.LG

IMPACT: Intelligent Motion Planning with Acceptable Contact Trajectories via Vision-Language Models

The paper proposes IMPACT, a novel motion planning framework that leverages Vision-Language Models to infer environment semantics and generate anisotropic cost maps, enabling a contact-aware A* planner to safely navigate cluttered environments by distinguishing between acceptable and dangerous object contacts.

Yiyang Ling, Karan Owalekar, Oluwatobiloba Adesanya, Erdem Bıyık, Daniel SeitaTue, 10 Ma🤖 cs.LG