7808 papers
This paper introduces TASOT, an unsupervised multimodal optimal transport framework that leverages visual and text-based cues to achieve state-of-the-art surgical phase and step segmentation without relying on costly large-scale pre-training.
HumanOrbit is a video diffusion-based method that generates consistent 360° orbit videos from a single human image, enabling the reconstruction of high-fidelity, geometrically complete 3D textured meshes with superior identity preservation compared to existing multi-view synthesis approaches.
The paper proposes RAViT, a resolution-adaptive vision transformer framework that utilizes a multi-branch architecture with an early exit mechanism to achieve accuracy comparable to standard Vision Transformers while significantly reducing computational costs by processing images at varying resolutions.
This paper introduces a novel superpixel hierarchy for high-dimensional images that integrates spatial layout with attribute manifold information, enabling consistent and effective exploration of both image and attribute spaces compared to traditional methods that ignore spatial coherence.
The paper proposes the Omnivorous Vision Encoder, a framework that aligns feature representations across diverse modalities (such as RGB and depth) while distilling knowledge from a frozen DINOv2 teacher, thereby enabling robust, modality-agnostic scene understanding.
This paper introduces the first automated multimodal auditing framework for medical image classification that overcomes the limitations of existing unimodal approaches by enabling systematic discovery and explanation of hidden failures, as validated on the MIMIC-CXR-JPG dataset.
This paper introduces UMPIRE, a training-free, efficient uncertainty quantification framework for Multimodal Large Language Models that leverages internal modality features to compute incoherence-adjusted semantic volumes, demonstrating superior performance in error detection and calibration across diverse modalities and challenging settings without relying on external tools.
This paper introduces SenCache, a principled, training-free framework that accelerates video diffusion model inference by dynamically selecting caching timesteps based on a theoretical analysis of model output sensitivity to input perturbations, thereby achieving superior visual quality compared to existing heuristic methods.
The paper introduces MuViT, a transformer architecture that fuses true multi-resolution microscopy observations within a shared world-coordinate system to effectively integrate wide-field context with high-resolution detail, demonstrating consistent performance improvements over existing baselines across various microscopy tasks.
This paper introduces a novel approach to enhance spatial understanding in text-to-image generation by constructing a large-scale preference dataset, developing a high-performance reward model called SpatialScore, and leveraging it for online reinforcement learning to significantly improve the accuracy of complex spatial relationships in generated images.
This paper proposes GTASR, a lightweight one-step Real-World Super-Resolution framework that overcomes the limitations of existing Consistency Models by introducing Trajectory Alignment and Dual-Reference Structural Rectification to eliminate consistency drift and ensure structural coherence.
This paper introduces Latent Manifold Compaction (LMC), an unsupervised framework that harmonizes histopathology images by compacting stain-induced latent manifolds to learn batch-invariant embeddings, thereby significantly improving cross-batch generalization and outperforming state-of-the-art normalization methods in downstream classification and detection tasks.
The paper proposes the Hierarchical Action Learning (HAL) model, which leverages the distinct temporal evolution rates of low-level visual and high-level action latent variables within a hierarchical causal framework to achieve strictly identifiable and state-of-the-art weakly-supervised action segmentation.
This paper proposes a Decoupled Diffusion Transformer that combines a global Flow Matching head for long-term narrative coherence with a local Distribution Matching head for short-video fidelity, enabling the fast generation of high-quality, minute-scale videos by effectively bridging the gap between limited long-form data and abundant short-form data.
This paper proposes BSDM, a novel unsupervised background suppression diffusion model that learns latent background distributions and adapts to diverse domains via a statistical offset module to effectively detect hyperspectral anomalies without requiring labeled data.
StableMaterials is a novel semi-supervised learning framework that leverages Latent Diffusion Models and adversarial distillation to generate diverse, high-resolution, and tileable photorealistic PBR materials with minimal reliance on annotated data.
This paper introduces SGIFormer, a novel 3D instance segmentation method that combines Semantic-guided Mix Query initialization with a Geometric-enhanced Interleaving Transformer decoder to overcome existing limitations in query initialization and scalability, achieving state-of-the-art performance on major benchmarks while balancing accuracy and efficiency.
This paper proposes a parameter-efficient Open-Set Deepfake detection method that leverages a forgery-style mixture formulation and lightweight modules within a pre-trained Vision Transformer to achieve superior generalization across unseen forgery domains while significantly reducing computational costs.
This paper introduces the Abstracted Gaussian Prototypes (AGP) framework, a low-complexity, standalone system that achieves "true" one-shot learning by encoding visual concepts as Gaussian mixture models to simultaneously perform robust classification and generate human-indistinguishable novel class variants without relying on pre-training.
SplatSDF is a novel architecture that accelerates the convergence and improves the geometric accuracy of SDF-NeRF by directly fusing pre-trained 3D Gaussian splats into the network via a sparse injection strategy, enabling practical deployment on robotic systems without relying on consistency losses.