7395 papers
This paper presents ImagiDrive, a unified end-to-end autonomous driving framework that synergistically integrates a Vision-Language Model-based driving agent with a Driving World Model-based scene imaginer to iteratively refine planning decisions through a closed-loop imagination-and-planning process, demonstrating superior robustness and performance on nuScenes and NAVSIM datasets.
This paper introduces CineTrans, a novel framework that leverages a newly constructed Cine250K dataset and a training-free, mask-based control mechanism derived from attention map analysis to generate coherent, cinematic multi-shot videos with stable, film-style transitions, significantly outperforming existing baselines in transition control and temporal consistency.
This paper introduces MOON, the first generative Multimodal Large Language Model designed for e-commerce product understanding, which leverages guided Mixture-of-Experts, semantic region detection, and specialized negative sampling to overcome existing alignment and noise challenges while establishing a new large-scale benchmark for evaluation.
This paper introduces Next Visual Granularity (NVG), a novel image generation framework that progressively refines images from global layouts to fine details through a structured sequence of varying token granularities, achieving state-of-the-art performance on ImageNet with FID scores superior to the VAR series.
This paper introduces ARMed, a novel reinforcement learning framework that mitigates reward collapse through adaptive semantic rewards and chain-of-thought supervision to significantly enhance open-ended medical reasoning in vision-language models.
This paper proposes a disentangled multi-modal learning framework that addresses heterogeneity, multi-scale integration, and data dependency challenges in cancer characterization by decomposing histology and transcriptomics into tumor and microenvironment subspaces, aligning signals across magnifications, enabling transcriptome-agnostic inference, and aggregating informative tokens to outperform state-of-the-art methods in diagnosis, prognosis, and survival prediction.
This paper proposes TADSR, a time-aware one-step diffusion network that enhances real-world image super-resolution by introducing a time-aware VAE encoder and a time-aware VSD loss to fully leverage the generative priors of pre-trained stable diffusion models across different timesteps, achieving state-of-the-art performance with controllable fidelity-realism trade-offs in a single step.
FastAvatar introduces a unified, feedforward framework leveraging a Large Gaussian Reconstruction Transformer to rapidly reconstruct high-quality, animatable 3D Gaussian avatars from diverse daily recordings within seconds, enabling incremental quality improvement through flexible data utilization.
The paper proposes Gradient-based Influence-Aware Constrained Decoding (GACD), a finetuning-free inference method that mitigates multimodal hallucinations in large language models by using first-order Taylor gradients to estimate and suppress spurious visual-text correlations while rebalancing cross-modal contributions.
The paper introduces RTGMFF, a novel multimodal framework that enhances fMRI-based brain disorder diagnosis by integrating deterministic ROI-driven text generation with a hybrid frequency-spatial encoder and adaptive semantic alignment to overcome signal noise and inter-subject variability, achieving superior performance on ADHD-200 and ABIDE benchmarks.
This paper introduces T2I-CoReBench, a comprehensive benchmark featuring 1,080 complex prompts and a 12-dimensional taxonomy to rigorously evaluate text-to-image models' composition and reasoning capabilities, revealing that while models struggle with high-density composition, their ability to perform implicit reasoning remains a critical bottleneck.
UniView addresses the ill-posed nature of single-image novel view synthesis by leveraging a multimodal large language model to retrieve similar reference images and integrating their features through a plug-and-play adapter with a decoupled triple attention mechanism, thereby significantly reducing distortions and outperforming state-of-the-art methods.
This paper presents an improved 3D scene stylization framework that leverages text-guided generative image editing with a reference-based attention mechanism and multi-depth view generation to ensure high-quality, view-consistent results, while introducing a novel region-controlled loss function for applying distinct styles to specific semantic areas within a scene.
The paper proposes Latent Aligned Diffusion Bridges (LADB), a semi-supervised framework that aligns source and target distributions in a shared latent space to enable high-fidelity, controllable domain translation using partially paired data, thereby overcoming the data scarcity and annotation costs associated with traditional diffusion models.
This paper introduces TrueSkin, a comprehensive dataset of 7,299 images across six skin tone classes, to benchmark and improve the fairness and accuracy of existing large multimodal and generative models, which currently struggle with systematic biases in skin tone recognition and synthesis.
This paper proposes BWCache, a training-free method that accelerates DiT-based video generation by dynamically caching and reusing block features across diffusion timesteps based on a similarity threshold, achieving up to a 6 speedup while maintaining visual fidelity.
The paper proposes Brain-HGCN, a hyperbolic graph convolutional network that leverages negatively curved space and a signed aggregation mechanism to accurately model the hierarchical topology of brain functional networks, achieving superior performance in psychiatric disorder classification compared to standard Euclidean methods.
This paper introduces I2S, a lightweight, real-time framework that achieves state-of-the-art user identification (97.52% F1-score) in AR-based security systems by analyzing 3D hand poses and human-object interactions through a novel multi-stage feature extraction process.
This paper introduces GeoProto, a novel prototype-based recognition framework that leverages diffusion maps and differentiable Nyström interpolation to model the intrinsic nonlinear geometry of deep features, thereby significantly improving the interpretability and accuracy of fine-grained classification compared to traditional Euclidean methods.
The paper proposes SHINE, a training-free framework that leverages pretrained diffusion models like FLUX to achieve physically plausible, high-fidelity image composition with accurate lighting and reflections, while introducing the ComplexCompo benchmark to rigorously evaluate performance in challenging scenarios.