UniPrune: Unified Progressive Visual Token Pruning with Information-Aware Budget Allocation for Efficient LLaVA-Style Vision Language Models
UniPrune is a unified progressive visual token pruning framework that synergistically combines encoder-stage semantic importance-diversity pruning with LLM-stage pyramid-shaped dropping, enhanced by Information-Aware Budget Allocation and Cross-Stage Information Continuity mechanisms, to achieve superior efficiency and performance in LLaVA-style Vision Language Models even at extreme compression ratios.