StructSAM: Structure- and Spectrum-Preserving Token Merging for Segment Anything Models
This paper introduces StructSAM, a novel token merging framework that preserves structural boundaries and spectral properties in Segment Anything Models (SAM) by using gradient-based energy scores and grid-based screening to achieve significant computational savings with minimal accuracy loss across natural and medical imaging benchmarks.