MicroSC: A Tiny, Performant Single-Cell Foundation Model
The paper introduces MicroSC, a family of tiny, high-performance single-cell foundation models (1.5M–7.7M parameters) that achieve near-parity with much larger 51M-parameter teachers like scGPT through efficient knowledge distillation, enabling fast, cost-effective deployment on commodity hardware while demonstrating that the practical utility of current single-cell models is highly compressible.