Scalable and Performant Data Loading
This paper introduces SPDL, an open-source, framework-agnostic library that significantly accelerates GPU data loading by leveraging concurrent thread pool execution with GIL release, achieving up to 74% faster iteration and reduced resource usage compared to PyTorch DataLoader while demonstrating further performance gains with Free-Threaded Python.