Double Momentum and Error Feedback for Clipping with Fast Rates and Differential Privacy
This paper introduces Clip21-SGD2M, a novel federated learning algorithm that combines clipping, heavy-ball momentum, and error feedback to achieve both optimal convergence rates for non-convex problems with heterogeneous data and near-optimal differential privacy guarantees without restrictive assumptions.