Value Gradient Guidance for Flow Matching Alignment
This paper introduces VGG-Flow, a gradient-matching finetuning method grounded in optimal control theory that aligns flow matching models with human preferences by matching velocity field differences to value function gradients, thereby achieving efficient adaptation and robust prior preservation on models like Stable Diffusion 3.