Distinguishing Order Effects from Random Variation in Cleaning Pipelines for Tabular Data Classification
This paper introduces the Order Sensitivity Index and a permutation test to rigorously distinguish meaningful pipeline order effects from random variation in tabular data classification, revealing that while order impacts accuracy beyond chance in many cases, the specific sequence of balancing classes and correcting labels is critical to preventing minority-class label degradation.