Are You Measuring the Failure Subspace, or Its Ceiling?
This paper demonstrates that the widely cited low-dimensional nature of failure subspaces in test-time adaptation is an algebraic artifact of specific gradient definitions constrained by the classifier's row space, rather than an intrinsic property, as alternative unconstrained demands reveal high-dimensional, width-sensitive structures where most energy remains confined to the classifier's row space.