Invariance of a loss function under certain transformations that don't change the actual model output.