Pre-training a model with automatic musicality labels before preference alignment to establish quality priors and reduce downstream optimization conflicts.