Supervised Finetuning

Retaining by Doing: The Role of On-Policy Data in Mitigating Forgetting