CATCH training lowers dishonesty in 2 language models
The method uses only hundreds of training targets.
CATCH is a training method that moves a model to an honest answer and away from a dishonest one. It lowered dishonesty with pressure on MASK and gave more honesty than prompting and supervised fine-tuning. It kept more of the utility of the model than honesty steering.
Sources
Posted
