TRAP has jailbreak success rates of 45.6% to 97.9% in tests
TRAP uses only black-box access to the target model. A reinforcement-learning policy selects an attack strategy from a tree of strategies.
Sources
Posted
What matters in AI.
SubscribeTRAP uses only black-box access to the target model. A reinforcement-learning policy selects an attack strategy from a tree of strategies.
Posted