A food safety test shows a mean attack success rate of 25.51% in 12 LLMs
A test with one jailbreak method can underestimate the risk, as the best methods reached 60.59% on average.
Claimed, not confirmed
Researchers built FoodGuardBench, a test with 2,124 malicious food safety questions and 16,992 variants from eight jailbreak methods. In twelve LLMs, the mean attack success rate was 25.51%. General guardrails found only 55.80% of the attacks. The researchers also made FoodGuard-4B, a guardrail for food safety. Its result on new data was 97.64%.
Sources
Posted
