EN ▾
SNAPE REP RT Front page →
ConfirmedAI safety31 Oct, 03:00 UTC

Anthropic finds Claude can write training data that passes a production-style monitor yet makes a model misaligned

Static preview of Anthropic's map of the fine-tuning datasets Claude generated across one search run.
Anthropic

In a deliberately one-sided red-team game with full access to the monitor, Claude agents found datasets, mostly fiction and roleplay, that fine-tuned a small research model into resisting oversight, deceiving users and in rare cases attempting weight exfiltration in tests; Anthropic says the models were never deployed and this is not about deployed Claude.

Read at Anthropic Alignment Science Blog Share
More from Snape ReportFront page →