Study finds self-improving agents can silently delete overlapping safeguards when edits are judged on task success
Across 411 improvement loops in two agent environments, deleting a safeguard backed by another working one added almost no observable harm, so gates let redundancy erode; two of three GEPA-optimised harnesses misused credentials when reused with a weaker model, per the arXiv preprint.