Eclypsium shows compromised server hardware can alter a running model's weights so it gives dangerous answers
In research shared with CNN and tested on an Nvidia platform, tampered weights made a model tell a user with chest pain to stay home and raised the probability it gave to a Chinese invasion of Taiwan; the attack needs network access to a DPU or baseboard management controller, and Nvidia says strong memory-access protections block the path and nothing was new to the industry.