AI Briefing#adversarial-attack
The latest AI and developer news about #adversarial-attack, with the original source and a short summary.
The latest AI and developer news about #adversarial-attack, with the original source and a short summary.
A man who attempted to manipulate judicial decisions through hidden prompt injections in litigation documents was sanctioned.
An automated AI security leaderboard measuring the security vulnerabilities of frontier models has been released.
A 'Context Bomb' attack and defense technique that reverses a model's guardrails to reduce LLM environment hacking success rates to 0% has been released.
This is a research finding addressing the 'role confusion' vulnerability that arises because LLMs recognize the style of text as more important than its content.
Injection detectors used to protect LLM agents saw their detection rate plummet from 93.8% to 9.7% against domain-camouflage attacks
Introducing 'Noroboto,' an attack technique that deceives both AI and users by manipulating a font's Unicode mapping.
Haize Labs has released a red teaming resistance benchmark that measures LLM vulnerability to sophisticated human attacks.
This covers the concepts and methodology of red-teaming to prevent harmful outputs from LLMs.