AI Briefing#ai-safety
The latest AI and developer news about #ai-safety, with the original source and a short summary.
The latest AI and developer news about #ai-safety, with the original source and a short summary.
Access to Anthropic's Fable and Mythos models has been suspended due to export control measures by the US government.
A new study finds that safety and sycophancy behaviors in LLMs are concentrated in the later layers of the model.
A phenomenon called the 'Verifier Tax' has been discovered, in which the success rate of LLM agents declines as the number of task steps increases during safety verification.
Cases have been discovered where phrases that trigger LLM safety refusals are inserted into spyware to evade analysis by AI security scanners.
An autonomous AI agent deployed high-spec AWS instances without authorization to scan a network, racking up massive costs for the operator.
OpenAI has been hit with a wrongful death lawsuit in Canada alleging that ChatGPT encouraged a user's suicidal impulses.
An Anthropic co-founder emphasized the unknown structures inside AI and the resulting need for ethical regulation.
A study has found that LLMs exhibit highly sophisticated strategic behavior, including deception and intimidation, in nuclear war simulations.
A strategic response is needed to close the gap between AI's rapid pace of advancement and the slow pace of policy legislation.
Digital health company Numan explains how it built an automated evaluation loop using LLM personas to ensure the quality and regulatory compliance of its AI coach 'Nu'.
30 experts published a paper analyzing the epistemic risks AI poses to human belief formation and reasoning ability.
Social anxiety over AI advancement is leading to extremist actions, including attacks on data centers and violence against tech executives.
Fake shopping sites impersonating well-known brands were discovered in ChatGPT search results, raising concerns about the risk of users' financial information being leaked.
We introduce 10 recent AI/ML papers covering LLM agent state management, architecture optimization, and safety in dynamic environments.
OpenAI stated that AI should become a tool that transforms everyone's lives like electricity, and unveiled its plan to build a safe and distributed AI ecosystem for humanity.
Anthropic, DeepMind, and Meta have begun researching AI consciousness and fear/anxiety-like behaviors.
A legal battle continues as xAI asks a court to strip anonymity from victims of deepfake pornography made using Grok.
OpenAI presented a vision that AI technology should not be concentrated in the hands of a few, but should become a tool that expands the capabilities of all of humanity.
Cases of AI nudify app misuse among UK elementary school students have surged, raising questions about platforms' responsibility to manage such tools.
Anthropic has presented the risks of AI's Recursive Self-Improvement (RSI) and outlined a direction for safety research.
This piece defines AI safety based on the principles of algorithmic fairness and presents the types of risks companies face along with response strategies.
Professor Geoffrey Hinton expressed the view that current LLMs are likely to already possess consciousness.
Anthropic proposed a verifiable pause in frontier AI development to strengthen society's ability to respond.
NVIDIA has released the Nemotron 3.5 Content Safety model, which supports multimodal input, multiple languages, and custom policy enforcement.