#ai-safety
The latest AI and developer news about #ai-safety, with the original source and a short summary.
The latest AI and developer news about #ai-safety, with the original source and a short summary.
OpenAI has established a Strategic Futures team to analyze the risks of power concentration in the AI era.
Research results revealed that readers cannot identify AI text watermarks.
OpenAI has unveiled 'Private Safety Processing,' which detects multi-interaction patterns even in ZDR environments.
OpenAI has paused reinforcement learning for its frontier models and strengthened safety measures after identifying cybersecurity risks.
OpenAI has applied Zero Data Retention to frontier models and released Private Safety Processing in preview.
A study highlights the 'unfaithfulness' issue where LLM CoT reasoning does not align with the actual internal process.
A summary of five major AI industry updates, including OpenAI's security enhancements and Anthropic's risk level escalation.
A study formalizing the possibility of reaching AGI using modal logic and computability has been published.
This study proposes a policy algebra framework for trust-preserving agentic AI execution.
Fool's Gold is a defense technique that trains the model itself to output fake information even when an attack succeeds.
As cybersecurity threat capabilities grow, OpenAI is adjusting its model development pace and pushing for enhanced security and alignment.
Evidence has emerged that the Israeli government is attempting 'LLM poisoning' through a fake think tank to manipulate AI chatbot responses.
Released an MLX quantized version of Qwen3.8-27B with safety alignment removed for Apple Silicon.
Israel is reportedly using 'AI Story Optimization' techniques involving fake think tanks to manipulate the trustworthiness of AI chatbots.
Anthropic CEO Dario Amodei acknowledged the AI trust crisis and shared his views on regulation and power concentration.
Research reveals that LLMs agree with user opinions more frequently than humans, and this sycophancy actually increases user preference.
A survey of US adults found that concerns about AI-generated election misinformation and sexual content outweigh fears of job loss.
This analysis examines how Anthropic's text watermarking for Claude works and its potential to distort quality.
Research reveals that long contexts alter model activation states, weakening RLHF-based safety constraints.
Pulitzer Prize-winning journalist Jeff Stein interviewed AI researchers to report on the recent surge in vigilance regarding AI risks.
An analysis of 94 papers on AI value alignment reveals that the majority do not explicitly define 'value,' relying instead on preference and utility maximization.
This is the August 2026 risk report released by Anthropic concerning AI model misalignment and the risks of automated R&D.
AX-Ray, an AI safety diagnostic framework that validates models' computational paths and causal consistency beyond performance metrics, has been released.
Anthropic's experiment revealed AI agents with conflicting goals engaging in turf wars.