AI Briefing#content-moderation
The latest AI and developer news about #content-moderation, with the original source and a short summary.
The latest AI and developer news about #content-moderation, with the original source and a short summary.
Deezer revealed that 44% of new uploads are AI-generated tracks.
Switzerland's finance minister has filed a complaint over a sexually defamatory post created by Grok.
Being a 'meat shield' who absorbs the blame for ML system failures could become a new job.
ElevenLabs strengthens real-time safety and compliance controls for voice agents with Guardrails 2.0.
OpenAI has revealed the operating principles and recommendation algorithm behind the Sora feed, aimed at fostering creativity and building a safe environment.
OpenAI has released gpt-oss-safeguard, an open-weight reasoning model designed for policy-based content classification.
OpenAI implements strong policies and technical safeguards to prevent child sexual exploitation and abuse involving AI models.
AI handles primary filtering to reduce operators' psychological burden and improve judgment consistency.
The LLM provides regulatory reasons and summaries in JSON format, reducing monitoring review time.
To reduce the burden of manual review, Kakao introduced the Swin Transformer and developed a cognitive psychology-based labeling tool to improve operational efficiency.
Kakao has open-sourced three models under Apache 2.0 that detect harmful content, legal risks, and prompt attacks.
OpenAI has introduced a new GPT-4o-based multimodal moderation model into the Moderation API.
OpenAI has unveiled a methodology for building an integrated classification system to effectively detect harmful content in real-world environments.
At the AI Seoul Summit, OpenAI revealed key safety practices applied from model development through deployment.
As user-generated content explodes, handling it with human review alone is difficult, so a more scalable moderation approach is needed.
It proposes design principles and tool usage methods to prevent potential abuse cases that can occur when developing repls with social features.
The principles apply to public spaces and were formalized through operational policy revisions in January 2021.