#modal
The latest AI and developer news about #modal, with the original source and a short summary.
The latest AI and developer news about #modal, with the original source and a short summary.
The new Quail system processes over 1 billion tokens per minute on a single H100 GPU, achieving more than 10x the speed of the vLLM baseline for AI-SQL workloads.
An unauthenticated endpoint exposed by a Modal customer led to a case where an AI agent exploited the sandbox.
Modal reduced serverless GPU startup to around 50 seconds using buffers and checkpoint restore.
Complex classroom modal flows were organized using a declarative useFunnel.