AI Briefing#together-ai
The latest AI and developer news about #together-ai, with the original source and a short summary.
The latest AI and developer news about #together-ai, with the original source and a short summary.
In hybrid model serving, it increased prefill TPM by up to 3.14x and reduced p90 TTFT by up to 88%.
The compiler uses persistent engines to reduce startup time from 467 seconds to 9.0 seconds, enabling real-time adaptation to traffic and hardware changes.
Together AI has released tev1-4B-experimental, a Jev-like classifier fine-tuned on Qwen3.5 4B, available on Together serverless for $0.042/M input tokens and $0/M output tokens, with a reported training cost of just $17.
TogetherAI has open-sourced OSCAR, a new KV cache quantization technique that improves inference efficiency.
Aurora is an open-source RL-based framework that continuously improves an LLM's speculative decoding performance by learning from real-time inference data.
AI21 and Together AI announced a collaboration for enterprise open-source AI operations.
Various LLMs on the Hugging Face Hub can now be easily fine-tuned through Together AI's infrastructure.