AI Briefing#storage
The latest AI and developer news about #storage, with the original source and a short summary.
The latest AI and developer news about #storage, with the original source and a short summary.
The system prioritizes full-attention KV cache admission to reduce SSD wear without sacrificing cache hit rates.
OpenAI significantly improved performance by rewriting Habitat, a storage platform handling 1 billion users of traffic for ChatGPT, in Rust.
The default storage for Vercel Sandbox has doubled from 32GB to 64GB.
Vercel has changed the billing basis for Sandbox snapshot storage from monthly average to daily average usage.
Hugging Face offers AI-dedicated storage with built-in Xet and CDN.
Vercel Sandbox has launched the **Drive** feature in private beta, a persistent storage that operates independently of the sandbox lifecycle.
Norway has deployed 2PB of Huawei flash storage for LLM training.
Vast Data raised $1 billion with participation from Nvidia.
Benchmarks illustrate where file-based storage alone is enough and where the line for actually needing a DB gets drawn.
LINE has unified its Rooms and Groups into a single **Group Chat**.
Hugging Face has switched the Hub repository backend from Git LFS to Xet to handle large-scale AI workloads.
Hugging Face has introduced Xet storage, which supports byte-level deduplication, to improve the efficiency of large file transfers.
Hugging Face is introducing a new CAS-based upload/download architecture for efficient transfer of large models and datasets.
Replit has expanded its storage limit from the previous 1GiB to over 256GiB to accommodate AI development environments.
A summary of 29 tips for SSD development and system optimization to minimize write amplification and leverage internal parallelism.
Small random writes cause internal fragmentation and degrade performance, so bulk writes aligned with the Clustered block size are recommended.
Analyzes the lifespan and latency differences among SLC, MLC, and TLC, emphasizing the importance of 'Pre-conditioning' through sustained random writes.
A 30-page guide based on Key-Value store development experience covers SSD internal structures and optimal access patterns.