AI Briefing
KO

Hugging Face Launches SQL Console for Datasets

·2024.09.17 09:00

Key point

Hugging Face has launched a SQL Console feature that lets users query datasets directly in the browser.

Details

The SQL Console feature has been introduced, allowing users to directly query, filter, and explore datasets on the Hugging Face Hub.

Using DuckDB WASM as its engine, all operations are processed 100% locally within the browser. This enables powerful data manipulation without any separate server or backend dependency.

Key features include the following:

  • DuckDB syntax support: Supports various built-in functions including regex, lists, JSON, and embeddings.
  • Export results: Query results can be saved as Parquet files.
  • Sharing feature: Query results for public datasets can be shared via a single link.

Datasets are primarily loaded using the Parquet format, and for other formats, the first 5GB is automatically converted. Although there is a browser memory limit (about 3GB), it provides fast filtering performance even on datasets with tens of millions of rows.

This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.

Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.