Hugging Face Adds Vision Capabilities to AI Sheets

Hugging Face's open-source data building tool AI Sheets now supports Vision capabilities through a major update.

Moving beyond its previous text-centric tasks, it can now analyze images and extract structured data directly within the spreadsheet. Key features include:

• Image Analysis and Data Extraction: Extract text or numerical data from receipts, documents, charts, etc., and convert them into table format.
• Image Generation and Editing: Generate images via text prompts, or edit existing images through methods such as style changes and adding elements.
• Automatic Labeling: Automatically generate metadata by captioning images or classifying them into categories.

All of this leverages thousands of open models through Inference Providers, allowing users to complete data building and transformation workflows within a spreadsheet environment without any separate coding.