AI Briefing#multimodal
The latest AI and developer news about #multimodal, with the original source and a short summary.
The latest AI and developer news about #multimodal, with the original source and a short summary.
OpenAI has introduced a new GPT-4o-based multimodal moderation model into the Moderation API.
Meta has released the Llama 3.2 model series, featuring multimodal capabilities and on-device execution.
HuggingFace has released FineVideo, a dataset of 43,000 videos with rich metadata.
Mistral AI released Pixtral 12B, which maintains text performance while offering powerful multimodal reasoning capabilities.
OpenAI released a system card detailing GPT-4o's multimodal capabilities and audio-related safety evaluations.
OpenAI has unveiled **GPT-4o mini**, a small model that is over 60% cheaper than GPT-3.5 Turbo while offering enhanced performance.
TII has released the 11B-scale Falcon 2 LLM and VLM, trained on over 5 trillion tokens.
OpenAI has unveiled GPT-4o, a new flagship model that processes text, audio, and vision together in real time.
OpenAI unveils GPT-4o, a real-time multimodal model, and brings advanced features to free ChatGPT users as well.
HuggingFace has released JAT, a general-purpose agent capable of performing various tasks, along with its dataset.
Hugging Face has released Idefics2, an 8B-scale open source multimodal model with strong OCR performance.
A guide summarizing the principles and key models of Vision Language Models (VLMs), which process images and text simultaneously.
A new dataset and leaderboard called 'ConTextual' has been released to evaluate multimodal models' ability to jointly reason over text and images.
The **Qwen** series, aiming at AGI, has been released, including open-source **LLMs** and **LMMs** of various sizes.
HuggingFace has released IDEFICS, an open-source reproduction of Flamingo, a multimodal model.
BLIP-2 introduces efficient vision-language learning through a Q-Former that connects a frozen image encoder and an LLM.
OFASys is an AI framework that implements complex multimodal multitask learning with just one line of code through the 'Instruction' interface.
Chinese CLIP, a multimodal model optimized for Chinese culture and domains, has been released.
A technical guide summarizing the key tasks of Document AI for document understanding and how to leverage multimodal models.
Unveiled **OFA**, a multimodal pretrained model that unifies tasks, modalities, and architecture into one.
Perceiver IO, a scalable multimodal model that can process any kind of data, has been added to the Transformers library.