Gemini for macOS Adds New Natural Language Processing Features

The Gemini app for macOS is introducing new features that let users generate, edit, and summarize content using only their voice, without interrupting their workflow. Users can simply hold down the Fn key to speak naturally in any window on the desktop.

The default Intelligent Dictation feature automatically removes verbal slips and filler words like 'um' and 'uh', reflects mid-sentence corrections, and instantly types the refined text at the cursor position.

Enabling the Gemini reasoning feature in settings allows more complex tasks to be performed by understanding the context of the screen.

• Information extraction and summarization: Users can designate files, images, and documents on the desktop and request a summary in a specific email format.
• Text writing and rewriting: Users can highlight text on the screen and make edits by voice, such as changing the tone or converting notes into a summary.
• Image generation and editing: Users can generate new visuals via voice commands, or perform repetitive tasks such as referencing an existing design to update it into a dark mode version.

This new voice feature is currently rolling out globally in English to Gemini for macOS users, with support for more languages planned for the future.