KEY POINTS
- Google's Gemini app for Mac now supports the Computer Use capability, already offered to PC users.
- Gemini works in a background window, shows a live preview in chat and asks approval for key actions.
- Google's examples include batch listings on eBay, filling out PDF forms and turning a pencil sketch into a 3D model.
Google has added a feature called Computer Use to the Gemini app for Mac, allowing the AI assistant to carry out repetitive tasks on its own, Engadget reported. The capability had already been offered to users on PC, and Mac owners can now use it too.
With Computer Use, Gemini can look at what is on the screen through screenshots. It can then click, type, scroll and move around programs and websites for the user. People describe what they want in natural language, and the tool is meant to take over jobs that normally require several steps across different programs and devices.
Gemini does this work in a background window rather than on the main display. The user sees a live preview inside the chat, but the assistant does not take over the screen or the cursor. That means the Mac can be used as usual while a task is running.
Google also set some limits on what the assistant can do. According to the report, Gemini can only work in the apps and programs that it has been given access to, and it will ask the user for approval before taking key actions.
Google's announcement included several examples of how the feature could be used. One is listing items for sale in batches on platforms such as eBay. A person selling a large amount of clothing could ask Gemini to go through photos stored in a local folder, research prices, record the details of each item and prepare the listings.
Another example is filling out PDF files stored locally, such as shipping declaration forms. Google also pointed to creative work, saying Gemini could be asked to turn a pencil sketch into a 3D model automatically.
The update brings the Mac version of the Gemini app closer to the PC version in terms of agent-style features, which let an AI system operate software directly instead of only answering questions in a chat window.