Microsoft Introduces “Computer Use,” a New AI Feature for Copilot Studio

Microsoft introduced this Tuesday a new feature for Copilot Studio called computer use that allows AI agents to interact with websites and desktop applications autonomously. The new update is available in early access research preview for selected users.

According to Microsoft’s announcement, computer use allows AI agents to recognize multiple elements in platforms, navigate, click, and interact with multiple websites without the need for an API.

“With computer use, agents can now interact with any system that has a graphical user interface,” wrote Charles Lamanna, Corporate Vice President, Business & Industry Copilot at Microsoft. “If a person can use the app, the agent can too.”

The tech giant highlighted several use cases, including automated data entry for handling large volumes of information, market research by having AI agents gather data from multiple websites and generate insight-driven analyses, and invoice processing by using AI agents in Copilot Studio to extract and transfer invoice data directly into a company’s accounting systems—eliminating the need for manual input.

Microsoft stated that the new capabilities are both intuitive and intelligent, designed to overcome challenges such as navigating complex interfaces. With computer use, AI agents can perform tasks in real time, allowing users to monitor their actions and track performance through a history log that includes reasoning steps and screenshots of the relevant task.

Those interested in testing the new AI feature can fill out a form and request to participate in the early access period. The company has also promised to provide more details at the Microsoft Build event in May.

Just a few weeks ago, Microsoft announced a set of AI-powered security agents, and now computer use. Copilot Studio’s new AI feature can be compared to OpenAI’s Operator program. The AI startup introduced Operator back in January as an AI agent that can take control of computers and perform tasks autonomously.