Copilot Studio can use a PC by itself as a human would.
Microsoft has rolled out a powerful new feature for Copilot Studio this week, allowing AI agents to use websites and desktop applications as if they were human users.
AI clicks, types, and works like you do
The feature is called “computer use” and enables Copilot agents to click buttons, select menus, and input text on the screen. According to Microsoft Vice President Charles Lamanna, this makes it possible to automate systems without APIs as well: “If a human can use the app, then the agent can too.”
With this, Copilot Studio can build AI workflows that, for example, input data into legacy ERP systems, process invoices, or conduct market research on websites. Importantly, the AI independently recognizes changes on screens such as moved buttons and adapts to them, ensuring that the automation doesn’t get stuck.
More extensive than copilot actions
Previously, Microsoft introduced a similar feature called Copilot Actions. This allows users to have tasks performed in the background, such as booking tickets or making online purchases. Those functions are limited to a selection of partners. Copilot Studio gets more freedom to work with any apps and websites.