Imagine an AI agent that can not only conduct research on the web but also interact with websites to accomplish specific tasks -- all on its own. That's the idea behind a new innovation from Microsoft.

On Wednesday, the software giant announced an interactive new skill designed to empower the AI agents that people create using its Copilot Studio product. That skill is computer use. Any agent you build can work with a desktop application or website to carry out specific actions just as you might.

Also: What are AI agents? How to access a team of personalized assistants

Arriving through an early access research preview, the new skill will allow agents to interact with apps and sites by clicking buttons, selecting menus, and filling out fields and forms on a screen. The agents can accomplish interactive tasks even if no API is available to use the app or site. As Microsoft phrased it: "If a person can use the app, the agent can too."

To carry out tasks on their own, the agents you design will be able to use mainstream browsers, such as Microsoft Edge, Chrome, and Firefox. The feature itself runs on a backend hosted by Microsoft, so you don't need your own servers or systems. The data generated remains on the Microsoft cloud and won't be used to train the company's AI model.

The agents can automatically adapt to changes in desktop apps and websites, so you shouldn't have to modify them if a button or screen is revised. Since they're able to "see" the screen, they can decide what to do and how to do it in real time without your intervention. They also possess built-in reasoning to grapple with any problems or obstacles along the way, so you shouldn't have to step in if an issue arises.

No programming or coding is required to build an AI agent. At the prompt in Copilot Studio, you simply describe what you want the agent to do using natural language. You can test and fine-tune your prompt as you see the steps play out in a simulated mode before sending the agent out on its mission. Plus, you can view a history of your agent's computer use, complete with screenshots and its own reasoning steps.

Also: ChatGPT just made it easy to find and edit all the AI images you've ever generated

In its blog post, Microsoft cited three examples in which the AI agents could play a role.

Automated data entry:You need to input large amounts of data from different sources into a central system. The AI agent can take on this task, reducing the time, effort, and manual labor on your end.

Market research:Someone in marketing needs to collect data from different online sources for analysis. The AI agent could browse to the various sites and collect the needed information on its own.

Invoice processing: Someone in finance has to extract data from invoices and add the information into an accounting system. The AI agent could automatically grab and transfer the data into the right system.

This all sounds great in theory. But today's AI is far from perfect. Even a plain old AI bot can make mistakes. Add in the complexity of automated and independent computer use, and the AI agent could conceivably take a misstep, click the wrong button, or simply give up on its mission.

Also: Copilot Studio is like a LEGO set for building AI agents

The only way to tell is by creating an agent to work with a website or app and see how it fares. With that in mind, Microsoft is inviting Copilot Studio users to fill out and submit a sign-up form to get early access to the computer use feature.

If you don't already use Copilot Studio, you can try it for free. To set it up, you'll need to use a work or school account. Once signed in, you're placed at the main Copilot Studio page, where you can describe the type of agent you want to create.

Want more stories about AI?Sign up for Innovation, our weekly newsletter.

Artificial Intelligence

7 strategic insights business and IT leaders need for AI transformation in 2025

How I used this AI tool to build an app with just one prompt - and you can too

The best AI for coding in 2025 (and what not to use)

My 5 favorite AI apps on Android right now - and how I use them

• 7 strategic insights business and IT leaders need for AI transformation in 2025
• How I used this AI tool to build an app with just one prompt - and you can too
• The best AI for coding in 2025 (and what not to use)
• My 5 favorite AI apps on Android right now - and how I use them