Looking for an AI that can analyze, summarize, and answer questions about your current web page? You may want to try Microsoft's Copilot Vision feature.
In a Bluesky post from Wednesday, Mustafa Suleyman, CEO of Microsoft AI, announced the official debut of Copilot Vision for all Edge users. Initially rolled out last October as an experimental feature, Copilot Vision expanded its reach in December as a preview, but only for Copilot Pro subscribers. Now, the feature is free for any Edge user with a Microsoft account.
Also: With Copilot Studio's new skill, your AI agent can use websites and apps just like you do
"Copilot Vision is out now, free in Edge," Suleyman said in his post. "It can literally see what you see on screen (if you opt in). Pretty amazing! It'll think out loud with you when you're browsing online. No more over-explaining, copy-pasting, or struggling to put something into words."
Using AI, the tool scans and analyzes the current web page in Edge. It can then tell you what it sees or summarize the information. You're also able to ask questions and submit requests about the page's content.
Also: Microsoft previews Spanish voice features for its Copilot Voice AI assistant
For example, you could open a page on Amazon that lists different products and ask Copilot to recommend the best item based on your specific needs and preferences. You can browse a cooking page with a tempting recipe and ask Copilot to talk you through the steps. You might visit a page with job listings and ask Copilot for advice on how to craft the right cover letter in response to a specific position.
Copilot Vision works with most sites, except those with harmful or adult content, according to Microsoft. Also, it can't scan a web page that's restricted or hidden behind a login. If you visit an unsupported site, Copilot will display a grayed-out icon and crossed eyeglasses and will refuse to discuss the content on the page.
Also: Microsoft 365 Copilot's two new AI agents can speed up your workflow
To address privacy concerns, your requests, as well as any images or page content, aren't logged or stored. Only Copilot's responses are logged so that Microsoft can monitor for unsafe conversations. After the session ends, all data is deleted.
To try Copilot Vision, make sure you're signed in to Edge with a Microsoft account. To activate the feature, clickthis link for Copilot Vision in Edge and follow the prompts. In the Copilot sidebar, click the microphone icon. The first time you do this, you'll be prompted to accept the option to browse with Copilot Vision. Click Accept, and you're good to go.
Also: Microsoft unveils 9 new Copilot features - you can try some now
Now open a web page that you want described. In the Copilot sidebar, click the microphone icon and then select the glasses icon. You can then ask Copilot to analyze or summarize what it sees on the screen. You can also ask questions, seek advice, and request generated content related to the information on the page.
In my initial testing, I was unable to use Copilot Vision. Each time I tried to activate the feature, Edge displayed a "One moment..." message at the bottom of the screen. That one moment never seemed to end because Edge never got past that point.
But after checking the feature a day later, all worked as expected. The glasses icon appeared for me to click on. Copilot greeted me, and I was able to ask it to analyze and summarize the current page.
What's cool is that Copilot Vision can see an entire web page, not just what's currently visible. For example, I asked it to summarize an article I had written, and it discussed the entire story from start to finish, even though only a few paragraphs were visible on the screen.
With Microsoft apparently fixing the initial access problem, Copilot Vision is one AI feature you'll want to try.
Also: Don't bother with Copilot on your Mac unless you say yes to both of these questions
Get the morning's top stories in your inbox each day with ourTech Today newsletter.