Microsoft's AI Copilot makeover lets it see and speak
Voice, Vision, Veracity, Value?
· TechRadarNews By Eric Hal Schwartz published 1 October 2024
Microsoft's Copilot AI assistant has a sleek new look and a slew of new and enhanced features. The tech giant is clearly keen to get more people to use its AI tools and to make it as much a part of people's lives as possible.
It's a strategy pursued by Google and Microsoft's other AI rivals as well. To stand out, Microsoft gave Copilot a makeover regarding how you engage with the AI and its capabilities when you do so. Copilot is noticeably quicker to adapt to your preferences and does so in more ways than it could before. You can test out the new Copilot experience on the web, a mobile device, or through the Windows app.
"Copilot will be there for you, in your corner, by your side and always strongly aligned with your interests." explained Microsoft AI CEO Mustafa Suleyman in a blog post. "We are not creating a static tool so much as establishing a dynamic, emergent and evolving interaction. It will provide you with unwavering support to help you show up the way you really want in your everyday life, a new means of facilitating human connections and accomplishments alike."
We've highlighted some of the most notable and intriguing changes and new features below.
Meet the new Copilot - YouTube
Voice
Copilot Voice - YouTube
The loudest upgrade is the new Copilot Voice feature that allows you to converse vocally with Copilot. It's a bit like OpenAI's new AdvancedVoice Mode in that you can speak to the AI like you would a human, even interrupting mid-word, and hear what it has to say back.
You can select four voices for the experience, with multiple accents, though only in English for now. Copilot Voice can also be your newscaster with the Copilot Daily feature. You can get audio summaries of the latest news and weather personalized to your location and interests. The AI relies on Microsft's partners, including Reuters, Axel Springer, Hearst, and the Financial Times, to source and summarize the news.
Vision and Visuals
Copilot Vision - YouTube
Not only can Copilot now talk, it can 'see' too. The new Copilot Vision feature lets the AI look at what's on your screen, whether it's a website or a personal document. The AI can suggest ideas for related information or analysis, even bring up products that might better suit your interests and budget if you ask, simply using the vision on the screen. It won't work universally yet, but it can handle most of the more popular websites. This is an opt-in feature, so none of the data is stored or used for training unless you agree. Notably, Copilot Vision isn't limited to printed text; it can even read handwriting.
Get daily insight, inspiration and deals in your inbox
Sign up for breaking news, reviews, opinion, top tech deals, and more.
Contact me with news and offers from other Future brandsReceive email from us on behalf of our trusted partners or sponsors