Microsoft Copilot is getting its biggest update yet. The main innovations are Copilot Voice and Copilot Vision, which make interacting with technology more intuitive and natural.
With the launch of Copilot Voice, Microsoft is offering a new way for users to interact with their digital assistant. Users can give voice commands to ask questions, share ideas or simply blow off steam after a long day. Copilot Voice offers four different voice options, making the assistant feel more personal. This feature is currently only available in English-speaking countries, including the United States, the United Kingdom, Canada, Australia and New Zealand. However, Microsoft is working to expand to other languages and regions.
In addition, Microsoft is introducing Copilot Daily, a feature that offers users a daily summary of news, weather and upcoming appointments. This information is read aloud in the voice of the chosen Copilot Voice. The content is carefully curated from verified sources such as Reuters, Axel Springer and the Financial Times.
Designed to combat information overload, Copilot Daily makes it easy to quickly get up to speed on key developments. In the future, the feature will expand to include more resources and personalization options, allowing users to further customize their daily updates.
Visual support with Copilot Vision
One of the most useful new features is Copilot Vision. This feature offers users a new way to interact with the content on their screen. Copilot Vision can recognize and interpret both text and images on a Web page, offering suggestions in real-time without interrupting the user’s workflow. This can be useful, for example, when decorating a new home, where Copilot Vision helps select furniture, put together a color palette or even visualize the layout of the room.
Copilot Vision is currently available through Copilot Labs, a platform where Microsoft is testing experimental features with a limited number of users. The feature is only being rolled out to users in the United States for now, but Microsoft has plans to make Copilot Vision more widely available in the future.
Experiments in Copilot Labs: Think Deeper
In addition to Copilot Vision, Microsoft is also introducing a new experimental feature in Copilot Labs: Think Deeper. This feature is designed for more complex questions and situations that require more in-depth analysis. Think Deeper takes more time to arrive at an answer, enabling Copilot to provide detailed and well-reasoned suggestions.
This can be useful when comparing different options Microsoft cites an example when considering a new place to live or looking for the best car to match your profile. Think Deeper is currently being tested in a limited group of English-speaking countries, including Australia, Canada, New Zealand, the United Kingdom and the United States.
Rollout and future plans
The revamped Copilot with all the above new features will be made available starting today on various platforms, including iOS, Android and Windows. Users can also access the assistant through Copilot’s web version. Copilot also integrates deeper into the Microsoft Edge browser. Users can invoke the help to summarize pages, translate text or answer questions by simply typing “@copilot” in the address bar.
Microsoft emphasizes that privacy and security are paramount in these innovations. Data processed through Copilot Vision will not be stored or used for further training of the system, according to the software giant. All sessions are temporary and fully opt-in. In addition, the assistant does not work on websites with sensitive or paid content, to ensure the safety of users.
In addition to its current features, Microsoft has plans to further expand Copilot to new regions and platforms, such as WhatsApp. This will make the assistant more accessible to a larger audience and allow more users to take advantage of Copilot’s capabilities. More information on this will follow in the future.