Microsoft adds voice and new visualization and reasoning capabilities in Copilot

Microsoft has presented new functions for its Artificial Intelligence (AI) assistant Copilot which will now have the ability to see and reason what is shown on the screen, as well as speak naturally with users through the mode Copilot Voice among other news.

The technology company is implementing new tools and functions in order to improve the user experience when carrying out their daily tasks. In this sense, in addition to announcing news for users with Copilot+ PC and Windows 11, it has also presented new options in Copilot, in order to make this assistant “an AI companion for everyone“.

Among these new features, Microsoft has indicated that it has renewed its assistant, implementing a more intuitive design for userswith answers that are displayed in a simpler way for a faster and more fluid understanding.

As the company has detailed in a statement on its blog, this redesign introduces warm tones and a “distinctive” style. Furthermore, it not only offers information, but also will show comments and useful tips for usersdepending on the tools they are using or the actions they are carrying out.

On the other hand, along with the redesign of Copilot, the technology company has introduced new features for the assistant, with which it offers a more natural and fluid experience for users. This is the case of Copilot Voice, Copilot Daily and Copilot Vision, among others.

Con Copilot VoiceMicrosoft ha added voice to your assistantso that users will be able to interact using voice commands and, in the same way, also receive responses via voice to achieve a more intuitive and natural conversation. This way, users will be able to use a conversation to ask a quick question or talk more comfortably with Copilot. Furthermore, they will be able Choose from four different voice options.

Following this line, Copilot has also added Copilot Dailyan option with which it will offer a daily summary of current news and weather when accessing the assistant. This function will display the information in a “clean and simple” way so as not to overload users with information, and will only offer content from authorized sources.

Likewise, Microsoft has indicated that Copilot has integrated directly into the Microsoft Edge browserand you can offer all its functions by simply typing ‘@copilot’ in the address bar.

COPILOT LABS

Microsoft has also announced that it has Copilot Labs launcheda platform that allows users test experimental features still in developmentbefore being officially launched. With Copilot Labs, users will be able to share their feedback on new features and, with this, the company will be able to make improvements based on the feedback.

One of the functions that Microsoft has incorporated into Copilot Labs is Copilot Vision. Now, the AI assistant can see what is on the screen and interact with this content, through “a completely new way of interacting with a computer.”

This new capability allows Copilot understand images and text that appear, for example, on a web page or in a document and, based on this, it can answer questions about this content or help the user by offering different options without interrupting the workflow. For example, in a search for furniture for a living room, Copilot can offer help based on what is being searched on the Internet, either by showing a color palette or suggestions for decoration accessories.

However, Microsoft has stressed that, although Copilot can see everything that is displayed on the screen, it does so safely and protecting the user. To this end, the company has explained that the use of Copilot Vision is “optional and ephemeral”, besides, none of the content the assistant interacts with is storedsince at the end of use, the data is permanently discarded.

Likewise, it must be taken into account that Copilot Vision will not work on all websites to ensure a safe experience. Likewise, this option It will not work with confidential or paid content either.. That is, Copilot Vision “simply reads and interprets the images and text you see on the page for the first time,” according to Microsoft. For the moment, it is a function in preview.

Also at Copilot Labs, Microsoft has begun testing the Think Deeper featurewith which the assistant can reasoning about more complex questions of all kinds. With this option, Copilot will take more time before responding, in order to offer more detailed answers to difficult questions.

With all this, this Copilot update has begun to be made available to iOS, Android and Windows devices, as well as through the Copilot web experience. However, for the moment, the new features Copilot Voice, Daily, Vision y Think Deeper, They have not been released in Europe.

Specifically, Copilot Voice is initially available to English users in Australia, Canada, New Zealand, the United Kingdom, and the United States. For its part, Copilot Daily has been launched in the United States and the United Kingdom.

Copilot Vision will be rolled out “soon” to Copilot Labs for a limited number of Copilot Pro users in the United States, and eventually Think Deeper will be added to Copilot Labs for users in Australia, Canada, New Zealand, the United Kingdom, and the United States.