Microsoft adds voice and new visualization and reasoning capabilities in Copilot

Microsoft has introduced new features for its assistant Artificial intelligence (AI) Copilot, which will now have the ability to see and reason what is shown on the screen, as well as speak naturally with users through the Copilot Voice mode, among other new features.

The technology company is implementing new tools and functions in order to improve the user experience when carrying out their daily tasks. In this sense, in addition to announcing new features for users with Copilot+ PC and Windows 11, it has also presented new options in Copilot, in order to make this assistant “an AI companion for everyone.”

Among these new features, Microsoft has indicated that it has renewed its assistant, implementing a more intuitive design for users, with answers that are displayed in a simpler way for a faster and more fluid understanding.

As the company has detailed in a statement on its blog, this redesign introduces warm tones and a “distinctive” style. In addition, it not only offers information, but will also show comments and useful tips for users, depending on the tools they are using or the actions they are carrying out.

On the other hand, along with the redesign of Copilot, the technology company has introduced new functions for the assistant, which offers a more natural and fluid experience for users. This is the case of Copilot Voice, Copilot Daily and Copilot Vision, among others.

With Copilot Voice, Microsoft has added voice to its assistant, so that users will be able to interact using voice commands and, in the same way, receive responses also by voice to achieve a more intuitive and natural conversation. This way, users will be able to use a conversation to ask a quick question or talk more comfortably with Copilot. In addition, they can choose between four different voice options.

Following this line, Copilot has also added Copilot Daily, an option with which it will offer a daily summary of current news and weather when accessing the assistant. This function will display the information in a “clean and simple” way so as not to overload users with information, and will only offer content from authorized sources.

Likewise, Microsoft has indicated that Copilot has been integrated directly into the Microsoft Edge browser, and will be able to offer all its functions by simply typing ‘@copilot’ in the address bar.

LOOK: The mystery of small red dots in space that baffles astronomers

Copilot Labs

Microsoft has also announced that it has launched Copilot Labs, a platform that allows users to test experimental functions still in development, before they are officially launched. With Copilot Labs, users will be able to share their feedback on new features and, with this, the company will be able to make improvements based on the feedback.

One of the features that Microsoft has incorporated into Copilot Labs is Copilot Vision. Now, the AI ​​assistant can see what is on the screen and interact with this content, through “a completely new way of interacting with a computer.”

This new capability allows Copilot to understand the images and text that appear, for example, on a web page or in a document and, based on this, it can answer questions about this content or help the user by offering different options without interrupting the flow. of work. For example, in a search for furniture for a living room, Copilot can offer help based on what is being searched on the Internet, either by showing a color palette or suggestions for decoration accessories.

However, Microsoft has stressed that, although Copilot can see everything that is displayed on the screen, it does so safely and protecting the user. To this end, the company has explained that the use of Copilot Vision is “optional and ephemeral”, in addition, none of the content with which the assistant interacts is stored, since at the end of its use, the data is permanently discarded.

LOOK: How AirPods allowed the police to find a stolen car and capture suspects

Also, please note that Copilot Vision will not work on all websites to ensure a safe experience. Likewise, this option will not work with confidential or paid content either. That is, Copilot Vision “simply reads and interprets the images and text you see on the page for the first time,” according to Microsoft. At the moment, this is a feature in preview.

Also in Copilot Labs, Microsoft has begun testing the Think Deeper function, with which the assistant will be able to reason about more complex questions of all kinds. With this option, Copilot will take more time before responding, in order to offer more detailed answers to difficult questions.

With all this, this Copilot update has begun to be made available to iOS, Android and Windows devices, as well as through the Copilot web experience. However, at the moment, the new Copilot Voice features, Daily, Vision and Think Deeper, have not been launched in Europe.

Specifically, Copilot Voice is initially available to English users in Australia, Canada, New Zealand, the United Kingdom, and the United States. For its part, Copilot Daily has been launched in the United States and the United Kingdom.

Copilot Vision will be rolled out “soon” to Copilot Labs for a limited number of Copilot Pro users in the United States, and eventually Think Deeper will be added to Copilot Labs for users in Australia, Canada, New Zealand, the United Kingdom, and the United States.