Google, Gemini Intelligence manages the smartphone for us

Technological evolution passes through a profound revision of task automation. Gemini will soon be able to operate over a much broader range of action, overcoming the current limitations that saw it confined to a few mobility and home delivery services. The most significant innovation is the integration of multimodality into operational processes: the system will be able to analyze screenshots and photographs to activate specific actions. A concrete example is the possibility of providing artificial intelligence with the image of a shopping list written by hand or in notes to see the products automatically added to the digital cart, provided you have hardware compatible with the new performance standards.

One of the pillars of this transformation is represented by Create My Widget, described as the first step towards the so-called generative user interface. The function allows you to create customized control tools starting from a simple textual description in natural language. Whether it’s a weather widget that highlights only the parameters relevant to a cyclist or a panel that suggests high-protein recipes on a weekly basis, AI takes care of the visual and functional programming of the element. This flexibility will not only concern smartphones, but will also extend to the Wear OS ecosystem, bringing the same customization directly to users’ wrists.

The integration of Gemini also becomes more widespread within the Chrome browser for Android, where a dedicated button will allow you to query the assistant on the contents of the web page being consulted. For users who have subscribed to the Pro or Ultra plans, an automatic navigation function will also be available for managing appointments and reservations. At the same time, Android’s automatic compilation system will become more intelligent, drawing, upon consent, from the data stored in Gmail and Google Photos to extrapolate useful information, such as the details of a document or the vehicle license plate. The release of these innovations will occur in waves over the course of the year, marking a decisive shift towards an increasingly less manual user experience.