The headphones that see the world: Apple approaches AirPods with cameras

According to the report, the new headphones include tiny cameras in both headphones, right and left. Unlike smartphone cameras, they are not intended for taking photos, videos or personal documentation, but rather for collecting basic low-resolution visual information. This information should be used by Siri, Apple’s voice assistant, to answer questions related to what the user sees in front of him.

The main idea is relatively simple to understand but very complex to execute: the user will be able to look at an object, a product, a food ingredient or a landmark on the street, and ask Siri what he sees, what can be done with it, or how to act. For example, a person standing in front of groceries in the kitchen could ask what they can make for dinner. A pedestrian in the city will be able to receive more precise directions, as the system identifies buildings, signs or landmarks and explains when and where to turn.

According to Bloomberg, the prototypes are currently in what is known as design verification testing, one of the last steps before early production testing. This means that the hardware is already relatively close to its final form, but the path to commercial launch still depends not only on the physical product, but also on the quality of the artificial intelligence capabilities that will activate it. If Apple is not satisfied with the accuracy, speed or reliability of the visual recognition, the launch may be delayed.

The new feature in AirPods connects to a wider race in the technology industry. Meta is promoting smart glasses with cameras and artificial intelligence capabilities, Ofen Ai is recruiting senior hardware personnel and developing new devices around artificial intelligence, and other companies are trying to find the next device that will replace or complement the smartphone. Apple, which for years has been considered a company that prefers to enter markets only when the product is mature enough, is now required to prove that it is not lagging behind.

In terms of design, the headphones are expected to look relatively similar to the AirPods Pro 3, but with longer arms designed to accommodate the cameras and accompanying components. Apple is not planning, according to the report, to turn them into a hand gesture control device, as can be seen in some of its sensor-heavy products. The goal is narrower: to add a vision layer to an existing and common product, without turning it into a cumbersome device.

Meanwhile, the report places the headphones as part of a wider wave of future products at Apple. According to Bloomberg, the company is also working on smart glasses, a pendant device with cameras, a MacBook with a touch screen, a foldable iPhone and smart home devices based on artificial intelligence. The big question is whether Apple will be able to combine polished hardware, privacy, an improved voice assistant and truly useful artificial intelligence capabilities.