Anthropic has introduced a new feature in public beta for its Claude 3.5 Sonnet AI model, which allows AI to interact with a computer in a similar way to a human. This ability, called “computer use”, allows Claude to analyze the screen, move the cursor, click buttons and type text. The functionality is currently available via API, giving developers the ability to integrate Claude into applications that require interaction with a computer. A demonstration video shows Claude working on a Mac, opening up new perspectives for process automation and user support.
Although other companies like Microsoft (with Copilot Vision), OpenAI (with the desktop app for ChatGPT), and Google (with Gemini for Android) have already explored the interaction between AI and the computer screen, Anthropic appears to be the first to release tools of this type on a large scale. It’s important to note that the “computer use” feature is still experimental and, as Anthropic points out, may have limitations in terms of accuracy and smoothness. Some common actions, such as dragging and zooming, are not yet supported by Claude. Furthermore, the screen analysis system, based on a series of screenshots rather than a continuous video stream, can result in temporary elements such as notifications being missed.
Anthropic has also implemented security measures to limit the use of Claude in sensitive areas. For example, there are mechanisms to prevent AI from being used for election-related activities, for generating and publishing content on social media, for registering web domains or for interacting with government sites. In addition to the new “computer use” feature, Claude 3.5 Sonnet features significant improvements in several benchmarks, particularly when it comes to coding and tool usage. Coding performance has increased dramatically, surpassing that of other public models, including reasoning models such as OpenAI o1-preview and specialized systems.
Arden's Garden Juice Bar & Smoothies Sandy Springs – Sandy Springs, GA
Neighborhood Link – Profile for fanniedodd
Why UK88 Is the Go-To Choice for Gambler – ImageEvent
Профиль пользователя на Cossa.ru
FidelDougan · Profile · Disqus
Page not found – Dad Book Club
Certificate verification problem detected
marvincrow | ReverbNation
UK88: A Comprehensive Guide to the Gambling Platform | 게임 플레이의 새로운 시대 in New York, NY 10001
lulamartinez
loriestarr – Users – TRCA Open Data
carolpautler | Peatix
Certificate verification problem detected
Vaporplanet | Blog Vape Shop Melhores opções de compra de gl…
Index Fórum
robbylucas – Users – Document Management System
The Best Home Management Is Free | Articles@PR7
Follow Scarlett Pope on Halaltrip timeline | Halal Trip
Situs Pilihan untuk Permainan Slot
Page not found – Potential Social Bookmarking System for Business Directory
soycattle0
أولوية تحسين الخدمات العامة( المجال أو المكان : القرى / المدن / العشوائيات ) – Lucky11: An Emerging Star in the Gambling…
The Best Housekeeper Agencies in Your Area – Crazy Sheep
Lice Busters :: Behance
zeldachilders's Profile – IMDb
Profile – evalynhawkins – CUSAT Alumni
Keuangan Bukittinggi
Page not found – Best Dofollow Social Bookmarking Site to Share Web Resource
Jaké Jsou Nezbytné Částí Českých Palačinek?
User porchfriend6 – FuMe – Happiness is contagious!