Meta collects employee mouse and keyboard actions

Theo ReutersMeta installs a tool called Model Capability Initiative (MCI) on employee computers, allowing to record mouse and keyboard operations. This is part of Mark Zuckerberg’s company’s larger campaign to build AI agents that can perform automated work, according to an April 21 email to employees.

MCI works on work-related apps and websites. Besides collecting mouse and keyboard data, it will also periodically take screenshots of the content on employees’ screens. The goal is to improve the ability to simulate how humans interact with computers, such as selecting from drop-down menus or using keyboard shortcuts.

In another email to employees sent on April 20, Andrew Bosworth, Meta’s chief technology officer, announced the company would increase internal data collection as part of its “AI for work” effort, called Agent Transformation Accelerator (ATA).

Reply TechCrunch, Meta spokesman Andy Stone confirmed information gathered from MCI would “be among the inputs”. MCI will not be used for performance evaluation or any purpose other than AI model training. The tool also has protections that help prevent the collection of “sensitive content”, but does not specify what types of data are excluded from collection.

According to professor Ifeoma Ajunwa of law at Yale University, computer activity monitoring and screen capture tools have been used by businesses for many years to detect wrongdoing and off-work activities. However, the implementation of keyboard and mouse logging technology is pushing the level of data collection “further forward”, with employees being subjected to real-time monitoring. This model was previously mainly applied to freelance workers or delivery drivers, but is now gradually becoming a part of the office environment.

However, many European countries have a stricter approach. In Italy, electronic monitoring to measure productivity is illegal, while in Germany the deployment of keylogging software is only allowed in exceptional cases, such as suspected involvement in serious illegal conduct. At a regional level, deep surveillance could be considered a violation of the European Union’s General Data Protection Regulation (GDPR).

The trend of automating tasks once performed by humans is spreading among large corporations in the US, especially in the technology sector. The development of AI agent systems capable of handling complex tasks such as writing software or organizing large-scale data with minimal supervision is changing the structure of business operations.

However, this led to fluctuations in the market, when stocks of traditional software companies were under pressure, and at the same time many business leaders began to consider plans to cut large-scale personnel to restructure. In fact, Meta plans to cut 10% of its global workforce from May, Amazon laid off about 30,000 office workers, and Block reduced its staff by nearly half.

Meta now pushes employees to use AI agents in programming. The company also established an Applied Artificial Intelligence (AAI) team to develop an AI system that can handle most of the product building, testing and deployment process, and began transferring engineers to this department.