2024-12-14
Microsoft's AI Recall Captures Sensitive Data Despite Safeguards
Microsoft's Recall AI feature for Copilot+ PCs was delayed for six months before limited release in December, 2024, in large part due to alarms raised over its security risks. The feature captures screenshots every few seconds and uses AI to make them searchable in a timeline, but the database of screenshots was originally stored in plain text. The new release is opt-in rather than opt-out, and encrypts screenshots, but the "filter sensitive information" safeguard -- meant to prevent Recall from storing data such as credit card numbers or social security numbers -- works inconsistently and is trivial to bypass, as demonstrated in a report from Avram Piltch at Tom's Hardware. "It's pretty much impossible for Microsoft's AI filter to identify every situation where sensitive information is on screen and avoid capturing it," states Piltch, showing Recall capturing user credentials typed in Notepad, a social security number entered in a PDF in the Edge browser, and credit card details in a local HTML page. The article also shows how an attacker with a stolen PIN can bypass biometric security checks to open Recall, even through remote access software.
Editor's Note
A good reminder that 'Secure By Design' of complex software is often an oxymoron, especially in overhyped, competitive areas like digital 'currencies' and artificial 'intelligence.' Given Microsoft's heavily publicized re-commitment to security and their revenue in selling security add-on services, I'm surprised that they release a product that claimed to have a 'Filter Sensitive Information' feature which is to security as a perpetual motion machine is to gas mileage.
John Pescatore
This is a feature that no customers seem to have requested yet they are being forced to take on an insecure and privacy-invasive feature. Microsoft really needs to recall this product until it is fit for purpose from a security point of view and provides value to users.
Brian Honan
No surprise here; Recall, like any tool, can be misused or abused and data leaks. As originally announced Microsoft seemed to think that Recall was simply a part of the operating system and that everyone would use it. It is better thought of as a tool or app that should be used only by design and intent, never by default. As I understand it, the default for individuals is that Recall is off, for enterprises it is set globally by administration.
William Hugh Murray
Recall remains opt-in and requires a Copilot+ PC to operate. Recall's sensitive data filtering is still evolving, so use caution testing it. Given that it is positioned to be your one-stop digital memory, expect users to want to enable and use it, particularly if it's enabled on their new home computers, so you're going to need to understand the risks and have sufficient sign-off before wide deployment.
Lee Neely
There are valid use cases for the Recall AI feature; however, one must also weigh the security risks in using new technology. At least the database where the screenshots are kept is encrypted now.
