Meta's new 'creative' AI tool might be quietly uploading your private photos
The feature effectively grants Meta access to users’ private, offline photo libraries — expanding its reach beyond publicly shared data like posts and comments
Meta is testing a new AI feature that taps directly into users' camera rolls to suggest creative photo edits, collages, and recaps — a move that has raised fresh privacy concerns.
How it works:
- When creating a new Facebook Story, users are prompted to "Allow" Meta to upload photos and videos from their phone's camera roll to the company's cloud.
- This permission enables Facebook to access the camera roll on an ongoing basis, continuously syncing new and existing photos.
- Meta's AI then analyzes the images — using time, location, and themes — to generate personalized suggestions like AI restylings or memory recaps.
- These creations stay private unless the user decides to share them.
Meta's position:
Keep updated, follow The Business Standard's Google news channel
- A Meta spokesperson confirmed the feature is in testing, describing it as a way to "make content sharing easier."
- The company says the uploaded media is not used for ad targeting and that the data helps improve the quality of suggestions, not AI models.
Why it matters
The feature effectively grants Meta access to users' private, offline photo libraries — expanding its reach beyond publicly shared data like posts and comments. Privacy advocates warn it could mark a turning point in how personal data is fed into generative AI systems.
The risks
- Broad data access: Opting in gives Meta permission to analyze your photos, including faces, objects, and timestamps.
- Vague retention policy: Meta's AI Terms allow the company to "retain and use" any personal information shared, though it's unclear how long or in what capacity this data is stored.
- Potential human review: The terms note that human reviewers may examine AI interactions — meaning uploaded photos could, in theory, be seen by real people.
- Difficult to disable: The toggle to turn off "camera roll sharing suggestions" is buried under Settings → Preferences, which may make it hard for users to opt out later.
- Slippery slope: Critics warn this "test" blurs the line between private and public data, normalizing ongoing uploads of personal media to corporate AI systems.
What users are saying
Some users have already encountered the feature and expressed confusion online, posting screenshots and asking how to stop the uploads. The opt-in prompt appears while users are about to post a Story — a moment designed for quick taps rather than deep reading.
Where it's rolling out
Meta is currently testing the feature in select markets, including the US and Canada, before a potential broader rollout. Company insiders and industry analysts expect that, if the trial proves successful, it could be expanded globally within months as part of Meta's wider push to embed AI across Facebook and Instagram.
Meta's new camera roll AI test could make sharing easier — but at a high privacy cost. Experts warn it's another step toward normalizing the continuous feeding of personal data into corporate AI systems, one "Allow" button at a time.
