TL;DR
Meta patented an AI system that continuously records voice to detect emotional state. It combines audio with location and activity data. Amazon tried and abandoned a similar product.
Meta has been granted a patent for an AI system that continuously records a user’s voice, transcribes it, and feeds the audio through a machine learning model to detect their emotional state. The patent, published on July 2, describes a device that listens for “audible communications” including sighs, laughter, and vocal tone, and combines them with “contextual factors” like time of day, location, activity, and medication timing. The system builds a persistent mood log from all of this.
The patent, first spotted by Patentlyze, frames the technology as a fitness tool. Meta argues that AI-powered emotional coaching could correct workout posture and adjust guidance in ways a human personal trainer cannot. But the architecture described goes well beyond a gym session. The system is designed for “continuous emotional monitoring on everyday devices,” using what the patent calls “multimodal sensor inputs on synchronized timelines.” It listens at “predefined times” for tone, pace, pauses, and breathing, then quantifies the user’s emotional state. It can correlate mood with medication schedules, producing summaries like “a happier emotional state associated with a particular time of day or at a time when medication is taken.”
Amazon tried something similar. In 2020, it launched the Halo Band, a fitness wearable with a built-in microphone that performed “tone of voice analysis.” After public backlash, Amazon removed the microphones from the next-generation model in 2021 and discontinued the product line entirely in 2023. Meta’s smart glasses are already the subject of a privacy crisis over covert recording, with seven million pairs sold and two US lawsuits alleging the company misled consumers about how footage was handled. Adding persistent ambient voice recording to the product line would extend the surveillance from what users see to how they feel.
The 💜 of EU tech
The latest rumblings from the EU tech scene, a story from our wise ol’ founder Boris, and some questionable AI art. It’s free, every week, in your inbox. Sign up now!
A Meta spokesperson told 404 Media that “patents at Meta are often filed to disclose concepts that may or may not be implemented.” That is standard corporate hedging. But the patent’s specificity, down to medication tracking and emotion-time correlations, suggests more than speculative filing. Kenyan data workers already lost their jobs after revealing they reviewed intimate footage captured by Meta’s glasses. If this patent becomes a product, someone will need to train the emotional model too, which means someone will be listening to recordings of strangers sighing, laughing, and talking to themselves at home, labelling each one with a mood score so the algorithm can learn what sadness sounds like.
