Apple Watch's Siri Recap Automatically Summarizes Conversations

Apple introduced Siri Recap for its new Watch models, which uses ambient listening to generate titles, summaries, and key points from conversations. Users can set the feature to always on, scheduled, or off. The always-listening capability raises privacy concerns, though Apple says raw audio is not stored and recaps are encrypted.
The new Watch models also gain instant song recognition via Shazam, matching a capability previously offered by Google's Now Playing. Additionally, the device can detect specific loud environmental noises, such as alarms or a baby crying, and alert the wearer. A separate control, Live Rewind, allows users to retrieve a brief 15-second audio recap by pressing the digital crown twice.
Apple has implemented several safeguards, including not storing raw audio, preventing speaker identification, and encrypting the Live Rewind recaps end-to-end. Despite these measures, the always-on option could still capture sensitive details within its generated summaries. This feature places the Watch in direct competition with existing third-party notetaking apps like Granola and Circleback, which already offer Watch compatibility.
The introduction of an always-listening notetaker on a wearable could significantly alter how people manage personal and professional interactions, potentially reducing the need for manual note-taking. However, it may also create new social frictions, as individuals might feel less comfortable speaking freely if they know their conversations are being summarized. Privacy-conscious users could face a dilemma between convenience and confidentiality, while employers and colleagues may need to establish new norms regarding consent and surveillance in everyday settings.