Apple’s Siri Audio Intelligence arrives with a detailed explanation of how the company aims to reconcile AI-driven “ambient listening” with user privacy. At Wednesday’s iPhone launch event, Apple introduced a range of new features, including Siri Recap, Live Rewind, Sound Recognition, and Music Recognition, and published a document outlining the technical measures behind them.
According to the company, the raw audio captured by these features “is handled within dedicated hardware, is not saved as a file, and is not accessible to the operating system, apps, or Apple.” That claim rests on a specific piece of silicon at the heart of the new wearables.
How the Secure Exclave Works
Audio Intelligence relies on the Secure Exclave built into the S11 chip that powers the new Apple Watch Series 12 and Apple Watch Ultra 4. The Secure Exclave is described as a hardware-isolated compartment within the silicon, designed to process sensor data separately from the rest of the system.
Data processed and analysed in this compartment cannot be accessed by watchOS, apps, the user, or Apple itself. Audio from the microphone enters the Secure Exclave, where it is initially processed for speech, sounds, or music, without transcribing or storing the raw audio. Apple states that this buffer is a continuously overwritten stream that exists only within the protected hardware and never creates an audio recording.
User Controls and Encryption
Apple says users retain control over “whether and when” Audio Intelligence features are active. Live Rewind requires users to double-tap the Digital Crown each time they wish to activate it. Should Audio Intelligence data need to be transferred to an iPhone, it moves with encryption through the Secure Exclaves of both devices.
Users also decide what text to keep from Siri Recap and Live Rewind. Text generated by Audio Intelligence syncs with end-to-end encryption, provided the device has a passcode set and uses iCloud’s two-factor authentication.
The new listening features debut alongside the Apple Watch Series 12 and Apple Watch Ultra 4, both powered by the S11 chip that houses the Secure Exclave.
Source
Image: theverge.com
