Apple’s Live Text will read aloud all the text in all your photos with AI


Apple has announced a new feature called Live Text, which digitizes the text in all your photos. This unlocks a whole host of useful features, from turning handwritten notes into emails and messages to searching your camera roll for receipts or recipes you’ve photographed.

This is certainly not a new feature and we have seen companies like Samsung offer similar tools in the past. But Apple’s implementation generally looks smooth. With Live Text, for example, you can tap the text in any photo in your camera roll and take immediate action on it. You can copy and paste that text, search for it on the web, or — if it’s a phone number — call that number.

Apple says the feature was enabled using “intelligence on the device,” which appears to be the company’s preferred phrase for machine learning. It highlights Apple’s privacy-focused approach to AI, which focuses on processing data on the device rather than in the cloud.

Live Text works on iPhones, iPads and Mac computers and supports seven languages.

Developing… we’re adding more to this post, but you can follow us with our WWDC 2021 live blog to get the news even faster.