Apple recently has announced a new feature called Live Text that aims to digitize the text in its users’ photos. This unlocks a plethora of handy functions. It can aid in turning handwritten notes into emails and messages, searching camera roll for receipts or recipes, and a lot more.
This isn’t a new feature, Samsung and Google have launched similar tools, yet Apple’s Live Text has a smoother implementation. For example, With Live Text, the user can tap on the text in any photo in the camera roll or viewfinder and immediately take action from it. They can copy and paste the text, search for it on the web, or call that number if it is a phone number.
According to Apple, the feature is enabled using deep neural networks and on-device intelligence. Apple’s Live Text feature adds OCR to the camera app. The feature works across Apple devices such as iPhones, iPads, and Mac computers. It can support seven languages, including English, Chinese, French, Italian, German, Spanish, and Portuguese. The feature is integrated with Apple’s Spotlight search feature on iOS.
Apart from extracting text from photos, iOS 15 will also enable users to search visually — a feature similar to Google Lens. According to the tech giant, the new tool would recognize “art, books, nature, pets, and landmarks” in photos. This is a step forward in utilizing AI to make things easier for its users.