Apple Introduces ‘Live Text’ Feature In iOS 15: An AI Powered Feature To Recognize Text In Photos

Apple’s Live Text feature brings OCR to the camera app

Add as a preferredsource on Google

Apple recently has announced a new feature called Live Text that aims to digitize the text in its users’ photos. This unlocks a plethora of handy functions. It can aid in turning handwritten notes into emails and messages, searching camera roll for receipts or recipes, and a lot more.

This isn’t a new feature, Samsung and Google have launched similar tools, yet Apple’s Live Text has a smoother implementation. For example, With Live Text, the user can tap on the text in any photo in the camera roll or viewfinder and immediately take action from it. They can copy and paste the text, search for it on the web, or call that number if it is a phone number.

Open Source OmniParseBench · by Datalab · Apache 2.0 Benchmark any document parser on tables, math, forms and handwriting. Yes/no tests per page across text, table and layout families. Score vendor parsers on the Hugging Face dataset or your own PDFs with score and predict primitives. ★ Star on GitHub Multi-column, rotated text, degraded scans · tagged by script and language github.com/datalab-to/omni_parse_bench Fork it · Add your parser

According to Apple, the feature is enabled using deep neural networks and on-device intelligence. Apple’s Live Text feature adds OCR to the camera app. The feature works across Apple devices such as iPhones, iPads, and Mac computers. It can support seven languages, including English, Chinese, French, Italian, German, Spanish, and Portuguese. The feature is integrated with Apple’s Spotlight search feature on iOS. 

https://www.apple.com/newsroom/2021/06/ios-15-brings-powerful-new-features-to-stay-connected-focus-explore-and-more/

Apart from extracting text from photos, iOS 15 will also enable users to search visually — a feature similar to Google Lens. According to the tech giant,  the new tool would recognize “art, books, nature, pets, and landmarks” in photos. This is a step forward in utilizing AI to make things easier for its users.  

Source: https://www.apple.com/newsroom/2021/06/ios-15-brings-powerful-new-features-to-stay-connected-focus-explore-and-more/

Website | + posts

Consultant Intern: Kriti Maloo is currently pursuing her B.Tech from Indian Institute of Technology (IIT) Bhubaneswar. She is interested in Data Analytics and its applications in various domains. She is a Bibliophile and loves to explore new advancements in the field of technology.