August 16 2019: Microsoft's Seeing AI app is a talking camera for the visually challenged. It narrates the world around you. Designed for the blind and low vision community, this ongoing research project harnesses the power of AI to open up the visual world and describe nearby people, text and objects.
Optimized for use with VoiceOver, the app enables you to recognize:
• Short Text - Speaks text as soon as it appears in front of the camera.
• Documents - Provides audio guidance to capture a printed page, and recognizes the text, along with its original formatting.
• Products - Scans barcodes, using audio beeps to guide you; hear the name, and package information when available. (works with iPhone 6 and later)
• People - Saves people’s faces so you can recognize them, and get an estimate of their age, gender, and emotions.
• Scenes (early preview) - Hear an overall description of the scene captured.
• Currency - Recognizes currency notes. (Requires iOS 11)
• Color - Identifies color.
• Handwriting - Reads handwritten text like in greeting cards
• Light - Generates an audible tone corresponding to the brightness in the surroundings.
• Images in other apps - Just tap “Share” and “Recognize with Seeing AI” to describe images from Mail, Photos, Twitter, and more.
• Photo browsing experience - Describes photos on your phone
Only one question: why has Microsoft left out 9/10th of the mobile phone owning world by doing this for Apple iPhones only and not for Android?