Microsoft ‘Seeing AI’ Helps Blind Users Explore Photos With Touch
The AI can also detect moods by reading facial patterns.
Microsoft has updated its computer vision app for visually challenged people with an option to explore photos by touching them.
The new feature in the "Seeing AI" iOS app enables users to tap their finger on an image on a touch-screen to hear a description of objects within an image and the spatial relationship between them.
“Users can explore photos of their surroundings taken on the ‘Scene’ channel, family photos stored in their photo browser, and even images shared on social media by summoning the options menu while in other apps,” Saqib Shaikh, Software Engineering Manager and Project Lead for ‘Seeing AI’, said in a blog-post.
Seeing AI is already helping users read printed text in books, restaurant menus, street signs and handwritten notes, as well as identify banknotes and products via their barcode.
Leveraging on-device facial-recognition technology, the app can even describe the physical appearance of people and predict their moods.
"For the first time we're releasing iPad support, to provide a better 'Seeing AI' experience that accounts for the larger display requirements," Shaikh added.
Since the app's launch in 2017, Seeing AI has leveraged AI technology and inclusive design to help people with more than 10 million tasks.
Subscribe To Our Daily Newsletter And Get News Delivered Straight To Your Inbox.