Microsoft Partners with Accessibility App to Enhance AI for the Blind and Visually Impaired
Be My Eyes will provide anonymized data to assist in training Microsoft's artificial intelligence systems.
A Partnership for More Inclusive AI
In an era of rapid technological advancement, Microsoft is partnering with Be My Eyes, an app supporting visually impaired and blind individuals. This collaboration aims to enhance the training of Microsoft’s artificial intelligence (AI) by using anonymized video data from Be My Eyes to improve scene understanding. Be My Eyes’ mission is to make the world more accessible for the 340 million people with visual impairments.
Unique Data for Better Representation
The data provided by Be My Eyes will include unique elements such as specific objects, lighting, and framings that accurately represent the experiences of blind and visually impaired users. This will aid in making Microsoft’s AI more inclusive for those with visual disabilities.
Privacy and Data Respect
It is critical to note that all personal information has been removed from the metadata. The data will not be used for advertising purposes, but solely for training Microsoft’s AI models.
An Established Collaborative Relationship
Be My Eyes has previously collaborated with Microsoft since 2017. The Be My AI tool, powered by GPT-4, has been integrated into Microsoft’s disability support desk, assisting visually impaired users with navigating Office, Windows, and Xbox platforms.
Earlier this month, Be My Eyes also sealed a deal with Hilton, where hotel staff assist blind and visually impaired guests with tasks such as adjusting thermostats, preparing coffee, or managing blinds. A prior partnership in 2023 helped train the Be My AI model.
Advancements in AI can ease cognitive burdens by streamlining synthesis, automating meeting note-taking, and providing detailed image descriptions. Such progress has profoundly positive impacts on neurodiverse, deaf, blind, and other communities. With over a billion people globally affected by disabilities, addressing the data gap in disability is crucial.
Through these partnerships, AI continues to evolve, become more inclusive, and better serve all users, regardless of their visual capabilities.