Skip to main content

Facebook tests tech to help blind people enjoy photos


Facebook introduced machine learning technology trained to recognize objects in pictures and then describe photos aloud.
"As Facebook becomes an increasingly visual experience, we hope our new automatic alternative text technology will help the blind community experience Facebook the same way others enjoy it," said accessibility specialist Matt King.

The feature was being tested on mobile devices powered by Apple iOS software and which have screen readers set to English.
Facebook planned to expand the capability to devices with other kinds of operating systems and add more languages, according to King, who lost his vision as a US college student studying electrical engineering.
The technology works across Facebook's family of applications and is based on a "neural network" taught to recognize things in pictures using millions of examples.
More than two billion pictures are shared daily across Facebook, Instagram, Messenger and WhatsApp, King said.
"While this technology is still nascent, tapping its current capabilities to describe photos is a huge step toward providing our visually impaired community the same benefits and enjoyment that everyone else gets from photos," King said.
The Silicon Valley-based social network said that it was moving slowly with the feature to avoid potentially offensive or embarrassing gaffes when it comes to automatically describing what is in pictures.
Words used in descriptions included those related to transportation, outdoors settings, sports, food, and people's appearances.
The Facebook technology made its debut less than a week after Microsoft enticed software developers with a suite of offerings that let them tap into the power of cloud computing, big data, and machine learning.
The Cortana Intelligence Suite boasted the ability to let applications see, hear, speak, understand and interpret people's needs.
Microsoft said that a "Seeing AI" research project was underway to show how those capabilities could be woven into applications to help people who are visually impaired or blind better learn what is around them, say by scanning scenes with smartphone cameras or specially equipped eyewear.

Comments

Popular posts from this blog

THE START UP OF YOU

Have you ever thought deeply about your life? How you’ve changed so much since your childhood.

Panama Papers: Shell company participated in unsuccessful bid for Pune IPL franchise in 2010

A shell company registered in the British Virgin Islands was part of a 10-member consortium that bid unsuccessfully for the Pune Indian Premier League (IPL) team in 2010, according to reports. It is the first link to emerge between the cash-rich IPL and leaked documents from the Panamanian law firm Mossack Fonseca.

HOW FAR; HOW WELL

Yesterday, I was passively listening to a radio program when the presenter played a Christmas tune. Like a big joke, I suddenly began to realize that the year is as good as over. I still remember like it was yesterday when I was putting down my new year’s resolutions and my goals.