We need your help now

Support from readers like you keeps The Journal open.

You are visiting us because we have something you value. Independent, unbiased news that tells the truth. Advertising revenue goes some way to support our mission, but this year it has not been enough.

If you've seen value in our reporting, please contribute what you can, so we can continue to produce accurate and meaningful journalism. For everyone who needs it.

Soon those with vision problems will be able to know what exactly is happening in photos like this one. AP Photo/Dar Yasin

A new feature from Facebook will change how millions experience it

The system, automatic alternative text, will help those who are blind or visually impaired know what is in a photo.

THOSE WHO ARE blind or have visual impairments will soon be able to find out what is contained in photos on Facebook.

The system, called ‘automatic alternative text’, was launched today and creates captions for photos posted on the site. Using a screen reader, which uses a device’s built-in text-to-speech function to read out text, the system will offer a brief summary of an image when it sees it.

So for example, a photo with your friends outside may be described as “image may contain three people, smiling, outdoors”.

Currently, the system will only read the person posting it and mention the term ‘photo’ on its own before skipping to the next post. This update will try to describe what is in the photo.

The description appears at the bottom of the image and is repeated by the phone’s text-to-speech function.

The descriptions aren’t the most comprehensive, instead focusing on basic labels like people, trees, and cars, but it only identifies objects when it’s confident it knows what’s in it. It is a work in progress, but Facebook hopes it will continue to improve over time.

facebook image description Facebook / Vimeo Facebook / Vimeo / Vimeo

How it manages to do this is through object recognition technology developed by its accessibility team, which was created five years ago. In recent months, the company had been demoing the service and explaining how it used artificial intelligence to power it.

Those who use the iOS version in the US will have access to it first while the feature will roll out to users in other countries over time.

When it arrives, you need to turn on VoiceOver on iOS to use it. Go into Settings > General > Accessibility > VoiceOver and you will see the different options and settings for it.

Read: A new iPhone bug lets you talk Siri into giving you its contacts and photos >

Read: Tesla made a crazy amount of money on a car that could take years to arrive >

Readers like you are keeping these stories free for everyone...
A mix of advertising and supporting contributions helps keep paywalls away from valuable information like this article. Over 5,000 readers like you have already stepped up and support us with a monthly payment or a once-off donation.

Your Voice
Readers Comments
    Submit a report
    Please help us understand how this comment violates our community guidelines.
    Thank you for the feedback
    Your feedback has been sent to our team for review.