B3 · Applications of Artificial Intelligence

Trying AI Accessibility Tools

AI accessibility tools use AI to make information available to more people, especially people with disabilities. Examples include live captions that turn speech into text, screen readers that read text and describe images aloud, text-to-speech, translation and camera apps that describe the surroundings. They are powerful helpers, but they make mistakes, so important details should be checked.

10 min Beginner Jump to the activity

What you need: Nothing. This page starts from the beginning, with no programming and no formulas.

Definition

A short announcement plays over the school speakers, and the live captions on a classmate's phone show the words. Can you trust every word the captions say?

AI accessibility tools use AI to make information available to more people, especially people with disabilities. Examples include live captions that turn speech into text, screen readers that read text and describe images aloud, text-to-speech, translation and camera apps that describe the surroundings. They are powerful helpers, but they make mistakes, so important details should be checked.

In simple words

Live captions are like a very fast note-taker who writes down everything that is said. Most of the time the notes are right, but a fast note-taker can mishear a name, a number or a word in a noisy room. Reading captions with care, and fixing them when needed, makes them truly useful.

Why it matters

Accessibility tools open up lessons, videos, phones and public notices to people who are deaf or hard of hearing, blind or have low vision, or reading in a new language. A wrong time or a missing instruction in a caption can make someone miss an exam or a bus, so learning to spot and fix errors matters for everyone.

Key terms

Accessibility
Designing things so that everyone, including people with disabilities, can use them.
Live captions
The text of spoken words shown on screen as they are said, usually made by speech recognition.
Screen reader
Software that reads aloud what is on a screen, used by people who are blind or have low vision.
Image description
A short written description of a picture, which a screen reader can read aloud; on websites it is often called alt text.
Recognition error
A word the tool heard or read wrongly, often a name, a number or something said in noise.

Explained in detail

What these tools do

Speech recognition listens to speech and writes it as text, which powers live captions on phones, computers and video calls. Many phones and computers now have a captions setting that works on almost any video or call. Screen readers do the reverse: they turn text into speech, so that a person who cannot see the screen can hear it, and newer ones use AI to describe photos. Translation tools turn a notice into another language, and camera apps can read signs or describe a room aloud. For many people these tools are not extras; they are how they take part in lessons, work and daily life.

Where captions go wrong

Kind of errorExampleWhy it happens
Missed or wrong name'Ms. Fernandes' left outNames are rare words the tool may not know
Wrong number or time'2:15' shown as '2:50''Fifteen' and 'fifty' sound alike
Missing instruction'Bring your ID card' droppedNoise or a fast speaker
Similar-sounding word'hall' shown as 'all'Similar sounds or unclear speech

Captions are usually right for everyday words spoken clearly. They struggle most with names, numbers, accents, background noise and several people talking at once. Those are exactly the details that matter in an announcement: who, when, where and what to bring.

Using captions wisely

Read captions actively. Ask whether each name, time, place and instruction makes sense. If something looks odd, compare it with another source: the written notice, the speaker or a friend who heard it. For important events, organisers should give a written notice or human-checked captions as well, instead of relying on automatic captions alone. In India, Section 42 of the Rights of Persons with Disabilities Act, 2016 asks the government to make information and communication technology accessible, including captions and audio description, which is one reason websites, apps and public services are adding these features.

Fixing a caption is simple: keep what is right, correct what is wrong and add what is missing. Writing a short corrected version for a classmate who relies on captions is a real act of inclusion.

The tools are improving quickly, but the people who rely on them every day are the real experts. Whenever you make a notice, a video or a presentation, ask whether someone who cannot hear it or see it could still follow it: add captions, describe important pictures in words, and never put key information only inside an image.

How it works

  1. Read or listen to the announcement and its captions together.
  2. Check each name, time, place and instruction.
  3. Mark anything that is missing, wrong or unclear.
  4. Confirm with another source, such as the written notice or the speaker.
  5. Write a corrected version and share it.

Worked example

The announcement said: 'Good morning. The science quiz led by Ms. Fernandes will begin at 2:15 pm in Room 12. Please bring a pencil and your ID card.' The captions showed: 'Good morning. The science quiz will begin at 2:50 pm in Room 12. Please bring a pencil.' Comparing line by line, three things are wrong: the name Ms. Fernandes is missing, the time is 2:50 instead of 2:15 because fifteen and fifty sound alike, and the instruction to bring an ID card has disappeared. The corrected caption reads: 'The science quiz, led by Ms. Fernandes, begins at 2:15 pm in Room 12. Bring a pencil and your ID card.'

Try it yourself

Fixing live captions

Follow one announcement from the speaker to a corrected caption.

Spot the caption error

Match each caption to what went wrong.

  • 'Meet at the main all at noon'
  • 'The bus leaves at 4:50', when the speaker said 4:15
  • 'The talk by will start soon'
  • 'Bring your form', when the speaker said 'Bring your signed form by Friday'

A new case: an automatic translation

Decide what to check before sharing.

  1. A notice in English says 'Parents' meeting on Saturday, 5 April, at 11 am.' An automatic Hindi translation shows the date as 4 April. What would you do before sharing it?
  2. List two other details in a translated notice that you would always check.
  3. With an adult's permission, turn on captions for a short video at home and note one word they got wrong.

Think about it

  • Who would be most affected if the wrong date were shared?

Common mistakes

  • Trusting every caption word, especially names and numbers.
  • Fixing a caption by guessing instead of checking the original.
  • Thinking accessibility tools help only a few people; they help everyone in noisy places, in new languages or when the sound is off.

Check yourself

Question 1

1. Which caption detail is most likely to be wrong?

Question 2

2. The caption says 2:50 but you suspect 2:15. What should you do?

Question 3

3. What does a screen reader do?

Question 4

4. New case: a translation app turns 'Bring a water bottle' into a sentence about 'bringing water from the well'. What is the best step?

Summary

  • AI accessibility tools, such as captions, screen readers and translation, open information to more people.
  • They make mistakes most often with names, numbers, noise and accents.
  • Check important details against another source, fix what is wrong and share the corrected version.

Finished reading?

Sources: Department of Empowerment of Persons with Disabilities · Acts, including the RPwD Act, 2016