Development of Automated Closed Captioning Tool in the Arabic Language

Summary

Seeing that people with hearing disabilities in the Arabic speaking world rely heavily on the use of closed captioning and text descriptions, there is a critical need for the development of technology to provide Arabic automated closed captioning tool where human interpreters cannot always be present.

As such, a solution is required to provide people with hearing disabilities access to static and rich multimedia content (e.g. video, audio announcements, text, graphics, signage).

The solution will enable people with hearing disabilities to access key information and partake in different activities in a more independent and equitable fashion.

This is particularly relevant in Media consumption, where information are presented in rich multimedia content to convey key information. The availability of Arabic automated closed captioning tool will ensure that such content is presented in an accessible format.

Not Initiated

Target Users

User Journey

MaryamMaryam is 24 yrs old. She is unable to hear spoken word and key audible events and relies on reading texts and closed captions. Mayram is looking to access live audible events in television, mobile phones, tablets or computers using automated closed captioning in the Arabic language.

1

Maryam opens a live stream of an Arabic news channel without closed captioning. She cannot hear the audible content.

2

Maryam uses an app on her smartphone to activate live automated Arabic closed captioning.

3

Once open, the app will detect speech in media and automatically generate captions.

4

The speech/audible content will be processed within the smartphone and will be presented to Maryam as an automated, live closed caption on her screen while she watches the news.

Potential Service Features

  • Emergency alerts
  • Haptic feature
  • Closed Captioning App API

Touch Points

Issue Statement

As a person with hearing impairment, Maryam is unable to access audible multimedia content while using her smart devices. She needs the multimedia content to have closed captioning so that she can read the audible content while the multimedia is being streamed.

Expected Key Benefits

Automated Live Closed Captioning of Multimedia content

Make key information accessible that is being delivered to mass audiences through closed captioned rich multimedia.

Contextual Information Delivery

Based on the user’s live location, relevant contextual information (e.g. emergency notifications, alternative routes, etc.) can be pushed to the user through media supporting closed captioning.

Audience Expansion

Businesses and public sector organizations can use the solution to broadcast contextualized information in closed captioning, thereby targeting a niche customer base that is not traditionally accessed through conventional advertising mediums.

Implementation Analysis

Implementation Timeline

Timeline Medium

Short

Medium

Long

Technology Commercial Viability

Timeline Short

Available Now

Viable in Short Term

Viable in Long Term

Investment Requirements

Timeline Medium

Low

Medium

High

Key Implementation Considerations

1

Identification and Instant / Real-time text translation of relevant data in audible content.

2

Intuitive User Interface