Ross Esmond Notes

Text Alternative

Almost all non-text elements of an interface which convey or capture information from a user should provide a text alternative of some form. Blind and visually impaired users require text to be able to use the application without issue, but text is also more durable than other mediums of communication. Text is compatible with every device and easier to archive, and so its presence allows an application to be used more reliably and for longer. The kindle reader cannot play videos, but it can open a pdf that describes the video. Image servers may go offline or remove old content, but the Internet Archive has committed to storing the alt-text forever. Text alternatives are a vital tool to achieve inclusivity, both for users today and users 100 years from now.

Interfaces convey information through media and capture information through controls, both of which require different forms of text alternatives. Conveyed information may come in the form of an image, a video, or audio. An image is any static non-text graphic, which includs purposelly arranged primitive elements. A video is any time-based graphic. And audio is any sound, which, of course, must be time-based. Time-based media may be prerecorded or live, and prerecorded media may be synchronized. Synchronized media will play or advance based on some external events in the application, like audio clips that play as the user scrolls to different points on a page. Synchronized media includes time-based media with interactive elements, like a video that asks the user to make a selection to continue.

Approaches to text-alternatives

How each form of non-text media is handled depends on its type and what information is conveyed, but there are three general approaches to writing the text alternative. You may not write any text alternative, you may identify the information in the media, or you may mirror the information in the media.

Not writing a text-alternative

If the non-text element does not convey or capture information, then the element is irrelivant, and you should not write a text alternative for the element. This includes decorative elements, which are purely asthetical, formatting elements, which only exist to help arrange content, and hidden elements, which are never perceived by a users. In all of these cases, the element should be constructed or marked so as to be ignored by content parsers like screen readers. On the web, there are several methods to mark an image as irrelevant.

Other mediums will likely have their own methods to mark an element as unimportant, as with the artifact tag in PDF's.