A Protocol for Evaluating the Accessibility of AI-Generated Educational Materials: Prompt Configuration, WCAG-Derived Criteria, and Content Overload

Abstract

Generative AI tools increasingly produce educational materials: documents, slides, images, audio, and video, yet little is known about whether this content meets accessibility requirements. This paper presents a protocol for evaluating the accessibility of AI-generated educational materials against the Web Content Accessibility Guidelines (WCAG), across five content types and multiple tools. The protocol compares three conditions applied to the same tool: a generic instruction with no accessibility language; a single prompt explicitly configured with WCAG criteria; and a persistent, reusable accessibility profile loaded once rather than re-specified each time. Evaluation combines a WCAG rubric per content type with heuristic validation by accessibility experts, addressing a known limitation of automated scanners. Prior evidence shows generative AI tools reproduce inaccessible practices by default, and that explicit configuration measurably improves compliance. This paper extends that discussion to a dimension WCAG checklists miss: visual and informational overload common in AI-synthesized content. The main contribution is methodological: a reproducible protocol and open evaluation instrument, with cases documenting the barriers non-configured AI content creates for people with disabilities. A first exploratory application is also reported: a rubric-based compliance score rose from a pooled mean of 24.2% under the generic condition to 96.7% under the WCAG-configured condition, using one model, one artifact per condition and type, and single-evaluator scoring; the persistent-profile condition was not exercised. The protocol is a reusable resource for the community to apply and extend at full benchmark scale. Beyond the protocol, this work aims to raise awareness of accessibility obstacles generative AI can introduce, and encourage creators to consider accessibility when using these tools.