Pattern #8 · Explainability

Layer AI explanations: short in the flow, deep on request

Transparency is not a wall of text with a scrollbar.

Track Aexplainabilitytransparencycitations

Do

One plain sentence of reasoning in the answer, sources named beside the claim they support, and a control that opens the full list, the method, and the caveats.

Don't

Park the entire explanation behind one link and call the product transparent. A panel nobody opens explains nothing.

The rule. Show the shortest useful explanation inside the response itself, and keep the sources, the method, and the caveats one deliberate click away.

Why. The guideline is about access, not volume: the eleventh human-AI interaction guideline reads "Make clear why the system did what it did. Enable the user to access an explanation of why the AI system behaved as it did" (Amershi et al., 2019), and the HAX Toolkit expands it into seven interchangeable explanation patterns, from local and global explanations to example based and "what if" ones, with the instruction to "mix and match explanation patterns as needed" (Microsoft, n.d.). Layering is the mechanism that makes that choice tractable: progressive disclosure means you "initially, show users only a few of the most important options" and "offer a larger set of specialized options upon request," which Nielsen credits with improving "3 of usability's 5 components: learnability, efficiency of use, and error rate" (Nielsen, 2006). The catch is that the first layer has to survive alone, because the deeper ones go mostly unread: Nielsen Norman Group's 2025 study of explainability in chat interfaces reports that people "rarely click citation links" and that while users could verify each source, "they seldom do so in practice" (Chan, 2025).

Seen in the wild. Microsoft Copilot cites its sources inline in the answer and adds a "See all" button that opens the complete reference list, so provenance is glanceable first and exhaustive on request (Chan, 2025).

References

  1. 01

    Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., Teevan, J., Kikin-Gil, R., & Horvitz, E. (2019). Guidelines for human-AI interaction. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1-13. https://doi.org/10.1145/3290605.3300233

    https://doi.org/10.1145/3290605.3300233
  2. 02

    Microsoft. (n.d.). Human-AI interaction guideline no. 11: Make clear why the system did what it did. HAX Toolkit. Retrieved July 28, 2026, from https://www.microsoft.com/en-us/haxtoolkit/guideline/make-clear-why-the-system-did-what-it-did/

    https://www.microsoft.com/en-us/haxtoolkit/guideline/make-clear-why-the-system-did-what-it-did/
  3. 03

    Nielsen, J. (2006, December 3). Progressive disclosure. Nielsen Norman Group. https://www.nngroup.com/articles/progressive-disclosure/

    https://www.nngroup.com/articles/progressive-disclosure/
  4. 04

    Chan, M. (2025, December 12). Explainable AI in chat interfaces. Nielsen Norman Group. https://www.nngroup.com/articles/explainable-ai/

    https://www.nngroup.com/articles/explainable-ai/