Pattern #1 · Usability heuristics

Audit AI features against the classic heuristics and the AI guidelines

The 10 usability heuristics still apply to AI interfaces. They just stopped being enough on their own.

Track Afoundationsheuristicsexpectation setting

Do

Run every AI feature through both lenses: the ten classic heuristics first, then the 18 human-AI guidelines.

Don't

Assume a chat window exempts you from visibility of system status. It doesn't. It just makes the status harder to show.

The rule. Audit every AI feature twice: once against classic usability heuristics, once against AI-specific guidelines. Passing one test says nothing about passing the other.

Why. When Microsoft synthesized two decades of HCI research into 18 guidelines for human-AI interaction, the finding was not that the classics had expired. They hold, but properties unique to AI (accuracy that varies, failure modes that surprise, behavior that shifts as systems learn) raise problems the classics never had to answer (Amershi et al., 2019). Yang et al. (2020) trace the difficulty to two roots: uncertainty about what the system can actually do, and the open-ended complexity of what it produces. Nielsen (2023) argues the interaction model itself flipped: users now state the outcome they want rather than the steps to reach it, which unsettles assumptions as basic as visibility of system status and direct manipulation.

Seen in the wild. Perplexity adapts a sixty-year-old heuristic to a probabilistic system by replacing the spinner with staged progress (searching, reading sources, writing answer). Old rule, new material.

References

  1. 01

    Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., Teevan, J., Kikin-Gil, R., & Horvitz, E. (2019). Guidelines for human-AI interaction. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1-13. https://doi.org/10.1145/3290605.3300233

    https://doi.org/10.1145/3290605.3300233
  2. 02

    Yang, Q., Steinfeld, A., Rose, C., & Zimmerman, J. (2020). Re-examining whether, why, and how human-AI interaction is uniquely difficult to design. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1-13. https://doi.org/10.1145/3313831.3376301

    https://doi.org/10.1145/3313831.3376301
  3. 03

    Nielsen, J. (2023, June 18). AI: First new UI paradigm in 60 years. Nielsen Norman Group. https://www.nngroup.com/articles/ai-paradigm/

    https://www.nngroup.com/articles/ai-paradigm/