Automation Bias
A tendency to over-rely on an automated or AI-generated suggestion, especially when people stop checking the result independently.
Automation bias does not mean that people always blindly trust systems. It describes situations where an automated recommendation changes attention, judgment or the ability to notice errors. In AI use, it can appear when a model output starts to replace independent checking.
Why it matters
- It helps explain why fluent or confident outputs can be accepted too quickly.
- It connects AI literacy with human oversight and calibrated trust.
- It shows that risk can come from the relation between person, system, task and workflow.
- It matters most when AI output informs consequential decisions.
What not to simplify
Automation bias is not the same as every mistake involving AI. It should not be used to claim that people always trust automation, or that any use of an automated recommendation is wrong. Context, time pressure, interface design and expertise all matter.
Sources and context
- Goddard, K., Roudsari, A., & Wyatt, J. C. (2012). Automation bias: A systematic review of frequency, effect mediators, and mitigators. Journal of the American Medical Informatics Association, 19(1), 121-127. https://doi.org/10.1136/amiajnl-2011-000089
- Parasuraman, R., & Riley, V. (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39(2), 230-253. https://doi.org/10.1518/001872097778543886
- Skitka, L. J., Mosier, K., & Burdick, M. (1999). Does automation bias decision-making? International Journal of Human-Computer Studies, 51(5), 991-1006. https://doi.org/10.1006/ijhc.1999.0252
Related reading
Continue exploring
- TopicHuman agency and responsibility
A guide to delegation, oversight and responsibility in AI-assisted systems.
- ArticleAre we afraid of AI, or of ourselves?
An essay on causal contribution, moral agency, distributed responsibility and the institutional uses of AI as an alibi.
- ConceptHuman agency
The capacity to choose, act and remain answerable for consequential decisions.
- ConceptHuman oversight
Human review with the information, competence, time and authority to intervene.
- PracticeHow to use AI without handing over the decision
Separate analysis from judgment and make the final responsibility visible.
© 2026 Feliks Mamczur / Prompted Psyche. All rights reserved. Short quotations are permitted only with attribution to the author, the title and a link to the source.