A cognitive science framework could prevent harmful public policy decisions involving AI

AI has the potential to help governments become more efficient and transparent and better able to serve their citizens. However, using AI in designing and implementing policies comes with challenges and risks. As in other arenas, it can lead to job loss and privacy infringements. But this article concerns another, more insidious risk: Using AI can amplify the tendency of people who apply the tools to rely on intuitive rather than deliberative reasoning, which, in the realm of governance, can result in flawed policies that can harm the public. This article introduces a framework, informed by cognitive science research, for helping government policymakers understand the risks of human–AI collaborations and mitigate those risks through inserting more deliberative reasoning into each aspect of these collaborations. By applying the framework to case studies, the article also demonstrates its potential for preventing disastrous outcomes from AI’s use in policy. Overall, the framework is meant to help policy professionals navigate AI’s complexities and produce effective, efficient policies that include procedural safeguards for protecting citizens from harm.