Professor Bot: An Exercise in Algorithmic Accountability

This assignment, by Jentery Sayers, is from the TextGenEd collection in the WAC Clearinghouse Repository.

The abstract from the site explains:

This low-tech, tool-agnostic, small-stakes assignment prompts students to attend to issues of power and governance in artificial intelligence (AI), with an emphasis on what students do not know and may thus want to learn about algorithmic decision-making. Students first consider a hypothetical scenario where AI is assessing university entrance essays. They then consult publications on “algorithmic accountability” to articulate questions they would want to ask key decision-makers about the AI decision-making process. They conclude the exercise by reflecting on what they learned about algorithmic accountability, transparency, and social responsibility.

Key Features of This Assignment

Focus on Algorithmic Accountability
This assignment prompts students to explore and reflect on the concept of algorithmic accountability. Through a speculative scenario where an AI called Professor Bot grades entrance essays, students consider the ethical and social responsibilities associated with algorithmic decision-making in educational contexts.
Interactive Workshop Format
The assignment is conducted as an in-class workshop where students engage in group discussions and collaborative exercises. They work together to define terms such as transparency, qualified transparency, and ethical and social responsibility, and apply these concepts to the hypothetical scenario of Professor Bot.
Emphasis on Critical Thinking and Policy Understanding
Students are encouraged to think critically about the implications of AI in education and governance. The workshop includes references to real-world policies like the Government of Canada’s “Directive on Automated Decision-Making” and academic research on algorithm audits, helping students connect theoretical knowledge with practical policy considerations.