Reproducibility as a Mechanism for Teaching Fairness, Accountability, Confidentiality, and Transparency in Artificial Intelligence

Authors

  • Ana Lucic University of Amsterdam
  • Maurits Bleeker University of Amsterdam
  • Sami Jullien AIRLab, University of Amsterdam
  • Samarth Bhargav University of Amsterdam
  • Maarten de Rijke University of Amsterdam

DOI:

https://doi.org/10.1609/aaai.v36i11.21558

Keywords:

Education, Reproducibility, Fairness, Accountability, Confidentiality, Transparency, Ethical AI

Abstract

In this work, we explain the setup for a technical, graduate-level course on Fairness, Accountability, Confidentiality, and Transparency in Artificial Intelligence (FACT-AI) at the University of Amsterdam, which teaches FACT-AI concepts through the lens of reproducibility. The focal point of the course is a group project based on reproducing existing FACT-AI algorithms from top AI conferences and writing a corresponding report. In the first iteration of the course, we created an open source repository with the code implementations from the group projects. In the second iteration, we encouraged students to submit their group projects to the Machine Learning Reproducibility Challenge, resulting in 9 reports from our course being accepted for publication in the ReScience journal. We reflect on our experience teaching the course over two years, where one year coincided with a global pandemic, and propose guidelines for teaching FACT-AI through reproducibility in graduate-level AI study programs. We hope this can be a useful resource for instructors who want to set up similar courses in the future.

Downloads

Published

2022-06-28

How to Cite

Lucic, A., Bleeker, M., Jullien, S., Bhargav, S., & de Rijke, M. (2022). Reproducibility as a Mechanism for Teaching Fairness, Accountability, Confidentiality, and Transparency in Artificial Intelligence. Proceedings of the AAAI Conference on Artificial Intelligence, 36(11), 12792-12800. https://doi.org/10.1609/aaai.v36i11.21558