Building Trustworthy AI: The Role of Patient and Public Involvement in Healthcare AI Development

Abstract

AI is helping researchers make great strides in healthcare. However, there is a trust deficit in AI when applied to critical areas like healthcare. Hence communicating the beneficial medical applications of AI and engaging the public with healthcare AI research is critical. One way to achieve this is by getting the community involved in co-designing better AI systems in healthcare projects. We argue that AI algorithms for healthcare should be co-designed with patients and healthcare workers, so that they are useful and trustworthy. We suggest a roadmap for this collaborative approach in AI model building. This will involve actively including patients with lived experience of a disease, as well as creating a research advisory group to walk patients through the process of AI model building. We suggest formulating and scoping a problem, and then generating a hypothesis that patients and scientists agree on. The road to building trustworthy AI systems may become easier if all stakeholders are involved in co-creating AI models.