Checklist for evaluating the meaningfulness of AI system explanations for internal users

ResearchComponents.InformationTable.Publication.Authors Henry Maathuis, Jenia Kim, Kees van Montfort, Raymond Zwaal, Danielle Sent, Sieuwert van Otterloo
ResearchComponents.InformationTable.Publication.PublicationDate 2025
ResearchComponents.InformationTable.Publication.Lectorates Artificial Intelligence
ResearchComponents.InformationTable.Publication.PublicationType Report

ResearchComponents.PublicationContent.Header

It is now widely accepted that decisions made by AI systems must be explainable to their users. However, in practice, it often remains unclear how this explainability should be concretely implemented. This is especially important for nontechnical users, such as claims assessors at insurance companies, who need to understand AI system decisions and be able to explain them to customers. Think, for example, of explaining a rejected insurance claim or loan application. Although the importance of explainable AI is broadly recognized, there is often a lack of practical tools to achieve it. That’s why, in this handbook, we have combined insights from two use cases in the financial sector with findings from an extensive literature review. This has led to the identification of 30 key aspects of meaningful AI explanations. Based on these aspects, we developed a checklist to help AI developers make their systems more explainable. The checklist not only provides insight into how understandable an AI application currently is for end users, but also highlights areas for improvement.

researchcomponents.publicationcontent.personslist.publicationauthors

  • Henry Maathuis
    • Researcher
    • researchcomponents.publicationcontent.authorlectoratelabelsingle: Artificial Intelligence
  • Jenia Kim
    • Researcher
    • researchcomponents.publicationcontent.authorlectoratelabelsingle: Artificial Intelligence
  • Danielle Sent
    • Senior lecturer
    • researchcomponents.publicationcontent.authorlectoratelabelsingle: Artificial Intelligence
  • Sieuwert van Otterloo
    Sieuwert van Otterloo
    • Researcher
    • researchcomponents.publicationcontent.authorlectoratelabelsingle: Artificial Intelligence
ResearchComponents.DetailedInformation.Language English
ResearchComponents.DetailedInformation.Keywords use cases, checklist, AI (artificial intelligence), systematic literature review, financial sector