Articoli correlati a Advanced Automation for Comprehensible Causal Explanations...

Advanced Automation for Comprehensible Causal Explanations of Reinforcement Learning Agents - Brossura

Milani, Rudy

 
9783658504946: Advanced Automation for Comprehensible Causal Explanations of Reinforcement Learning Agents

Sinossi

This thesis introduces Auto-BENEDICT, a novel, fully automated methodology designed to generate human-comprehensible causal explanations for model-free Reinforcement Learning (RL) agents. The system addresses the trade-off between high performance and transparency in RL by integrating Bayesian Networks for causal inference and Recurrent Neural Networks to forecast future states and actions. The method provides answers to both “Why” and “Why not” questions, thereby increasing user trust and interpretability. The work also introduces enhanced importance metrics―including both Q-value-based and graph-based approaches―used to detect distal information, i.e., critical sequences of states or actions that are key to solving a task. These metrics are then fused with the causal explanation framework, resulting in Auto-BENEDICT, which not only explains but also recognizes high-risk or critical states automatically. Validation through computational experiments and a human evaluation study shows that Auto-BENEDICT significantly outperforms traditional methods in comprehensibility and trustworthiness, contributing a major advancement in Explainable Reinforcement Learning.

Le informazioni nella sezione "Riassunto" possono far riferimento a edizioni diverse di questo titolo.

Informazioni sull'autore

Rudy Milani obtained his Dr. rer. nat. in 2025 in Explainable Reinforcement Learning from the Universität der Bundeswehr München as a member of the COMTESSA research group. His work focuses on reinforcement learning, mathematical modelling, and optimization, combining theoretical insights with practical applications.

Dalla quarta di copertina

This thesis introduces Auto-BENEDICT, a novel, fully automated methodology designed to generate human-comprehensible causal explanations for model-free Reinforcement Learning (RL) agents. The system addresses the trade-off between high performance and transparency in RL by integrating Bayesian Networks for causal inference and Recurrent Neural Networks to forecast future states and actions. The method provides answers to both “Why” and “Why not” questions, thereby increasing user trust and interpretability. The work also introduces enhanced importance metrics—including both Q-value-based and graph-based approaches—used to detect distal information, i.e., critical sequences of states or actions that are key to solving a task. These metrics are then fused with the causal explanation framework, resulting in Auto-BENEDICT, which not only explains but also recognizes high-risk or critical states automatically. Validation through computational experiments and a human evaluation study shows that Auto-BENEDICT significantly outperforms traditional methods in comprehensibility and trustworthiness, contributing a major advancement in Explainable Reinforcement Learning.
 
About the Author
 
Rudy Milani obtained his Dr. rer. nat. in 2025 in Explainable Reinforcement Learning from the Universität der Bundeswehr München as a member of the COMTESSA research group. His work focuses on reinforcement learning, mathematical modelling, and optimization, combining theoretical insights with practical applications.

Le informazioni nella sezione "Su questo libro" possono far riferimento a edizioni diverse di questo titolo.

I tuoi diritti di garanzia legale: Ogni consumatore nell'UE beneficia di almeno 2 anni di garanzia legale per qualsiasi bene di consumo venduto nell'UE. Scopri di più