Effect of Explanations in AI-Assisted Anomaly Treatment for Human Spaceflight Missions Academic Article uri icon

abstract

  • Articial Intelligence (AI) agents have the potential to play a critical role in human spaceight by being the rst point of contact for astronauts during emergencies in a long duration spaceight mission, when communication delays with the Mission Control Crew (MCC) become longer and more frequent. Sharing some of tasks done by the MCC with an on-board AI agent that can provide assistance with treating in-ight anomalies gives the crew more autonomy and allows them to respond faster and more safely to emergencies, or focus on other critical aspects of their mission. For this technology to succeed in this role, providing accurate diagnoses for the anomalies encountered is obviously important. However, providing explanations for those recommendations may also be a critical factor to help establish trust and increase the likelihood of the crew actually following the agents recommendations. This paper evaluates the effects of explanations on crew performance, trust in automation, mental workload, and situational awareness in the context of anomaly resolution tasks. We conduct a study where subjects subjects work with the AI agent on various simulated anomaly scenarios. They are provided by the agent with a diagnosis and recommendation with no explanations in one session and with explanations for its diagnosis in the other session. We measure the effects of the explanations on Trust in Automation, Situational Awareness, Performance, and Workload. We discuss our ndings and provide design recommendations for AI agents in the context of anomaly treatment in Long Duration Exploration Missions (LDEM).

published proceedings

  • Proceedings of the Human Factors and Ergonomics Society Annual Meeting

author list (cited authors)

  • Dutta, P., Josan, P. K., Wong, R., Dunbar, B. J., Diaz-Artiles, A., & Selva, D.

complete list of authors

  • Dutta, Prachi||Josan, Poonampreet Kaur||Wong, Raymond KW||Dunbar, Bonnie J||Diaz-Artiles, Ana||Selva, Daniel

publication date

  • January 1, 2022 11:11 AM