Deep System Instrumentation for In Situ Human-AI Interaction Measurement Within Complex Information Systems
• Conference Paper
Publisher
Software Engineering Institute
Topic or Tag
Abstract
In this report, we explore key objectives for Human Systems Integration (HSI) Test Evaluation Validation and Verification (TEVV) for human-Artificial Intelligence (AI) interactions within analytical and information systems. Owing to their features and function, these systems pose challenges to the test community in evaluating the reciprocal influence of human and AI elements on one another. We argue that software system instrumentation provides the necessary capabilities to resolve measurement gaps. We further report our own efforts in adapting this technology for HSI TEVV and making these capabilities accessible to the larger test community.
Part of a Collection
AI Engineering Assets
Proceedings of the AAAI Spring Symposium on AI Engineering, 2022