AI Engineering Assets
• Collection
Publisher
Software Engineering Institute
Abstract
AI Engineering is an emergent discipline focused on developing tools, systems, and processes to enable the application of artificial intelligence in real-world contexts. This collection includes papers, videos, presentations, and other publications related to the SEI's AI Engineering work.
Collection Items
Deep System Instrumentation for In Situ Human-AI Interaction Measurement Within Complex Information Systems
• Conference Paper
By Joshua C. Poore (University of Maryland at College Park), Alex Veerasammy (University of Maryland at College Park), Amir Ghaemi (University of Maryland at College Park), Grant Tamrakar (University of Maryland at College Park), Kelsey Rassmann (University of Maryland at College Park), Craig Lawrence (University of Maryland at College Park)
This paper was presented at the 2022 AAAI Spring Symposium on AI Engineering.
Read
Building Coherent Use into the DevOps Lifecycle for High-Stakes AI
• Conference Paper
By Kelsey Rassmann (University of Maryland at College Park), Jana Schwartz (University of Maryland), Julie Marble (University of Maryland), William Regli (University of Maryland at College Park)
This paper was presented at the 2022 AAAI Spring Symposium on AI Engineering.
Read
Measuring Beyond Accuracy
• Conference Paper
By Violet Turri, Rachel Dzombak, Eric Heim, Nathan M. VanHoudnos, Jay Palat, Anusha Sinha
This paper was presented at the 2022 AAAI Spring Symposium on AI Engineering.
Read
Lessons Learned in Human-Artificial Intelligence Teaming in Business Processes
• Conference Paper
By Michael J. Mendenhall (Air Force Research Laboratory), Gilbert L. Peterson (Air Force Research Laboratory), Alexander Graves (Air Force Research Laboratory), Jonathan W. Butler (Air Force Research Laboratory)
This paper was presented at the 2022 AAAI Spring Symposium on AI Engineering.
Read
Exploring Opportunities in Usable Hazard Analysis Processes for AI Engineering
• Conference Paper
By Nikolas Martelaro (Carnegie Mellon University), Carol J. Smith, Tamara Zilovic (Carnegie Mellon University)
This paper was presented at the 2022 AAAI Spring Symposium on AI Engineering.
Read
Experience with Using Synthetic Training Images for Wearable Cognitive Assistance
• Conference Paper
By Roger Iyengar (Carnegie Mellon University), Emily Zhang (Carnegie Mellon University), Mahadev Satyanarayanan (Carnegie Mellon University)
This paper was presented at the 2022 AAAI Spring Symposium on AI Engineering.
Read
Adaptive Autonomy as a Means for Implementing Shared Ethics in Human-AI Teams
• Conference Paper
By Allyson I. Hauptman (Clemson University), Beau G. Schelble (Clemson University), Nathan J. McNeese (Clemson University)
This paper was presented at the 2022 AAAI Spring Symposium on AI Engineering.
Read
Kernel Density Decision Trees
• Conference Paper
By Jack H. Good (Carnegie Mellon University, Robotics Institute, Kyle Miller (Carnegie Mellon University, Robotics Institute), Artur Dubrawski (Carnegie Mellon University, Robotics Institute)
This paper was presented at the 2022 AAAI Spring Symposium on AI Engineering.
Read
Juneberry - Tutorial
• Presentation
By Andrew O. Mellinger, Nathan M. VanHoudnos, Nick Winski
Presented at Naval Applications of Machine Learning 2022, this tutorial reviews Juneberry, a reproducible research framework to build, maintain, and evaluate ML with declarative configs.
Learn More
AI at the SEI
• Video
By Michael Mattarock, Matthew J. Butkovic
In this episode, Matt Butkovic, talked with Michael Mattarock, about the SEI’s efforts to apply AI techniques to address national security mission needs while leading a national initiative to build …
Watch
Explainable AI Explained
• Podcast
By Violet Turri
Violet Turri discusses explainable AI, which encompasses all the techniques that make the decision-making processes of AI systems understandable to humans.
Listen
Human-Centered AI
• White Paper
By Hollen Barmer, Rachel Dzombak, Matt Gaston, Jay Palat, Frank Redner, Carol J. Smith, Tanisha Smith
This white paper discusses Human-Centered AI: systems that are designed to work with, and for, people.
Read
Scalable AI
• White Paper
By Hollen Barmer, Rachel Dzombak, Matt Gaston, Jay Palat, Frank Redner, Tanisha Smith, John Wohlbier
This white paper discusses Scalable AI: the ability of AI algorithms, data, models, and infrastructure to operate at the size, speed, and complexity required for the mission.
Read
Robust and Secure AI
• White Paper
By Hollen Barmer, Rachel Dzombak, Matt Gaston, Eric Heim, Jay Palat, Frank Redner, Tanisha Smith, Nathan M. VanHoudnos
This white paper discusses Robust and Secure AI systems: AI systems that reliably operate at expected levels of performance, even when faced with uncertainty and in the presence of danger …
Read
AI Engineering: 11 Foundational Practices
• White Paper
By Software Engineering Institute
This initial set of recommendations can help organizations that are beginning to build, acquire, and integrate artificial intelligence capabilities into business and mission systems.
Read
AI Engineering for Defense and National Security: A Report from the October 2019 Community of Interest Workshop
• Special Report
By Software Engineering Institute
Based on a workshop with thought leaders in the field, this report identifies recommended areas of focus for AI Engineering for Defense and National Security.
Read
Future Reach Conversation: Countering Adversarial Operations Made Possible by AI
• Video
By Allen D. Householder, Lujo Bauer (Carnegie Mellon University, Department of Electrical and Computer Engineering), Kathleen Carley (Carnegie Mellon School of Computer Science)
Watch as Dr. Matt Gaston, Director of SEI Emerging Technology Center, moderates discussion on countering adversarial operations made possible by AI
Watch
Defining AI Engineering
• Video
By Matt Gaston
Watch Dr. Matt Gaston, Director of the SEI Emerging Technology Center, and Professor Martial Hebert, Dean of CMU School of Computer Science and recognized world expert in computer vision, discuss …
Watch
Ethics in AI Engineering
• Video
By Carol J. Smith
The presentation discusses how to reduce unintended/harmful bias and prevent the inevitable harm that comes from "unknowable" systems.
Watch
AI at the SEI
• Fact Sheet
By Software Engineering Institute
The SEI's history as a federally funded research and development center (FFRDC) dedicated to software engineering means that we know what it takes to lay a foundation for confident, rapid …
Learn More
Train, but Verify: Towards Practical AI Robustness
• Presentation
By Nathan M. VanHoudnos, Jon Helland
This presentation describes efforts to train AI systems to enforce at least two security policies and verify security by testing against realistic threat models.
Learn More
Train, but Verify: Towards Practical AI Robustness
• Video
By Nathan M. VanHoudnos, Jon Helland
This presentation describes efforts to train AI systems to enforce at least two security policies and verify security by testing against realistic threat models.
Watch
Poster - Train, but Verify: Towards Practical AI Robustness
• Poster
By Nathan M. VanHoudnos, Jon Helland
This presentation describes efforts to train AI systems to enforce at least two security policies and verify security by testing against realistic threat models.
Download
Designing Trustworthy AI
• Podcast
By Carol J. Smith
Carol Smith discusses a framework that builds upon the importance of diverse teams and ethical standards to ensure that AI systems are trustworthy and able to effectively augment warfighters.
Listen
Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Development
• Conference Paper
By Carol J. Smith
The Human-Machine Teaming (HMT) Framework for Designing Ethical AI Experiences, when used with a set of technical ethics, will guide AI development teams to create AI systems that are accountable, …
Read
Learning by Observing via Inverse Reinforcement Learning
• Video
By Ritwik Gupta, Eric Heim
This SEI Cyber Talk episode explains how inverse reinforcement learning can be effective for teaching agents to perform complex tasks with many states and actions.
Watch
A Series of Unlikely Events: Learning Patterns by Observing Sequential Behavior (video)
• Video
By Eric Heim
Watch SEI principal investigator Eric Heim discuss research to develop novel Inverse Reinforcement Learning (IRL) techniques as efficient and effective means for DoD/IC to perform activity-based intelligence or to teach …
Watch
A Series of Unlikely Events: Learning Patterns by Observing Sequential Behavior
• Poster
By Eric Heim
This poster represents research to apply Inverse Reinforcement Learning techniques to model sequential behavior.
Download