Artificial Intelligence
Blog Posts
Measuring AI Accuracy with the AI Robustness (AIR) Tool
Understanding your artificial intelligence (AI) system’s predictions can be challenging. In this post, SEI researchers discuss a new tool to help improve AI classifier performance.
Read More•By Michael D. Konrad, Nicholas Testa, Linda Parker Gates, Crisanne Nolan, David James Shepard, Julie B. Cohen, Andrew O. Mellinger, Suzanne Miller, Melissa Ludwick
In Artificial Intelligence Engineering
Generative AI and Software Engineering Education
Educators have had to adapt to rapid developments in generative AI to provide a realistic perspective to their students. In this post, experts discuss generative AI and software engineering education.
Read More•By Ipek Ozkaya, Douglas Schmidt (Vanderbilt University)
In Artificial Intelligence Engineering
Auditing Bias in Large Language Models
This post discusses recent research that uses a role-playing scenario to audit ChatGPT, an approach that opens new possibilities for revealing unwanted biases.
Read More•By Katherine-Marie Robinson, Violet Turri
In Artificial Intelligence Engineering
The Latest Work from the SEI: Rust, DevSecOps, AI, and Penetration Testing
Learn more about the SEI's latest work in penetration testing, model-based design for cyber-physical systems, UEFI, and DevSecOps.
Read More•By Douglas Schmidt (Vanderbilt University)
In Software Engineering Research and Development
Improving Automated Retraining of Machine-Learning Models
This post describes how to improve representative MLOps pipelines by automating exploratory data-analysis tasks.
Read More•By Rachel Brower-Sinning
In Artificial Intelligence Engineering
Six Dimensions of Trust in Autonomous Systems
This post chronicles the adoption and growth of autonomous systems and provides six considerations for establishing trust.
Read More•By Paul Nielsen
In Software Engineering Research and Development
Release of SCAIFE System Version 2.0.0 Provides Support for Continuous-Integration (CI) Systems
Key features in new release of SCAIFE System Version 2.0.0 including support for continuous-integration (CI) systems, and status of evolving SEI SCAIFE work
Read More•By Lori Flynn
In Secure Development
Systems Engineering and Software Engineering: Collaborating for the Smart Systems of the Future
Convergence between systems engineering and software engineering is forging new practices for engineering the smart systems of the future.
Read More•By Paul Nielsen
In Cyber-Physical Systems
Software Engineering for Machine Learning: Characterizing and Detecting Mismatch in Machine-Learning Systems
This post describes how we are creating and assessing empirically validated practices to guide the development of machine-learning-enabled systems.
Read More•By Grace Lewis, Ipek Ozkaya
In Artificial Intelligence Engineering
A Game to Assess Human Decision Making with AI Support
In decision-support systems based on AI, humans often make poor choices causing the systems to be abandoned. Rotem Guttman introduces a game that collects data on actual human decision making …
Read More•By Rotem D. Guttman
In Artificial Intelligence Engineering
