SEI Digital Library
Latest Publications
Using Role-Playing Scenarios to Identify Bias in LLMs
• Podcast
By Katherine-Marie Robinson, Violet Turri
Harmful biases in large language models (LLMs) make AI less trustworthy and secure. Katie Robinson and Violet Turri discuss their recent work using role-playing game scenarios to identify biases in …
Listen
Best Practices and Lessons Learned in Standing Up an AISIRT
• Podcast
By Lauren McIlvenny
In the wake of widespread adoption of AI practices in critical infrastructure, best practices and lessons learned in standing up a AI Security Incident Response Team (AISIRT).
Listen
Embracing AI: Unlocking Scalability and Transformation Through Generative Text, Imagery, and Synthetic Audio
• Webcast
By Tyler Brooks, Shannon Gallagher, Dominic A. Ross
In this webcast, Tyler Brooks, Shannon Gallagher, and Dominic Ross aim to demystify AI and illustrate its transformative power in achieving scalability, adapting to changing landscapes, and driving digital innovation.
Watch
Counter AI: What Is It and What Can You Do About It?
• White Paper
By Nathan M. VanHoudnos, Carol J. Smith, Matt Churilla, Shing-hon Lau, Lauren McIlvenny, Greg Touhill
This paper describes counter artificial intelligence (AI) and provides recommendations on what can be done about it.
Read
3 API Security Risks (and How to Protect Against Them)
• Podcast
By McKinley Sconiers-Hasan
McKinley Sconiers-Hasan discusses three API risks and how to address them through the lens of zero trust.
Listen
Using Quality Attribute Scenarios for ML Model Test Case Generation
• Conference Paper
By Rachel Brower-Sinning, Grace Lewis, Sebastián Echeverría, Ipek Ozkaya
This paper presents an approach based on quality attribute (QA) scenarios to elicit and define system- and model-relevant test cases for ML models.
Read
Lessons Learned in Coordinated Disclosure for Artificial Intelligence and Machine Learning Systems
• White Paper
By Allen D. Householder, Vijay S. Sarvepalli, Jeff Havrilla, Matt Churilla, Lena Pons, Shing-hon Lau, Nathan M. VanHoudnos, Andrew Kompanek, Lauren McIlvenny
In this paper, the authors describe lessons learned from coordinating AI and ML vulnerabilities at the SEI's CERT/CC.
Read
On the Design, Development, and Testing of Modern APIs
• White Paper
By Alejandro Gomez, Alex Vesey
This white paper discusses the design, desired qualities, development, testing, support, and security of modern application programming interfaces (APIs).
Read
Evaluating Large Language Models for Cybersecurity Tasks: Challenges and Best Practices
• Podcast
By Jeff Gennari, Samuel J. Perl
Jeff Gennari and Sam Perl discuss applications for LLMs in cybersecurity, potential challenges, and recommendations for evaluating LLMs.
Listen
Capability-based Planning for Early-Stage Software Development
• Podcast
By Anandi Hira, Bill Nichols
This SEI podcast introduces capability-based planning (CBP) and its use and application in software acquisition.
Listen