Blog Posts
Applying Large Language Models to DoD Software Acquisition: An Initial Experiment
This SEI Blog post illustrates examples of using LLMs for software acquisition in the context of a document summarization experiment and codifies the lessons learned from this experiment and related …
• By Douglas Schmidt (Vanderbilt University), John E. Robert
In Artificial Intelligence Engineering
OpenAI Collaboration Yields 14 Recommendations for Evaluating LLMs for Cybersecurity
This SEI Blog post summarizes 14 recommendations to help assessors accurately evaluate LLM cybersecurity capabilities.
• By Jeff Gennari, Shing-hon Lau, Samuel J. Perl
In Artificial Intelligence Engineering
Using ChatGPT to Analyze Your Code? Not So Fast
This blog post explores the efficacy of ChatGPT 3.5 in identifying errors in software code.
• By Mark Sherman
In Artificial Intelligence Engineering
Creating a Large Language Model Application Using Gradio
This post explains how to build a large language model across three primary use cases: basic question-and-answer, question-and-answer over documents, and document summarization.
• By Tyler Brooks
In Artificial Intelligence Engineering
Generative AI Q&A: Applications in Software Engineering
This post explores the transformative impacts of generative AI on software engineering as well as its practical implications and adaptability in mission-critical environments.
• By John E. Robert, Douglas Schmidt (Vanderbilt University)
In Artificial Intelligence Engineering
Harnessing the Power of Large Language Models For Economic and Social Good: 4 Case Studies
This blog post, the second in a series, outlines four case studies, that explore the potential of large language models, such as ChatGPT, and explores their limitations and future uses.
• By Matthew Walsh, Dominic A. Ross, Clarence Worrell, Alejandro Gomez
In Artificial Intelligence Engineering
Harnessing the Power of Large Language Models For Economic and Social Good: Foundations
This blog post explores the capabilities and limitations of large language models.
• By Matthew Walsh, Dominic A. Ross, Clarence Worrell, Alejandro Gomez
In Artificial Intelligence Engineering
Contextualizing End-User Needs: How to Measure the Trustworthiness of an AI System
As potential applications of artificial intelligence (AI) continue to expand, the question remains: will users want the technology and trust it? This blog post explores how to measure the trustworthiness …
• By Carrie Gardner, Katherine-Marie Robinson, Carol J. Smith, Alexandrea Steiner
In Artificial Intelligence Engineering
The Challenge of Adversarial Machine Learning
This SEI Blog post examines how machine learning systems can be subverted through adversarial machine learning, the motivations of adversaries, and what researchers are doing to mitigate their attacks.
• By Matt Churilla, Nathan M. VanHoudnos, Robert W. Beveridge
In Artificial Intelligence Engineering
Tackling Collaboration Challenges in the Development of ML-Enabled Systems
This SEI blog post highlights research examining the collaboration challenges inherent in the development of machine-learning-enabled systems compared to traditional software development projects.
• By Grace Lewis
In Artificial Intelligence Engineering
