Using Large Language Models in the National Security Realm
• Podcast
Publisher
Software Engineering Institute
DOI (Digital Object Identifier)
10.58012/knta-5r36Listen
Watch
Abstract
At the request of the White House, the Office of the Director of National Intelligence (ODNI) began exploring use cases for large language models (LLMs) within the Intelligence Community (IC). As part of this effort, ODNI sponsored the Mayflower Project at Carnegie Mellon University’s Software Engineering Institute from May 2023 through September 2023. The Mayflower Project attempted to answer the following questions:
- How might the IC set up a baseline, stand-alone LLM?
- How might the IC customize LLMs for specific intelligence use cases?
- How might the IC evaluate the trustworthiness of LLMs across use cases?
In this SEI Podcast, Shannon Gallagher, AI engineering team lead, and Rachel Dzombak, special advisor to the director of the SEI’s AI Division, discuss the findings and recommendations from the Mayflower Project and provide additional background information about LLMs and how they can be engineered for national security use cases.
About the Speaker
Shannon Gallagher
Shannon Gallagher is a data scientist in the SEI’s CERT Division. In that role, Gallagher focuses on modeling, uncertainty quantification, and data visualization and leading research to develop a statistical pipeline to help determine the authenticity of images and videos. Prior to joining the SEI, Gallagher worked as a post-doctoral …
Read more