Evaluating Large Language Models for Cybersecurity Tasks: Challenges and Best Practices

July 26, 2024 • Podcast

By

Jeff Gennari and Samuel J. Perl

Jeff Gennari and Sam Perl discuss applications for LLMs in cybersecurity, potential challenges, and recommendations for evaluating LLMs.

Publisher

Software Engineering Institute

DOI (Digital Object Identifier)

10.58012/bfe0-3p05

Topic or Tag

Artificial Intelligence Engineering Cybersecurity

Listen

Watch

Abstract

How can we effectively use large language models (LLMs) for cybersecurity tasks? In this podcast, Jeff Gennari and Sam Perl discuss applications for LLMs in cybersecurity, potential challenges, and recommendations for evaluating LLMs.

About the Speaker

Jeff Gennari

Jeff Gennari is a Senior Member of the Technical Staff in the CERT program at Carnegie Mellon University’s Software Engineering Institute (SEI). While at the SEI Mr. Gennari has worked as a malicious code analyst where he analyzed hundreds of malware samples, served as an expert witness in U.S. federal …

Samuel J. Perl

Samuel J. Perl is a member of the CSIRT (Computer Security Incident Response Team) development team within the CERT® Division at the Software Engineering Institute (SEI), a unit of Carnegie Mellon University in Pittsburgh, PA. He has been with CERT since 2011 and has worked in a variety of areas, …

Software Engineering Institute