Software Engineering Institute

Shing-hon Lau

Software Engineering Institute

All

Tech Publications

Blog Posts

Videos

Beyond Capable: Accuracy, Calibration, and Robustness in Large Language Models

December 3, 2024 • Blog Post

By Matthew Walsh , David Schulker , Shing-hon Lau

Counter AI: What Is It and What Can You Do About It?

October 7, 2024 • White Paper

By Nathan M. VanHoudnos , Carol J. Smith , Matt Churilla , Shing-hon Lau , Lauren McIlvenny , Greg Touhill

Lessons Learned in Coordinated Disclosure for Artificial Intelligence and Machine Learning Systems

August 20, 2024 • White Paper

By Allen D. Householder , Vijay S. Sarvepalli , Jeff Havrilla , Matt Churilla , Lena Pons , Shing-hon Lau , Nathan M. VanHoudnos , Andrew Kompanek , Lauren McIlvenny

OpenAI Collaboration Yields 14 Recommendations for Evaluating LLMs for Cybersecurity

February 21, 2024 • Blog Post

By Jeff Gennari , Shing-hon Lau , Samuel J. Perl

Considerations for Evaluating Large Language Models for Cybersecurity Tasks

February 20, 2024 • White Paper

By Jeff Gennari , Shing-hon Lau , Samuel J. Perl , Joel Parish (OpenAI) , Girish Sastry (OpenAI)

More from Shing-hon Lau

Counter AI: What Is It and What Can You Do About It?

October 7, 2024 • White Paper

By Nathan M. VanHoudnos , Carol J. Smith , Matt Churilla , Shing-hon Lau , Lauren McIlvenny , Greg Touhill

Lessons Learned in Coordinated Disclosure for Artificial Intelligence and Machine Learning Systems

August 20, 2024 • White Paper

By Allen D. Householder , Vijay S. Sarvepalli , Jeff Havrilla , Matt Churilla , Lena Pons , Shing-hon Lau , Nathan M. VanHoudnos , Andrew Kompanek , Lauren McIlvenny

Considerations for Evaluating Large Language Models for Cybersecurity Tasks

February 20, 2024 • White Paper

By Jeff Gennari , Shing-hon Lau , Samuel J. Perl , Joel Parish (OpenAI) , Girish Sastry (OpenAI)

More from Shing-hon Lau

Beyond Capable: Accuracy, Calibration, and Robustness in Large Language Models

December 3, 2024 • Blog Post

By Matthew Walsh , David Schulker , Shing-hon Lau

OpenAI Collaboration Yields 14 Recommendations for Evaluating LLMs for Cybersecurity

February 21, 2024 • Blog Post

By Jeff Gennari , Shing-hon Lau , Samuel J. Perl

How Do You Trust AI Cybersecurity Devices?

January 24, 2022 • Blog Post

By Grant Deffenbaugh , Shing-hon Lau

Measuring Resilience in Artificial Intelligence and Machine Learning Systems

December 12, 2019 • Blog Post

By Alexander Petrilli , Shing-hon Lau

More from Shing-hon Lau

Ask Us Anything: Generative AI Edition

September 25, 2023 • Webcast

By Douglas Schmidt (Vanderbilt University) , John E. Robert , Rachel Dzombak , Jasmine Ratchford , Matthew Walsh , Shing-hon Lau

Preview of AI Evaluation Methodology for Defensive Cyber Operator Tools

November 7, 2022 • Video

By Shing-hon Lau

AIDE: Artificial Intelligence Defense Evaluation

December 15, 2020 • Video

By Shing-hon Lau

More from Shing-hon Lau

Shing-hon Lau

Send a Message