AI Product Security: Incident Response

AI Product Security: Incident Response

1h 32mIntermediate2025-03-10

Authors

Malcolm Shore

Malcolm Shore

Cybersecurity Expert, Former Director of GCSB

Course details

AI is experiencing a number of growing pains as it evolves, and these are too frequently escalating into high-profile incidents. In this course, instructor Malcolm Shore covers a wide range of issues which are relevant to AI applications, including the traditional cybersecurity issues as well as more contemporary and AI-specific issues associated with inadequately protected data, inadequately protected AI applications, untested models, and supply chain issues with training data and model construction. From prompt and thought injections to gaining operating system shells, this course provides a hands-on approach to understanding how you can respond to and minimize the damage caused by an incident.

Learning objectives
Analyze the scope and types of incidents that can affect AI applications and their potential impacts.
Identify events and indicators that may constitute emerging AI incidents through hands-on lab exercises.
Evaluate and execute appropriate incident response procedures for different types of AI incidents.
Formulate effective communication strategies for stakeholders during AI incidents.
Design preventive measures to protect AI applications based on common incident patterns and vulnerabilities.

Skills covered

Incident ResponseCybersecurityOne-Off

Concepts

Introduction

  • Managing AI incidents to minimize damage
  • What you should know
  • Disclaimer

Understanding AI Incidents

  • Introduction to Incidents
  • Incident reporting obligations
  • AI incident case studies
  • High-risk AI models
  • Prohibited AI models

Planning for an Incident

  • Preparing for an incident
  • Assessing the threats
  • Preparing the incident response plan
  • Upskilling with AI drills
  • Running an AI crisis exercise
  • Running an AI IR maturity assessment

Detect and Log AI Issues

  • Test harness for AI logging
  • Detecting toxicity
  • Logging llm-guard
  • The challenge of hallucinations

AI Incident Response

  • Responding to an AI incident
  • Documenting the response

Incident Communications

  • Introduction to the Knight-Nurse framework
  • When and how to communicate
  • What to communicate
  • Special considerations for AI models

Conclusion

  • What's next
40,000 Toman