AI Product Security: Secure Architecture, Deployment, and Infrastructure
2h 20mIntermediate2025-04-18
Authors

Sam Sehgal
Cloud and Application Security Leader
Course details
In this course, Sam Sehgal—a cloud and application security leader—provides a thorough guide to building secure AI products, focusing on the unique security challenges in machine learning (ML) and large language models (LLMs). Learn how to safeguard AI systems across all stages of development, from data protection and secure coding to model and deployment security. Explore essential security frameworks, threat modeling, and mitigation strategies that can help you anticipate and defend against potential attacks. Dive into industry best practices for securing AI deployments, infrastructure, and the software supply chain. By the end of the course, you'll be equipped to apply logging, monitoring, and auditing techniques to maintain ongoing system security and compliance. Whether you're a developer, product manager, or security professional, this course prepares you with the skills to secure your AI products end-to-end.
Learning objectives
Identify the key security threats and vulnerabilities specific to machine learning (ML) and large language model (LLM)-based AI products.
Explain the end-to-end architecture of AI systems and the security measures required at each stage of development, deployment, and operation.
Apply best practices for securing data, code, and models in AI products to prevent breaches, adversarial attacks, and unauthorized access.
Evaluate different security frameworks and techniques for protecting AI deployments and infrastructure, ensuring robust protection in production environments.
Learning objectives
Identify the key security threats and vulnerabilities specific to machine learning (ML) and large language model (LLM)-based AI products.
Explain the end-to-end architecture of AI systems and the security measures required at each stage of development, deployment, and operation.
Apply best practices for securing data, code, and models in AI products to prevent breaches, adversarial attacks, and unauthorized access.
Evaluate different security frameworks and techniques for protecting AI deployments and infrastructure, ensuring robust protection in production environments.
Skills covered
Application SecurityVulnerability ManagementArtificial Intelligence FoundationsCybersecurityArtificial Intelligence (AI)One-Off
Concepts
0. Introduction
- 01 - Builld your AI products securely
- 02 - What you need to know
1. Foundations of Securing AI Products
- 03 - ML- vs. LLM-based development
- 04 - ML-based AI product development
- 05 - MLOps stages
- 06 - LLM-based AI product development
- 07 - LLMOps stages
2. What Can Go Wrong
- 08 - What can go wrong in ML and MLOps
- 09 - What can go wrong in LLM and LLMOps
3. Security Model for AI Products
- 10 - Introducing the N-factor model for securing AI products
- 11 - Factor - Securing data
- 12 - Factor - Securing models
- 13 - Factor - Securing code
- 14 - Factor - Securing deployments and infrastructure
- 15 - Interconnected nature of all factors
4. Securing Data
- 16 - Data exposure during transit
- 17 - Injection attacks
- 18 - Unauthorized access
- 19 - Insider threat
- 20 - Feature poisoning
- 21 - Privacy leakage
- 22 - Poisoned feedback loop
5. Securing Models
- 23 - Intro to poisoning
- 24 - Data poisoning
- 25 - Model poisoning
- 26 - Model theft
- 27 - Model testing attack prerequisites
- 28 - Model testing attack scenarios
- 29 - Model testing attack defense
- 30 - Model registry unauthorized modifications
- 31 - Model extraction threat
- 32 - Model extraction defense
- 33 - Model inversion comparison
- 34 - Model inversion threat
- 35 - Model inversion defense
- 36 - Prompt injection attack
6. Securing Code
- 37 - Insecure data processing code
- 38 - Hard-coded secrets
- 39 - Vulnerabilities in open-source libraries
- 40 - Dependency confusion
- 41 - Backdoor libraries
- 42 - Conclusion
7. Securing AI Deployments and Infrastructure
- 43 - Insecure compute and storage
- 44 - CI CD pipelines
- 45 - Unrestricted network access
- 46 - Insufficient resource isolation
- 47 - Misconfigured container images
- 48 - Drift
- 49 - Vector databases
8. Best Practices
- 50 - Introduction to top 10 practices
- 51 - Threat modeling
- 52 - Security testing
- 53 - Incidence response
- 54 - Governance
- 55 - Privacy
- 56 - Adversarial robustness
- 57 - Collaboration
- 58 - Explainability and transparency
- 59 - Logging and monitoring
- 60 - Security training and awareness
- 61 - Bringing it all together
Conclusion
- 62 - Next steps in your AI journey