Course Outline
Introduction to AI Threat Modeling
- Factors that make AI systems vulnerable.
- AI attack surface compared to traditional systems.
- Key attack vectors: data, model, output, and interface layers.
Adversarial Attacks on AI Models
- Understanding adversarial examples and perturbation techniques.
- White-box vs. black-box attacks.
- FGSM, PGD, and DeepFool methods.
- Visualizing and crafting adversarial samples.
Model Inversion and Privacy Leakage
- Inferring training data from model outputs.
- Membership inference attacks.
- Privacy risks associated with classification and generative models.
Data Poisoning and Backdoor Injections
- The influence of poisoned data on model behavior.
- Trigger-based backdoors and Trojan attacks.
- Detection and sanitization strategies.
Robustness and Defense Techniques
- Adversarial training and data augmentation.
- Gradient masking and input preprocessing.
- Model smoothing and regularization techniques.
Privacy-Preserving AI Defenses
- Introduction to differential privacy.
- Noise injection and privacy budgets.
- Federated learning and secure aggregation.
AI Security in Practice
- Threat-aware model evaluation and deployment.
- Applying the Adversarial Robustness Toolbox (ART) in real-world settings.
- Industry case studies: real-world breaches and mitigations.
Summary and Next Steps
Requirements
- Understanding of machine learning workflows and model training processes.
- Experience with Python and common ML frameworks, such as PyTorch or TensorFlow.
- Familiarity with basic security or threat modeling concepts is beneficial.
Target Audience
- Machine learning engineers.
- Cybersecurity analysts.
- AI researchers and model validation teams.
Testimonials (2)
I really enjoyed learning about AI attacks and the tools out there to begin practicing and actively using for security testing. I took a lot of knowledge away which I didn't have at the beginning and the course met what I hoped it would be. My favorite part shown from the training was Comet Browser and was amazed at what it could do. Definitely something will be looking into more. Overall it was a great course and enjoyed learning all OWASP GenAI Top 10.
Patrick Collins - Optum
Course - OWASP GenAI Security
The profesional knolage and the way how he presented it before us
