Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Introduction to AI Inference with Docker
- Gaining an understanding of AI inference workloads.
- Exploring the benefits of containerized inference.
- Analyzing deployment scenarios and constraints.
Building AI Inference Containers
- Selecting appropriate base images and frameworks.
- Packaging pre-trained models for deployment.
- Structuring inference code to run efficiently within containers.
Securing Containerized AI Services
- Reducing the container attack surface.
- Managing secrets and sensitive files securely.
- Implementing safe networking and API exposure strategies.
Portable Deployment Techniques
- Optimizing images for maximum portability.
- Ensuring predictable runtime environments across deployments.
- Managing dependencies effectively across different platforms.
Local Deployment and Testing
- Running services locally using Docker.
- Debugging inference containers efficiently.
- Evaluating performance and reliability through testing.
Deploying on Servers and Cloud VMs
- Adapting containers for remote environments.
- Configuring secure server access protocols.
- Deploying inference APIs on cloud virtual machines.
Using Docker Compose for Multi-Service AI Systems
- Orchestrating inference alongside supporting components.
- Managing environment variables and configuration files.
- Scaling microservices effectively with Compose.
Monitoring and Maintenance of AI Inference Services
- Adopting logging and observability approaches.
- Detecting failures within inference pipelines.
- Updating and versioning models in production environments.
Summary and Next Steps
Requirements
- A solid understanding of fundamental machine learning concepts.
- Practical experience with Python or backend development.
- Familiarity with core containerization principles.
Audience
- Software Developers
- Backend Engineers
- Teams responsible for deploying AI services
14 Hours
Testimonials (3)
How trainer deliver knowledge so effectively
Vu Thoai Le - Reply Polska sp. z o. o.
Course - Certified Kubernetes Administrator (CKA) - exam preparation
the trainer had a lot of knowledge and patience to share with us
Bogdan Olaru
Course - Introduction to Docker
The knowledge and exchanges with Augustin
