Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-tier ETL architectures
- Crafting modular and reusable components
- Hybrid methodologies spanning various systems
Advanced Performance Engineering
- Optimization at the step level
- Strategies for parallelism and threading
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Embedding scripting within transformations
- Building custom plugins
- Expanding PDI features using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming connections
- Interacting with big data platforms
- Sophisticated file and API handling
Data Governance, Security, and Compliance
- Protecting transformations and credentials
- Tracking data lineage and traceability
- Regulatory and compliance factors
Enterprise Orchestration and Scheduling
- Oversizing large job networks
- Designing error recovery and failover mechanisms
- Orchestration at the environment level
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories
- Integrating PDI with Git
- Patterns for continuous deployment
Deployment, Monitoring, and Production Operations
- Migrating solutions across different environments
- Operational tools and dashboards
- Complete production readiness
Summary and Future Directions
Requirements
- Familiarity with ETL pipelines and data modeling principles
- Proficiency with mid-level PDI transformations
- Strong capabilities in SQL and scripting
Target Audience
- Experienced data engineers
- ETL architects
- Specialists overseeing intricate data integration tasks
Testimonials (1)
It's a hands-on session.
