Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layer ETL architectural patterns
- Crafting modular, reusable components
- Implementing hybrid strategies across various systems
Advanced Performance Engineering
- Optimizing at the step level
- Strategies for parallelism and threading
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Integrating scripting within transformations
- Building custom plugins
- Expanding PDI functionality using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming data integration
- Interaction with big data platforms
- Sophisticated file and API handling
Data Governance, Security, and Compliance
- Protecting transformations and managing credentials
- Ensuring data lineage and traceability
- Addressing regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Overseeing large-scale job networks
- Designing error recovery and failover mechanisms
- Orchestration at the environment level
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories
- Connecting PDI with Git
- Implementing continuous deployment workflows
Deployment, Monitoring, and Production Operations
- Migrating solutions across different environments
- Utilizing operational tools and dashboards
- Achieving end-to-end production readiness
Wrap-up and Future Pathways
Requirements
- Familiarity with ETL pipelines and data modeling concepts
- Hands-on experience with intermediate PDI transformations
- Proficiency in SQL and scripting languages
Target Audience
- Senior data engineers
- ETL architects
- Professionals overseeing complex data integration tasks
21 Hours
Testimonials (1)
It's a hands-on session.