Get in Touch

Course Outline

Enterprise Architecture and Pipeline Design

  • Multi-layer ETL architectural patterns
  • Crafting modular, reusable components
  • Implementing hybrid strategies across various systems

Advanced Performance Engineering

  • Optimizing at the step level
  • Strategies for parallelism and threading
  • Monitoring pipelines under high load

Automation, Scripting, and Custom Extensions

  • Integrating scripting within transformations
  • Building custom plugins
  • Expanding PDI functionality using Java and JavaScript

Complex Data Processing and Integrations

  • Real-time and streaming data integration
  • Interaction with big data platforms
  • Sophisticated file and API handling

Data Governance, Security, and Compliance

  • Protecting transformations and managing credentials
  • Ensuring data lineage and traceability
  • Addressing regulatory and compliance requirements

Enterprise Orchestration and Scheduling

  • Overseeing large-scale job networks
  • Designing error recovery and failover mechanisms
  • Orchestration at the environment level

Repository, Version Control, and CI/CD

  • Strategies for enterprise repositories
  • Connecting PDI with Git
  • Implementing continuous deployment workflows

Deployment, Monitoring, and Production Operations

  • Migrating solutions across different environments
  • Utilizing operational tools and dashboards
  • Achieving end-to-end production readiness

Wrap-up and Future Pathways

Requirements

  • Familiarity with ETL pipelines and data modeling concepts
  • Hands-on experience with intermediate PDI transformations
  • Proficiency in SQL and scripting languages

Target Audience

  • Senior data engineers
  • ETL architects
  • Professionals overseeing complex data integration tasks
 21 Hours

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories