Advanced Training course

Orchestration

Learn how to orchestrate data pipelines with jobflows, branch job execution, collect execution statistics, handle errors and move files.
Enroll to course

Who is it for?

Everyone who is comfortable building basic transformation graphs and wants to take the next step towards more complex data processes. Essentials course is required prior this course.

What you’ll learn

You’ll be able to effectively develop data pipelines using jobflows. You'll learn to:

  • Orchestrate multi-step data pipelines
  • Build reusable data flows that can be controlled by parameters
  • Gracefully handle failed jobs, report and recover from errors.
  • Gather statistics from jobs for further evaluation.

How it works

  • This course is organized as a combination of exercises and remote live sessions (MS Teams or videoconferencing tool of your choice if applicable).
  • Duration: 2 days, expected workload 2 hours a day including a 60 to 90-minute remote live session with an expert trainer per day

Course curriculum

  • 1

    Orchestration layer

    • 📚 Introduction

    • 📚 Executing jobs with jobflows, typical structure of a jobflow

    • 📚 File Operations

    • 📥 Materials for Download
  • 2

    Advanced concepts

    • 📚 Reusing jobflows (Parameters, Dictionary)

    • 📚 Iteration (Loop component)

    • 📚 Config driven approach to orchestration
  • 3

    Exercises

    • 💪 Retry job

    • 💪 Processing payments files

Book a training session

Please pick a date or private classroom.
Private session

Who will attend

Please add yourself or at least one other attendee.
Me
Add another attendee

Your contact details