Skip to content

Contact sales

By filling out this form and clicking submit, you acknowledge our privacy policy.

Introduction to ETL Management with Airflow

Course Summary

The Introduction to ETL Management with Airflow training course is designed to demonstrate the use of Airflow schedule and maintain numerous Extract, Transform and Load (ETL) processes running on a large scale Enterprise Data Warehouse (EDW).

The course begins with an introduction to Airflow, including a brief background and an exploration of the Airflow framework, database and User Interface (UI). Next, the course dives into Airflow development including operators and plugins, Directed Acyclic Graphs (DAGs), and scheduling. The course concludes with a session on deploying with Airflow and complex task dependency management.

Purpose
 Learn how to use Apache Airflow to manage data warehouses.
Audience
 DevOps engineers who want to monitor their enterprise data warehouses.
Role
Project Manager - Software Developer - System Administrator - Technical Manager
Skill Level
Intermediate
Style
Hack-a-thon - Learning Spikes - Workshops
Duration
2 Days
Related Technologies
Big Data Training | Apache Airflow | Apache | Server Administration

 

Productivity Objectives
  • Assess how to organize and arrange scheduling
  • Determine how to standardize Extract, Transform and Load (ETL) formats and processes
  • Integrate Scheduling code into regular code flows

What You'll Learn:

In the Introduction to ETL Management with Airflow training course, you'll learn:
  • Introduction to Airflow
    • Background and history
      • Airbnb
      • DAGs (Directed Acyclic Graph)
      • Python
    • The Airflow framework and python
    • The Airflow database
    • The Airflow UI and Webserver
  • Development in Airflow
    • Introduction to DAGs
    • Airflow, Abstraction for developers
    • Operators and plugins
    • Hooks, connections and variables
    • Visualize DAGs
    • Schedule- when and how to
    • RabbitMQ and multiple workers
  • Deployment with Airflow
    • Work with AIRFLOW management
    • Complex task dependency management
    • Airflow and Docker- setting up the environment
    • Set up large scale environments with Airflow in git
real world content

Real-World Content

Project-focused demos and labs using your tool stack and environment, not some canned "training room" lab.
expert practitioners

Expert Practitioners

Industry experts that bring their battle scars into the classroom.
experiential learning

Experiential Learning

More coding than lecture, coupled with architectural and design discussions.
tailored outlines

Tailored Outlines

One-size-fits-all doesn't apply to training teams. That's where we come in!
“I appreciated the instructor's technique of writing live code examples rather than using fixed slide decks to present the material.”

VMware

Dive in and learn more

When transforming your workforce, it's important to have expert advice and tailored solutions. We can help. Tell us your unique needs and we'll explore ways to address them.

Let's chat

By filling out this form and clicking submit, you acknowledge our privacy policy.