Introduction to ETL management with Airflow

The Introduction to ETL management with Airflow training course is a 2-day course designed to familiarize students with the use of Airflow schedule and maintain numerous ETL processes running on a large scale Enterprise Data Warehouse.

As Data Warehouses increase in complexity it is important to have a dependable, scalable, intuitive, and simple scheduling and management program to monitor the flow of data and watch how transformations are completed. Apache Airflow, originally conceived of by AirBnb to help manage the complexities of their Enterprise Data Warehouse, is being adopted by tech companies everywhere for it’s ease of management, scalability, and elegant design. Airflow is rapidly becoming the go-to technology for companies scaling out large data warehouses.

Course Summary

Purpose: 
Teach how to use Apache Airflow to manage data warehouses
Audience: 
DevOps engineers who want to monitor their enterprise data warehouses.
Skill Level: 
Learning Style: 

Hands-on training is customized, instructor-led training with an in-depth presentation of a technology and its concepts, featuring such topics as Java, OOAD, and Open Source.

Hands On help
Duration: 
2 Days
Productivity Objectives: 
  • Organize and arrange scheduling
  • Standardize ETL formats and process
  • Integrate Scheduling code into regular code flows

What You'll Learn

In the Introduction to ETL management with Airflow training course you’ll learn:

  • Introduction to Airflow

    • Background and history – Airbnb, DAGS, python

    • The Airflow framework and python

    • The Airflow database

    • The Airflow U/I and Webserver

  • Development in Airflow

    • Introduction to DAGs

    • Airflow Abstraction for developers

    • Operators and plugins

    • Hooks, connections, and variables

    • Visualizing your DAGs

    • Scheduling- when and how to

    • RabbitMQ and multiple workers

  • Deploying with Airflow

    • Working with AIRFLOW management

    • Complex  task dependency management

    • Airflow and Docker- setting up the environment

    • Setting up large scale environments with Airflow in git


Contact us to learn more

Not all training courses are created equal. Let the customization process begin! We'll work with you to design a custom Introduction to ETL management with Airflow training course that meets your specific needs.

DevelopIntelligence has been in the technical/software development learning and training industry for nearly 20 years. We’ve provided learning solutions to more than 48,000 engineers, across 220 organizations worldwide.

About Develop Intelligence
Di Clients
Need help finding the right learning solution?   Call us: 877-629-5631