Introduction to Airflow

...
This is now a virtual classroom course. You can find more information about our virtual classroom here

This is a 16-hour hands-on workshop on Airflow with ultimate goal to make participants feel comfortable with the fundamentals of Airflow, discuss practices and patterns and gain insights by implementing a small use case end to end

A discount is available when:
  • a single customer proceeds with more than three registrations for a particular session;
  • a learner is not currently employed.
Please contact us to receive your discount coupon if you meet any of the above-mentioned criteria.

Please also note that the upcoming sessions are guaranteed to run once they have a minimum number of learners registered.
Total price:
540.00660.00 final price

Available Sessions

DateTimezoneTraining TypeWeekend-WeekdayDescriptionPrice 
Coming soon540.00660.00 final price

This is a 16-hour hands-on workshop on Airflow with ultimate goal to make participants feel comfortable with the fundamentals of Airflow, discuss practices and patterns and gain insights by implementing a small use case end to end

The use case will read data from one or more sources, transform the data in different formats and schemas in order to make it easier for data scientists to run queries and store them in a filesystem and/or a Data Lake query engine. Participants will also explore and work with the most commonly used operators to define ETL flows and apply practices to implement a layered data lake.

​ Who should attend 

IT Professionals with some experience in programming, data analysis and statistics interested in expanding and building skills on a state of the art platform used to programmatically author, schedule and monitor workflows over big amounts of data

​Prerequisites 

There are no prerequisites but familiarity with IT terminology and IT related work experience would be beneficial. 

​What will you learn 

During this hands-on course, the following topics will be covered through practical examples and exercises: 

  • Introduction to Workflow management systems 
  • Airflow Concepts
    • DAGs 
    • Tasks 
  • Developing DAGs
    • Basic DAG structure
    • Parametricity in DAGs
    • Using Task Operators 
    • Using Task Sensors 
    • Taskflow API 
    • Variables / Connections 
  • DAG development patterns
    • Success/Failure/Retry Conditions and Patterns 
    • Taking alternative routes in DAGs 
    • DAG Factories 
    • Testing DAGs
  • Deploying DAGs
    • How to organize source control repository 
    • CI/CD scenarios for deployments
  • Monitoring DAGs 
    • Web console 
    • Web API
    • Logs
  • Managing Airflow Plugins and Extensions
    • Installing Extensions 
    • Implementing Extensions 
Date

Coming soon

Timezone

Training Type

Weekend-Weekday

How it works

Registration

You may enroll in the course by providing your full name and email address through our website's 'add to cart' feature or by sending an email to hello@learningactors.com. We treat your personal data, including your full name and email address, with strict confidentiality.

Payment Options

We offer multiple payment methods, including credit cardbank transfer, and PayPal. To receive your invoice, please provide your VAT number (when applicable), address, and zip code. Again, you may provide us with this information either through our website's 'add to cart' feature or by sending an email to hello@learningactors.com. Please note that you can typically expect to receive your invoice on the first day of training, unless there are exceptional circumstances that necessitate a different approach. We’re happy to provide you with a pro-forma invoice if this meets your needs.

Expectations

Following registration, you can anticipate an info email from us approximately one week before the course start date. This email will contain course details, such as the title, date, and time, along with a request to complete a pre-course form. Additionally, we will provide the relevant Zoom link, which is  applicable for all our virtual-live courses, and will invite you to the course's Slack channel on the LA Slack workspace (learningactors.slack.com). For specific courses, you will also receive a preparation email that will set you ready for the course.
Finally, after the session concludes, we kindly request that you take a moment to provide us with your feedback, as it is of great importance to us. Additionally, we will ensure that you receive the learning material through Slack, which will be instrumental in keeping your learning journey on track!

Reminders

  • Discounts are available in two scenarios: when a single customer registers for more than three sessions or if the customer is currently unemployed. Contact the LA team to receive a discount coupon if you meet these criteria.
  • All upcoming sessions displayed on our website are guaranteed to proceed once the minimum required number of learners register. In the case that we must cancel a session, a full refund will be issued to those who have pre-paid for that specific session.