Tag: DAG

Simplify Airflow DAG Creation and Maintenance with Hamilton in 8 minutes

This post walks you through the benefits of having two open source projects, Hamilton and Airflow, and their directed acyclic graphs (DAGs) work in tandem. At a high level Airflow is responsible for orchestration (think macro) and Hamilton helps author clean and maintainable...

Simplify Airflow DAG Creation and Maintenance with Hamilton in 8 minutes

This post walks you through the benefits of having two open source projects, Hamilton and Airflow, and their directed acyclic graphs (DAGs) work in tandem. At a high level Airflow is responsible for orchestration (think macro) and Hamilton helps author clean and maintainable...

Simple airflow DAG using windows part 1

Airflow was developed by AirBNB software team in 2014, and it was made available for everyone. Apache Airflow is an open-source tool designed for orchestrating, scheduling, and monitoring data workflows. Airflow is a framework which has a UI, and can be used using python. The key factors that made a...

Dag Hammarskjöld relieves my unease

These days and particularly on these uncharacteristically sunny Vancouver days I feel this empty thing in my stomach. I feel uneasy. Both my Rosemary and I are more or less in good health. There is money in the bank and we live in a nice neighbourhood. Our deck garden is about to explode in the b...