2 Blog

Orchestration services: Apache Airflow or Azure Data Factory?

Orchestration services: Apache Airflow or Azure Data Factory?

Data integration and analysis are the cornerstones of modern, fact-based decision-making and corporate management. To ensure that the most up-to-date and correct data is ...
More
Data-Aware Scheduling with Apache Airflow Datasets

Data-Aware Scheduling with Apache Airflow Datasets

It is well established by now that Airflow is the state-of-the-art tool for scheduling and monitoring workflows in a unified framework. Airflow enables us to define ...
More
How to Scale Data Processing Tasks with Apache Airflow Celery

How to Scale Data Processing Tasks with Apache Airflow Celery

Digital transformation is a major success factor for companies and the ability to derive valuable insights from an abundance of data generated is a key competitive ...
More
How to build Airflow CI/CD Pipelines for Automated Software Testing

How to build Airflow CI/CD Pipelines for Automated Software Testing

Apache Airflow is the de-facto standard for workflow management platforms under a free license and is the glue that holds the data transformation and process chains of ...
More
Apache Airflow Summit 2022 - Trends and Topics

Apache Airflow Summit 2022 - Trends and Topics

The Apache Airflow Summit is the highlight of the year for the community of developers, contributors, and users of the popular workflow orchestration platform. The 2022 ...
More
How to operate Apache Airflow with GitLab CI/CD

How to operate Apache Airflow with GitLab CI/CD

Apache Airflow promotes itself as a community-based platform for programmatic workflow management and orchestration. For data teams in charge of ETL pipelines or machine ...
More
Application Ideas for the Apache Airflow API

Application Ideas for the Apache Airflow API

The Apache Airflow workflow management platform not only provides a comprehensive web interface for managing and monitoring automation created in the form of workflows, ...
More
More flexibility for processes: Connecting SAP BW and Apache Airflow

More flexibility for processes: Connecting SAP BW and Apache Airflow

The integration of systems is an interesting and necessary field that no modern IT landscape can do without. At a time when digital processes are gaining the upper hand ...
More
Apache Airflow 2.1 - Why the Airflow upgrade is worth it

Apache Airflow 2.1 - Why the Airflow upgrade is worth it

The new major release of the Apache Airflow workflow management platform will soon be one year old. If you haven't considered upgrading before, now is a good time to do ...
More
Apache Airflow ETL - Get inspired by the possibilities

Apache Airflow ETL - Get inspired by the possibilities

Running ETL workflows with Apache Airflow means relying on state-of-the-art workflow management. It orchestrates recurring processes that organize, manage and move their ...
More