06-19, 12:00–12:40 (Europe/Berlin), Palais Atelier
This talk will explore the bad and best practices when deploying Apache Airflow in a production environment. From common pitfalls such as misconfigured tasks and lack of scalability,
Apache Airflow has become a popular open-source platform for managing and orchestrating data pipelines. However, as with any technology, there are good and bad ways to use it. This talk will explore the bad and best practices when deploying Apache Airflow in a production environment. From common pitfalls, such as misconfigured tasks and lack of scalability, to best practices, such as robust monitoring and proper security measures, this talk will provide practical advice for anyone looking to implement Apache Airflow in their production environment.
Bhavani Ravi is an independent DataOps consultant who helps you setup scalable data infrastructures. She is also an avid technical blogger, Opensource enthusiast and Linkedin Learning Instructor