RED Global are currently looking for a Airflow Subject Matter Expert (SME) to help optimize our customers existing Airflow environment, ensuring high reliability, performance, and scalability. This position is a 6 month contract + extensions and requires someone who is available to be in London 3 days per week. We are looking for the following: • Proven experience as an Apache Airflow SME or Lead Developer in a production-grade environment. • Strong understanding of Airflow internals, including scheduler, executor types (Celery, Kubernetes), and plugin development. • Experience with workload orchestration and autoscaling using KEDA (Kubernetes-based Event Driven Autoscaler), and familiarity with Celery for distributed task execution and background job processing, particularly in data pipeline or microservices environments • Hands-on experience with Azure cloud services, especially Azure Data Factory, Azure Databricks, Azure Storage, and Azure Synapse. • Proficiency in designing and deploying CI/CD pipelines using Azure DevOps (YAML pipelines, release management, artifact handling). • Solid programming skills in Python, with experience in writing modular, testable, and reusable code. • Familiarity with containerization (Docker) and orchestration (Kubernetes) as it relates to Airflow deployment. • Experience with monitoring tools (e.g., Prometheus, Grafana, Azure Monitor) and log aggregation (e.g., ELK, Azure Log Analytics). • Strong problem-solving skills and the ability to work independently in a fast-paced, agile environment. • Excellent communication skills and the ability to collaborate effectively with cross-functional teams. If this sounds like something of interest then please apply directly and someone from the team will be in touch to discuss the requirement further.