Apache Airflow Engineer

Hiring: Apache Airflow Engineer | New York City, NY | Hybrid We're looking for an experienced Apache Airflow Engineer with strong expertise in Apache Airflow, Python, Linux, Shell Scripting, and workflow orchestration to support a large-scale scheduler migration initiative. The ideal candidate will have experience migrating enterprise scheduling platforms to Apache Airflow while ensuring production readiness, operational stability, and seamless workflow execution. Location: New York City, NY (Hybrid) Duration: 6 Months (Possibility of Extension) Key Responsibilities & Skills: • Analyze existing Cybermation job schedules, dependencies, runtime parameters, and execution workflows • Design, develop, and maintain Apache Airflow DAGs for shell scripts, REST APIs, and scheduled workflows • Migrate legacy scheduler jobs (Cybermation, Control-M, Autosys, UC4, Tidal, Cron, etc.) to Apache Airflow • Configure Airflow scheduling, task dependencies, retries, logging, variables, connections, and monitoring • Develop Python-based Airflow DAGs with robust exception handling and operational controls • Execute dry runs, unit testing, schedule validation, API validation, and production readiness checks • Create migration documentation, deployment notes, operational runbooks, and support documentation • Collaborate with application teams, infrastructure teams, release management, and client stakeholders • Support production deployments, hypercare activities, incident resolution, and workflow optimization • Follow best practices for workflow orchestration, monitoring, governance, and operational excellence Mandatory Skills: • 7+ years of software engineering experience • Strong hands-on experience with Apache Airflow DAG development • Experience migrating from legacy schedulers such as Cybermation, Control-M, Autosys, UC4, or Tidal • Strong Python programming skills • Linux/Unix administration and Shell Scripting • REST APIs and cURL integration • Git and version control • Production support and operational troubleshooting • Runbook creation and deployment documentation • Strong communication and stakeholder management skills What We're Looking For: A highly skilled Apache Airflow Engineer who can successfully lead and execute enterprise scheduler migration initiatives while maintaining business continuity. The ideal candidate should possess deep expertise in Airflow, Python, Linux, workflow orchestration, production support, and enterprise scheduling systems. Preferred Qualifications: • Experience migrating Cybermation workloads to Apache Airflow • Experience with AWS services including EKS, S3, CloudWatch, Lambda, IAM, Secrets Manager, and EventBridge • Experience working with Financial Services or regulated environments • Familiarity with CI/CD pipelines and containerized Airflow deployments • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline Interested? Apply now or DM us to explore this opportunity! You can share resumes at sanskar@wiseskulls.com or call at +1 302-292-9192