Airflow Migration Developer - Autosys to Apache Airflow

Key Responsibilities

Analyse existing Autosys job definitions and dependencies. Design and implement equivalent DAGs in Apache Airflow. Integrate Airflow with MarkitEDM and other downstream systems. Ensure job scheduling, logging, and ing are aligned with current SLAs. Collaborate with cloud engineering and application teams for seamless deployment on AWS. Document migration logic, configurations, and operational procedures. Support UAT and production rollout phases.

Required Skills & Experience

Strong experience with Apache Airflow. Hands-on experience with Autosys job scheduling and batch processing. Familiarity with MarkitEDM or similar data management platforms. Proficiency in Python and scripting for workflow orchestration. Experience with AWS cloud services (ECS, S3, Lambda, CloudWatch). Understanding of CI/CD pipelines and DevOps practices. Strong problem-solving and debugging skills. Excellent communication and documentation abilities.

Desirable

Experience in financial services or large-scale enterprise data environments. Knowledge of Airflow deployment in containerised environments (Docker, Kubernetes). Familiarity with audit and compliance requirements in batch processing.