Position Summary

This role involves leading day-to-day technical delivery of data engineering work, especially modernizing existing ETL and scheduling systems. This role focuses on moving data pipelines from Informatica BDM to Databricks and migrating job schedules from TIDAL to Airflow.
The person will be hands-on, guide a small team and work closely with architects, analysts and stakeholders on healthcare data platforms.

Job Responsibilities Lead migration of existing Informatica BDM ETL jobs to Databricks using PySpark. Migrate job scheduling and dependencies from TIDAL to Apache Airflow. Design, develop and maintain scalable data pipelines on Databricks. Work on healthcare data such as claims, prescriptions, patient, provider or sales data. Ensure data is accurate through data quality checks and reconciliations, especially during migration. Guide and review work done by data engineers and senior associates. Break down work into tasks, estimate effort and support sprint delivery. Work with architects and BAs to turn requirements into working data solutions. Support testing, defect fixes and production releases. Maintain clear technical documentation and runbooks. Education BE/B.TechMaster of Computer ApplicationWork Experience 6–8 years of experience in data engineering, with experience leading small teams or workstreams. Strong hands-on experience on Databricks (PySpark), Informatica BDM, Informatica IICS / IDMC, Apache Airflow Experience migrating: BDM → Databricks TIDAL → Airflow Good SQL skills and understanding of batch data processing. Experience working with healthcare or life sciences data. Exposure to cloud platforms (AWS, Azure or GCP). Good communication and documentation skills. Experience in data modernization or platform migration projects. Familiarity with Agile delivery, Jira and Confluence. Experience working in regulated data environments. Behavioural Competencies OwnershipTeamwork & LeadershipCultural FitMotivation to Learn and GrowTechnical Competencies Problem SolvingLifescience KnowledgeCommunicationInformaticaDatabricksPythonSkills