Bengaluru, India
19 hours ago
Lead Data Engineer

Job Title

Lead Data Engineer

Job Description Summary

The Lead Data Engineer helps architect and lead the development of enterprise-scale data platforms and advanced analytics solutions across multiple business units and subject areas. In addition, they assist the project delivery team with scoping and planning integration projects and contribute to the design, implementation, and support of the data artifacts in the data lakehouse and databases. This role combines deep technical expertise with leadership and mentoring responsibilities, driving innovation and best practices across the data engineering function.

Job Description

About the Role:

Support the Solution and Data Architect(s) to help lead the design, development, and optimization of scalable data platforms and analytics solutions that support global data strategy.Architect and implement robust, scalable, metadata-driven pipelines in Databricks using Delta Lake, Unity Catalog, and declarative workflows.Oversee the development and maintenance of Azure SQL database objects using advanced T-SQL for data quality and insight generation.Drive performance, reliability and observability of real-time data processing using Spark Structured Streaming and Change Data Feed strategies.Own CI/CD processes and infrastructure automation using Databricks Asset Bundles, Azure DevOps, and Infrastructure as Code.Define and enforce standards for reusable, metadata-driven integration patterns, including Unity Catalog governance, Declarative Pipeline design, and data quality across the engineering team.Manage and mentor a small team of data engineers, providing technical leadership, pair programming support, conducting design/code reviews, guiding technical decisions and aligning data engineering efforts with strategic goalsCollaborate with cross-functional stakeholders to translate business and technical requirements into scalable data solutions, assisting the project delivery team to scope, plan and deliver new and enhanced data integrationsChampion innovation, best practices, and continuous improvement in data engineering, while mentoring team members and fostering technical growth.Evaluate and introduce emerging technologies to enhance platform capabilities

About You:

6+ years in cloud-native data engineering, including 3+ years with Databricks and Delta Lake on Azure and 2+ years in technical leadership or architecture roles.Deep experience with Databricks ecosystem: Delta Lake, Unity Catalog, Declarative Pipelines, Spark Structured Streaming, Change Data Feed, Serverless SQL, and cluster optimization.Expert-level SQL skills for designing performant queries, optimizing data models, and generating insights from large datasets.Proficient in PySpark, Scala, R, and Python, with experience mentoring teams and promoting best practices.Strong understanding of Lakehouse architecture, data integration patterns, and automation strategies.Hands-on experience with CI/CD, Git, Databricks Asset Bundles, and Infrastructure as Code, driving DevOps practices in data engineering.Skilled in requirements gathering and solution design, translating business needs into technical specifications.Demonstrated leadership in troubleshooting complex data and code issues, performing root cause analysis, and implementing long-term fixes.Exposure to machine learning pipelines, data mesh architectures, and test-driven development (pytest, nUnit, tSQLt).Knowledge of real-time integrations and IoT solutions (Azure Event Hubs, Service Bus, IoT Core).Familiarity with data governance frameworks (data lineage, cataloging, GDPR, HIPAA compliance).Holds a degree in IT, Engineering, Computer Science, or quantitative disciplines.

Why join Cushman & Wakefield?

As one of the leading global real estate services firms transforming the way people work, shop and live working at Cushman & Wakefield means you will benefit from;

Being part of a growing global company;Career development and a promote from within culture;An organisation committed to Diversity and Inclusion

We're committed to providing work-life balance for our people in an inclusive, rewarding environment.
We achieve this by providing a flexible and agile work environment by focusing on technology and autonomy to help our people achieve their career ambitions. We focus on career progression and foster a promotion from within culture, leveraging global opportunities to ensure we retain our top talent. We encourage continuous learning and development opportunities to develop personal, professional and technical capabilities, and we reward with a comprehensive employee benefits program.

We have a vision of the future, where people simply belong.

 

That's why we support and celebrate inclusive causes, not just on days of recognition throughout the year, but every day. We embrace diversity across race, colour, religion, sex, national origin, sexual orientation, gender identity or persons with disabilities or protected veteran status.

We ensure DEI is part of our DNA as a global community - it means we go way beyond than just talking about it - we live it. If you want to live it too, join us.







INCO: “Cushman & Wakefield”
Confirm your E-mail: Send Email