Join us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.
As a Lead Data Engineer at JPMorganChase within the Commercial and Investment Bank team, you are an integral part of an agile team that works to enhance, build, and deliver data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. As a core technical contributor, you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm’s business objectives.
Job responsibilities
Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
Contributes to software engineering communities of practice and events that explore new and emerging technologies
Adds to team culture of diversity, equity, inclusion, and respect
Required qualifications, capabilities, and skills
Formal training or certification on software engineering concepts and applied experience
Hands-on practical experience in system design, application development, testing, and operational stability
Development experience in Java and/or Python
Experience working with any tool (terraform) to provision AWS cloud services
Experience of AWS Glue, AWS Athena & AWS S3
Knowledge of Apache Parquet & open table formats such as Delta, Iceberg & Hudi
Test Driven Development experience in using JUnit, Mojito or similar
Extensive knowledge and work experience with distributed system and massively parallel processing
Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
Overall knowledge of the Software Development Life Cycle
Preferred qualifications, capabilities, and skills
Experience with big data technologies
Knowledge in working with Databricks, Iceberg
Familiarity with message bus technologies such as Kafka or AMPS and query engines such as AWS Athena & Redshift
Knowledge with AWS Lake Formation
Working knowledge of AWS Glue, AWS Athena & AWS S3
Experience in financial industry