GA, USA
11 hours ago
Data Platform Engineer
A position at White Cap isn’t your ordinary job. You’ll work in an exciting and diverse environment, meet interesting people, and have a variety of career opportunities. The White Cap family is committed to Building Trust on Every Job. We do this by being deeply knowledgeable, fully capable, and always dependable, and our associates are the driving force behind this commitment. Responsible for designing and implementing high-performance data pipelines, APIs, and integrations between transactional systems and our analytics platform. The ideal candidate will have expertise in Postgres OLTP systems, Databricks-based data processing, and modern middleware technologies to enable secure and scalable data exchange. **Major Tasks, Responsibilities and Key Accountabilities** + Design, build, and maintain batch and streaming data pipelines using Databricks (PySpark, Delta Live Tables, Unity Catalog). + Develop and manage inbound/outbound data feeds via APIs, SFTP, pub/sub, or middleware platforms. + Build and optimize data models in Postgres and synchronize with analytical layers. + Collaborate with product, architecture, and InfoSec teams to ensure secure and compliant data movement. + Implement data quality, observability, and governance standards. + Automate deployment and testing with CI/CD tools (e.g., Databricks Asset Bundles, GitHub Actions, or Azure DevOps). + Participate in refactoring existing data pipelines to modern, scalable approaches. Aid in retirement of former techniques and communications around new methods + Create build vs buy proposals. Implement “greenfield” solutions or integrate 3rd party apps and connectors. **Nature and Scope** + Demonstrates skill in data analysis techniques by resolving missing/incomplete information and inconsistencies/anomalies in more complex research/data. + Nature of work requires increasing independence; receives guidance only on unusual, complex problems or issues. Work review typically involves periodic review of output by a supervisor and/or direct customers of the process. + May provide general guidance/direction to or train junior level support or professional personnel. **Work Environment** + Located in a comfortable indoor area. Any unpleasant conditions would be infrequent and not objectionable. + Most of the time is spent sitting in a comfortable position and there is frequent opportunity to move about. On rare occasions there may be a need to move or lift light articles. + No travel required. **Education and Experience** + Typically requires BS/BA in a related discipline. Generally, 2-5 years of experience in a related field OR MS/MA and generally 2-4 years of experience in a related field. Certification is required in some areas. **Preferred Qualifications** + Proficiency in Python or Scala, with strong SQL skills. + Hands-on experience with Databricks or Spark-based data engineering. + Experience integrating APIs, building middleware connectors, and managing event-based data flows. + Solid understanding of Postgres or similar OLTP databases. + Familiarity with cloud environments (Azure preferred) and containerization (Docker/Kubernetes). + Strong problem-solving, performance tuning, and communication skills. + Relevant certifications (e.g., Databricks Certified Data Engineer, Azure Data Engineer Associate) + Experience working in Agile/Scrum environments. + Strong documentation and technical writing skills. If you’re looking to play a role in building America, consider one of our open opportunities. We can’t wait to meet you. **Functional Area** Information Technology **Work Type** Remote **Recruiter** Hampton, Corey **Req ID** WCJR-029231 White Cap is an Equal Opportunity Minority/Female/Individuals with Disabilities/Protected Veteran and Affirmative Action Employer. White Cap considers for employment and hires qualified candidates without regard to age, race, religion, color, sex, sexual orientation, gender, gender identity, national origin, ancestry, citizenship, protected veteran or disability status or any factor prohibited by law.
Confirm your E-mail: Send Email