Data Lakes Engineer
Arena Technical Resources, LLC
Job Title: Data Lakes Engineer
Location: Doral, FL
Eligibility: Candidate must possess an active TS/SCI clearance and be
willing to obtain a CI Polygraph
Job Description:
Role Overview: Full-stack Databricks platform administration designing
scalable storage, ETL, and transformation workflows.
Responsibilities:
- Support DoD data-driven initiatives by administering Data Lake
environments and contributing to enterprise data architecture and
platform operations.
- Manage and tune the Data Lake platform end to end, including
workspace governance, cluster performance optimization, Unity
Catalog configuration, and secure cloud connectivity.
- Build and optimize mission-grade analytics pipelines using ETL/ELT
patterns, Delta Lake and Lakehouse design, and integrated AI/ML
workflows aligned to DoD operational needs.
- Apply SysEngOps and DevSecOps practices to accelerate delivery,
leveraging Git-based version control and automated CI/CD to
standardize development and deployments.
- Implement cloud security controls across AWS, Azure, and GCP, with
strong grounding in IAM, RBAC, and security best practices, plus
hands-on delivery using Python, SQL/NoSQL, Spark, Databricks SQL,
Terraform, and cloud-native data services at scale.
Required Experience or Education Requirements (Must have one or the
other)
- Master’s degree in a field closely related to the work
- 11+ years of experience managing complex technical projects in
enterprise data architecture, Databricks administration, and
cloud-based data platforms
Location: Doral, FL
Eligibility: Candidate must possess an active TS/SCI clearance and be
willing to obtain a CI Polygraph
Job Description:
Role Overview: Full-stack Databricks platform administration designing
scalable storage, ETL, and transformation workflows.
Responsibilities:
- Support DoD data-driven initiatives by administering Data Lake
environments and contributing to enterprise data architecture and
platform operations.
- Manage and tune the Data Lake platform end to end, including
workspace governance, cluster performance optimization, Unity
Catalog configuration, and secure cloud connectivity.
- Build and optimize mission-grade analytics pipelines using ETL/ELT
patterns, Delta Lake and Lakehouse design, and integrated AI/ML
workflows aligned to DoD operational needs.
- Apply SysEngOps and DevSecOps practices to accelerate delivery,
leveraging Git-based version control and automated CI/CD to
standardize development and deployments.
- Implement cloud security controls across AWS, Azure, and GCP, with
strong grounding in IAM, RBAC, and security best practices, plus
hands-on delivery using Python, SQL/NoSQL, Spark, Databricks SQL,
Terraform, and cloud-native data services at scale.
Required Experience or Education Requirements (Must have one or the
other)
- Master’s degree in a field closely related to the work
- 11+ years of experience managing complex technical projects in
enterprise data architecture, Databricks administration, and
cloud-based data platforms
Confirm your E-mail: Send Email
All Jobs from Arena Technical Resources, LLC