Job Title: Data Engineer
Location: Elkridge MD or Annapolis Junction, MD
Eligibility: Candidate must possess an active TS/SCI w/ CI Poly
clearance
Salary Range: (lvl 3: 5yrs +BA ) $120K-125K (lvl 4: 9yrs+ BA) $170K-180K
Job Description:
As a Data Engineer/Integrator, your role entails collaborating closely
with a team of developers to fulfill data integration requirements. This
involves writing and maintaining code using an Extract-Transform-Load
(ETL) platform to ensure data is transformed into suitable formats as
defined by IC ITE initiatives. You will interface with external teams
and systems, employing various protocols including HTML and SFTP to
collect data efficiently. Additionally, your responsibilities include
enhancing the ETL platform by adding features aimed at shortening
timelines for future data integration efforts. Beyond coding tasks,
you'll develop and maintain software, ensuring seamless integration into
a fully functional system. Collaboration with external teams will be
necessary to validate data ingest processes. Finally, you'll be
responsible for providing comprehensive documentation covering system
architecture, development, and any enhancements made throughout the
process.
Education & Experience Requirements:
- 5+ years of professional experience with a Bachelor's degree or
equivalent
- 3+ years of professional experience with a Master's degree or
equivalent
- 10+ years of professional experience
- Additional experience will be considered in lieu of a degree
Required/Must Have Qualifications:
• Active TS/SCI with CI Polygraph
• Specialization using the Databricks platform for building, deploying,
and managing data and AI solutions
• Experience building ETL pipelines, managing data pipelines, and
working with large datasets using tools like Spark, Python, and SQL
• Experience with technologies like Delta Lake, Delta Live Tables, and
Databricks Workflows
• Familiarity with Advana
Desired Qualifications:
• Experience collaborating with data scientists.
• Strong Python programming skills
• Solid SQL knowledge for querying and data manipulation
• Coud platform experience, such as AWS, Azure, etc.