Design, develop, test, and deploy highly scalable and reliable data processing pipelines using Java 17+ and the Apache Beam SDK, executed on GCP Cloud Dataflow.

Develop and manage complex data orchestration workflows using Apache Airflow (or GCP Cloud Composer), including creating and maintaining DAGs utilizing various common and custom operators.

Interact with and optimize data stored in key GCP Big Data services, including BigQuery, BigTable, and Google Cloud Storage (GCS).

Write, optimize, and review complex SQL queries for data retrieval, transformation, and analysis, particularly within BigQuery and Cloud SQL.

Maintain high standards of code quality, testing, and documentation.

As an added advantage: Deploy applications using GKE (Google Kubernetes Engine), manage security through IAM, work with globally consistent databases like Cloud Spanner, and develop secure API endpoints for data access.

Mandatory Skills:

5+ years of experience in Java GCP - Java 17+ Cloud Dataflow (Apache Beam programming) Airflow/Composer - Creating DAGs and various common Operators Common GCP BigData services such as BigQuery, BigTable, GCS, Cloud SQL, SQL queries etc. Spring, Spring boot, REST/SOAP web services, Hibernate, SQL, Tomcat, Application servers (WebSphere), SONAR, Agile, AJAX, Jenkins. Etc

Optional Skills:

GKE, IAM, Spanner, API development etc are added advantage