**Job Description:** **Roles & Responsibilities** + Minimum 6+ years of experience in the fundamental technology work of architecting/designing/building/managing/Optimizing the core frameworks for our cloud-based system platforms and end-to-end solutions. + Responsible for optimization of cloud infrastructure, including **Databricks** , ADLS, Blob, VMs etc., + Conduct Proof-of-Concept activities in support of advanced use cases. + Must have architectural focus for ensuring availability, reliability and scalability are necessary + Responsible for documenting the technical solutions + Administer and manage Azure Databricks workspaces, clusters, and jobs with a focus on maximizing efficiency and performance. + Implement and manage **Unity Catalog** to provide centralized governance and fine-grained access control across data assets. + Design and execute cost optimization strategies, including monitoring cluster usage, autoscaling, and resource allocation to minimize cloud expenses. + Collaborate with data engineers and security teams to enforce data governance, compliance, and security policies using Unity Catalog. + Automate deployment, scaling, and monitoring tasks using scripting and cloud-native tools. + Troubleshoot and resolve issues related to Databricks clusters, jobs, and Unity Catalog configurations. + Responsible for working with international teams spread across multiple time zones. **Must Have:** + 6 to 8 years of hands-on experience administering Azure Databricks in cloud environments. + In-depth knowledge and experience with Unity Catalog for data governance and security. + Proven expertise in cost optimization for Databricks clusters and cloud resources. + Strong understanding of Databricks architecture, cluster management, and job orchestration. + experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java,spark/Pyspark. + Proficiency in Spark architecture, including cluster management, job scheduling, and performance tuning. + Experience in Azure DevOps, Git/Github. + Azure Event Hub/ Azure Event Grid / Kafka + Hands-on experience with scripting languages such as Python, Scala, or SQL. + Experience with infrastructure-as-code tools like Terraform or ARM templates. + Solid understanding of data security, governance, and compliance standards. + Excellent problem-solving skills and ability to work in a collaborative environment. + Strong communication skills and ability to explain technical concepts to non-technical stakeholders. **Additional experience:** + Hadoop Administration and/or Azure cloud Administration + Working with Object storage ( ADLS/Blob or S3), Kubernetes (preferably AKS) + Azure AD/ OpenID /OAuth/ SAML + NSG /Firewall deployment and usage + DNS configuration and management + Automation through Ansible or Teraform or Azure DevOps + Basic Linux administration and Shell scripting (Bash) + Good documentation skills + Ability to troubleshoot to isolate and diagnose common technical problems + Monitoring and use of monitoring tools for managing critical infrastructure **Preferred Certifications:** + Microsoft Certified: Azure Administrator Associate/Microsoft Certified: Azure Solutions Architect Expert + Databricks Accredited Platform Administrator Accreditation **Weekly Hours:** 40 **Time Type:** Regular **Location:** IND:KA:Bengaluru / Innovator Building, Itpb, Whitefield Rd - Adm: Intl Tech Park, Innovator Bldg It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made. AT&T will consider for employment qualified applicants in a manner consistent with the requirements of federal, state and local laws We expect employees to be honest, trustworthy, and operate with integrity. Discrimination and all unlawful harassment (including sexual harassment) in employment is not tolerated. We encourage success based on our individual merits and abilities without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, age, disability, marital status, citizenship status, military status, protected veteran status or employment status