Mandatory
Skills
Databricks
Engineer, Power Bi Developer, SQL, Dax Queries, SQL Server, Data Warehousing
Skill
to Evaluate
Databricks
Engineer, Power Bi Developer, SQL, Dax Queries, SQL Server, Data Warehousing
Experience
5
to 6 Years
Location
Bengaluru
Job
Description
Job
Title: Data Engineer with Databricks and Power BI (DAX) Experience
you
will be responsible for designing, developing, and maintaining robust data
pipelines and data architectures to support advanced analytics and reporting
initiatives. You will work closely with data scientists, analysts, and other
stakeholders to deliver high-quality data solutions that empower the
organization to make data-driven decisions. Your expertise in Databricks and
Power BI (DAX) will be critical in optimizing data workflows and visualizing
complex datasets.
Key
Responsibilities:
-
Design and implement scalable data processing solutions using Databricks,
including ETL processes that efficiently handle large data volumes.
-
Develop interactive dashboards and reports using Power BI to facilitate
real-time data visualization and insights for stakeholders.
-
Collaborate with cross-functional teams to understand data requirements and
deliver solutions that meet business needs and objectives.
-
Optimize data storage and retrieval processes to enhance performance and reduce
latency.
-
Ensure data quality and integrity by implementing best practices for data
governance and validation.
-
Mentor junior data engineers and contribute to knowledge sharing within the
team.
-
Stay updated with the latest trends and technologies in data engineering, and
evaluate their applicability to the organization's needs.
Skills
and Tools Required:
-
Proficiency in Databricks and experience with Spark for big data processing.
-
Strong experience with Power BI, particularly in building reports and
dashboards using DAX.
-
Solid programming skills in Python or Scala for developing data pipelines.
-
Knowledge of SQL and experience with relational databases and data warehousing
concepts.
-
Familiarity with cloud platforms - Azure, particularly in relation to data
storage and processing.
-
Understanding of data modeling, ETL processes, and data integration
methodologies.
-
Excellent problem-solving skills and attention to detail.
-
Strong communication and collaboration abilities to work effectively in a
team-oriented environment.
Skill
Area Tools & Technologies
Data
Engineering Databricks, Apache Spark,
Delta Lake
Programming Python, SQL, PySpark
BI
& Visualization Power BI, DAX, Power
Query
Cloud
Platforms Azure
DevOps
& CI/CD Git, Azure DevOps
Data
Governance Unity Catalog, Data Lake
Security
Preferred
Qualifications:
-
Bachelor's or Master's degree in Computer Science, Data Science, Information
Technology, or a related field.
-
Previous experience in a similar data engineering role, particularly within a
corporate environment.
-
Knowledge of additional BI tools and data visualization platforms is a plus.
Education
Qualificaiton B Tech
Job
Title Data Engineer with Databricks
Roles
& Responsibilities
Data
Pipeline Development (Databricks)
Design
and implement scalable ETL/ELT pipelines using Databricks and Apache Spark.
Integrate
structured and unstructured data from various sources into unified data lakes
or warehouses.
Optimize
performance and cost-efficiency of data workflows in cloud environments
(Azure).
Data
Modelling & Transformation
Develop
robust data models using Delta Lake and Unity Catalog in Databricks.
Apply
advanced transformation logic using PySpark, SQL, and notebooks.
Ensure
data quality, lineage, and governance across the pipeline.
Power
BI Reporting & DAX
Create
interactive dashboards and reports tailored to business needs.
Write
complex DAX expressions for calculated columns, measures, and KPIs.
Optimize
Power BI performance through efficient data modeling and query tuning.
Collaboration
& Stakeholder Engagement
Work
closely with business analysts, data scientists, and decision-makers to gather
requirements.
Translate
business needs into technical solutions and visualizations.
Provide
training and support for self-service analytics using Power BI.
Skill
Area Tools & Technologies
Data
Engineering:Databricks, Apache Spark, Delta Lake
Programming:Python,
SQL, PySpark
BI
& Visualization: Power BI, DAX, Power
Query
Cloud
Platforms:Azure
DevOps
& CI/CD: Git, Azure DevOps
Data
Governance: Unity Catalog, Data Lake
Security