GROW YOUR CAREER WITHIN STEFANINI

We are looking for an experienced Senior Databricks Engineer to design, build, and optimize scalable data solutions on the Databricks platform. The ideal candidate will have strong expertise in data engineering, Spark, SQL, Python/Scala, and cloud-based data platforms. This role involves working closely with data architects, analysts, and business teams to deliver reliable, high-performance data pipelines and analytics solutions.

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark

Build batch and streaming data processing solutions for large-scale datasets

Optimize ETL/ELT workflows for performance, reliability, and cost efficiency

Work with data from multiple sources and integrate it into curated data models

Implement data quality checks, monitoring, and troubleshooting for production pipelines

Collaborate with stakeholders to understand data requirements and translate them into technical solutions

Develop reusable frameworks, notebooks, and libraries for data engineering standards

Ensure adherence to data governance, security, and compliance best practices

Support migration of legacy data workloads to Databricks/cloud platforms

Mentor junior engineers and contribute to engineering best practices