Databricks Engineer

We are seeking an experienced and driven Databricks Engineer to join our expanding Data Engineering team.
In this role, you will be a key member of one of our established Platform Teams, designing, developing, and scaling data pipelines in Databricks with PySpark on Microsoft Azure for the AI Factory team. This is an exciting opportunity to work at the intersection of big data and cloud engineering, delivering reliable, scalable, and high-performance data platforms that drive innovation across our organization.
Responsibilities
Design cloud-native analytical solutions using Big Data and NoSQL technologies
Build and optimize scalable data pipelines in Databricks with PySpark on Azure
Develop and maintain data lakes and data warehouses to ensure reliability and performance
Design and implement ETL/ELT workflows to collect, clean, and structure data
Implement data quality, lineage, and monitoring frameworks
Collaborate with ML and analytics teams to deliver clean, production-ready datasets
Conduct code reviews to uphold technical standards and best practices
Mentor junior engineers and foster a high-performance, collaborative culture
Integrate CI/CD methodologies into data engineering workflows using tools such as Jenkins or GitLab CI/CD
Support requirements gathering and deliver solutions in alignment with architects, technical leads, and cross-functional teams
Engage with stakeholders to understand business processes, model input data, and ensure deliverables meet requirements
Requirements
2+ years of experience in Data Engineering or a related field
Proficiency in Python and PySpark
Hands-on experience with Databricks and Microsoft Azure cloud services
Familiarity with software version control tools (e.g., GitHub, Git)
Experience with CI/CD frameworks such as Jenkins, Concourse, or GitLab CI/CD
Proven ability to build scalable, robust, and highly available data solutions
Strong problem-solving, analytical, and stakeholder engagement skills
English level of minimum B2 (Upper-Intermediate) for effective communication
Nice to have
Experience with additional programming languages such as Java, SQL, or Scala
Knowledge of SAP BTP or similar enterprise data platforms
Familiarity with agile development methodologies