Senior Data Engineer, Azure Databricks
About this role
About the Company
Avaron AB is a growing consultancy that matches your expertise with the market's most interesting assignments, offering a platform where your professional development is central.
About the Assignment
About Avaron AB
Avaron AB is a growing consultancy that matches your expertise with the market's most interesting assignments, offering a platform where your professional development is central. About the Assignment You will join a team building the data foundation for two performance evaluation products in a global retail environment. The assignment focuses on creating a unified and reliable data platform that consolidates information from multiple operational systems and supports faster decision-making across a complex omnichannel business. You will help replace fragmented and manually managed data flows with scalable pipelines, automated validation, and robust data models that improve quality, consistency, and timeliness. Job DescriptionDesign, build, and maintain data pipelines that connect, collect, organize, version, and consolidate data from multiple operational sources. Develop scalable data models and ingestion frameworks for a unified data platform. Create resilient batch and streaming pipelines across ingestion, transformation, and serving layers. Implement automated validation checks to improve data accuracy and reduce reporting time. Optimize data workflows for performance, scalability, maintainability, and cost efficiency. Monitor and troubleshoot pipelines in production environments. Contribute across the full data engineering lifecycle, including solution design, architecture, estimation, sprint planning, development, testing, documentation, deployment, and operational follow-up. Work hands-on with Databricks, Apache Spark, Delta Lake, Azure services, and DevOps practices to deliver reusable and high-quality data solutions. RequirementsProven experience designing and implementing end-to-end data pipelines for both batch and streaming workloads. Hands-on expertise with Databricks, including Apache Spark, Delta Lake, job orchestration, performance tuning, and environment management. Strong knowledge of Microsoft Azure, particularly services used in d