Senior Python Data Engineer

About this role

About Avaron AB

Avaron helps you find assignments that match your skills and ambitions. As a permanently employed consultant with us, you get competitive terms – combined with the variety and growth that a consulting career offers. About the Assignment You will help shape the data flows behind advanced automotive testing, turning large volumes of test bed data into reliable and usable information for engineering teams. This assignment sits in a technically demanding environment where Python development, ETL/ELT, distributed systems, and production-grade infrastructure all come together. You will work with file-heavy and domain-specific data processing, where performance, robustness, and maintainability are critical. The environment includes Windows-based deployments, Azure, CI/CD, and a mix of database technologies. This is a strong fit for you if you enjoy solving complex data engineering challenges close to real-world product development. Job DescriptionYou will build and improve ETL/ELT pipelines for large-scale ingestion and processing of automotive test data. You will develop Python-based solutions in a production environment, with focus on clean design, maintainable code, and reliable delivery. You will work with object-oriented designs, including more complex class structures and inheritance patterns. You will handle concurrency and parallel processing using multiprocessing, queues, events, and threading where it adds value. You will contribute to the design and evolution of distributed systems that manage demanding data flows and enterprise-level integrations. You will work with domain-specific data handling, including file processing across several formats and frameworks such as Sympathy for Data. You will support deployments and operations in Windows Server environments, including CI/CD with GitHub Actions, packaging with Poetry, and monitoring with Grafana. You will collaborate with teams working close to automotive test bed systems, databases, and infr