Senior Data Engineer

About this role

About Avaron AB

Avaron helps you find assignments that match your skills and ambitions. As a permanently employed consultant with us, you get competitive terms – combined with the variety and growth that a consulting career offers. About the Assignment You will join a technically advanced environment in the automotive sector where large volumes of test bed data need to be ingested, processed, and made usable across enterprise systems. The assignment combines data engineering, distributed system design, and domain-specific data handling in a setting with high demands on reliability, performance, and maintainability. You will work close to complex data flows, specialized file formats, and production-grade pipelines that support testing and analysis. This is a great opportunity if you enjoy solving demanding data challenges in a real-world engineering context. Job DescriptionYou will build and improve ETL and ELT pipelines for large-scale test bed data ingestion and processing. You will develop Python-based solutions in a production environment, with a strong focus on object-oriented design and maintainable code. You will design and evolve distributed systems that handle complex data flows and enterprise integration needs. You will work with domain-specific data processing, including Sympathy for Data and specialized file formats such as .sydata and .h5. You will contribute to deployment and operations in a Windows Server environment, including Windows services and PowerShell scripting. You will support CI/CD flows with GitHub Actions and work with Poetry for dependency and package management. You will manage and integrate data across Oracle Database, SQL, and MongoDB. You will work with logging and monitoring, including file system level logging and Grafana. You will handle infrastructure-related data access such as network drive mounting, SMB/CIFS protocols, and NAS interactions. RequirementsSenior-level experience in Python 3.9-3.11. Strong experience in object-or