Senior Data Engineer

About this role

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines for large-scale data processing
• Manage ingestion and transformation of high-volume test bed data across multiple formats
• Build and optimize distributed data processing systems with a focus on performance and reliability
• Implement object-oriented solutions using advanced programming patterns and concurrency techniques
• Collaborate with cross-functional teams to support data-driven applications and workflows
• Deploy and manage applications within Windows Server environments
• Develop and maintain CI/CD pipelines using tools such as GitHub Actions
• Monitor system performance and implement logging solutions, including integrations with monitoring tools like Grafana
• Handle file system operations, including network drive configurations and NAS interactions
• Ensure efficient database integration and management across Oracle, SQL, and MongoDB systems
• Required Experience
• Senior-level experience in data engineering or related roles
• Strong hands-on experience with production-grade ETL pipeline development
• Proven expertise in designing distributed systems and handling large-scale data processing
• Experience working in enterprise environments, preferably within the automotive or testing domain
• Solid understanding of concurrency, multiprocessing, and performance optimization techniques
• Familiarity with Windows-based deployment and system environments
• Ski