Senior DevOps Engineer (all genders) | Data Platform
About this role
AnstellungsdetailsPermanent Contract, Full- or Part-Time, Remote or Cologne / Düsseldorf / Darmstadt / Berlin
InfoWho we areWe are the tech powerhouse behind Kaufland’s international online marketplaces and a company within the Schwarz Group. Driven by a start-up mentality and working on an equal footing within flat hierarchies, we develop the best marketplace solutions for our customers, sellers and partners. #FromEuropeForEurope
Day by day, our Tech & Product Team of about 400 experts pursues the goal of creating the best possible customer shopping experience for our online marketplace. Through innovative technical developments, they not only create an outstanding shopping experience but also lay the foundation for an optimal selling experience for our sellers. Learn more about our division, areas, and cross-functional teams here!
AufgabenYour tasks – this is what awaits you in detail
You run and own our self-hosted Apache Kafka backbone and Schema Registry end-to-end, managing ACLs, client quotas, certificates, upgrades, and disaster recovery
You operate our Debezium-based change data capture pipelines, overseeing connectors, snapshots, offsets, replica lag, and BigQuery sink loaders
You run our workloads on Kubernetes, including Navarch - our self-built workflow orchestrator executing ~7,500 SQL and Python tasks daily - owning resource management, autoscaling, and debugging
You automate and own access management and infrastructure as code across our self-hosted GitLab CI/CD pipelines, replacing manual tickets wi
Responsibilities
- You run and own our self-hosted Apache Kafka backbone and Schema Registry end-to-end, managing ACLs, client quotas, certificates, upgrades, and disaster recovery
- You operate our Debezium-based change data capture pipelines, overseeing connectors, snapshots, offsets, replica lag, and BigQuery sink loaders
Requirements
- You run our workloads on Kubernetes, including Navarch - our self-built workflow orchestrator executing ~7,500 SQL and Python tasks daily - owning resource management, autoscaling, and debugging
- You automate and own access management and infrastructure as code across our self-hosted GitLab CI/CD pipelines, replacing manual tickets wi