AI Engineer (Enablement)

About this role

Responsibilities

• Collaborate with cross-functional teams including data analysts, data scientists, and software engineers to understand data requirements and design optimal data solutions in the Data Mesh environment.
• Develop, implement, and maintain scalable data products that enable the seamless flow of data from various sources to the Data Mesh architecture.
• Create and manage data models that cater to the specific needs of data consumers while adhering to data governance and security standards.
• Design and build data quality monitoring frameworks to ensure data accuracy, consistency, and reliability.
• Stay updated with the latest industry trends and best practices in Data Engineering and Data Mesh to continuously improve data pipelines and processes.
• Build high-performance APIs to access and query data from data warehouse.
• Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Coordinate and oversee the successful delivery of complex data engineering projects, ensuring alignment with timelines, objectives and stakeholders.

Requirements

• You have advanced knowledge of at least one programming language and are happy to learn more. Our core languages are Scala and Python.
• Expert level of SQL (especially SparkSQL) and Datawarehouse concept, Database. Experience in building data pipelines is a core requirement. Love getting your hands dirty with the data implementing custom ETLs to craft it into information
• You have knowledge of distributed system, Lambda, AWS S3, AWS Cloud watch ...
• Experience with AWS, Hive, Spark, Trino, Databricks is helpful.
• Enjoy working with stream processing frameworks like Spark structured streaming, Kafka streams.
• You understand requirements beyond the written word. Whether you're working on an API used by other developers, an internal tool consumed by our operation teams, or a feature used by many customers, your attention to detail leads to a delightful user experience.
• Fluent proficiency in Business English.
• Exceptional analytical skills, lateral thinking and experience in solving challenging problems. Experiences in working with Data Visualisation tools (e.g. Tableau, Metabase) is a plus.