Start Date: Mid-September
Location: Luxembourg
Languages: English C1 spoken and written skills
Seniority: 5-8 years experience
Contract type: Employee (CDI)
We are looking for a skilled and motivated Kafka Engineer to design, deploy, and manage scalable, real-time data streaming solutions using Confluent Kafka and Confluent Cloud platforms. The ideal candidate will have hands-on experience in large-scale production environments, deep knowledge of Kafka internals, and a strong DevOps mindset. You will collaborate with cross-functional teams to ensure the reliability, performance, and security of our data pipelines and streaming infrastructure.
This role primarily focuses on Kafka, but experience with IBM MQ Series – including administration, troubleshooting, and integration – would be a very strong asset and highly valued within our broader messaging infrastructure.
Responsibilities
- Design, configure, and deploy Kafka clusters to support high-volume, real-time data streams.
- Monitor Kafka infrastructure health, performance, and security, and implement necessary optimizations and enhancements.
- Troubleshoot and resolve issues related to Kafka cluster operation, data ingestion, and processing.
- Implement best practices for data governance, access control, and compliance within the Kafka ecosystem.
- Collaborate with cross-functional teams to design and implement end-to-end data pipelines.
- Stay up to date with Kafka-related developments and industry trends, recommending relevant tools and practices.
- Administering/troubleshooting (patching, monitoring queue managers/queues/channels, troubleshooting, etc.) IBM MQ Series would be a strong plus.
Requirements
- Proven experience working with Kafka in large-scale, production environments.
- Strong understanding of Kafka architecture, internals, and ecosystem components.
- Expertise in Confluent Kafka and Confluent Cloud.
- Proficiency in Java programming languages for developing Kafka applications.
- Experience with IBM MQ Series (administration, patching, monitoring, troubleshooting) is a strong plus.
- Strong scripting skills in Bash, Python, and PowerShell.
- Familiarity with DevOps tools such as GitHub, Nexus, Jira, Azure DevOps, and Splunk.
- Experience with Infrastructure-as-Code (IaC) tools like Terraform and Ansible.
- Solid working knowledge of Linux environments.
- Effective communication skills and the ability to work collaboratively in a team environment.
- Self-motivated and proactive with a commitment to continuous learning and professional development.