Data Streaming Engineer

We are looking for a Data Streaming Engineer to join our young and dynamic team. As a Data Streaming Engineer, you will lead the charge in building and supporting our on-prem data streaming architecture. This includes leveraging Apache Kafka, event sourcing, streaming ETL technologies, and integrating Apache Spark or Apache Flink for enhanced data processing capabilities. Your work will ensure the delivery of scalable, high-throughput, and reliable data streaming solutions essential for real-time analytics and decision-making.

Responsibilities

  • Design and implement scalable data streaming solutions using Apache Kafka, with a focus on on-prem deployments.
  • Develop and maintain event-driven architectures and streaming ETL processes, integrating Apache Spark or Apache Flink for advanced data processing and analytics.
  • Optimize on-prem data streaming solutions for performance, reliability, and scalability.
  • Establish robust support and maintenance protocols for our on-prem data streaming infrastructure.
  • Lead efforts in securing data, implementing encryption and compliance measures for on-prem data processing.
  • Troubleshoot and resolve issues in the data streaming architecture, providing expert guidance and technical support.
  • Continuously evaluate new technologies and tools in the streaming ETL and data processing space to enhance our system capabilities.
  • Facilitate knowledge sharing and ensure best practices are followed in the design and implementation of on-prem data streaming solutions.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience with Apache Kafka, event sourcing, and streaming ETL technologies, specifically tailored to on-prem deployments.
  • Strong programming skills in Java, Scala, or Python.
  • Good to have: Experience with Apache Spark or Apache Flink for data processing – candidates with this experience will be given preference.
  • Demonstrated capability in designing and supporting on-prem data streaming architectures, including performance optimization and troubleshooting.
  • Deep understanding of data security, encryption, and compliance frameworks relevant to on-prem data processing.
  • Exceptional problem-solving skills, along with effective communication and project management abilities.

Benefits

  • Vibrant modern office space.
  • Remote work arrangements.
  • Bi-monthly company wide social and team building activities.
  • Lunch vouchers.
  • Support in personal and professional growth.
  • Pension scheme.
  • Private medical and dental insurance coverage for employees + dependents.

At Logifuture we embrace equality and diversity. We do not discriminate and our values of delivering results together support this statement. We are determined to foster an inclusive environment where everyone feels valued, heard, and empowered to contribute their unique skills and experiences.