Senior Data Engineer

  • Anywhere

About Norma

Norma is a cutting-edge company that specializes in integrating with large Tech Companies and managing complex ETL (Extract, Transform, Load) processes. We have developed a sophisticated Business Intelligence (BI) ecosystem, serving both web and mobile platforms, to provide powerful analytics solutions to our customers.

Job Overview

We are seeking an experienced Senior Data Engineer to oversee and maintain a critical project within our company. The successful candidate will be responsible leading the company’s data engineering efforts, ensuring data integrity, optimising processes, and maintaining seamless data flow across our multi-layered data architecture. The candidate will work with and potentially lead a team of Data Engineers.

Key Responsibilities

  • Manage and maintain the integrity of data shared through Snowflake, ensuring accuracy and consistency.
  • Oversee data operations, including merging data from various APIs and creating precalculations in the gold layer. Using Snowflake
  • Maintain and optimize the data pipeline serving our desktop BI tool,
  • Manage ETL processes using tools like Airbyte to transport data from Snowflake to our PostgreSQL serving layer
  • Work closely with the backend team to ensure a smooth customer experience, particularly in addressing and resolving data discrepancies.
  • Develop and implement data validation and reconciliation mechanisms, ensuring data integrity when integrating data from third party sources.
  • Lead cost optimisation initiatives, including planning for migration of the serving layer away from Snowflake.
  • Establish and maintain comprehensive monitoring, alerting and backfill mechanisms so as to ensure the reliability of ETL operations from Snowflake to other serving layers.
  • Collaborate with other team members to align data outputs with business objectives.
  • Continuously optimize data processing and reporting for efficiency and accuracy.

Requirements

  • Proven production experience in handling large volumes of data and creating mechanisms to efficiently transfer it to serving layers.
  • Proven experience with ETL tools such as Airbyte or Fivetran, particularly in moving data from analytical to transactional databases.
  • At least 3 years of experience working with Data Lakes such as Snowflake, Databricks, Redshift, or BigQuery.
  • Strong proficiency in SQL and database structures.
  • Excellent analytical and problem-solving skills.
  • Strong communication skills, both written and verbal.
  • Ability to work independently and manage multiple priorities in a fast-paced environment.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

Preferred Qualifications

  • Experience with restaurant POS systems and related data structures.
  • Familiarity with ERP systems and their data requirements.
  • Knowledge of data security best practices, especially in handling sensitive business data.
  • Familiarity with Thoughtspot ( BI tool we use for embedded analytics ).

Benefits

Work Environment

  • Fully remote or hybrid option available (if based in Athens).
  • Flexible working hours (local time).
  • Collaborative team environment.
  • Lead a team of aspiring Data Engineers

Compensation

  • Competitive salary commensurate with experience (starting from 3,000 EUR net monthly).