Senior Data Engineer (Stockholm)

The role

You will propose and drive the architecture for user-data handling across Airflow, Spark, dbt and BigQuery, and migrate existing pipelines one at a time while keeping their outputs unchanged. You will also set up team processes and mentor a data engineer so the team can own the migrated pipelines.

What you will do

• Propose and drive the architecture for user-data handling across Airflow, Spark, dbt and BigQuery, including encryption points, derived tables, backfills and partitioning.
• Migrate existing pipelines one at a time, keeping their outputs unchanged, using a regression harness you build.
• Design and introduce processes for the team after the migration, including pipeline change reviews, testing standards, incident post-mortems and release checklists.
• Refactor pipelines to remove duplicated steps and copy-pasted logic.
• Build verification jobs to show that data-lifecycle rules are followed end to end.
• Pair with and mentor a data engineer, with the goal of enabling the team to own the migrated pipelines independently.
• Share pipeline maintenance and incident handling, and address root causes.
• Document key decisions in concise architecture decision records.

Required qualifications

• Deep hands-on experience with Airflow, Spark, dbt, BigQuery and Python.
• A track record of technically leading at least one pipeline migration from start to finish.
• Experience refactoring a live pipeline and proving that its output remained unchanged.
• Proven ability to introduce engineering practices such as testing, code review and incident handling, and help a team adopt them consistently.
• Mentoring experience with a concrete outcome.
• A hands-on approach to technical decisions, combined with the ability to support and guide other engineers.

Nice to have

• Experience with encryption at rest, data retention or deletion compliance, for example GDPR.
• Experience with envelope encryption and a key manager such as GCP KMS, BigQuery AEAD functions or Tink.
• Experience with BigQuery column-level security, policy tags or Data Catalog.
• Experience with Config Connector (KCC) for managing GCP resources from Kubernetes.
• Experience working with Kafka events.

Before you apply

• Work from the European Union region and a work permit are required.

About the company

Xebia is a global AI-first, digital transformation, and engineering partner with over 25 years of experience and a team of 5,000 professionals across 16 countries. Its CEE region team of nearly 1,000 experts delivers modern applications, data platforms, and AI solutions.