Jobiglo

No results.

Senior Data Engineer

Accel Club

New
Senior 🇬🇧 English
Python SQL Apache Beam Google Cloud Dataflow Airflow BigQuery dbt Playwright Terraform PostgreSQL Docker GitHub Actions

Job description

About the role

A small engineering team is looking for a Senior Data Engineer to own production data pipelines, from source collection through processing and warehouse models to the datasets used by business teams and applications. The role works closely with Data Analytics, Finance and Operations, and calls for someone who can understand an existing platform, make independent technical decisions and take responsibility for data correctness and reliable operation.

Key responsibilities

  • Build and maintain integrations with marketplace, advertising and business systems, including Amazon SP-API, Amazon Ads, TikTok and Odoo.
  • Develop Apache Beam pipelines on Google Cloud Dataflow to turn source data into BigQuery.
  • Maintain Airflow workflows for pipeline orchestration.
  • Develop dbt models supporting financial reporting, advertising and inventory planning.
  • Maintain Playwright-based scraping and report collection, parsing results into validated datasets and adapting to changes in source pages and formats.
  • Improve data quality through testing, reconciliation, freshness monitoring and alerts, and investigate discrepancies across sources, warehouse models and reports.
  • Deliver safe migrations and backfills while improving pipeline performance and cloud costs.

Required profile

  • Strong production experience with Python and SQL.
  • Hands-on experience developing and operating Apache Beam pipelines on Google Cloud Dataflow.
  • Experience building and operating Airflow workflows and maintaining dbt models.
  • Strong understanding of incremental processing, deduplication, late-arriving data and safe reprocessing, and careful reasoning about dataset grain, joins, metric definitions and historical revisions.
  • Independent ownership of production pipelines, including troubleshooting and incident resolution.
  • Effective use of AI coding tools, with responsibility for reviewing and verifying their output.
  • Clear communication with technical and business colleagues, with English sufficient for daily collaboration.

Required skills

  • Python and SQL
  • Apache Beam / Google Cloud Dataflow
  • Airflow / Google Cloud Composer
  • BigQuery, including data modelling, query performance and cost optimisation
  • dbt
  • Playwright, Cloud Storage, Cloud Run, PostgreSQL/AlloyDB, Docker, GitHub Actions, Terraform/Terragrunt

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Accel Club.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 2 days ago

Expires 1 month from now

7 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

Accel Club