Jobiglo

Aucun resultat.

Senior Data Engineer

Accel Club

Nouveau
Senior 🇬🇧 English
Python SQL Apache Beam Google Cloud Dataflow Airflow BigQuery dbt Playwright Terraform PostgreSQL Docker GitHub Actions

Description du poste

About the role

A small engineering team is looking for a Senior Data Engineer to own production data pipelines, from source collection through processing and warehouse models to the datasets used by business teams and applications. The role works closely with Data Analytics, Finance and Operations, and calls for someone who can understand an existing platform, make independent technical decisions and take responsibility for data correctness and reliable operation.

Key responsibilities

  • Build and maintain integrations with marketplace, advertising and business systems, including Amazon SP-API, Amazon Ads, TikTok and Odoo.
  • Develop Apache Beam pipelines on Google Cloud Dataflow to turn source data into BigQuery.
  • Maintain Airflow workflows for pipeline orchestration.
  • Develop dbt models supporting financial reporting, advertising and inventory planning.
  • Maintain Playwright-based scraping and report collection, parsing results into validated datasets and adapting to changes in source pages and formats.
  • Improve data quality through testing, reconciliation, freshness monitoring and alerts, and investigate discrepancies across sources, warehouse models and reports.
  • Deliver safe migrations and backfills while improving pipeline performance and cloud costs.

Required profile

  • Strong production experience with Python and SQL.
  • Hands-on experience developing and operating Apache Beam pipelines on Google Cloud Dataflow.
  • Experience building and operating Airflow workflows and maintaining dbt models.
  • Strong understanding of incremental processing, deduplication, late-arriving data and safe reprocessing, and careful reasoning about dataset grain, joins, metric definitions and historical revisions.
  • Independent ownership of production pipelines, including troubleshooting and incident resolution.
  • Effective use of AI coding tools, with responsibility for reviewing and verifying their output.
  • Clear communication with technical and business colleagues, with English sufficient for daily collaboration.

Required skills

  • Python and SQL
  • Apache Beam / Google Cloud Dataflow
  • Airflow / Google Cloud Composer
  • BigQuery, including data modelling, query performance and cost optimisation
  • dbt
  • Playwright, Cloud Storage, Cloud Run, PostgreSQL/AlloyDB, Docker, GitHub Actions, Terraform/Terragrunt

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Accel Club.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Pourquoi signalez-vous cette offre ?

Merci pour votre signalement. Nous allons examiner cette offre.

Postulez en 30 secondes

Entrez votre email pour postuler. Un compte sera cree automatiquement.

Postuler maintenant →

En continuant, vous acceptez nos conditions d'utilisation.

Deja un compte ? Connexion

Une question sur cette offre ?

Posez-la ici : vous recevrez le récapitulatif de l'offre par e-mail, tout de suite.

Publie il y a 2 jours

Expire dans 1 mois

8 vues · 0 interesses

Boostez vos chances

Importez votre CV : nous vous proposons les offres qui matchent votre profil.

Analyse de votre CV en cours...

Accel Club