Senior Data Engineer

About the role

Join Exadel as a Senior Data Engineer and help a global marketplace platform turn raw data into actionable insights. You will design, build, and maintain robust data pipelines on Google Cloud, ensuring high‑quality data is available for analytics and downstream systems.

Key responsibilities

• Develop and maintain Bronze, Silver, and Gold data pipelines using SQL‑based ELT patterns.
• Ingest data from SFTP, APIs, and databases into BigQuery (raw, append‑only).
• Design dimensional models for the curated Silver layer, handling SCDs and surrogate keys.
• Implement data quality checks, row‑count reconciliations, and validation logic.
• Build and support Airflow DAGs for orchestration, scheduling, and monitoring.
• Enable idempotent reprocessing and reliable pipeline reruns.
• Collaborate on schema evolution, CI/CD deployments (Git, Flyway, Jenkins) and metadata documentation.
• Optimize BigQuery performance and cost through partitioning, clustering, and query tuning.
• Integrate data with downstream systems such as ERP and reporting tools.
• Troubleshoot pipeline failures and maintain alerting processes.

Required profile

• Strong experience with Google Cloud Platform, especially BigQuery.
• Hands‑on expertise with Apache Airflow (Cloud Composer) for workflow orchestration.
• Solid background in relational and analytical databases (PostgreSQL, AlloyDB, Teradata).
• Proven ability to design and implement SQL‑based ELT pipelines.
• Familiarity with data governance tools (OpenMetadata) and IAM/RBAC concepts.
• Experience with CI/CD and DevOps practices using GitHub, Jenkins, Flyway, Terraform.
• Upper‑intermediate English communication skills.

Required skills

• Google BigQuery
• GCP
• Apache Airflow / Cloud Composer
• SQL
• ELT
• SFTP
• API integration
• NetSuite
• PostgreSQL
• AlloyDB
• Teradata
• OpenMetadata
• IAM / RBAC
• GitHub
• Jenkins
• Flyway
• Terraform
• CI/CD