Senior Data Engineer
Accel Club
Job description
About the role
A small engineering team is looking for a Senior Data Engineer to own production data pipelines, from source collection through processing and warehouse models to the datasets used by business teams and applications. The role works closely with Data Analytics, Finance and Operations, and calls for someone who can understand an existing platform, make independent technical decisions and take responsibility for data correctness and reliable operation.
Key responsibilities
- Build and maintain integrations with marketplace, advertising and business systems, including Amazon SP-API, Amazon Ads, TikTok and Odoo.
- Develop Apache Beam pipelines on Google Cloud Dataflow to turn source data into BigQuery.
- Maintain Airflow workflows for pipeline orchestration.
- Develop dbt models supporting financial reporting, advertising and inventory planning.
- Maintain Playwright-based scraping and report collection, parsing results into validated datasets and adapting to changes in source pages and formats.
- Improve data quality through testing, reconciliation, freshness monitoring and alerts, and investigate discrepancies across sources, warehouse models and reports.
- Deliver safe migrations and backfills while improving pipeline performance and cloud costs.
Required profile
- Strong production experience with Python and SQL.
- Hands-on experience developing and operating Apache Beam pipelines on Google Cloud Dataflow.
- Experience building and operating Airflow workflows and maintaining dbt models.
- Strong understanding of incremental processing, deduplication, late-arriving data and safe reprocessing, and careful reasoning about dataset grain, joins, metric definitions and historical revisions.
- Independent ownership of production pipelines, including troubleshooting and incident resolution.
- Effective use of AI coding tools, with responsibility for reviewing and verifying their output.
- Clear communication with technical and business colleagues, with English sufficient for daily collaboration.
Required skills
- Python and SQL
- Apache Beam / Google Cloud Dataflow
- Airflow / Google Cloud Composer
- BigQuery, including data modelling, query performance and cost optimisation
- dbt
- Playwright, Cloud Storage, Cloud Run, PostgreSQL/AlloyDB, Docker, GitHub Actions, Terraform/Terragrunt
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Georgia.
Salary: Senior Data Engineer Based on 5 job offers in GeorgiaApply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 2 days ago
Expires 1 month from now
7 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Accel Club