Senior DataOps Engineer

About the role

We are seeking a Senior DataOps Engineer to design, build and operate a secure, hybrid‑cloud data platform on AWS for a leading Azerbaijani telecommunications operator. You will drive the implementation of lakehouse architectures, data tokenization, and real‑time streaming pipelines while ensuring compliance and cost efficiency.

Key responsibilities

• Design and maintain the AWS data platform, including S3 lake layout, Apache Iceberg tables, and Glue Data Catalog integration.
• Build scalable batch and streaming pipelines using Amazon EMR (Serverless & EMR‑on‑EKS), Apache Spark/PySpark, Apache Flink, and Athena.
• Implement data tokenization and de‑identification pipelines with Protegrity and Spark UDFs for both batch and streaming data.
• Develop real‑time streaming architectures with Amazon MSK, MSK Replicator/MirrorMaker2, and Schema Registry.
• Apply Medallion Architecture (Bronze, Silver, Gold) for lakehouse modeling and automate Iceberg table registration.
• Configure data access control, governance, and PII detection using Lake Formation, Macie, and Informatica catalogs.

Required profile

• 4+ years of hands‑on experience as a Data Engineer or DataOps Engineer building enterprise‑grade data platforms.
• Strong analytical and problem‑solving abilities with a proactive, results‑oriented mindset.
• Excellent communication skills and ability to collaborate with data science, security, and governance teams.

Required skills

• AWS Data Analytics services (S3, Glue, Lake Formation, EMR, Athena, DataSync, MSK).
• Apache Iceberg table format and catalog management.
• Apache Spark / PySpark and Spark Streaming.
• Apache Flink, Kafka, Kafka Connect, Schema Registry, MirrorMaker2.
• Data tokenization tools (Protegrity, Spark UDFs).
• Relational databases (PostgreSQL, Oracle, Amazon RDS).
• Infrastructure‑as‑Code (Terraform, AWS CDK) and CI/CD (GitLab CI/CD).
• Data governance tools (Informatica Axon/EDC, AWS Lake Formation, Macie).

What we offer

• Flexible working format – remote, office‑based or hybrid.
• Competitive salary and comprehensive compensation package.
• Personalized career growth and professional development programs.
• Access to tech communities, mentorship, and training resources.
• Education reimbursement, anniversary gifts, and regular corporate events.