Lead Data Software Engineer – Spark, Kafka, Kubernetes

About the role

EPAM is seeking a Lead Data Software Engineer to drive the migration of an existing analytics platform to a cloud‑agnostic, on‑premises solution. The role is fully remote within Georgia, allowing you to work from home or any of our offices.

Key responsibilities

• Design and implement streaming and batch Spark pipelines on Kubernetes.
• Lead development of objects within the data generator framework.
• Oversee deployment and testing across local and development environments.
• Continuously improve the evolving solution and resolve bugs.
• Perform unit testing to ensure high‑quality code.
• Participate in refinement, planning, and demo sessions.
• Mentor and guide team members throughout implementation.

Required profile

• 5+ years of experience with Apache Spark, Kafka and Kubernetes.
• Strong proficiency in Python and ability to learn new technologies quickly.
• Hands‑on team player with technical leadership experience.
• Excellent communication skills and proactive attitude.
• Professional English level B2 or higher.

Required skills

• Apache Spark
• Confluent/Apache Kafka
• Kubernetes
• Python
• Java (nice to have)
• Kafka Connect, KSQL, Kafka Streams (nice to have)
• Ansible, Argo CD (nice to have)
• Test‑Driven Development (TDD) (nice to have)

What we offer

• Remote work flexibility across Georgia.
• Opportunities to work abroad for up to two months per year.
• Leadership development, certifications (GCP, Azure, AWS) and unlimited learning resources.
• Corporate events, stock purchase plan, referral bonuses.
• Comprehensive medical and family care package.