Senior Data Software Engineer with Apache Airflow and Databricks

About the role

EPAM is seeking a Senior Data Software Engineer with deep expertise in Apache Airflow and Databricks. You will design, build, and maintain scalable data pipelines, support machine‑learning workflows, and help migrate legacy systems to modern cloud platforms.

Key responsibilities

• Develop new data pipelines and maintain existing ones.
• Migrate pipelines from BDP to Databricks.
• Maintain ML ETL pipelines and adapt ML code as needed.
• Monitor daily pipelines, troubleshoot issues, and ensure reliability.
• Support ML model development, training, and deployment.
• Perform data integration and transformation using ETL processes.
• Contribute to database design, optimization, and data‑quality assurance.
• Document processes and workflows clearly.
• Collaborate with the team via BitBucket, Jira, Confluence, and Teams.

Required profile

• 3+ years of data‑engineering experience.
• Advanced proficiency in Python, Spark, and PySpark.
• Hands‑on experience with Databricks and AWS.
• Background in ML model development, training, and deployment.
• Strong understanding of ETL pipeline development and maintenance.
• Knowledge of database design, optimization, and data‑quality practices.
• Fluent English with excellent documentation skills.
• Result‑oriented and proactive problem‑solver.

Required skills

• Python
• Spark
• PySpark
• Apache Airflow
• Databricks
• AWS

What we offer

• Fully remote work with flexibility to work from anywhere in Armenia.
• Opportunities to work abroad for up to two months per year.
• Career development programs, certifications, and leadership training.
• Comprehensive medical and family care package.
• Employee Stock Purchase Plan and referral bonuses.
• Access to EPAM’s internal learning platform and free English classes.