Senior ML Infrastructure Engineer – DevOps

About the role

We are seeking a Senior ML Infrastructure Engineer who will own the end‑to‑end deployment and operation of machine‑learning models serving millions of customers. Working closely with applied scientists, you will ensure real‑time inference services run reliably in a fully remote setting based in Armenia.

Key responsibilities

• Maintain real‑time inference services, respond to alerts, debug incidents, perform rollbacks and write post‑mortems as part of a 24×7 on‑call rotation.
• Design, build, and improve AWS infrastructure using IaC, CI/CD pipelines, Kubernetes, Docker, autoscaling, monitoring and cost‑control mechanisms.
• Manage the GPU fleet – NVIDIA driver and CUDA upgrades, node provisioning, debugging and capacity planning.
• Automate user access, SSH credentials, service accounts and developer environments for the science team.
• Run real‑time data pipelines, stream ingestion into an online feature store and serve low‑latency features.
• Orchestrate batch workloads with Apache Airflow or Databricks Workflows.
• Collaborate with scientists to productionise prototypes and keep them healthy.
• Write and review production‑grade Python code, including AI‑generated snippets.

Required profile

• Proven 24×7 on‑call experience with high‑load online services and live incident resolution.
• Strong Linux systems expertise with hands‑on Kubernetes, Docker and infrastructure‑as‑code.
• Solid experience in Python, Git and CI/CD practices.
• Experience with workflow orchestration tools such as Airflow or Databricks.
• Familiarity with generative AI within the software development lifecycle.
• English proficiency at B2 level or higher.

Required skills

• AWS (including EC2, S3, IAM)
• Infrastructure as Code (e.g., Terraform, CloudFormation)
• CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions)
• Kubernetes and Docker
• Python programming
• Git version control
• Apache Airflow or Databricks Workflows
• NVIDIA driver and CUDA management
• Linux system administration

What we offer

• Fully remote work with flexibility to operate from any location in Armenia.
• Opportunities to work abroad up to two months per year.
• Relocation possibilities across 55+ countries.
• Corporate and social events, leadership development and career advising.
• Access to certifications (GCP, Azure, AWS) and EPAM’s internal learning platform.
• Free English classes with certified teachers.
• Employee Stock Purchase Plan and performance bonuses.