DevOps Engineer (AI Inference)

About the role

Gcore is looking for a DevOps Engineer to join its AI Inference Operations Team. You will design, deploy and maintain the infrastructure that powers scalable and secure AI inference workloads in on‑premises environments.

Key responsibilities

• Design, develop and maintain infrastructure for AI inference, including GPU scheduling, model deployment pipelines and data access patterns.
• Build and manage monitoring and observability tools (dashboards, alerts, runbooks) for model health and system performance.
• Collaborate with ML engineers and platform teams to define system architecture, integrate inference runtimes and test performance at scale.

Required profile

• Strong understanding of Kubernetes architecture (CNI, CSI, operators, ingress/gateway, control‑plane components).
• Hands‑on experience operating and troubleshooting production Kubernetes clusters.
• Deep Linux and networking troubleshooting skills (DNS, routing, firewalling, TLS, MTU, connectivity).
• Ability to develop automation and operational tooling using Python, Go or Bash.
• Experience with IaC tools such as Terraform or Ansible.
• Familiarity with monitoring solutions like VictoriaMetrics and Grafana.
• Proficiency with Git‑based workflows and CI/CD pipelines.

Required skills

• Kubernetes (CNI, CSI, operators, ingress, gateway, control‑plane)
• Linux system administration
• Network troubleshooting (DNS, routing, firewall, TLS, MTU)
• Python, Go, Bash scripting
• Terraform, Ansible
• VictoriaMetrics, Grafana
• Git, CI/CD pipelines