Senior Data DevOps Engineer

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We are seeking a Senior Data DevOps Engineer to join our team. We are building an Enterprise AI Gateway from scratch. It is the one door every team in the company goes through to use large language models. It is also how we keep AI under control at this scale: who can use which models, what it costs, and what gets logged. The aim is that it runs itself. Onboarding of teams, agents, and MCP servers, along with keys, permissions, limits, and guardrails, should be handled by automation, not by tickets. Very little of it exists yet, so you will shape it from the very first design decision. The team is small and focused, so decisions do not take long and your work is visible. We are looking for someone who automates by default, and who cares about the governance side of AI as much as the models themselves. Responsibilities Design and build the core architecture of the Enterprise AI Gateway from the ground upAutomate the onboarding of teams, agents, and MCP servers, including provisioning of keys, permissions, limits, and guardrailsDevelop and maintain infrastructure as code to support scalable, self-service platform operationsImplement monitoring, logging, and cost-tracking mechanisms to maintain visibility and control over AI usageBuild guardrails and governance controls to manage which teams and models can access specific resourcesEnsure the reliability, availability, and performance of production systems supporting the gatewayCollaborate directly with teams using the platform, addressing questions and helping resolve errorsContinuously improve automation to reduce manual intervention and ticket-based processesEvaluate and integrate emerging GenAI and agentic AI patterns, frameworks, and protocols into the platformContribute to key architectural and design decisions as the platform evolves from an early stage Requirements A minimum of 3 years of relevant experienceStrong Python skills for automation, extensions, and integrationsStrong SRE skills, with real-world experience keeping production systems healthyProficiency with Git for version controlExperience with Google Cloud PlatformFamiliarity with LLMOps practicesExperience with Terraform and Helm for infrastructure automationWorking knowledge of GenAI/Agentic AI concepts, including relevant patterns, frameworks, and protocolsVery good communication skills, with the ability to clearly explain technical concepts, since you will interact daily with teams using the platform, answering questions and helping resolve issuesExcellent English proficiency (B2 level or higher) Nice to have Hands-on experience with Google Vertex AI, particularly endpoints for model serving and Model ArmorGCP experience with services such as BigQuery, Cloud Run, and IAMExperience building AI agents, for example using Google's Agent Development Kit (ADK)Experience with AWS BedrockDeep Kubernetes experience, preferably with GKEFamiliarity with GroovyExperience with CI/CD using JenkinsProduction experience with an AI gateway, such as LiteLLM or EPAM DIAL, highly appreciated We offer International projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement oppor