LLM Ops Engineer

Job Summary

A company is looking for a LLMOps Engineer (Large Language Models Operations Engineer).

Key Responsibilities:

• Provide operational support for Large Language Models (LLM), including incident management, ongoing model management and maintenance, and user support
• Monitor and maintain GenAI solutions, including performance monitoring, user interaction monitoring, and efficacy monitoring
• Implement and uphold LLMOPS guardrails, ensuring adherence to best practices and implementation standards

Required Qualifications:

• Strong experience in developing, deploying, and managing large language models, specifically on Microsoft Azure
• Proven expertise in Azure cloud platforms and services, including Azure Machine Learning, Azure Kubernetes Service, and Azure DevOps
• Solid understanding of LLMOPS guardrails implementation practices
• Proficiency in Python for scripting and automation
• Experience with Terraform for infrastructure deployment and management is essential