Ai Gateway Engineer

AI Gateway EngineerWe are seeking a skilledAI Gateway Engineerto join our team.

The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI / ML models in a production environment.

You will be instrumental in building and scaling our AI infrastructure within an enterprise-grade setting.Key Responsibilities : Design and manageAI / API gateways like Kong, Mosaic, or Portkey.

• Develop and maintainbackend services, primarily using Go, with Pythonas a valuable secondary skill.
• Optimize and productizeAI / ML models for production use, ensuring performance, scalability, and reliability.
• Leverage AWSto build and manage our cloud infrastructure.
• Implement and manageobservability tools, including OpenTelemetry (OTel), Grafana, and Prometheus, to monitor system health and performance.
• Apply prompt engineering techniquesto improve the efficiency and effectiveness of AI models.
• Collaborate with cross-functional teamsto ensure seamless integration and deployment of AI solutions.Required Skills & Qualifications : Proven experience with API or AI gateways(e.g., Kong, Mosaic, Portkey).
• Strong backend development skills, particularly in Go; proficiency in Pythonis a plus.
• Experience with AI / ML optimization and productization.
• Expertise in AWS, including its various services for building scalable applications.
• Familiarity with observabilitytools like OTel, Grafana, and Prometheus.
• Practical experience with prompt engineering.
• A history of working in enterprise-grade environments.Other Details : Location : Remote (preferred in LATAM region)- Length : 1+ Year- Client : Gaming GiantThe difference between something good and something great is attention to detail – AVM Consulting.