AI Gateway Engineer

AI Gateway Engineer We are seeking a skilled AI Gateway Engineer to join our team. The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI / ML models in a production environment. You will be instrumental in building and scaling our AI infrastructure within an enterprise-grade setting.

Key Responsibilities : Design and manage AI / API gateways like Kong, Mosaic, or Portkey.

Develop and maintain backend services, primarily using Go, with Python as a valuable secondary skill.

Optimize and productize AI / ML models for production use, ensuring performance, scalability, and reliability.

Leverage AWS to build and manage our cloud infrastructure.

Implement and manage observability tools, including OpenTelemetry (OTel), Grafana, and Prometheus, to monitor system health and performance.

Apply prompt engineering techniques to improve the efficiency and effectiveness of AI models.

Collaborate with cross-functional teams to ensure seamless integration and deployment of AI solutions.

Required Skills & Qualifications : Proven experience with API or AI gateways (e.g., Kong, Mosaic, Portkey).

Strong backend development skills, particularly in Go; proficiency in Python is a plus.

Experience with AI / ML optimization and productization.

Expertise in AWS, including its various services for building scalable applications.

Familiarity with observability tools like OTel, Grafana, and Prometheus.

Practical experience with prompt engineering.

A history of working in enterprise-grade environments.

Other Details : Location : Remote (preferred in LATAM region)

Length : 1+ Year

Client : Gaming Giant

The difference between something good and something great is attention to detail – AVM Consulting.