AI Gateway Engineer

About the Company

We are seeking a skilled AI Gateway Engineer to join our team. The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI/ML models in a production environment. You will be instrumental in building and scaling our AI infrastructure within an enterprise-grade setting.

About the Role

Key Responsibilities:

• Design and manage AI/API gateways like Kong, Mosaic, or Portkey.
• Develop and maintain backend services, primarily using Go, with Python as a valuable secondary skill.
• Optimize and productize AI/ML models for production use, ensuring performance, scalability, and reliability.
• Leverage AWS to build and manage our cloud infrastructure.
• Implement and manage observability tools, including OpenTelemetry (OTel), Grafana, and Prometheus, to monitor system health and performance.
• Apply prompt engineering techniques to improve the efficiency and effectiveness of AI models.
• Collaborate with cross-functional teams to ensure seamless integration and deployment of AI solutions.

Qualifications

• Proven experience with API or AI gateways (e.g., Kong, Mosaic, Portkey).
• Strong backend development skills, particularly in Go; proficiency in Python is a plus.
• Experience with AI/ML optimization and productization.
• Expertise in AWS, including its various services for building scalable applications.
• Familiarity with observability tools like OTel, Grafana, and Prometheus.
• Practical experience with prompt engineering.
• A history of working in enterprise-grade environments.

Required Skills

• API or AI gateways experience.
• Backend development in Go.
• AI/ML optimization.
• AWS expertise.
• Observability tools knowledge.
• Prompt engineering experience.

Preferred Skills

• Proficiency in Python and Golang
• Experience in enterprise-grade environments.

Location: Remote (preferred in LATAM region)

Length: 1+ Year

Client: Gaming Giant

The difference between something good and something great is attention to detail – AVM Consulting.