AI Gateway Engineer

AI Gateway Engineer

We are seeking a skilled AI Gateway Engineer to join our team. The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI / ML models in a production environment. You will be instrumental in building and scaling our AI infrastructure within an enterprise-grade setting.

Key Responsibilities :

• Design and manage AI / API gateways like Kong, Mosaic, or Portkey.
• Develop and maintain backend services, primarily using Go , with Python as a valuable secondary skill.
• Optimize and productize AI / ML models for production use, ensuring performance, scalability, and reliability.
• Leverage AWS to build and manage our cloud infrastructure.
• Implement and manage observability tools, including OpenTelemetry (OTel), Grafana, and Prometheus , to monitor system health and performance.
• Apply prompt engineering techniques to improve the efficiency and effectiveness of AI models.
• Collaborate with cross-functional teams to ensure seamless integration and deployment of AI solutions.

Required Skills & Qualifications :

Other Details :

The difference between something good and something great is attention to detail – AVM Consulting.