AI Gateway Engineer

AI Gateway Engineer

We are seeking a skilled

AI Gateway Engineer

to join our team. The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI / ML models in a production environment. You will be instrumental in building and scaling our AI infrastructure within an enterprise-grade setting.

Key Responsibilities :

Design and manage

AI / API gateways like Kong, Mosaic, or Portkey. Develop and maintain

backend services, primarily using

Go , with

Python

as a valuable secondary skill. Optimize and productize

AI / ML models for production use, ensuring performance, scalability, and reliability. Leverage AWS

to build and manage our cloud infrastructure. Implement and manage

observability tools, including

OpenTelemetry (OTel), Grafana, and Prometheus , to monitor system health and performance. Apply prompt engineering techniques

to improve the efficiency and effectiveness of AI models. Collaborate with cross-functional teams

to ensure seamless integration and deployment of AI solutions. Required Skills & Qualifications :

Proven experience with

API or AI gateways

(e.g., Kong, Mosaic, Portkey). Strong backend development skills, particularly in

Go ; proficiency in

Python

is a plus. Experience with

AI / ML optimization and productization . Expertise in

AWS , including its various services for building scalable applications. Familiarity with

observability

tools like OTel, Grafana, and Prometheus. Practical experience with

prompt engineering . A history of working in

enterprise-grade environments .

Other Details : Location :

Remote (preferred in LATAM region) Length :

1+ Year Client :

Gaming Giant

The difference between something good and something great is attention to detail – AVM Consulting.