Ai Gateway Engineer

AI Gateway EngineerWe are seeking a skilledAI Gateway Engineerto join our team.

The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI / ML models in a production environment.

You will be instrumental in building and scaling our AI infrastructure within an enterprise-grade setting.Key Responsibilities : Design and manageAI / API gateways like Kong, Mosaic, or Portkey.

Develop and maintainbackend services, primarily usingGo , withPythonas a valuable secondary skill.

Optimize and productizeAI / ML models for production use, ensuring performance, scalability, and reliability.

Leverage AWSto build and manage our cloud infrastructure.

Implement and manageobservability tools, includingOpenTelemetry (OTel), Grafana, and Prometheus , to monitor system health and performance.

Apply prompt engineering techniquesto improve the efficiency and effectiveness of AI models.

Collaborate with cross-functional teamsto ensure seamless integration and deployment of AI solutions.

Required Skills & Qualifications : Proven experience withAPI or AI gateways(e.g., Kong, Mosaic, Portkey).

Strong backend development skills, particularly inGo ; proficiency inPythonis a plus.

Experience withAI / ML optimization and productization .

Expertise inAWS , including its various services for building scalable applications.

Familiarity withobservabilitytools like OTel, Grafana, and Prometheus.

Practical experience withprompt engineering .

A history of working inenterprise-grade environments .

Other Details : Location : Remote (preferred in LATAM region)

Length : 1+ Year

Client : Gaming GiantThe difference between something good and something great is attention to detail – AVM Consulting.