AI Engineer (NLP)

We're looking for a Senior ML / AI Engineer to own and evolve our LLM-powered user experience. You'll work directly with our technical co-founder to build, optimize, and monitor agent systems that parse workout descriptions, provide scaling recommendations, and enable conversational data retrieval - all with production-grade accuracy and speed. This is a hands-on role focused on the ML / AI engineering side : prompt engineering, model optimization, agent orchestration, and continuous improvement based on real-world usage patterns.

What You’ll Do

Core Responsibilities

Own the workout parsing system : improve accuracy of our fine-tuned model (currently Qwen-based) that converts natural language workout descriptions into structured schemas

Design and implement agent workflows for workout scaling recommendations and performance tracking

Build observability workflows using Langfuse to identify and systematically address model performance issues

Optimize agent response latency while maintaining accuracy across our tool-based reasoning system

Collaborate on agent architecture decisions, including potential migration to frameworks like DSPy

Ship production features : workout entry system, scaling recommendations, and score reporting

What We’re Looking For

Required

5+ years of ML / AI engineering experience with at least 2 years working with LLMs in production

Strong prompt engineering and model optimization skills

Experience building and deploying agent systems with tools / functions

Proven ability to use observability platforms to diagnose and improve model performance

Experience with model fine-tuning (any framework / approach)

Strong Python programming skills

Active CrossFit participant - candidates should understand standard movements and workout structures

Strongly Preferred :

Experience with agent orchestration frameworks (DSPy, LlamaIndex, or similar)

Background in production ML operations and monitoring

Experience with Modal.com or similar serverless ML platforms

Track record of iteratively improving LLM systems based on user feedback and metrics

Experience fine tuning similar open-source LLMs

Success in First 6 Months

Ship workout entry system with improved parsing accuracy

Launch basic workout scaling recommendations

Implement user score reporting and retrieval

Establish robust monitoring workflows to catch and address model failures and poor user experiences

Contribute to agent architecture decisions as we scale