Lead ML Engineer / Head of ML
Location:
San Francisco, on site
Compensation:
Salary range: $250K – USD 500K (depending on experience)
Equity: 0.2% - 1.5%
Team size:
·4 ML engineers
Are you ready to pioneer cutting-edge technology in the AI field? Join a revolutionary company that is transforming the landscape for LLMs. We are on the lookout for an exceptional Lead ML Engineer or Head of ML to bring groundbreaking ideas to life and steer the future of AI model routing. This role is exclusively with Connect Group.
About the Company:
Backed by top-tier investors, this innovative company solves that problem with a state-of-the-art model router: simply provide your prompt, and it will run on the optimal model in real-time.
About the Role:
This technically demanding role involves developing a sophisticated model-routing system, incorporating human feedback, optimizing routing models, reducing model costs, and ensuring production-readiness. This is an exclusive opportunity to tackle these challenges and lead the technological evolution of model-routing.
Responsibilities:
Collaborate with founders to develop and deploy model-routing technology, directly influencing product direction.
Lead a team of approximately 4 ML engineers with backgrounds from top tech companies.
Innovate with new techniques, tools, and architecture to enhance model performance, latency, throughput, and efficiency.
Ideal Candidate:
You will excel in this role if you:
Possess a deep understanding of modern ML architectures and how to optimize them for inference.
Have experience with model evaluation, coding in Pytorch, and deploying LLMs in production environments.
Are adept at discerning when off-the-shelf solutions are viable and can swiftly build tools when they are not.
Can identify and own critical problems end-to-end, willing to acquire new knowledge as needed.
Bring at least 5 years of professional ML engineering experience or its equivalent.
Have a startup mindset and are keen to make a significant impact.