Member of Technical Staff Evals and Post Training Product
Fireworks AIVisit Fireworks AI website
Fireworks AI operates an AI platform for production inference and training of open-source models.
Fireworks AI on X (Twitter)Fireworks AI on DiscordFireworks AI on GitHubFireworks AI on Documentation
San Mateo, United States
Funding history
About Fireworks AI
Fireworks AI provides serverless and dedicated model inference, model deployment, and supervised and reinforcement fine-tuning for developers and enterprises building AI applications.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will build infrastructure and workflows connecting model evaluation and post-training. You will scale evaluation systems, create benchmarks, improve fine-tuning experiences, investigate model results, and turn user needs into reusable product solutions.
Requirements
- Software engineering or data science
- System design
- Sandbox infrastructure
- LLM evaluation
- Data science
- Model fine-tuning
- GenAI lifecycle
Responsibilities
- Scale evaluation infrastructure
- Track benchmarks and reproduce published results
- Design and build new model-performance benchmarks
- Build and improve post-training and fine-tuning workflows
- Partner with users to understand needs and productize solutions
Benefits
- Equity