Member of Technical Staff LLM Infrastructure

Fireworks AI operates an AI platform for production inference and training of open-source models.

San Mateo, United States
About Fireworks AI

Fireworks AI provides serverless and dedicated model inference, model deployment, and supervised and reinforcement fine-tuning for developers and enterprises building AI applications.

View jobs by Fireworks AI

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will design and develop scalable backend infrastructure for distributed training, inference, and data pipelines. You will maintain CI/CD, control-plane, and model-serving systems; improve reliability and efficiency; and translate research and product needs into infrastructure solutions.

Requirements

  • Software engineering
  • Infrastructure
  • Machine learning system
  • Python
  • Go
  • ML infrastructure
  • PyTorch
  • MLflow
  • Vertex AI
  • SageMaker
  • Kubernetes
  • LLM

Responsibilities

  • Design and develop scalable backend infrastructure
  • Build and maintain CI/CD, control-plane, and model-serving systems
  • Improve performance, cost efficiency, and reliability
  • Build frameworks and safeguards for model quality
  • Translate research and product needs into infrastructure solutions
  • Participate in code reviews and deployment processes

Benefits

  • Equity
Member of Technical Staff LLM Infrastructure at Fireworks AI | JobStash