Job for Web3 Beginners
Software Engineer - Baseten Inference Stack
57 minutes agoSalary: 180K - 360KSan Francisco; Montreal; New York; Seattle; TorontoHybridFull TimeBackendJobs by Baseten
BasetenVisit Baseten website
Baseten is an AI inference platform for deploying, optimizing, and scaling custom, open-source, and fine-tuned models in production.
San Francisco, United States
Funding history
About Baseten
Baseten provides model runtimes, inference infrastructure, developer workflows, and deployment options including managed cloud, self-hosted, and hybrid environments.
Skills
About the Role
You will develop infrastructure and orchestration systems for distributed LLM inference. You will build customer-facing and low-level platform capabilities, improve routing and runtime management, debug production systems, and own architecture, deployment, monitoring, and iteration for your projects.
Requirements
- Distributed systems
- Backend infrastructure
- Platform engineering
- Production systems
- Reliability
- Latency
- Scalability
- Developer experience
- System debugging
- Inference engineering
- Communication
- Collaboration
Responsibilities
- Develop infrastructure and orchestration systems for distributed LLM inference
- Build customer-facing features and low-level infrastructure components
- Build routing, autoscaling, scheduling, observability, and runtime-management capabilities
- Improve the reliability, scalability, and usability of the inference stack
- Make inference optimizations broadly available and configurable
- Define testing, release automation, benchmarking, and operational best practices
- Debug Kubernetes, distributed runtime, networking, and GPU production systems
- Own projects from architecture through deployment, monitoring, and iteration
Benefits
- Equity
- 100% medical, dental, and vision insurance coverage for U.S. employees and dependents
- Flexible PTO
- Company-wide winter break
- Paid parental leave
- Fertility and family-building stipend through Carrot
- Company-facilitated 401(k) for U.S. employees