Software Engineer - Infrastructure
52 minutes agoSalary: 165K - 330KSan Francisco; Montreal; New York; Remote; Seattle; TorontoHybridFull TimeDevopsJobs by Baseten
BasetenVisit Baseten website
Baseten is an AI inference platform for deploying, optimizing, and scaling custom, open-source, and fine-tuned models in production.
San Francisco, United States
Funding history
About Baseten
Baseten provides model runtimes, inference infrastructure, developer workflows, and deployment options including managed cloud, self-hosted, and hybrid environments.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will develop ML inference infrastructure in Python and Go, maintain Kubernetes deployments, and contribute to model-deployment orchestration. You will enhance monitoring, resource management, automation, reliability, and performance for machine learning workloads.
Requirements
- Computer science
- Programming
- Scripting
- Go
- Kubernetes
- Containerization
- Machine learning
- Model serving
- Distributed system
- Monitoring
- Logging
- Infrastructure
Responsibilities
- Develop ML inference infrastructure using Python and Go
- Implement and maintain Kubernetes deployments for model serving
- Contribute to the inference orchestration layer
- Build and enhance model performance monitoring systems
- Implement resource management solutions for ML workloads
- Support infrastructure automation for ML deployments
- Balance performance optimization with system reliability
- Participate in infrastructure improvement discussions
- Apply infrastructure best practices
Benefits
- Equity
- Medical insurance for employees and dependents in the U.S.
- Dental insurance for employees and dependents in the U.S.
- Vision insurance for employees and dependents in the U.S.
- Flexible PTO
- Company-wide Winter Break
- Paid parental leave
- Fertility and family-building stipend through Carrot
- Company-facilitated 401(k) in the U.S.