Member of Technical Staff Model Serving API Backend Engineer
1 hour agoSalary: 180K - 300KSan Francisco (United States)OnsiteFull TimeBackendJobs by Black Forest Labs
Black Forest LabsVisit Black Forest Labs website
Frontier AI research lab building the FLUX family of multimodal visual-intelligence models and delivering them through an API, playground, and open weights.
Freiburg im Breisgau, Germany
Funding history
About Black Forest Labs
Black Forest Labs develops generative AI models for image, video, audio, and action prediction, alongside production API and enterprise deployment offerings.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will turn research checkpoints into dependable production inference services. You will design high-performance APIs, optimize GPU latency and throughput, operate scalable serving systems, strengthen observability and reliability, and rapidly ship demos that expose new model capabilities.
Requirements
- Experience building and operating systems at meaningful scale
- Experience scaling APIs or ML systems under load
- Strong judgment on performance, reliability, and cost tradeoffs
- Ownership from system design through debugging and deployment
- Experience building ML inference services in production
- Experience designing scalable API architectures with asynchronous processing
- Experience optimizing GPU workloads
- Experience managing distributed systems and task queues
- Experience implementing monitoring and observability for production ML systems
Responsibilities
- Turn research checkpoints into production-ready inference services
- Design and maintain high-performance APIs
- Optimize inference latency and throughput across GPU infrastructure
- Build scalable serving architectures for unpredictable traffic
- Improve reliability, monitoring, and observability
- Prototype and ship demos for new capabilities
- Collaborate with researchers to rapidly launch live endpoints
Benefits
- Equity
- Coverage of reasonable travel costs for required in-person time