Member of Technical Staff - Pre-Training Evals Infra (Inference)
Reflection is an AI research lab building open frontier models and a full AI stack for developers, enterprises, and public-sector users.
Funding history
About Reflection
Reflection develops open-weight AI models, open-source software for customizing and running agents, AI-factory infrastructure, and related solutions. Its current research emphasizes large language models, reinforcement learning, and agentic reasoning.
Skills
About the Role
You will own inference performance and correctness for pre-training evaluations, bridging the training framework and inference framework. Your work spans model implementations, GPU execution, distributed serving and inference worker lifecycle. You will work with researchers and engineers to implement research efficiently, establish validation, profile and optimize inference, and improve autoscaling and fleet efficiency.
Requirements
- Track record of improving performance or reliability in complex distributed systems and inference infrastructure
- Understanding of CPU execution, GPU architecture, memory hierarchy, and interconnects
- Understanding of inference including prefill and decode, batching, attention, KV-cache management, and distributed model execution
- Measurement-driven approach to optimization
- Rigor in correctness and validation design
- Ability to take ownership of ambiguous technical problems and communicate findings clearly
Responsibilities
- Establish parity between training and inference frameworks by defining numerical acceptance criteria based on activations, logits, and downstream evaluation results
- Optimize inference by profiling CPU and GPU execution, memory use, communication, and scheduling
- Validate that changes improve throughput or cost while preserving correctness
- Improve autoscaling and fleet efficiency by identifying signals for demand and serving capacity
- Work with researchers and engineers to carry improvements into regular use
Benefits
- Stock options
- Comprehensive medical, dental, vision, and life insurance
- Annual wellness allowance
- Lunch and dinner provided in the office daily
- 22 weeks paid parental leave
- Unlimited paid time off in the U.S. and 30 days in the U.K.
- Visa sponsorship support
- Regular off-sites, happy hours, and team celebrations
