Senior Software Engineer Training Inference C++
SpaceXAI builds frontier AI models and products including the Grok conversational assistant and a multimodal developer API.
Funding history
About SpaceXAI
SpaceXAI is a US-based AI company focused on accelerating scientific discovery and understanding the universe through reasoning, voice, image, video, and generative AI systems. Formerly xAI, it was acquired by SpaceX effective February 2, 2026, while continuing to operate the x.ai site and services.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design and optimize large-scale model-serving systems from distributed infrastructure through GPU-level inference optimizations. You will improve latency and throughput, operate reliable high-concurrency services, benchmark inference engines, develop full-stack diagnostic tools, build CI/CD infrastructure, and accelerate research on scaling compute and model-hardware co-design.
Requirements
- Bachelor’s degree in computer science, computer engineering, or a science discipline
- 5+ years of low-level system programming experience in C/C++ or Rust
- Experience with large-scale high-concurrency production serving
- Experience with GPU inference engines
- Knowledge of batching, caching, load balancing, and parallelism
- Experience with GPU kernels, code generation, quantization, speculative decoding, distillation, and low-precision numerics
- Experience testing, benchmarking, and ensuring reliability of inference services
- Experience designing and implementing CI/CD infrastructure for inference
Responsibilities
- Architect and implement distributed infrastructure for model serving
- Optimize inference latency and throughput under production workloads
- Build and operate high-concurrency serving systems with reliable tail latency
- Benchmark, fine-tune, and accelerate inference engines
- Develop tools to trace, replay, and fix full-stack issues
- Create CI/CD infrastructure for endpoint deployment, image publishing, and inference engine updates
- Accelerate research on test-time compute, RL rollout, and model-hardware co-design
Benefits
- Equity
- Medical coverage
- Vision coverage
- Dental coverage
- 401(k) retirement plan
- Short-term disability insurance
- Long-term disability insurance
- Life insurance
- Discounts and perks