Software Engineer Model Routing and Inference
Anysphere, Inc. (doing business as Cursor)Visit Anysphere, Inc. (doing business as Cursor) website
Cursor is an AI coding-agent product operated by Anysphere, Inc.; it was acquired by SpaceX in August 2026 and continues to operate.
Distributed
Funding history
About Anysphere, Inc. (doing business as Cursor)
Cursor provides AI-assisted software-development tools, including desktop and CLI coding agents, autonomous cloud agents, code review, and enterprise offerings.
Skills
About the Role
You will build the inference platform that supports AI interactions in the product. You will evolve an inference gateway across provider APIs, design cross-provider failover, and develop routing backpressure and admission controls to prevent traffic spikes from affecting providers.
Requirements
- Experience building high-throughput low-latency distributed systems
- Experience with inference serving traffic routing or real-time data pipelines
- Ability to assess cost and performance tradeoffs at scale
- Software engineering fundamentals
- Experience shipping production systems that handle millions of requests
- Judgment regarding reliability cost latency and user experience
Responsibilities
- Build and evolve the inference gateway
- Design cross-provider failover
- Design routing backpressure and admission control
Hiring Process
2–3 short technical interviews, followed by an onsite office session with a small project, idea discussion, and team meetings.
