Senior LLM Inference Performance and Evaluation Engineer
Bitdeer is a NASDAQ-listed (BTDR) high-performance computing and Bitcoin mining company headquartered in Singapore. It provides end-to-end Bitcoin mining solutions (mining hardware like SEALMINER, Minerbase containers, cloud mining, hosting, and mining farm/data center operations) as well as AI Cloud services offering GPU compute (NVIDIA GB200 NVL72, B200, H200, H100) for AI training and deployment. Its customers range from individual and institutional Bitcoin miners to enterprises and developers needing scalable AI/ML compute infrastructure.
Funding history
Investors
About Bitdeer
Bitdeer Technologies Group is a NASDAQ-listed (ticker: BTDR) technology company headquartered in Singapore that describes itself as a "world-leading" high-performance computing platform and Bitcoin mining services provider. The company is vertically integrated across the value chain, spanning IC design and hardware manufacturing (its own SEALMINER ASIC miners and Minerbase mobile cooling containers), infrastructure construction and cloud mining, and artificial intelligence/high-performance computing. Bitdeer handles the full range of mining-related processes for its customers, including equipment procurement, transport logistics, datacenter design and construction, equipment management, and daily operations, and offers institutional services, a hash rate market, and a miner rights trading marketplace via its mobile apps (Bitdeer App and Minerplus App). Since 2013 Bitdeer has built more than 30 data centers globally and currently operates 9 large-scale data centers (including one of North America's largest) with roughly 3GW of diversified energy capacity and tens of exahashes of managed hash rate, with major operations in the United States, Bhutan, Norway, Canada, Malaysia, and Ethiopia. Since 2023 it has also been expanding a global AI infrastructure business (Bitdeer AI Cloud), powered by thousands of NVIDIA GPUs (including GB200 NVL72 and B200, with GB300 NVL72 and B300 planned), offering turnkey AI datacenter solutions and GPU cloud compute for AI training and deployment starting at around $2/hour. Bitdeer serves both individual/retail Bitcoin miners and institutional clients, as well as AI developers and enterprises seeking scalable, energy-efficient compute.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You build benchmark pipelines for LLM inference performance, create model launch gates, maintain representative workloads, compare model and runtime options, automate regression detection, and collaborate with runtime engineers and SRE to identify bottlenecks and define service objectives and alert thresholds.
Requirements
- 5+ years of experience in ML infrastructure, performance engineering, model evaluation, QA automation, or backend testing for production systems
- Experience with TTFT, TPOT/ITL, request latency, token throughput, concurrency, and GPU-utilization metrics
- Strong Python skills
- Go experience preferred
- Familiarity with OpenAI and Anthropic APIs, vLLM, Dynamo, SGLang, Triton-style servers, and Kubernetes test environments
- Ability to design statistically meaningful tests and communicate tradeoffs
- Experience building dashboards, reports, and release gates
Responsibilities
- Build benchmark pipelines for latency, throughput, concurrency, error rate, and GPU utilization
- Create model launch gates for API compatibility, streaming, tool calling, reasoning, multimodal behavior, and long-context cases
- Maintain synthetic, replayed, and customer-like workloads
- Compare model, runtime, and provider options and recommend routing, fallback, pricing, and capacity decisions
- Automate regression detection in CI/CD and staging
- Identify bottlenecks and verify performance improvements
- Convert benchmark results into SLOs and alert thresholds
- Build dashboards, reports, and release gates