AI Infrastructure Platform Research and Development Engineer for Fault Management
Active AI foundation-model company offering multimodal models, consumer AI products, and an enterprise/developer API platform.
Funding history
About MiniMax Group Inc.
MiniMax develops proprietary multimodal foundation models spanning language, video, speech, and music, and operates AI-native products including MiniMax Agent, MiniMax Design, MiniMax Audio, Talkie, Hailuo AI, and an Open Platform.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design and operate hardware health management and fault-handling systems for GPU clusters and bare-metal infrastructure. You will build Kubernetes controllers, model fault workflows and states, integrate resource systems, and improve monitoring, testing, release safeguards, incident mitigation, and recovery.
Requirements
- Bachelor's degree or above in computer science or a related field.
- At least 3 years of backend, cloud-native, or distributed-systems development experience.
- Proficiency in Go.
- Practical Kubernetes Controller or Operator development experience.
- Understanding of CRDs, reconciliation loops, concurrent updates, and conflict retries.
- Ability to address reliability issues in event-driven systems.
- Ability to design state machines and asynchronous task systems.
- Familiarity with MySQL, Redis, HTTP, and gRPC.
- Production-system maintenance and incremental modernization experience.
Responsibilities
- Design and operate hardware health management systems.
- Automatically detect, isolate, and remediate abnormal hardware.
- Develop fault discovery and handling pipelines across cluster events, node states, custom resources, and resource-management systems.
- Develop and maintain Kubernetes Operators and Controllers.
- Design fault events, workflow instances, and task state models.
- Implement event deduplication, correlation tracking, retries, timeouts, compensation, and replay.
- Build unified interfaces for Kubernetes-node and bare-metal fault handling.
- Improve system state management and module boundaries while maintaining compatibility.
- Build monitoring, testing, and release safeguards for fault-handling pipelines.
- Participate in production incident diagnosis, mitigation, and recovery.