Machine Learning Infrastructure Engineer
AbridgeVisit Abridge website
Abridge is an enterprise AI platform that turns clinician-patient conversations into clinical documentation, insights, and workflow outputs for healthcare systems.
Distributed
Funding history
About Abridge
Abridge AI, Inc. provides purpose-built healthcare AI for clinical conversations, including documentation, revenue-cycle, and nursing workflows.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, deploy, and maintain Kubernetes clusters for model training and inference. You will build and optimize model-serving infrastructure, APIs, distributed systems, compute-heavy workflows, and GPU utilization. You will work with research and product teams to scale model deployment, throughput, and compute efficiency.
Requirements
- 5+ years of production machine learning model deployment experience
- Container orchestration
- Distributed systems architecture
- Kubernetes administration
- Custom resource definitions
- Kubernetes operators
- API development
- Batch processing
- Real-time processing
- NVIDIA Triton Server
- vLLM
- TRT-LLM
- PyTorch
- TensorFlow
- GPU cluster management
- CUDA optimization
- Terraform
- Ansible
- GitOps
- Container registry
- ASR
- LLM
Responsibilities
- Design, deploy, and maintain Kubernetes clusters for AI model inference and training
- Develop and maintain low-latency ML model-serving infrastructure
- Scale backend infrastructure for AI-driven products
- Optimize model deployment, throughput, compute efficiency, and GPU utilization
- Build a model API orchestration system
- Define and implement infrastructure-scaling strategies
Benefits
- 14 paid holidays
- Flexible PTO for salaried employees
- Accrued time off for hourly employees
- Medical, dental, and vision coverage for full-time employees and families
- HSA contributions
- Paid parental leave
- Family-forming benefits
- 401(k) matching
- Personal device allowance
- Flexible spending accounts
- Commuter benefits
- Lifestyle wallet contributions
- Mental health therapy and coaching
- Paid sabbatical after 5 years
- Equity grants for full-time employees