Senior Distributed ML Engineer
LawZeroVisit LawZero website
Montréal-based nonprofit AI-safety research organization developing safe-by-design advanced AI, centered on its Scientist AI approach.
Recently fundedCompany intelligence
Montréal, Québec, Canada
Funding history
About LawZero
LawZero develops technical solutions and research for highly capable, non-agentic, safe-by-design AI systems. Its Scientist AI research aims to provide transparent, evidence-based prediction and potential oversight/guardrails for agentic AI.
Skills
About the Role
You will work with researchers to accelerate distributed model training and inference. You will investigate performance bottlenecks, optimize computing resources, develop orchestration tools and libraries, and establish documented best practices for large-scale machine-learning workflows.
Requirements
- Degree in a relevant computer science field
- 3 or more years designing and implementing distributed ML training frameworks
- Experience with Megatron, DeepSpeed, HuggingFace Accelerate, FSDP, vLLM, or verl
- Experience with cloud platforms such as AWS, GCP, or Azure
- Experience with Ray or Slurm
- Experience with PyTorch Profiler, PyProf, or NVIDIA Nsight
- Familiarity with gRPC, Docker, or Kubernetes
- Familiarity with vector databases
- Track record contributing to deep-learning research projects
Responsibilities
- Collaborate with researchers on large-scale model training and inference
- Investigate performance bottlenecks and debug research experiment code
- Optimize computing-resource utilization
- Develop tools and libraries for distributed research experiments
- Establish, document, and maintain distributed ML development practices
Benefits
- Comprehensive health benefits including mental health and wellness management account
- 20 vacation days per year from the start date
- 4% employer retirement savings contribution with no employee match
