Research Engineer ML Infrastructure
CognitionVisit Cognition website
Cognition is an applied AI company that operates Devin, an autonomous software-engineering agent.
San Francisco, United States
Funding history
About Cognition
Cognition builds AI agents and models for software engineering. Its flagship product, Devin, can plan, write, test, and ship code in a customer’s existing codebase and tools.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will build and operate distributed training infrastructure, experiment tools, agent rollout systems, and data pipelines. You will improve GPU training performance, implement parallelism strategies, diagnose failures across the stack, and create reliable systems that accelerate research workflows at large scale.
Requirements
- Experience building and operating distributed training systems for large models
- Knowledge of distributed systems, networking, storage, and hardware-software performance
- Proficiency in Python and C++
- Experience with PyTorch or an equivalent deep learning framework at the systems level
- Experience with GPU performance profiling, memory optimization, and compute efficiency
- Experience implementing or optimizing large-model parallelism strategies
- Experience building tooling that accelerates research workflows
- Machine learning knowledge sufficient to engage with training architecture and infrastructure needs
Responsibilities
- Build and operate systems for large-scale distributed training jobs
- Build infrastructure for concurrent coding-agent rollouts in VM sandboxes
- Profile and improve training throughput, memory use, communication, and compute efficiency
- Design and maintain experiment launch, tracking, and analysis tooling
- Build reliable high-throughput training and evaluation data pipelines
- Diagnose and resolve failures across GPUs, networking, numerics, and data
- Implement and optimize data, tensor, pipeline, and sequence parallelism
- Anticipate and build infrastructure required for future research