Software Engineer Infrastructure
Manifold Labs describes itself as a decentralized frontier AI lab, focused on building for the long-term with a strong in-person culture in Austin, TX. Targon provides a secure AI developer cloud to train and run advanced AI models on its GPU cloud. It emphasizes data confidentiality through Nvidia Confidential Computing and high-speed performance via a permissionless network of Nvidia H200 GPUs.
Funding
About Manifold Labs (Targon)
Manifold Labs is a decentralized frontier AI lab. Their core values include sacrifice, impact, persistence, commitment to being in-person in Austin, TX, longevity, thinking big, integrity, respect, adaptability, and humility. They are developing products such as Targon, Sybil, and Tao.xyz. Targon is a secure AI developer cloud for training and running frontier AI models. It provides a private and secure environment using hardware-backed protection with Nvidia Confidential Computing. The platform boasts ultra-fast inference speeds powered by InfiniBand and RoCE networking for multi-GPU performance. Users can run demanding workloads on a permissionless network of over 1,000 Nvidia H200 GPUs.
Skills
About the Role
You will develop and maintain the API layers and backend services powering the Targon ecosystem. You will build and scale systems that orchestrate confidential workloads across a distributed GPU network including TVM and TargonOS attestation and scheduling paths. You will benchmark existing and new services to identify bottlenecks and ship measurable improvements. You will design and operate resilient observable infrastructure that maintains enterprise grade latency and throughput. You will create new services and applications from scratch to expand the Targon platform.
Requirements
- Proficiency with Golang for backend development.
- Experience with Kubernetes in production.
- Familiarity with Python for scripting and tooling.
- Strong Unix/Linux background.
- Experience with distributed systems, networking, or high throughput service design.
- Exposure to confidential computing TEEs or secure infrastructure.
- Ownership mindset with ability to drive ambiguous problems to a shipped well tested solution.
Responsibilities
- Develop APIs and backend services powering the Targon ecosystem.
- Build and scale systems that orchestrate confidential workloads across a distributed GPU network, including TVM and TargonOS attestation and scheduling paths.
- Benchmark existing and new services to identify bottlenecks and ship measurable performance and reliability improvements.
- Design and operate resilient observable infrastructure that maintains enterprise grade latency and throughput guarantees.
- Create new services and applications from scratch to expand the Targon platform.
Benefits
- Competitive compensation structure
- 401K Matching
- Unlimited PTO
- Fully covered Health Dental and Vision Insurance
- Access to 24/7 Employee Assistance Program EAP
- Opportunity to work on cutting edge projects in a fast paced startup environment