Senior Network Production Engineer, Operations
3 days agoSeniorSalary: 230000 - 280000 USD / yearSan Francisco, CA - USOnsiteFull TimeDevopsJobs by Crusoe, Inc.
Crusoe, Inc.Visit Crusoe, Inc. website
Crusoe is an active AI-infrastructure company operating an AI cloud platform, managed AI services, and AI data-center infrastructure.
Denver, United States
Projects
About Crusoe, Inc.
Crusoe designs, builds, and operates energy-first AI infrastructure. Its offerings include Crusoe Cloud for GPU-based training, fine-tuning, inference, and managed services, alongside AI-optimized data centers and energy infrastructure.
Skills
Candidate Availability
About the Role
You will support uptime across edge, backbone, data center and GPU cluster networks. You will write Python tooling to reduce toil, respond to high-severity incidents, perform root cause analyses, build observability automation, maintain runbooks and SOPs, and help build SLI/SLO dashboards with Architecture and SRE teams.
Requirements
- 5+ years of production network engineering experience in operations, incident response and reliability
- Strong Python and scripting proficiency
- Hands-on experience with observability tools such as streaming telemetry, SNMP, NetFlow/sFlow, Grafana, Prometheus and ThousandEyes
- Experience operating RDMA/RoCE lossless fabrics including PFC, ECN and DCQCN tuning
- Knowledge of BGP, EVPN-VXLAN, IS-IS, OSPF, MPLS, QoS and TCP/IP
- Proficiency with Arista (EOS) and Juniper (Junos) in leaf-spine CLOS architectures
- Comfort operating large device fleets multi-region with on-call responsibility
- Bachelor's degree in Computer Science, Electrical Engineering or related field, or equivalent experience
Responsibilities
- Support uptime across global edge, backbone, data center and GPU cluster network
- Write and maintain Python tooling to reduce toil and automate remediation
- Participate in high-severity network incidents and contribute to postmortems
- Perform root cause analyses and drive remediation to closure
- Build automation on the monitoring stack including streaming telemetry, SNMP, NetFlow, Kentik, Grafana, Prometheus and ThousandEyes
- Maintain and improve runbooks, escalation playbooks and SOPs
- Build and maintain automated dashboards and alerting for SLIs/SLOs
- Collaborate with Architecture and SRE teams
Benefits
- Restricted Stock Units
- Paid time off & paid holidays
- Comprehensive health, dental & vision insurance
- Employer contributions to HSA account
- Paid parental leave
- Paid life insurance, short-term and long-term disability
- Professional development & tuition reimbursement
- Mental health & wellness support
- Commuter benefits (parking & transit)
- Cell phone stipend
- 401(k) with company match up to 4% of salary
- Volunteer time off
