Software Engineer Early Career
DeepInfraVisit DeepInfra website
AI inference cloud providing OpenAI-compatible APIs, private deployments, and GPU infrastructure for production AI workloads.
Palo Alto, United States
Funding history
About DeepInfra
DeepInfra operates an AI inference cloud for running LLMs, vision, embeddings, image/video generation, speech, and other machine-learning models at scale, including private GPU deployments and GPU rental.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, develop, and test inference solutions for AI models with experienced engineers. You will implement, optimize, and evaluate models; monitor production model-serving systems; develop features; fix bugs; review code; and explore AI/ML techniques to improve model performance.
Requirements
- Hold or be in the final year of a Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field
- Have 0–2 years of experience, including internships
- Demonstrate knowledge of data structures, algorithms, and software design
- Demonstrate proficiency in Python and AI/ML libraries or frameworks
- Demonstrate AI/ML experience through coursework, research, projects, employment, or internships
- Demonstrate familiarity with AI models, Transformers, Diffusers, Git, and agile development methodologies
- Demonstrate debugging, optimization, communication, and collaboration skills
- Work from the Palo Alto office five days per week
Responsibilities
- Collaborate with engineers to design, develop, and test inference solutions
- Implement, optimize, and evaluate AI models using Python, C++, CUDA, and NCCL
- Monitor and maintain production model-serving systems
- Develop features, fix bugs, and contribute to code reviews
- Participate in stand-ups, design reviews, and team discussions
- Explore AI/ML techniques and tools to improve model performance