Software Engineer
DeepInfraVisit DeepInfra website
AI inference cloud offering OpenAI-compatible APIs for machine-learning models, private deployments, and GPU infrastructure.
Series BRecently funded
Palo Alto, United States
Funding history
About DeepInfra
DeepInfra provides hosted AI inference for language, vision, embedding, image, video, and speech models, alongside private model deployments and dedicated GPU clusters.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, develop, test, optimize, and evaluate inference solutions for AI models. You will help monitor and maintain production model-serving systems, implement new features, fix bugs, participate in code reviews and design discussions, and explore techniques to improve model performance.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field, completed or in the final year
- Strong fundamentals in data structures, algorithms, and software design
- Proficiency in Python and experience with AI/ML libraries and frameworks
- Experience with AI/ML through coursework, research, personal projects, employment, or internships
- Familiarity with AI models, Transformers, and Diffusers
- Experience with version control systems such as Git and agile development methodologies
- Problem-solving, debugging, and code optimization skills
- Communication and collaboration skills
Responsibilities
- Collaborate to design, develop, and test inference solutions for AI models
- Implement, optimize, and evaluate AI models using Python, C++, CUDA, and NCCL
- Monitor and maintain production model-serving systems
- Develop new features, fix bugs, and contribute to code reviews
- Participate in daily standups, design reviews, and team discussions
- Explore AI and machine-learning techniques and tools to improve model performance
Benefits
- Stock options
- 25 days of paid annual leave
- Up to 3 well-being days per year
- Private health insurance
- Company lunch every working day
- Team gatherings, conferences, and business trips across Europe and Silicon Valley
