Software Engineer

Responsibilities

• Collaborate with engineers to design, develop, and test inference solutions for state-of-the-art AI models
• Implement, optimize, and evaluate AI models using Python and other high-performance tools
• Monitor and maintain production model-serving systems
• Work on new features, fix bugs, and contribute to code reviews
• Participate in daily standups, design reviews, and team discussions
• Explore new AI/ML techniques and experiment with improving model performance

Requirements

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field
• Strong fundamentals in data structures, algorithms, and software design
• Proficiency in Python, including experience with AI/ML libraries (e.g., NumPy, pandas, TensorFlow, PyTorch)
• Experience with AI/ML through coursework, research, personal projects, or internships
• Familiarity with AI models, Transformers, and Diffusers
• Experience with version control systems such as Git
• Excellent problem-solving and debugging skills

Preferred Qualifications

• Exposure to C++, CUDA, or AI inference
• Contributions to open-source ML projects

Benefits

• Work on cutting-edge AI model serving powering the next generation of LLMs
• High-impact environment where your work ships directly to customers
• Opportunity to learn from engineers building high-performance inference at scale
• Fast-paced environment with high levels of ownership and autonomy

About the Company

DeepInfra is building the infrastructure to serve top open-source AI models at scale. We provide the high-performance systems required to power the next generation of LLMs and multimodal models.