Software Engineer Intern

Responsibilities

• Collaborate with the engineering team to design, develop, and test inference solutions for top AI models
• Implement and optimize AI models using Python, C++, CUDA, and NCCL
• Monitor and maintain live services to ensure high availability
• Work on feature development, bug fixing, and code reviews to ensure high-quality software delivery
• Participate in daily stand-ups and design discussions to ensure seamless collaboration
• Ship production-ready code and stay up-to-date with industry trends in AI and machine learning

Requirements

• Currently pursuing a Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field
• Strong fundamental knowledge of data structures, algorithms, and software design patterns
• Proficiency in Python and experience with AI/ML libraries (e.g., NumPy, pandas, TensorFlow, PyTorch)
• Familiarity with AI models, including Transformers and Diffusers
• Experience with version control systems such as Git
• Excellent problem-solving skills and the ability to debug and optimize code
• Ability to work onsite in our Palo Alto, CA office 5 days a week

Benefits

• Opportunity to work on cutting-edge AI model serving systems powering next-generation LLMs
• High-impact environment where your work ships directly to customers
• Mentorship from engineers building high-performance inference at scale
• Fast-paced environment offering ownership, autonomy, and end-to-end responsibility
• Monthly compensation ranging from $7,000 - $8,000 USD

About the Company

DeepInfra is building high-performance inference solutions to deploy top open AI models at scale. We focus on creating the systems that power the next generation of LLMs and multimodal models.