Senior Lead AI Engineer, Gen AI Platform

Responsibilities

• Partner with cross-functional teams of engineers, research scientists, and product managers to deliver AI-powered products.
• Design, develop, test, and deploy AI software components including foundation model training, LLM inference, similarity search, and guardrails.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch.
• Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus 6 years of experience, OR a Master's degree in a related field plus 4 years of experience.
• 6+ years of programming experience in Python, Go, Scala, or Java.
• Proven experience developing AI and ML algorithms or technologies.
• Experience working with cloud platforms.

Preferred Qualifications

• 7+ years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, etc.).
• Experience designing and supporting complex AI systems including LLM Inference, Similarity Search, VectorDBs, and Guardrails.
• Demonstrated ability to lead and mentor engineering teams and influence cross-functional stakeholders.
• Experience optimizing training and inference software to improve hardware utilization and cost.
• Strong communication skills with the ability to articulate complex AI concepts to technical and non-technical peers.

Benefits

• Comprehensive, competitive, and inclusive health and financial benefits.
• Performance-based incentive compensation, including potential cash bonuses or long-term incentives.
• Support for total well-being, including mental and physical health resources.

About the Company

Capital One is an industry leader in using machine learning to create real-time, personalized customer experiences. We are committed to building world-class applied science and engineering teams to deliver industry-leading capabilities through scalable, high-performance AI infrastructure.