Lead AI Engineer

Responsibilities

• Partner with cross-functional teams of engineers, research scientists, and product managers to deliver AI-powered products.
• Design, develop, test, and deploy AI software components including foundation model training, LLM inference, similarity search, and guardrails.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch.
• Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One.

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus 4 years of experience, OR a Master's degree in a related field plus 2 years of experience.
• At least 4 years of experience programming with Python, Go, Scala, or Java.
• Proven experience developing AI and ML algorithms or technologies.

Preferred Qualifications

• 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, or Azure).
• Experience designing, developing, and supporting AI services.
• Expertise in LLM Inference, Similarity Search, VectorDBs, Guardrails, or Memory.
• Experience optimizing training and inference software to improve hardware utilization and cost.
• Ability to stay abreast of the latest AI research and apply novel techniques in a production environment.

Benefits

• Comprehensive, competitive, and inclusive health and financial benefits.
• Support for total well-being, including mental and physical health options.
• Opportunities for professional growth and career advancement.

About the Company

Capital One is an industry leader in using machine learning to create real-time, personalized customer experiences. We are committed to building world-class applied science and engineering teams to deliver breakthrough product experiences and scalable, high-performance AI infrastructure.