Lead Data Engineer

Responsibilities

• Collaborate with Agile teams to design, develop, test, and implement technical solutions using full-stack development tools.
• Work alongside developers experienced in machine learning, distributed microservices, and full-stack systems.
• Utilize programming languages such as Java, Scala, and Python, along with RDBMS, NoSQL databases, and cloud data warehousing services like Redshift and Snowflake.
• Partner with digital product managers to deliver robust cloud-based solutions for hyper-personalized marketing and messaging experiences.
• Perform unit testing and code reviews to ensure high-quality, performant, and elegantly coded software.
• Mentor other members of the engineering community and stay updated on emerging technology trends.

Requirements

• Bachelor’s Degree.
• At least 4 years of experience in application development.
• At least 2 years of experience in big data technologies.
• At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud).

Preferred Qualifications

• 7+ years of experience in application development including Python, SQL, Scala, or Java.
• 4+ years of experience with public cloud platforms (AWS, Azure, or GCP).
• 4+ years of experience with distributed data/computing tools (e.g., Spark, Kafka, Hadoop, or EMR).
• 4+ years of experience with NoSQL implementations (e.g., MongoDB, Cassandra) and data warehousing (Redshift or Snowflake).
• 4+ years of experience working on real-time data and streaming applications.
• 4+ years of experience with UNIX/Linux and shell scripting.
• 2+ years of experience with Agile engineering practices.
• Experience leveraging AI-assisted coding tools like GitHub Copilot or Claude Code.

Benefits

• Comprehensive and competitive health and financial benefits.
• Support for total well-being, including mental and physical health resources.
• Performance-based incentive compensation, which may include cash bonuses or long-term incentives.

About the Company

Capital One is a technology-driven company focused on solving real problems and meeting customer needs through innovation. The Enterprise Platforms Technology team plays an essential role in establishing technical practices and delivering scalable capabilities across the organization.