Lead Data Engineer

Responsibilities

• Collaborate with Agile teams to design, develop, test, and implement technical solutions using full-stack development tools.
• Work alongside developers experienced in machine learning, distributed microservices, and full-stack systems.
• Utilize programming languages such as Java, Scala, and Python, along with RDBMS, NoSQL databases, and cloud data warehousing services like Redshift and Snowflake.
• Partner with digital product managers to deliver robust cloud-based solutions that drive customer experiences.
• Perform unit testing and code reviews to ensure code is rigorously designed, elegantly coded, and optimized for performance.
• Mentor other members of the engineering community and stay updated on emerging technology trends.

Requirements

• Bachelor's Degree.
• At least 4 years of experience in application development.
• At least 2 years of experience in big data technologies.
• At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud).

Preferred Qualifications

• Master's Degree.
• 7+ years of experience in application development including Python, SQL, Scala, or Java.
• 4+ years of experience with a public cloud provider.
• 4+ years of experience with distributed data/computing tools (e.g., Spark, Kafka, Hadoop, or EMR).
• 4+ years of experience with NoSQL implementation (e.g., MongoDB, Cassandra).
• 4+ years of experience with data warehousing (Redshift or Snowflake).
• 4+ years of experience with real-time data and streaming applications.
• Experience leveraging AI-assisted coding tools like GitHub Copilot or Claude Code.

About the Company

Capital One is a technology-driven company dedicated to using data and emerging technologies to solve complex business problems and meet real customer needs. Our Enterprise Platforms Technology team plays an essential role in establishing best practices for building technology solutions across the entire organization.