Lead Data Engineer

Responsibilities

• Collaborate with Agile teams to design, develop, test, and implement technical solutions using data movement tools.
• Act as a lead developer for a team specializing in data movement, distributed computing, and full-stack systems.
• Utilize Python, SQL, and various RDBMS/NoSQL databases to build scalable data pipelines.
• Leverage cloud-based data warehousing services such as Snowflake and Databricks.
• Optimize information systems for end-users and downstream application consumers through sound data design.
• Mentor other members of the engineering community and stay updated on emerging tech trends.
• Perform unit tests and code reviews to ensure high-performance, elegantly coded solutions.

Requirements

• Bachelor's Degree.
• At least 4 years of experience in application development.
• At least 2 years of experience in big data technologies.
• At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud).

Preferred Qualifications

• 7+ years of experience in application development including Python, SQL, Spark, ETL tools, and AWS Glue.
• 4+ years of experience with public cloud platforms and distributed computing tools (Hadoop, Hive, EMR, Kafka, or Spark).
• 4+ years of experience with real-time data, streaming applications, and NoSQL implementation (Mongo, Cassandra).
• 4+ years of experience with data warehousing (Redshift or Snowflake) and data modeling.
• 2+ years of experience with Agile engineering practices.
• 1+ years of experience leveraging AI-assisted coding tools like Claude Code or GitHub Copilot.

Benefits

• Comprehensive and competitive health and financial benefits.
• Performance-based incentive compensation, including potential cash bonuses or long-term incentives.
• Support for total well-being, including mental and physical health resources.

About the Company

Capital One is a technology-driven company focused on solving complex business problems and meeting real customer needs. The Marketing and Messaging team builds scalable platforms that deliver hyper-personalized, omnichannel experiences to help millions of Americans achieve financial empowerment.