Lead Data Engineer

Responsibilities

• Collaborate with Agile teams to design, develop, test, and implement technical solutions using full-stack development tools.
• Work alongside developers experienced in machine learning, distributed microservices, and full-stack systems.
• Utilize programming languages such as Java, Scala, and Python, along with RDBMS, NoSQL databases, and cloud data warehousing services like Redshift and Snowflake.
• Mentor other members of the engineering community and stay updated on emerging technology trends.
• Partner with digital product managers to deliver robust, cloud-based solutions that drive customer financial empowerment.
• Perform unit testing and code reviews to ensure high-quality, performant, and elegantly coded software.

Requirements

• Bachelor’s Degree.
• At least 4 years of experience in application development.
• At least 2 years of experience in big data technologies.
• At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud).

Preferred Qualifications

• 7+ years of experience in application development including Python, SQL, Scala, or Java.
• 4+ years of experience with a public cloud provider.
• 4+ years of experience with distributed data/computing tools (e.g., MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL).
• 4+ years of experience working on real-time data and streaming applications.
• 4+ years of experience with NoSQL implementations (e.g., MongoDB, Cassandra).
• 4+ years of experience with data warehousing (Redshift or Snowflake).
• 4+ years of experience with UNIX/Linux and shell scripting.
• 2+ years of experience with Agile engineering practices.
• Experience leveraging interactive AI tooling to accelerate productivity.

Benefits

• Comprehensive and competitive health and financial benefits.
• Support for total well-being, including mental and physical health options.
• Performance-based incentive compensation, which may include cash bonuses or long-term incentives.

About the Company

Capital One is a technology-driven company dedicated to solving real problems and meeting customer needs through innovation. The Transaction Core team within the Payments Intelligence organization builds foundational data platforms that provide real-time, intelligent insights into customer spend to enrich financial lives.