Lead Data Engineer

Responsibilities

• Collaborate with Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools.
• Work alongside developers experienced in machine learning, distributed microservices, and full-stack systems.
• Utilize programming languages such as Java, Scala, and Python, along with RDBMS, NoSQL databases, and cloud data warehousing services like Redshift and Snowflake.
• Mentor members of the engineering community and stay updated on emerging technology trends.
• Partner with digital product managers to deliver robust cloud-based solutions that drive financial empowerment for customers.
• Perform unit testing and code reviews to ensure high-quality, performant, and elegantly coded software.

Requirements

• Bachelor’s Degree.
• At least 4 years of experience in application development (internship experience does not apply).
• At least 2 years of experience in big data technologies.
• At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud).

Preferred Qualifications

• 7+ years of experience in application development including Python, SQL, Scala, or Java.
• 4+ years of experience with a public cloud provider (AWS, Azure, or GCP).
• 4+ years of experience with distributed data/computing tools such as MapReduce, Hadoop, Hive, EMR, Kafka, or Spark.
• 4+ years of experience working on real-time data and streaming applications.
• 4+ years of experience with NoSQL implementations like MongoDB or Cassandra.
• 4+ years of experience with data warehousing tools like Redshift or Snowflake.
• 4+ years of experience with UNIX/Linux, including shell scripting.
• 2+ years of experience with Agile engineering practices.

Benefits

• Comprehensive and competitive health and financial benefits.
• Support for total well-being, including mental and physical health options.
• Performance-based incentive compensation, which may include cash bonuses or long-term incentives.

About the Company

Capital One is a technology-driven financial institution that seeks to solve real problems and meet customer needs through innovation. Our Enterprise Platforms Technology (EPTech) team plays an essential role in establishing best practices for building technology solutions across the entire company.