Senior Lead Data Engineer

Responsibilities

• Lead a team of developers with deep experience in machine learning, distributed microservices, and full-stack systems
• Collaborate with Agile teams to design, develop, test, and implement technical solutions using full-stack development tools
• Utilize programming languages such as Java, Scala, and Python alongside RDBMS, NoSQL databases, and cloud data warehousing services like Redshift and Snowflake
• Partner with digital product managers to deliver robust cloud-based solutions that drive financial empowerment for customers
• Perform unit tests and conduct rigorous code reviews to ensure performance, elegance, and design quality
• Mentor members of the engineering community and stay at the forefront of emerging technology trends

Requirements

• Bachelor's Degree
• At least 6 years of experience in application development
• At least 2 years of experience in big data technologies
• At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud)

Preferred Qualifications

• Master's Degree
• 9+ years of experience in application development including Python, SQL, Scala, or Java
• 4+ years of experience with a public cloud provider
• 5+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
• 4+ years of experience working on real-time data and streaming applications
• 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
• 4+ years of experience with data warehousing (Redshift or Snowflake)
• 4+ years of experience with UNIX/Linux and shell scripting
• 2+ years of experience with Agile engineering practices
• Experience leveraging interactive AI tooling to accelerate productivity

About the Company

Capital One is a technology-driven financial institution that solves real problems and meets real customer needs through innovation. Our Intelligent Foundations & Experiences (IFX) team drives our real-time intelligent future, delivering broad-reaching technical solutions and state-of-the-art science to help millions of customers succeed.