
Posted 10 hours ago
Senior Lead Data Engineer
Capital OneSenior Lead Data Engineer
Requirements
Bachelor's Degree, 6+ years application development, 2+ years big data technologies, 1+ year cloud computing
Skills
PythonJavaAWSSnowflakeScalaSQLSparkKafka
About the role
Responsibilities
- Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
- Collaborate with Agile teams to design, develop, test, implement, and support technical solutions
- Utilize programming languages such as Java, Scala, and Python alongside RDBMS, NoSQL, and cloud data warehousing services like Redshift and Snowflake
- Partner with digital product managers to deliver robust cloud-based solutions that drive financial empowerment for customers
- Perform unit tests and conduct code reviews to ensure high-quality, performant, and elegantly coded software
- Mentor members of the engineering community and stay updated on emerging technology trends
Requirements
- Bachelor's Degree
- At least 6 years of experience in application development
- At least 2 years of experience in big data technologies
- At least 1 year of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud)
Preferred Qualifications
- Master's Degree
- 9+ years of experience in application development including Python, SQL, Scala, or Java
- 4+ years of experience with a public cloud provider
- 5+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, etc.)
- 4+ years of experience with real-time data and streaming applications
- 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
- 4+ years of experience with data warehousing (Redshift or Snowflake)
- 4+ years of experience with UNIX/Linux and shell scripting
- 2+ years of experience with Agile engineering practices
- Experience leveraging interactive AI tooling to accelerate productivity
Benefits
- Comprehensive and competitive health and financial benefits
- Performance-based incentive compensation, including cash bonuses and long-term incentives
- Support for total well-being, including mental and physical health resources
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSenior Lead Data Engineer
Capital One · United States
