
Posted a day ago
Senior Data Engineer
ConverseSenior Data Engineer
Requirements
6-8 years software development experience, Databricks, Snowflake & SQL, Python or Java, Hive, Spark, EMR, Data modelling and ETL development, Data streaming, DevOps responsibilities, Automated testing (E2E), Scrum and Agile principles, Bachelor's degree in Computer Science or Engineering
Skills
DatabricksSnowflakeSQLPythonJavaSparkETL
About the role
Responsibilities
- Build, test, and maintain scalable data pipelines and distributed systems
- Design and implement large datasets and complex pipelines using Python, Java, Databricks, Hive, and Spark
- Work closely with Product Managers and Engineers to translate requirements into quality software
- Perform technical code reviews to ensure best practices and high code quality
- Develop databases to ensure efficient data storage and retrieval
- Write unit and integration tests to maintain high standards using frameworks like Jest or Mocha
- Identify and resolve performance bottlenecks to ensure high availability and responsiveness
- Participate in Agile processes, including sprint planning, daily stand-ups, and retrospectives
Requirements
- 6-8 years of software development experience in data engineering
- Proficiency with Databricks, Snowflake, and SQL
- Strong experience in Python or Java, Hive, Spark, and EMR
- Demonstrated expertise in data modelling, ETL development, and data streaming
- Experience with DevOps responsibilities, including deploying and supporting software in production
- Experience developing automated end-to-end (E2E) tests
- Solid understanding of Scrum and Agile principles
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field
Preferred Qualifications
- Curiosity regarding the use of AI/ML to accelerate engineering workflows
- Ability to drive complex work to completion with minimal oversight
- Strong communication skills to effectively connect with both business and technical stakeholders
About the Company
Converse is a worldwide advocate for self-expression. We are a place where passionate individuals come together to create the future of sport, bringing innovation and inspiration to every athlete in the world. We celebrate unique and creative people, providing a culture where you have the freedom to create and grow professionally.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSenior Data Engineer
Converse · Karnataka
