A
Posted 20 hours ago
Spark/Scala Developer
Algotale - IntelliatechSpark/Scala Developer
Requirements
7-12 years experience, Scala expertise, Spark expertise, Hadoop/Hive/Impala, Advanced SQL, Unix, CI/CD tools
Skills
SparkScalaHadoop
About the role
Responsibilities
- Lead a squad of engineers to build data pipelines supporting data science and analytics use cases
- Develop, test, and implement code into production environments
- Participate in the solution design phase and analyze requirements
- Lead a team of 3-5 data engineers with minimal supervision
- Integrate with wider IT and business project teams to implement data transformation projects in Hadoop
Requirements
- 7-12 years of experience in Big Data/Hadoop environments
- Mandatory expertise in Scala and Spark
- Strong experience with Hadoop, Hive, Impala, HDFS, and SQOOP
- Proficiency in Advanced SQL and Relational Databases
- Experience with CI/CD tools including Git, Jenkins, and Nexus
- Familiarity with Agile methodologies using Jira and Confluence
- Proficiency in Unix operating systems
Preferred Qualifications
- Experience with PySpark
- Experience working on Data Analytics projects
- Exposure to Tableau and SAS
- Good understanding of Unix and HDFS commands
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSpark/Scala Developer
Algotale - Intelliatech · Chennai