Senior Data Engineer

Responsibilities

• Design, develop, and implement efficient and scalable ETL/ELT pipelines using Apache NiFi, Airflow, and Airbyte
• Perform efficient data processing via Pyspark and Apache Flink
• Build and maintain data warehouses using ClickHouse, StarRocks, and Apache Doris
• Deploy, configure, and optimize distributed query engines like Trino, Drill, and Dremio
• Develop and maintain dashboards and visualizations using Superset, Grafana, Metabase, and Redash
• Manage data infrastructure on AWS Ubuntu including EC2, S3, VPC, IAM, and CloudWatch
• Implement data quality checks and monitoring to ensure accuracy and reliability
• Mentor junior data engineers and maintain comprehensive documentation

Requirements

• 4-6 years of experience in data engineering roles
• Strong proficiency in Python and libraries like Pandas, NumPy, and Dask
• Expertise in SQL and database technologies
• Extensive experience with AWS Ubuntu infrastructure (EC2, S3, VPC, IAM, CloudWatch)
• Hands-on experience with at least one tool in each category: Data Warehousing, Data Processing, Distributed Query Engines, ETL/Orchestration, and Business Intelligence
• Strong understanding of data modelling and pipeline design principles

Preferred Qualifications

• AWS certifications (e.g., AWS Certified Data Analytics - Specialty)
• Experience with containerization (Docker) and orchestration (Kubernetes)
• Experience with cloud-native data platforms
• Contributions to open-source projects
• Bachelor's or Master's degree in Computer Science or Engineering

About the Company

SarvaGram leads India's fintech revolution, focusing on rural households. Our mission is to empower rural communities via credit-led household-centric solutions blending high-tech innovation with a personal touch.