Q
Posted 18 hours ago
Data Engineer
Quation Solution
Requirements
5+ years Data Engineering experience, Proficiency in Python and PySpark, Strong SQL and relational/NoSQL database knowledge, Experience with AWS (Glue, S3, Lambda), Knowledge of data modeling (star/snowflake, data vault), Degree in Computer Science or Engineering
Skills
PythonPySparkAWSSQLSpark
About the role
About the Company
Quation is a data analytics consultancy dedicated to empowering brands to unlock the true potential of their data. We translate complex data landscapes into clear, actionable insights that inform strategic decision-making across organizations using cutting-edge technology.
Responsibilities
- Implement data engineering solutions using Big Data technologies in cloud and on-prem environments
- Manage and optimize Spark clusters and other Spark implementations
- Perform data transformation using Python scripts
- Execute data read/write to Medallion Architecture using PySpark scripts
- Conduct data cuts and variance analysis
- Manage databases including AWS S3 (Landing, Bronze, Silver, Gold) and Postgres
Requirements
- 5+ years of experience in Data Engineering
- Experience in manufacturing, logistics, or transportation industry sectors
- Bachelor's or master's degree in Computer Science, Engineering, or a related field
- Proficiency in Python and PySpark with object-based structures
- Strong SQL skills and experience with relational (PostgreSQL, MySQL, Oracle) and NoSQL (MongoDB, Cassandra, DynamoDB) databases
- Hands-on experience with AWS services including Glue, S3, and Lambda
- Knowledge of data modeling techniques (star/snowflake, data vault) and semantic modeling
- Familiarity with BI tools such as Power BI or Oracle Analytics Cloud
- Strong understanding of the AWS ecosystem and distributed computing principles
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer
Quation Solution · Bangalore
