O
Posted 18 hours ago
Data Engineer
OpenPlayData Engineer
Requirements
3-5 years AWS Data platform experience, Proficiency in Python and PySpark, Experience with AWS Redshift and S3, Knowledge of SQL and NoSQL, Experience with Kafka and Kinesis
Skills
PythonAWSSpark
About the role
Responsibilities
- Develop, construct, test, and maintain large-scale processing systems and infrastructure using Hadoop, Spark, and Kafka
- Assemble large, complex data sets using SQL, NoSQL, and cloud-based warehousing like Amazon Redshift or Google BigQuery
- Automate manual processes and optimize data delivery using Python and PySpark
- Build infrastructure for ETL from various sources using SQL and Apache Flink
- Create and design Data Lakes with AWS services including S3, Lambda, Step Functions, Cloud Formation, Kinesis, and Firehose
- Support stakeholders with data-related technical issues using visualization tools like Tableau and Superset
- Create data tools for analytics using machine learning frameworks like TensorFlow, PyTorch, or Scikit-Learn
- Implement segmentations using graph databases such as Neo4j, AWS Neptune, or GraphQL
- Document solutions using Confluence and Jira
- Troubleshoot infrastructure issues using the ELK Stack
Requirements
- 3-5 years of experience building AWS Data platform solutions or related BI experience
- Experience building and optimizing data pipelines using AWS/DBT ETL tools
- Proficiency with Superset, Airbyte, AWS S3, Lambda, Step Functions, and AWS Redshift
- Experience designing data platforms for batch analysis and real-time analytics
- Experience with Python, PySpark, Kinesis, Firehose, and Kafka for real-time streaming
- Knowledge of Data governance frameworks
- Proficiency in MySQL and Python
- Experience in query optimization and data warehousing concepts
Preferred Qualifications
- Experience with Tableau, Hadoop, and AI/ML Data modelling
- Experience with Hive, HBase, and EMR clusters
About the Company
OpenPlay is a leading multi-player skill-based gaming company in the real money gaming space and is part of the Nazara Group. The company provides a culture of empowerment and collective ownership, aiming to be India’s largest vernacular social gaming platform.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer
OpenPlay · Hyderabad
