S
Posted 19 hours ago
Data Engineer
StatusNeoData Engineer (Big Query)
Requirements
7+ years Data Engineering experience, Google BigQuery expertise, GCP ecosystem proficiency, SQL and Python proficiency, ETL/ELT framework experience
Skills
BigQueryPythonSQLGCPETL
About the role
Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for structured and semi-structured data
- Work extensively with Google BigQuery for data modeling, transformation, and performance optimization
- Integrate data from multiple sources including APIs, Cloud Storage, Databases, and Streaming Services
- Collaborate with data analysts, data scientists, and business teams to deliver reliable datasets
- Implement best practices for data governance, security, and quality
- Optimize query performance, partitioning, and clustering in BigQuery
- Support real-time and batch data processing using GCP Dataflow, Pub/Sub, or Airflow
- Troubleshoot issues in data pipelines to ensure high data reliability and availability
Requirements
- 7+ years of experience in Data Engineering or related roles
- Strong hands-on experience with Google BigQuery and GCP ecosystem (Dataflow, Pub/Sub, Cloud Storage, Composer/Airflow)
- Proficiency in SQL and Python for data processing and automation
- Experience with ETL/ELT frameworks, data modeling, and data warehousing concepts
- Understanding of data partitioning, clustering, and performance tuning in BigQuery
- Familiarity with CI/CD pipelines and version control (Git)
- Experience in handling large-scale datasets and optimizing data workflows
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field
Preferred Qualifications
- Experience with other cloud data warehouses such as Snowflake or Redshift
- Exposure to Machine Learning pipelines or data analytics
- Knowledge of Terraform or infrastructure-as-code tools
About the Company
StatusNeo is a digital consultancy that accelerates business transformation by leveraging cloud-native technologies. They specialize in cloud-native technology consulting and solutions, building highly scalable, modular applications on leading cloud platforms.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer
StatusNeo · Mumbai
