
Posted a day ago
Data Engineer 4
ComcastData Engineer 4
Requirements
8-12 years experience, 5+ years hands-on SQL, 5+ years ETL and Data pipelines, Experience with GCP BigQuery, Experience with CI/CD, Experience with Scala and Spark, Experience with CDP, Bachelor's Degree preferred
Skills
DatabricksSQLETLGCPBigQueryScalaSparkAirflowKubernetes
About the role
Responsibilities
- Design, develop, and optimize scalable data pipelines to ingest, process, and transform data from various sources.
- Implement ETL/ELT workflows using modern orchestration tools such as Airflow and Spark Jobs.
- Create ingestion frameworks for structured and unstructured data, implementing quality checks and reporting mechanisms.
- Ensure data quality, security, and integrity across all stages of data processing and storage.
- Implement data solutions on platforms including Kubernetes, Teradata, and Databricks.
- Mentor junior data engineers to foster skill development and knowledge sharing within the team.
- Collaborate with product, engineering, and analytics teams to deliver strategic data solutions.
Requirements
- 8 to 12 years of professional experience in data engineering.
- 5+ years of hands-on experience with SQL, ETL, and building data pipelines.
- Extensive experience with GCP (BigQuery, DAG) and CI/CD processes.
- Proficiency with Scala and Spark.
- Experience working with Customer Data Platforms (CDP).
Preferred Qualifications
- Bachelor's Degree in a relevant field.
- Experience with modern orchestration tools and cloud-native data architectures.
About the Company
Comcast brings together the best in media and technology, driving innovation to create world-class entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative businesses and provide career opportunities across a wide range of disciplines.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer 4
Comcast · Chennai
