Senior Data Engineer

Responsibilities

• Develop and maintain batch and real-time data pipelines on AWS
• Implement ETL/ELT solutions using AWS Glue, Spark on EMR, and other AWS services
• Assist in workflow orchestration using Apache Airflow (MWAA)
• Support serverless data processing using AWS Lambda
• Participate in designing data warehousing solutions using Amazon Redshift
• Design and manage data storage strategies with Amazon S3 and DynamoDB
• Apply data governance and access controls using AWS DataZone
• Monitor and troubleshoot data platform issues using Amazon CloudWatch
• Collaborate with Analytics, BI, Data Science, and Business teams
• Write clean, efficient code and perform peer code reviews

Requirements

• 5–7 years of experience in Data Engineering or related roles
• 3+ years of hands-on experience designing data solutions on AWS
• Proficiency with AWS Glue, Amazon EMR (Spark), AWS Lambda, Apache Airflow (MWAA), Amazon Redshift, Amazon DynamoDB, and Amazon S3
• Strong programming skills in Python
• Advanced SQL skills with performance tuning expertise
• Understanding of data warehousing and data modeling (Star/Snowflake)
• Familiarity with Agile/Scrum delivery environments

Preferred Qualifications

• AWS Professional Certification (Solutions Architect or Data Analytics Specialty)
• Experience with real-time streaming technologies such as Kinesis or Kafka
• Exposure to data governance and metadata management tools
• Knowledge of cost optimization strategies within AWS

About the Company

NorthBay Solutions is a fast-growing AWS Premier Consulting Partner focused on guiding organizations through their digital transformation journeys. Our globally distributed team of over 350 AWS-certified professionals specializes in cloud migration, application modernization, and data analytics for high-profile clients in financial services, healthcare, retail, and more.