Lead Data Engineer

Responsibilities

• Design, develop, and maintain scalable and reliable data pipelines, ETL/ELT frameworks, and data integration solutions.
• Build cloud-native data solutions using AWS services including Glue, Lambda, Redshift, Aurora, OpenSearch, Step Functions, SNS, and S3.
• Develop and optimize data processing workflows using Python, PySpark, SQL, and PL/SQL.
• Design and implement data warehouse solutions, data marts, and data models to support enterprise reporting and analytics.
• Collaborate with business stakeholders, product teams, and data scientists to translate requirements into high-quality technical solutions.
• Ensure data quality, integrity, governance, security, and compliance across the entire data ecosystem.
• Optimize database performance, query execution, and large-scale data processing workloads.
• Mentor junior team members and promote engineering best practices and code quality standards.

Requirements

• 8–10 years of experience in Data Engineering, Data Warehousing, and Cloud Data Platform development.
• Hands-on experience with AWS services: Glue, Lambda, Redshift, Aurora, OpenSearch, Step Functions, SNS, and S3.
• Advanced proficiency in Python and PySpark for large-scale data processing.
• Strong expertise in SQL and PL/SQL development.
• Proven experience building and optimizing ETL/ELT pipelines and data ingestion frameworks.
• Solid understanding of data warehousing concepts, dimensional modeling, and database design.
• Strong understanding of modern data architectures, including Data Lakes and Data Warehouses.

Preferred Qualifications

• Experience supporting Data Science, Machine Learning, AI, or Advanced Analytics initiatives.
• Exposure to modern Data Lakehouse architectures.
• Experience with CI/CD pipelines, DevOps practices, and Infrastructure as Code (IaC).
• Experience working in Agile/Scrum delivery environments.
• AWS Certifications such as AWS Certified Data Engineer or Solutions Architect.

About the Company

Brillio is a digital transformation leader that helps enterprises build modern products and platforms. We specialize in Data & AI, Product Engineering, and Cloud services to help businesses navigate the complexities of the digital age.