Posted 4 days ago
Lead Data Engineer
BrillioLead Data Engineer
Requirements
Data engineering and ETL experience, Salesforce platform and data models, Airflow and MuleSoft, SQL with Snowflake, Python for custom ETL, Batch and real-time data pipelines, dbt for data transformation, AWS or GCP, Data modeling and warehousing, Agile delivery
Skills
PythonSQLAWSPySparkSnowflakeAirflowDBTETL
About the role
Responsibilities
- Build and manage complex batch and real-time data pipelines
- Design and implement ETL workflows using Python and SQL
- Develop data transformation and modeling processes using dbt
- Collaborate closely with Product, Data Science, and Analytics teams to meet business needs
- Ensure data quality, monitoring, and efficient pipeline orchestration
- Work within an Agile delivery framework to provide scalable data solutions
Requirements
- Strong experience in data engineering, ETL, and data architecture
- Hands-on experience with Airflow, MuleSoft, and Snowflake
- Proficiency in writing complex Python modules for custom ETL workflows
- Expertise in data modeling, data warehousing, and big data processing
- Experience working with Salesforce platforms and data models
- Proficiency in SQL and experience with AWS or GCP cloud environments
- Understanding of distributed and event-driven architectures
Preferred Qualifications
- Experience with Salesforce Flows and Apex
- Familiarity with Informatica for ETL processes
- Knowledge of Spark (PySpark), AWS Glue, and Lambda
About the Company
Brillio is a digital transformation leader that helps companies build modern products and scale their digital capabilities through expertise in Data & AI, Cloud, and Product Engineering.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeLead Data Engineer
Brillio · Bangalore
