Lead Data Engineer at Brillio - ScoutJobs - The AI-curated global job board
Skip to content
Brillio
Posted 2 hours ago

Lead Data Engineer

BrillioLead Data Engineer

Requirements

5+ years in Data Engineering, Agentic AI application development, Multi-Agent Orchestration frameworks, Snowflake Cortex, Snowflake Data Cloud, SQL and query optimization, Python programming, ETL/ELT pipeline development, Data modeling, REST APIs, Git and CI/CD

Skills

SnowflakePythonSQLAIETLCI/CD

About the role

Responsibilities

  • Design, build, and maintain scalable data pipelines and modern data platforms
  • Develop AI-powered data solutions using Agentic AI and Multi-Agent architectures
  • Build and optimize intelligent workflows using Snowflake Cortex capabilities
  • Integrate LLMs with enterprise data while ensuring governance and security
  • Design semantic search, RAG, and AI-assisted analytics solutions
  • Develop and optimize Snowflake data models, stored procedures, and performance tuning
  • Collaborate with Data Scientists, AI Engineers, and stakeholders to deliver AI-enabled data products
  • Ensure data quality, reliability, observability, and security across all platforms
  • Automate deployment using CI/CD pipelines and Infrastructure as Code

Requirements

  • 5+ years of experience in Data Engineering or Data Platform Development
  • Expertise in Agentic AI application development and Multi-Agent Orchestration frameworks
  • Hands-on experience with Snowflake Cortex (Cortex AI, Analyst, Search, and Functions)
  • Proficiency in Snowflake Data Cloud and advanced SQL query optimization
  • Strong Python programming skills
  • Experience with ETL/ELT pipeline development and data modeling
  • Knowledge of REST APIs, system integrations, Git, and CI/CD practices

Preferred Qualifications

  • Experience with LangGraph, CrewAI, AutoGen, or similar multi-agent frameworks
  • Experience with LLMs and Retrieval-Augmented Generation (RAG)
  • Knowledge of vector databases and semantic search
  • Experience with cloud platforms such as Azure, AWS, or GCP
  • Familiarity with orchestration tools like Apache Airflow or dbt
  • Experience with Docker, Kubernetes, or streaming technologies like Kafka

About the Company

Brillio is a fast-growing digital technology service provider and a partner of choice for many Fortune 1000 companies. We help organizations turn disruption into a competitive advantage through innovative digital adoption. Known for our "Brillians," we integrate cutting-edge digital and design thinking skills with a dedication to client satisfaction and groundbreaking technology.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Lead Data Engineer

Brillio · New York

Sign up to apply