Senior Data Engineer

Responsibilities

• Design, build, and maintain end-to-end data solutions on Microsoft Fabric and Databricks
• Implement scalable ETL/ELT pipelines using Fabric Pipelines and PySpark
• Develop robust data models and semantic models for Power BI and enterprise BI
• Optimize Lakehouse and Data Warehouse performance through partitioning and compute tuning
• Design and prepare feature-ready datasets for AI and GenAI applications
• Collaborate with data scientists to productionize AI pipelines
• Implement data governance, security, and monitoring best practices
• Mentor junior engineers and participate in architecture reviews

Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or Data Science
• 7+ years of professional experience in data engineering
• Mandatory hands-on expertise with Microsoft Fabric, Databricks, or Snowflake
• Advanced proficiency in PySpark and SQL
• Experience with Lakehouse, Data Warehouse, and Semantic Models
• Understanding of GenAI architectures, vectorization, and embedding pipelines
• Proficiency in Power BI and Tableau
• Experience designing large-scale data pipelines in Azure environments

About the Company

Orion Innovation is a premier, award-winning, global business and technology services firm delivering business transformation and product development rooted in digital strategy, experience design, and engineering.