
Posted 21 days ago
Principal Data Engineer
AutodeskPrincipal Data Engineer
Requirements
10+ years in data engineering, 3+ years in technical leadership, Expertise in SQL and Python, Cloud platforms (AWS, Azure), Data warehousing (Snowflake), Batch and streaming frameworks, ETL/ELT paradigms
Skills
PythonSQLAWSAzureSnowflakeSparkKafkaAirflow
About the role
Responsibilities
- Lead the end-to-end design and implementation of scalable, enterprise-grade data architectures and pipelines (batch and real-time)
- Define and drive the data engineering strategy and roadmap aligned with the enterprise data platform vision
- Architect solutions leveraging AWS, Azure, Snowflake, and modern data stack tools
- Build and maintain high-performance, resilient, and cost-optimized data pipelines using Spark, Kafka, or Kinesis
- Develop robust ETL/ELT pipelines and workflows using tools like Airflow and Fivetran
- Establish best practices for CI/CD, testing, deployment, data quality, and observability
- Partner with cross-functional stakeholders in Data Science, AI/ML, Product, and Finance to translate business requirements into scalable solutions
- Lead and mentor a team of data engineers, fostering engineering excellence and innovation
Requirements
- 10+ years of experience in data engineering or distributed data systems
- 3+ years in a technical leadership or principal-level role
- Proven experience designing and delivering large-scale, enterprise-grade data platforms
- Strong expertise in SQL and Python, including data modeling and architecture design
- Hands-on experience with Cloud platforms (AWS, Azure) and Data warehousing (Snowflake or equivalent)
- Experience with batch and streaming frameworks such as Spark, Kafka, Hadoop, or Kinesis
- Deep understanding of ETL/ELT paradigms and the modern data stack
- Experience with orchestration and ingestion tools like Airflow and Fivetran
- Strong communication, stakeholder management, and leadership skills
Preferred Qualifications
- Experience with Data Lakehouse architectures and Data Mesh principles
- Exposure to AI/ML pipelines and production ML systems
- Experience with multi-cloud or hybrid cloud strategies
- Background in FinOps or cost optimization of data platforms
- Strong foundation in distributed systems, algorithms, and scalability
- Experience mentoring senior engineers or leading distributed teams
About the Company
Autodesk helps innovators turn their ideas into reality, transforming not only how things are made, but what can be made. From the greenest buildings to the smartest factories, our software powers the creation of amazing things every day.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freePrincipal Data Engineer
Autodesk · Bengaluru
