
Posted 21 days ago
Principal Data Engineer
AutodeskPrincipal Data Engineer
Requirements
10+ years data engineering experience, 3+ years technical leadership, Expertise in SQL and Python, Cloud platforms (AWS, Azure), Data warehousing (Snowflake), Batch and streaming frameworks, ETL/ELT paradigms
Skills
PythonSQLAWSSnowflakeSparkKafkaAirflow
About the role
Responsibilities
- Lead the end-to-end design and implementation of scalable, enterprise-grade data architectures and pipelines for both batch and real-time processing
- Define and drive the data engineering strategy and roadmap in alignment with the enterprise data platform vision
- Architect robust solutions leveraging AWS, Azure, Snowflake, and modern data stack tools
- Build and maintain high-performance, resilient, and cost-optimized data pipelines using frameworks like Spark, Kafka, or Kinesis
- Establish best practices for CI/CD, testing, data quality, observability, and automated monitoring
- Partner with cross-functional stakeholders in Data Science, AI/ML, Product, and Finance to translate business requirements into scalable data products
- Mentor a team of data engineers to foster engineering excellence and innovation
Requirements
- 10+ years of experience in data engineering or distributed data systems
- 3+ years in a technical leadership or principal-level role
- Proven track record of designing and delivering large-scale, enterprise-grade data platforms
- Strong expertise in SQL, Python, data modeling, and architecture design
- Hands-on experience with cloud platforms (AWS, Azure) and data warehousing (Snowflake or equivalent)
- Experience with batch and streaming frameworks such as Spark, Kafka, Hadoop, or Kinesis
- Deep understanding of ETL/ELT paradigms and orchestration tools like Airflow or Fivetran
- Strong communication, stakeholder management, and leadership skills
Preferred Qualifications
- Experience with Data Lakehouse architectures and Data Mesh principles
- Exposure to AI/ML pipelines and production ML systems
- Experience with multi-cloud or hybrid cloud strategies
- Background in FinOps or the cost optimization of large-scale data platforms
- Strong foundation in distributed systems, algorithms, and scalability
About the Company
Autodesk helps innovators turn their ideas into reality, transforming not only how things are made, but what can be made. From the greenest buildings to the smartest factories, our software empowers creators to design a better world.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freePrincipal Data Engineer
Autodesk · Bengaluru
