
Posted 15 hours ago
Principal Data Engineer
Autodesk
Requirements
10+ years data engineering experience, Python, Spark, PySpark, advanced SQL, LLM ecosystems, embeddings, vector databases, RAG and agent frameworks, Streaming technologies (Kafka, Flink), Modern data platforms (Snowflake, Redshift, Iceberg), AWS services (EMR, Glue, S3, Lambda)
Skills
PythonSparkSQLAWSKafkaLLMDBT
About the role
Responsibilities
- Architect and implement large-scale batch and streaming pipelines for product telemetry to support LLMs and agentic workflows
- Optimize data access for retrieval, including embeddings, vector search, and contextual data access
- Partner with AI/ML teams to operationalize feature engineering, feature stores, and RAG-based systems
- Ensure high data quality and observability for AI-driven decision systems
- Guide build vs. buy decisions for data tooling and platforms
- Collaborate across Product, Engineering, Data Science, and Design to translate product questions into measurable data signals
- Drive alignment on data standards, governance, and engineering best practices
Requirements
- 10+ years of experience in data engineering, data platform engineering, or distributed systems
- Strong hands-on expertise with Python, Spark, PySpark, and advanced SQL
- Proven experience with LLM ecosystems, embeddings, vector databases, and RAG frameworks
- Experience with streaming technologies such as Kafka, Flink, or Spark Streaming
- Proficiency with modern data platforms including Snowflake, Redshift, Iceberg, or Athena
- Hands-on experience with AWS services (EMR, Glue, S3, Lambda, Step Functions)
- Demonstrated ability to lead cross-functional technical initiatives and mentor engineers
Preferred Qualifications
- Experience with product telemetry, clickstream data, and behavioral analytics
- Experience with orchestration and transformation tools like Airflow, dbt, or Fivetran
- Track record of supporting LLM, RAG, or agentic AI workflows in production environments
- Experience modernizing data infrastructure in complex or fragmented environments
About the Company
Autodesk helps customers design and make anything, from the greenest buildings to the smartest factories. We empower innovators to turn their ideas into reality, transforming how things are made and what can be made.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freePrincipal Data Engineer
Autodesk · Toronto
