
Posted 16 hours ago
Lead Data Engineer
International Motors, LLCLead Data Engineer
Requirements
Bachelor's degree with 2+ years experience, Master's degree with 1+ years experience, 5+ years experience, SQL, Python, PySpark, Azure Data Factory, Databricks
Skills
DatabricksAzurePythonSQLPySparkSnowflake
About the role
Responsibilities
- Transform raw, complex data into governed high-performance pipelines using Databricks
- Build and rigorously test data products to support analytics, operational reporting, and real-time decision-making
- Build scalable pipelines integrating data from legacy and modern platforms including DB2, Teradata, Hadoop, and Snowflake
- Lead the design and delivery of Azure-based data engineering solutions using ADF, ADLS, and Databricks
- Define, enforce, and educate the team on data engineering standards
- Build RESTful APIs, event-driven pipelines, and integrate third-party services
- Support CI/CD deployments, auditing, and troubleshooting across environments
Requirements
- Bachelor's degree with 2+ years of data engineering, data quality, or analytics experience
- OR Master's degree with 1+ years of data engineering, data quality, or analytics experience
- OR 5+ years of data engineering, data quality, or analytics experience
- Proficiency in SQL, Python, and PySpark
- Experience with Azure Data Factory and Databricks
- Legal authorization to work in the United States without sponsorship
Preferred Qualifications
- 5+ years of experience in data engineering, statistics, or related fields
- Strong knowledge of cloud-based platforms such as AWS Glue or Databricks
- Deep understanding of medallion architecture, data governance, and distributed systems
- Experience with clean code practices, scalable systems, and rigorous testing
- Collaborative mindset with experience coaching junior teammates
Benefits
- Competitive market-based compensation
- Comprehensive benefits package designed to support employee wellbeing
About the Company
International Motors, LLC is a leader in the transportation industry, creating solutions that deliver greater uptime and productivity for commercial vehicles. As part of the TRATON GROUP, we are transforming from a supplier of trucks and buses to a provider of complete and sustainable transport solutions, aiming to accelerate the impact of sustainable mobility globally.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeLead Data Engineer
International Motors, LLC · Lisle
