Senior DataOps Engineer

Responsibilities

• Contribute to the design, implementation, automation, and maintenance of enterprise-scale cloud data platforms using Databricks and AWS
• Lead the design and operational management of enterprise-scale ETL/ELT pipelines
• Build and maintain scalable batch and streaming data pipelines using PySpark, Spark SQL, and Delta Lake
• Configure and optimize Databricks clusters for performance and cost efficiency
• Design and build data models and implement BI dashboards for visualization
• Design, train, and deploy ML models to extract actionable insights
• Implement monitoring solutions and collaborate with security teams for compliance

Requirements

• Bachelor's degree in computer science, IT, or related field
• 7+ years of hands-on experience as a DataOps Engineer in manufacturing or automotive environments
• Experience with streaming and event-based architecture
• Experience implementing data lakehouse solutions using Databricks
• Proficiency in Python and SQL
• Experience with Infrastructure as Code (Terraform)
• Experience with AWS data services (Glue, Kinesis, Firehose)
• Knowledge of cloud platforms (AWS and Azure) and various database types (RDS, DynamoDB, Mongo, etc.)
• Proven ability to develop and deploy scalable ML models

About the Company

Scout Motors is an iconic American brand revitalizing the electric pick-up truck and rugged SUV marketplace through innovation, electrification, and digitization.