Lead Data Engineer

Responsibilities

• Lead the design and development of scalable data pipelines and workflows
• Define and implement best practices for data modeling, orchestration, testing, and monitoring
• Drive improvements in data architecture, warehousing, and transformation layers
• Act as a technical mentor and coach for a team of data engineers
• Uplevel team capabilities in SQL, Python, and system design
• Partner with Product, Engineering, and Data Platform teams to align architecture
• Build and maintain data solutions that integrate human-driven workflows with automated systems
• Develop reporting and monitoring solutions for data quality and pipeline reliability

Requirements

• Bachelor’s degree in Computer Science, Engineering, Statistics, or related field
• 5+ years of experience in data engineering
• Advanced SQL skills and experience with large, complex datasets
• Strong Python experience for data processing and automation
• Proven experience building ETL/ELT pipelines (batch and event-driven)
• Experience with modern data stacks such as Snowflake
• Familiarity with orchestration tools like Airflow
• Experience with BI tools such as Tableau or Power BI
• Exposure to cloud platforms (AWS, Azure, or GCP)
• Authorized to work in the United States without visa sponsorship

Preferred Qualifications

• Experience applying AI/ML or automation techniques to improve operational efficiency
• Experience improving data quality, observability, and governance practices
• Experience working with large-scale proprietary data environments

Benefits

• Comprehensive health, medical wellness, and life insurance
• Paid sabbatical program after four years
• Paid family and paternity leave
• Annual educational stipend and tuition reimbursement
• 401k match and shared ownership employee stock program
• Generous vacation, sick, and volunteer days

About the Company

PitchBook, a Morningstar company, provides top-quality data and insights for the private markets. We foster a collaborative culture of curiosity, innovation, and excellence.