Data Engineer

About the Company

Altimate AI is revolutionizing enterprise data operations through AI-driven solutions like DataPilot and DataMates. Founded in San Francisco, the company provides contextually aware AI agents that integrate into existing workflows to automate data documentation, performance optimization, and more.

Responsibilities

• Build highly performant large-scale data infrastructure capable of handling PB-scale data and 100K+ jobs per day
• Design and implement robust, scalable cloud-native data infrastructure on AWS
• Develop an intelligent SQL ecosystem encompassing query optimization, dynamic pipeline generation, and data lineage tracking
• Leverage SQL query profiling, AST analysis, and parsing to create engines for query performance and adaptive pipelines

Requirements

• 2-4 years of experience in data engineering
• Strong proficiency in Python and SQL
• Extensive experience with SQL query profiling, optimization, and performance tuning (preferably Snowflake)
• Deep understanding of SQL Abstract Syntax Tree (AST) and experience with SQL parsers like sqlglot
• Experience building data pipelines using Airflow or dbt

Preferred Qualifications

• Solid understanding of cloud platforms, particularly AWS
• Familiarity with Kubernetes (K8s) for containerized deployments