Senior Data Engineer

About the Company

Metropolis is pioneering the Recognition Economy, creating artificial intelligence to make the real world responsive. They are building an ecosystem of technologies at the intersection of parking, mobility, and real estate to transform mundane repetition into seamless experiences.

Responsibilities

• Collaborate with cross-functional teams to develop end-to-end data pipelines and foundational data sets
• Design and own data architecture for large-scale projects while managing operational trade-offs
• Build and optimize sophisticated data pipelines, models, and visualizations across multiple domains
• Define and manage Service Level Agreements (SLAs) for all owned data sets
• Implement data security models, ensure privacy compliance, and evolve data governance processes
• Solve complex integration challenges using optimal ETL/ELT patterns for structured and unstructured data
• Maintain production processes by optimizing complex code using advanced algorithmic concepts
• Mentor team members through actionable feedback to foster collective skill growth

Requirements

• Bachelor's degree in Computer Science, Computer Engineering, or a relevant technical field
• 5+ years of experience in data engineering, database engineering, or data warehousing
• 5+ years of experience with Python and building scalable Big Data solutions
• Proficiency in SQL, ETL/ELT, and data modeling
• Extensive experience in Snowflake and dbt
• Hands-on experience with RDBMS such as MySQL and Postgres
• Familiarity with Airflow, Automic, and CI/CD pipelines
• Experience with cloud computing services, preferably AWS (Glue, MWAA, DMS, EKS, SNS)
• Deep understanding of the modern IaC ecosystem

Preferred Qualifications

• Experience with Spark and PySpark
• Master's degree in Computer Science or a relevant technical field