Senior Data Engineer

About the Company

Metropolis is pioneering the Recognition Economy, creating artificial intelligence to make the real world responsive. From transforming parking into a seamless experience to expanding intelligence across retail and hospitality, they are building a world that feels instinctive and magical.

Responsibilities

• Collaborate with cross-functional teams to develop end-to-end data pipelines and foundational data sets
• Design and own data architecture for large-scale projects while managing operational trade-offs
• Build and optimize sophisticated data pipelines, models, and visualizations across multiple domains
• Define and manage Service Level Agreements (SLAs) for all owned data sets
• Implement data security models, ensure privacy compliance, and evolve data governance processes
• Solve complex integration challenges using optimal ETL/ELT patterns for structured and unstructured data
• Maintain production processes by optimizing complex code using advanced algorithmic concepts
• Streamline data artifact development by optimizing pipelines, dashboards, and frameworks
• Mentor team members through actionable feedback to foster collective skill growth

Requirements

• Bachelor's degree in Computer Science, Computer Engineering, or a relevant technical field
• 5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools
• 5+ years of experience with Python and building scalable Big Data solutions
• Proficiency in SQL, ETL/ELT, and data modeling
• Extensive experience in Snowflake and dbt
• Hands-on experience with RDBMS such as MySQL and Postgres
• Familiarity with integration tools like Airflow and Automic
• Working knowledge of CI/CD pipelines and the modern IaC ecosystem
• Experience with cloud computing services, preferably AWS (Glue, MWAA, DMS, EKS, SNS)
• Experience leveraging AI tools to transform workflows

Preferred Qualifications

• Experience with Spark and PySpark
• Master's degree in Computer Science or a relevant technical field