ETL Engineer

Responsibilities

• Design, develop, and maintain robust ETL pipelines to ingest data from multiple sources including databases, APIs, and Snowflake
• Build and optimize scalable data warehouse solutions using Snowflake
• Develop data transformation and processing workflows using Python and SQL
• Work with large-scale distributed data processing frameworks like Spark and PySpark
• Implement real-time and batch data processing pipelines
• Ensure data quality through validation, testing, and monitoring frameworks
• Troubleshoot and resolve data pipeline and performance issues in production environments
• Collaborate with business stakeholders to understand requirements and deliver data solutions

Requirements

• 10+ years of experience in ETL and Data Engineering
• Strong hands-on experience with Python and SQL
• Expertise in Snowflake, including data warehousing, streams, tasks, and optimization
• Experience with ETL tools such as Talend or Informatica
• Hands-on experience with Apache Spark or PySpark
• Solid understanding of data warehousing concepts like EDW, Data Marts, and OLAP/ROLAP
• Experience working with cloud platforms, preferably AWS
• Strong debugging, performance tuning, and troubleshooting skills

Preferred Qualifications

• Experience with Kafka or real-time data streaming tools
• Exposure to CI/CD pipelines using Jenkins, Git, or Groovy
• Knowledge of Infrastructure as Code tools like Terraform or CloudFormation
• Basic exposure to Java, REST APIs, or Spring Boot

Benefits

• Medical, vision, and dental benefits
• 401k retirement plan
• Variable pay and incentives
• Paid time off and paid holidays

About the Company

Photon is a global leader in digital transformation, helping enterprises modernize their data platforms and scale their digital capabilities through advanced engineering and cloud solutions.