Lead Data Engineer - Data Archival

Responsibilities

• Develop, maintain, and create cloud-oriented big data features including ingestion, processing, and cleaning
• Maintain an excellent service level for the platform to ensure stability and avoid issues
• Research new methods for obtaining valuable data and improving overall data quality
• Create and enhance data solutions and architectures using various programming languages and tools to meet business requirements
• Collaborate with the DDS and Data Foundation teams to advance the data approach across all entities and subsidiaries
• Communicate within the tech league group to identify and implement new technical approaches

Requirements

• 3-5 years of experience in big data engineering
• Proficiency in computer programming with Spark, Scala, Java, and Python
• Strong knowledge of operating systems, specifically Unix and Linux
• Extensive experience with databases and SQL
• Proven expertise in ETL processes and data warehousing
• Hands-on experience with Hadoop and Apache Spark

About the Company

Photon is a global leader in digital transformation, helping businesses scale through innovative data-as-a-service solutions and advanced data platform management.