Senior Data Engineer

Responsibilities

• Design, implement, operate and improve the analytics platform
• Design data solutions using various big data technologies and low latency architectures
• Collaborate with data scientists, business analysts, product managers, and software engineers to develop and validate data solutions
• Maintain the data warehouse with timely and quality data
• Build and maintain data pipelines from internal databases and SaaS applications
• Improve, manage, and teach standards for code maintainability and performance
• Mentor and provide guidance to junior engineers

Requirements

• Expert at writing and optimising SQL queries
• Proficiency in Python, Java or similar languages
• Familiarity with data warehousing concepts
• Experience in Airflow or other workflow orchestrators
• Familiarity with basic principles of distributed computing
• Experience with big data technologies like Spark or Delta Lake
• Proven ability to innovate and lead delivery of complex solutions
• Excellent verbal and written communication skills

Preferred Qualifications

• Authoritative in ETL optimisation and tuning big data processes using Spark
• Knowledge of big data architecture concepts like Lambda or Kappa
• Experience with streaming workflows for low latency processing
• Experience managing data quality, lineage, and discovery
• Sound knowledge of distributed systems and MPP optimization
• Familiarity with AWS

About the Company

MoneyLion is a fintech company that relies on data to guide long-term strategies and day-to-day operations, disrupting the traditional finance industry through innovative initiatives.