Senior Data Engineer

Responsibilities

• Design and build scalable ETL/ELT data pipelines using Databricks (Apache Spark, Delta Lake, Delta Live Tables) for batch and streaming ingestion.
• Manage data architecture by integrating Databricks with specialized OLAP engines like ClickHouse or Druid.
• Design, develop, test, and orchestrate complex data workflows to streamline pipelines.
• Optimize performance and reliability by fine-tuning Spark jobs, ClickHouse schemas, and Druid data partitioning.
• Develop internal tools to automate data processes and business workflows.
• Collaborate with product, MLOps, and data science teams to ensure an optimal data experience for ML practitioners.

Requirements

• 3-5+ years of professional experience in data engineering.
• Strong expertise in Python and data frameworks such as Pandas and PySpark.
• Experience with modern data storage solutions including Data Lakes (Delta tables) and data warehouses.
• Proficiency with data orchestration tools like Dagster or Airflow.
• Experience with streaming technologies such as Kafka or Spark structured streaming.
• Hands-on experience with cloud platforms (AWS S3, EC2).
• Practical experience with OLAP databases (ClickHouse and/or Apache Druid) for real-time analytics.
• Based in Barcelona or willing to relocate to Barcelona.

Preferred Qualifications

• Experience working with the Databricks platform.
• Experience building ML data platforms.

About the Company

Appodeal is a dynamic US-based product company and a leader in the mobile app monetization space. We thrive on diversity, collaboration, and innovation, helping mobile app businesses grow through cutting-edge products. We operate globally with offices in Warsaw, Barcelona, and Parkland (FL).