Senior Data Platform Engineer

Responsibilities

• Design, build, and operate large-scale data processing infrastructure using Spark on Databricks.
• Architect and maintain lakehouse solutions including Delta Lake or Iceberg, focusing on partitioning and compaction.
• Build robust, idempotent ETL/ELT pipelines for both batch and near-real-time workloads.
• Manage the Apache Airflow orchestration layer, including DAG authoring and SLA enforcement.
• Implement and maintain CDC pipelines to ensure low-latency, high-fidelity data propagation.
• Model analytical data stores using dimensional models and aggregation layers optimized for BI and ML.
• Define data platform engineering best practices, including CI/CD, automated testing, and observability.

Requirements

• 5+ years of data engineering experience with 2+ years focused on large-scale big data platforms.
• Hands-on expertise with Apache Spark, including performance tuning and execution plans.
• Deep experience with Databricks (workspace configuration, Unity Catalog, or Delta Live Tables).
• Solid experience with Apache Airflow for workflow orchestration.
• Production experience implementing CDC pipelines (e.g., Debezium, Kafka Connect).
• Strong proficiency in Python and SQL.
• Proven experience designing analytical data models for large datasets.

Preferred Qualifications

• Experience with modern data lake technologies like Delta Lake or Apache Iceberg.
• Experience building streaming pipelines using Spark Structured Streaming or Kafka Streams.
• Proficiency with dbt for data transformations and lineage management.
• Experience with cloud infrastructure (AWS, GCP, or Azure) and Infrastructure-as-Code (Terraform).
• A strong data-as-a-product mindset with an emphasis on SLOs and versioned schemas.

Benefits

• Competitive ESOPs to align your growth with the company's long-term vision.
• Comprehensive health insurance.
• Strong leave policies.
• Significant career growth opportunities within a high-impact startup environment.

About the Company

Aspora is building a borderless financial operating system designed to make money as mobile and transparent as its users. Backed by top-tier investors like Sequoia Capital and Y Combinator, we are a global team working to redefine what global banking can be through extreme ownership and customer obsession.