Data Engineer

Responsibilities

• Own external data pipelines, including scrapers for bestseller rankings, price benchmarking, and demand signals via APIs.
• Build the Deal Quality Score pipeline to compute product competitiveness scores for real-time lookup in Redis.
• Maintain structured data stores for seasonal and festive trend overlays.
• Design and own the in-store event schema in ClickHouse to power behavioral cohorts.
• Build ETL infrastructure using AWS S3 and Glue for long-horizon market data.
• Own data quality and freshness SLAs, ensuring monitoring and alerting for all critical signals.

Requirements

• 3–5 years of data engineering experience, ideally in a startup or product-focused environment.
• Strong Python skills with experience writing clean, production-grade pipeline code.
• Proven experience building and maintaining web scrapers or large-scale data collection pipelines.
• Hands-on experience with workflow orchestrators such as Airflow or Prefect.
• Solid SQL skills and experience with OLAP databases like ClickHouse.
• Familiarity with Redis for serving layers, including key design and cache invalidation.
• Proficiency with AWS services including S3, Glue, and ECS.

Preferred Qualifications

• Experience with e-commerce or marketplace data, such as price intelligence and product taxonomies.
• Familiarity with data patterns used in recommender systems.
• Experience with Spark or other distributed processing frameworks for large datasets.
• Prior experience working on gaming or consumer mobile products.

About the Company

RemoteStar is building a sophisticated recommendation engine designed to surface the right products to players at the perfect moment within an in-game store. We leverage external market signals and real-time data to drive engagement and value in the gaming ecosystem.