Senior Data Platform Engineer

About the Company

G2 is the world's largest and most trusted software marketplace. Having joined forces with Capterra, SoftwareAdvice, and GetApp, G2 provides the largest source of online data and software insights to fuel intelligent buying in the age of AI.

Responsibilities

• Design, develop, and maintain storage, processing, orchestration, cataloging, and governance components of a scalable data platform
• Build tools, libraries, and services that enable teams to manage pipelines and workflows independently
• Provide self-service infrastructure including templates, SDKs, CI/CD patterns, and DBT macros
• Implement orchestration frameworks, data catalogs, access control layers, and metadata systems
• Collaborate with stakeholders to define SLAs, monitoring, and observability
• Champion infrastructure as code, automation, and standardization
• Ensure data security, compliance, and cost efficiency
• Mentor and guide other data platform associates through code reviews and best practices

Requirements

• 6+ years of experience in Data or Infrastructure Engineering
• 3+ years focused on building self-service platforms
• Proficiency in Python and SQL
• Deep understanding of AWS cloud data resources (S3, EKS, Glue, Athena, etc.)
• Expertise in building and supporting solutions on Snowflake
• Experience with orchestration frameworks like Airflow or Prefect
• Experience with distributed systems and data processing frameworks such as Apache Spark
• Proficiency with CI/CD, Terraform (IaC), and GitOps practices
• Familiarity with Kubernetes, Docker, and container-based deployment
• Knowledge of security and governance including RBAC, masking, SSO, and secrets management

Preferred Qualifications

• Experience in MLOps (Data Science productionisation)
• Active contributions to open-source data projects
• Experience implementing Apache Iceberg
• Experience with streaming architectures (Kafka, Kinesis, or Flink)
• Exposure to observability tools like Datadog or Splunk