Data Engineer at OpenAI - ScoutJobs - The AI-curated global job board
Skip to content
OpenAI
Posted 3 days ago

Data Engineer

OpenAIData Engineer

Requirements

3+ years data engineering experience, 8+ years software engineering experience, Proficiency in Python, Scala, or Java, Experience with Hadoop, Flink, or HDFS/S3, Expertise with Airflow, Dagster, or Prefect, Solid understanding of Spark

Skills

PythonSparkAirflowScalaJavaHadoop

About the role

Responsibilities

  • Design, build, and manage data pipelines to ensure seamless integration of user event data into the data warehouse
  • Develop canonical datasets to track key product metrics including user growth, engagement, and revenue
  • Collaborate with Infrastructure, Data Science, Product, Marketing, Finance, and Research teams to provide data solutions
  • Implement robust, fault-tolerant systems for data ingestion and processing
  • Participate in data architecture and engineering decisions
  • Ensure data security, integrity, and compliance according to industry and company standards

Requirements

  • 3+ years of experience as a data engineer and 8+ years of software engineering experience
  • Proficiency in Python, Scala, or Java
  • Experience with distributed processing technologies and frameworks such as Hadoop, Flink, and distributed storage (HDFS, S3)
  • Expertise with ETL schedulers like Airflow, Dagster, or Prefect
  • Solid understanding of Spark, including the ability to write, debug, and optimize Spark code

Benefits

  • Competitive salary ($230K – $385K) and equity offers
  • Medical, dental, and vision insurance for you and your family
  • 401(k) retirement plan with employer match
  • Paid parental leave and flexible PTO
  • Daily meals in the office and meal delivery credits
  • Annual learning and development stipend
  • Relocation support for eligible employees

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of AI capabilities and seek to safely deploy them to the world through our products.

ScoutJobs Agent

Get matches like this delivered daily

Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.

Get started — it's free

Data Engineer

OpenAI · San Francisco

Sign up to apply