
Posted 3 days ago
Data Engineer
OpenAIData Engineer
Requirements
3+ years data engineering experience, 8+ years software engineering experience, Proficiency in Python, Scala, or Java, Experience with Hadoop, Flink, or HDFS/S3, Expertise with Airflow, Dagster, or Prefect, Solid understanding of Spark
Skills
PythonSparkAirflowScalaJavaHadoop
About the role
Responsibilities
- Design, build, and manage data pipelines to ensure seamless integration of user event data into the data warehouse
- Develop canonical datasets to track key product metrics including user growth, engagement, and revenue
- Collaborate with Infrastructure, Data Science, Product, Marketing, Finance, and Research teams to provide data solutions
- Implement robust, fault-tolerant systems for data ingestion and processing
- Participate in data architecture and engineering decisions
- Ensure data security, integrity, and compliance according to industry and company standards
Requirements
- 3+ years of experience as a data engineer and 8+ years of software engineering experience
- Proficiency in Python, Scala, or Java
- Experience with distributed processing technologies and frameworks such as Hadoop, Flink, and distributed storage (HDFS, S3)
- Expertise with ETL schedulers like Airflow, Dagster, or Prefect
- Solid understanding of Spark, including the ability to write, debug, and optimize Spark code
Benefits
- Competitive salary ($230K – $385K) and equity offers
- Medical, dental, and vision insurance for you and your family
- 401(k) retirement plan with employer match
- Paid parental leave and flexible PTO
- Daily meals in the office and meal delivery credits
- Annual learning and development stipend
- Relocation support for eligible employees
About the Company
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of AI capabilities and seek to safely deploy them to the world through our products.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer
OpenAI · San Francisco
