B
Posted a day ago
Senior/Staff Data Engineer
BiohubSenior/Staff Data Engineer
Perks & benefits
CommissionRelocation AllowancePaid LeaveHealth InsuranceFamily Medical Insurance
Requirements
8+ years experience in petabyte-scale data systems, Distributed computing (Databricks, Spark, or Ray), Infrastructure as Code (Terraform or CDK), Cloud infrastructure (AWS preferred), Strong software engineering fundamentals
Skills
DatabricksSparkRayTerraformAWSPython
About the role
About the Company
Biohub is a 501(c)(3) biomedical research organization building the first large-scale scientific initiative combining frontier AI with frontier biology to solve disease. We build the technology to help scientists around the world use AI-powered biology to study how cells operate, organize, and work as part of systems to understand why disease happens and how to correct it.
Responsibilities
- Design and build data pipelines that process genomic and imaging data at petabyte scale
- Solve performance and bandwidth challenges with creative engineering
- Build agent-based systems for automated dataset curation, quality control, and workflow generation
- Create tooling for data cataloging and registration that makes datasets discoverable and accessible
- Collaborate with AI Research teams to translate model requirements into data specifications
- Improve pipeline reliability and observability
Requirements
- 8+ years experience building reliable, operable data systems at petabyte scale
- Strong software engineering fundamentals
- Experience deploying distributed computing frameworks like Databricks, Spark, or Ray
- Experience building and deploying large scale data platform solutions using infrastructure as code like Terraform or CDK
- Experience with cloud infrastructure (AWS preferred) and on prem infrastructure
- Comfort with ambiguity
- Interest in AI-native development practices and tooling
Preferred Qualifications
- Background in computational biology, bioinformatics, or life sciences
- Experience with genomics datasets and formats (FASTQ, BAM, VCF)
- Experience with imaging formats (OME-Zarr, HDF5)
Benefits
- Generous employer match on 401(k) contributions
- Paid time off to volunteer
- Funding for select family-forming benefits
- Relocation support
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSenior/Staff Data Engineer
Biohub · New York
