M
Posted 6 hours ago
Data Engineer
MithrlData Engineer, Scientific Data Ingestion
Perks & benefits
CommissionHealth InsuranceMedical InsurancePaid Leave
Requirements
5+ years data engineering experience, Python fluency, Pandas/Polars/PyArrow, ETL/ELT pipeline design, LLM data normalization
Skills
PythonPandasETL
About the role
About the Company
Mithrl is building the world’s first commercially available AI Co-Scientist—a discovery engine that empowers life science teams to go from messy biological data to novel insights in minutes. Our platform helps scientists move from target discovery to patient outcomes using natural language analysis.
Responsibilities
- Build and own an AI-powered ingestion and normalization pipeline for diverse data sources including Excel, CSV, and lab instrument exports
- Develop robust schema mapping, coercion, and conversion logic for units, metadata, and variable-name harmonization
- Use LLM-driven and classical data-engineering tools to structure semi-structured or messy tabular data
- Ensure all transformations execute during ingestion to provide clean, canonical data for downstream analytics
- Build validation, verification, and quality-control layers to catch inconsistent or corrupt data
- Collaborate with product, data science, and infrastructure teams to define and enforce data standards
Requirements
- 5+ years of experience in data engineering or data wrangling with tabular or semi-structured data
- Strong fluency in Python and data processing tools such as Pandas, Polars, or PyArrow
- Extensive experience normalizing messy Excel/CSV data with inconsistent headers and mixed formats
- Experience designing and maintaining robust ETL/ELT pipelines
- Ability to combine classical data engineering with LLM-powered data normalization
- Strong ownership mindset for end-to-end ingestion layers
Preferred Qualifications
- Familiarity with scientific data types like genomics metadata, plate-readers, or time-series data
- Experience with workflow orchestration tools like Nextflow, Prefect, Airflow, or Dagster
- Experience with cloud infrastructure and data storage (AWS S3, data lakes, database schemas)
- Past exposure to LLM-based data transformation or cleansing agents
- Background in computational biology, lab-data, or bioinformatics
Benefits
- Comprehensive PPO health coverage through Anthem (medical, dental, and vision)
- 401(k) with top-tier plans
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer
Mithrl · San Francisco
