Scientific Evals

About the Company

Edison Scientific builds and commercializes AI agents for science. Scientific discovery moves too slowly, and autonomous AI agents are how we intend to fix that. We're assembling a team of top researchers and engineers across AI and biology to build an AI scientist.

Responsibilities

• Design benchmarks that capture the complexity of real biological research
• Curate and vet biological datasets to ensure scientific rigor
• Analyze model outputs, identify failure modes, and contribute to iterative improvements
• Collaborate with AI/ML researchers to translate scientific intuition into training signal
• Coordinate operations and manage workflows, including working with domain experts

Requirements

• Graduate-level training in biology, biochemistry, computational biology, or a related field
• Hands-on research experience
• Working knowledge of machine learning concepts, particularly deep learning and LLMs
• Proficiency with Python for data processing and analysis
• Strong scientific reasoning and attention to detail

Preferred Qualifications

• Experience creating evaluation datasets or annotation guidelines
• Experience with bioinformatics pipelines or biological databases
• Experience fine-tuning or evaluating large language models
• Research publications in AI for science