ML Researcher - Evaluations

About the Company

Fundamental is an AI company pioneering the future of enterprise decision-making. Founded by DeepMind alumni, Fundamental has developed NEXUS – the world's most powerful Large Tabular Model (LTM) – purpose-built for the structured records that actually drive enterprise decisions.

Responsibilities

• Develop Signal-Driven Evals: Design and implement rigorous evaluation frameworks and measurable metrics.
• Own the Evaluation Infrastructure: Build, scale, and maintain internal Python pipelines and datasets.
• Explore External Benchmarks: Scout and evaluate models against industry-standard external benchmarks for tabular data.
• Maintain Competitive Baselines: Monitor external foundation models and classical ML baselines to ensure state-of-the-art performance.
• Manage the Internal Leaderboard: Create and maintain a comprehensive leaderboard to report model performance to the research team.

Requirements

• Proven experience in Machine Learning, Data Science, or AI Engineering with a focus on evaluation or benchmarking.
• Strong programming skills in Python and libraries like pandas.
• Solid understanding of traditional ML metrics and foundation model evaluation.
• Experience building automated testing pipelines or evaluation harnesses.
• Ability to translate real-world problems into quantifiable metrics.
• Excellent internal communication skills.

Preferred Qualifications

• Experience with tabular data or time series forecasting.