LLM Dataset Engineer

About the Company

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD, the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

Responsibilities

• Own the end-to-end creation of pre-training datasets for LLMs, including web data, code, books, and technical papers
• Design and implement pipelines for data cleaning, deduplication, and signal extraction from petabytes of raw data
• Lead development of post-training datasets including SFT instructions, multi-turn dialogues, and preference modeling (RLHF/DPO)
• Drive acquisition and processing of vision and video data for multimodal alignment
• Develop high-throughput data processing scripts using Python with multiprocessing and multithreading
• Conduct statistical analysis on training corpora to identify biases and quality regressions
• Design pipelines to generate high-reasoning synthetic data

Requirements

• 5+ years of industry experience in Data Science or Machine Learning
• Proven track record of building and managing datasets for foundation models
• Expert-level Python skills with focus on high-performance code and memory management
• Experience working with petabyte-scale datasets used for production-grade LLMs or LVMs
• Experience building LLM training sets from scratch, including raw web crawls
• Hands-on experience building datasets for RLHF, DPO, and multi-turn instruction following
• Mastery of data-at-scale frameworks such as Spark, Ray, or formats like WebDataset and Parquet

Preferred Qualifications

• Experience building large-scale image or video datasets (e.g., LAION-style pipelines)
• Familiarity with multimodal crawling and video processing challenges
• Experience designing complex labeling schemas for reasoning, coding, and math benchmarks
• Master’s or PhD in a quantitative field focused on data-centric AI or information retrieval

Benefits

• Medical, dental, and vision insurance
• 401k plan
• Daily lunch, snacks, and beverages
• Flexible time off
• Competitive salary and equity