Helix AI Engineer, Pretraining

Responsibilities

• Design and train large-scale foundation models across multimodal data including text, vision, and robot data
• Develop pretraining strategies to improve generalization, reasoning, and transfer to downstream embodied tasks
• Explore and implement transformer-based and emerging foundation model architectures
• Work on scaling laws, dataset mixture design, and training dynamics for frontier models
• Build and optimize large-scale distributed training pipelines across multi-node GPU clusters
• Collaborate with video, generative, agent, and robot learning teams to integrate models into the autonomy stack
• Design evaluation frameworks to measure reasoning ability, robustness, and cross-domain generalization
• Contribute to post-training approaches including fine-tuning, alignment, and model adaptation

Requirements

• Experience training large-scale foundation models or working on pretraining for LLMs or multimodal systems
• Strong understanding of modern deep learning architectures, especially transformers
• Experience with large-scale distributed training and optimization
• Proficiency in Python and deep learning frameworks such as PyTorch
• Strong experimental rigor and ability to iterate on model design and training strategies
• Solid software engineering skills and ability to build scalable, reliable systems
• Ability to operate independently and drive ambiguous, high-impact technical problems

Preferred Qualifications

• Experience working on frontier foundation models at companies such as Anthropic, OpenAI, Google DeepMind, or xAI
• Experience with multimodal pretraining (vision-language or vision-language-action models)
• Background in scaling laws, dataset curation, and large-scale data mixture optimization
• Experience with post-training techniques such as RLHF, reward modeling, or alignment methods
• Familiarity with embodied AI, robotics, or real-world deployment constraints
• Publication record in machine learning, NLP, or multimodal AI

About the Company

Figure is an AI robotics company developing autonomous general-purpose humanoid robots. Our goal is to build embodied AI systems that can perceive, reason, and act in the real world.