Member of Technical Staff, AI Developer Experience

About the Company

Crosby is the first AI-native law firm, helping ambitious companies like Cursor, Ramp, and Cognition sign commercial contracts faster. We build proprietary tools and human-in-the-loop workflows that change what's possible for corporate legal teams.

Responsibilities

• Build AI developer tooling for prompt management, evaluation, experimentation, and model iteration
• Create systems that enable rapid testing, debugging, and comparison of model outputs
• Develop frameworks for benchmarking, regression testing, and monitoring AI system performance
• Build pipelines and tooling to support data collection, labeling, and feedback loops
• Partner with engineering teams to ensure AI features are reliable and observable in production
• Identify bottlenecks in the development process to increase developer velocity

Requirements

• 3+ years of software engineering experience, ideally in developer tools, infrastructure, or platform teams
• Strong proficiency in Python
• Experience building backend systems and internal tooling
• Hands-on experience with LLMs, APIs (e.g., OpenAI, Anthropic), and modern AI workflows
• Experience building systems for experimentation, evaluation, or data pipelines
• Strong systems thinking and pragmatic approach to developer velocity

Benefits

• Unlimited PTO
• Lunch & dinner in the office every day
• Medical, dental, and vision insurance
• HSA or FSA options
• One Medical membership
• 401(k) match
• In-office desk setup stipend