Software Engineer, Trust & Safety

About the Company

Gamma is an AI platform focused on providing creative freedom while maintaining a safe environment for millions of users. The team is building the infrastructure to protect against phishing, abuse, fraud, and malicious content using frontier models.

Responsibilities

• Own detection and prevention systems for fraud, abuse, spam, and malicious content
• Design and build scalable trust infrastructure including rate limiting, content scanning, and anomaly detection
• Build tools to empower internal support teams to investigate suspicious activity
• Investigate and resolve complex security incidents with limited context
• Partner with engineering and product to balance security with user experience
• Leverage AI/LLM-based detection to stay ahead of AI-generated abuse
• Build automated triage and investigation workflows

Requirements

• 5+ years of experience as a software engineer focused on abuse, spam, or fraud prevention
• Strong systems thinking and experience building highly available web APIs
• Proficiency in at least one programming language and comfort with a modern web stack
• Hands-on experience implementing rate limiting, content detection, and fraud prevention
• Experience with event streaming systems such as Redis or Kafka

Preferred Qualifications

• Experience with AI/LLMs for content moderation
• Familiarity with TypeScript, Prisma, Apollo GraphQL, or AWS
• Experience building AI-assisted moderation pipelines
• Knowledge of the evolving AI threat landscape including generative model abuse