engineering
Posted Apr 15, 2025Software Engineer, Trust & Safety
at Gamma
San Francisco, United StatesOn-site
Responsibilities
- WHAT YOU'LL DO - Own detection and prevention systems for fraud, abuse, spam, and malicious content across millions of daily users - Design and build scalable trust infrastructure including rate limiting, content scanning, anomaly detection, and account security - Build tools that empower internal support teams to investigate and act on suspicious or malicious activity - Investigate and resolve complex security incidents with limited context - Partner with engineering and product to balance security with
Requirements
- WHY THIS ROLE MATTERS NOW AI has dramatically lowered the barrier for bad actors.
- At the same time, AI is transforming what's possible on the defensive side.
- AI-assisted content scanning, automated investigation workflows, and intelligent alert prioritization mean that a lean team can protect millions of users—if they build the right infrastructure.
- ABOUT THE ROLE Gamma is tackling one of the most critical challenges for any fast-growing AI platform: keeping millions of users safe while preserving the creative freedom that makes the product magical.
- experience - Shape Gamma's long-term trust and safety strategy and technical roadmap - Leverage AI/LLM-based detection to stay ahead of AI-generated abuse—phishing, fraud, and malicious content that's increasingly indistinguishable from legitimate activity - Build automated triage and investigation workflows that let a small team operate at the scale of a much larger one WHAT YOU'LL BRING - 5+ years as a software engineer with a focus on abuse, spam, or fraud prevention - Strong systems thinking and
- experience building highly available web APIs, with proficiency in at least one programming language and comfort working across a modern web stack - Hands-on
- experience implementing trust features like rate limiting, content detection, and fraud prevention -
- Experience with event streaming systems (Redis, Kafka, or similar) - Passion for security, user protection, and solving problems at scale NICE TO HAVE -
- Experience with AI/LLMs for content moderation, or familiarity with TypeScript, Prisma, Apollo GraphQL, or AWS -
Benefits
- Experience building AI-assisted moderation pipelines or using frontier models for automated abuse detection and response - Familiarity with the evolving AI threat landscape—how generative models are being used for phishing, social engineering, and content abuse at scale COMPENSATION RANGE: The base salary for this full-time position, which spans multiple internal levels depending on qualifications, ranges between $180K - $275K plus
- benefits & equity. Final offer amounts are determined by multiple factors, including but not limited to experience and expertise in the
Additional details
- Generating convincing phishing pages, spinning up realistic-looking fraudulent accounts, and producing abusive content at scale no longer requires specialized skill—a motivated attacker with access to widely available models can do it.
- The volume and sophistication of platform abuse is increasing faster than traditional approaches can keep up with.
- A small, sharp T&S team equipped with frontier models can now build detection, triage, and response systems that would have required a team five times the size just a couple of years ago.
- As a Trust & Safety Engineer, you'll architect the systems that protect our platform from phishing, abuse, fraud, and malicious content, all while ensuring Gamma stays fast, reliable, and delightful to use.
- You'll join a small, high-impact team building the foundation for trust at scale.
- You'll design infrastructure that serves millions, ship improvements daily, and build the internal tools that let our support teams act quickly on threats.
- You'll collaborate across engineering, product, and design to define how Gamma approaches safety for the long term.
- Our team has a strong in-office culture and works in person 4–5 days per week in San Francisco.
- We love working together to stay creative and connected, with flexibility to work from home when focus matters most.
- requirements listed above. If you're interested in this role but you don't meet every requirement, we encourage you to apply anyway! We're always excited about meeting great people.