CrawlJobs Logo

Software Engineer, Trust and Safety

United States, Boston, NYC 170000.00 - 240000.00 USD / Year · Job Posted January 13, 2026
Apply Position
Job Link Share

Job Description

Suno is hiring a Software Engineer, Trust and Safety, to be on the front lines of protecting our platform and users from abuse, fraud, and harmful behaviors / content. Your work will directly impact user safety and platform integrity, making it a more trustworthy place for our community.

Job Responsibility

  • Build and maintain data pipelines for bot detection and content moderation using Python, Snowflake, and Dagster
  • Design and implement anomaly detection systems to identify suspicious patterns in user behavior and platform activity
  • Develop internal tools and dashboards for Trust & Safety operations and investigations
  • Help improve detection algorithms and reduce false positives
  • Build automated systems for content moderation, user verification, and abuse prevention
  • Analyze large datasets in Snowflake to uncover new attack vectors and improve existing detection methods
  • Work closely with product and engineering teams to implement Trust & Safety features at scale
  • Help finance teams reduce fraudulent transactions and chargebacks by identifying and preventing payment abuse

Requirements

  • 3+ years of experience in Trust & Safety, fraud detection, or content moderation
  • Strong Python and SQL skills (5+ years preferred)
  • Experience with data engineering tools and pipelines (Dagster, Airflow, or similar)
  • Proficiency with SQL and data analysis (Snowflake experience preferred)
  • Experience building internal tools and dashboards for operational teams
  • Understanding of statistical analysis and anomaly detection techniques
  • Experience with real-time systems and event-driven architectures
  • Strong problem-solving skills and attention to detail
  • Knowledge of anti-abuse techniques, bot detection, and content moderation systems

Nice to have

  • Experience with machine learning pipelines and model deployment
  • Background in cybersecurity or anti-fraud systems
  • Knowledge of behavioral analytics and user journey analysis
  • Experience with A/B testing and experimentation in Trust & Safety

What we offer

  • Company Equity Package
  • 401(k) with 3% Employer Match & Roth 401(k)
  • Medical, Dental, & Vision Insurance (PPO w/ HSA & FSA options)
  • 11 Paid Holidays + Unlimited PTO & Sick Time
  • 16 Weeks of Paid Parental Leave
  • Creative Education Stipend
  • Generous Commuter Allowance
  • In-Office Lunch (5 days per week)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer, Trust and Safety

8 matching positions

Software Engineer, Trust & Safety (Distributed Systems)

You'll architect and scale the trust infrastructure that keeps 70M+ users safe w...
Location
Location
United States , San Francisco
Salary
Salary:
180000.00 - 275000.00 USD / Year
gamma.app Logo
Gamma
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of backend engineering experience building scalable, high-traffic production systems
  • Strong systems thinking and experience building highly available web APIs
  • Strong proficiency in backend technologies (Node.js, Python, or similar) and databases (PostgreSQL, Redis)
  • Experience with event streaming systems (Redis, Kafka, or similar) and high-volume event pipelines
  • Hands-on experience implementing trust features like rate limiting, content detection, and fraud prevention
  • Track record shipping high-quality, complex applications under tight timelines
  • Product-minded approach with understanding of how technical decisions impact user experience and business metrics
  • Passion for security, user protection, and solving problems at scale
Job Responsibility
Job Responsibility
  • Own detection and prevention systems for fraud, abuse, spam, and malicious content across millions of daily users
  • Design and build scalable trust infrastructure including rate limiting, content scanning, anomaly detection, and account security
  • Architect distributed systems, APIs, and high-volume event pipelines that power real-time abuse detection at Gamma's scale
  • Help define and evolve the core data model and storage systems that underpin trust and safety across the product
  • Build tools that empower internal support teams to investigate and act on suspicious or malicious activity
  • Leverage AI/LLM-based detection to stay ahead of AI-generated abuse — phishing, fraud, and malicious content that's increasingly indistinguishable from legitimate activity
  • Build automated triage and investigation workflows that let a small team operate at the scale of a much larger one
  • Investigate and resolve complex security incidents with limited context
  • Partner with engineering and product to balance security with user experience
  • Shape Gamma's long-term trust and safety strategy and technical roadmap
What we offer
What we offer
  • equity
  • Fulltime
Read More
Arrow Right

Software Engineer, Trust & Safety

Gamma is tackling one of the most critical challenges for any fast-growing AI pl...
Location
Location
United States , San Francisco
Salary
Salary:
180000.00 - 275000.00 USD / Year
gamma.app Logo
Gamma
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years as a software engineer with a focus on abuse, spam, or fraud prevention
  • Strong systems thinking and experience building highly-available web APIs
  • Hands-on experience implementing trust features like rate limiting, content detection, and fraud prevention
  • Proficiency in at least one programming language and comfort working across a modern web stack
  • Experience with event streaming systems (Redis, Kafka, or similar)
  • Passion for security, user protection, and solving problems at scale
Job Responsibility
Job Responsibility
  • Own detection and prevention systems for fraud, abuse, spam, and malicious content across millions of daily users
  • Design and build scalable trust infrastructure including rate limiting, content scanning, anomaly detection, and account security
  • Ship trust and safety features daily across our stack
  • Build tools to empower our internal support teams to investigate and take action on suspicious & malicious activity
  • Partner with engineering teams and product managers to balance security with user experience
  • Investigate and resolve complex security incidents with limited context
  • Shape Gamma's long-term trust and safety strategy and technical roadmap
What we offer
What we offer
  • competitive equity
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Trust & Safety

As a Senior Software Engineer on our Trust & Safety team at Vercel, you’ll build...
Location
Location
United States
Salary
Salary:
196000.00 - 294000.00 USD / Year
vercel.com Logo
Vercel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in abuse prevention, trust & safety, or security engineering
  • Strong programming skills in JavaScript/TypeScript and Python
  • Hands-on experience working with LLMs, including prompt engineering, evaluation, and fine-tuning
  • Solid understanding of cloud infrastructure, including AWS
  • Strong understanding of real-world threat actor behavior and abuse tactics
  • Experience owning systems end-to-end, from initial research through production deployment and iteration
Job Responsibility
Job Responsibility
  • Analyze threat actor behavior and evolving abuse patterns across large, heterogeneous datasets to inform detection logic, policy decisions, and scalable mitigations
  • Research, prototype, and implement state-of-the-art LLM-driven techniques for abuse detection, classification, and prevention
  • Design and develop production-ready systems that detect and disruptive abusive behavior across the Vercel platform
  • Build, maintain, and fine-tune internal tools, datasets, and evaluation pipelines for trust and safety workflows
  • Collaborate closely with security, product, and infrastructure teams to bring research ideas into stable, scalable production systems
What we offer
What we offer
  • Competitive compensation package, including equity
  • Inclusive Healthcare Package
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills
  • Flexible Time Off
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed
  • Fulltime
Read More
Arrow Right

Software Engineer - Trust & Safety

As a webhost, millions of project builds flow through Vercel each day, and the f...
Location
Location
United States , San Francisco
Salary
Salary:
194000.00 - 294000.00 USD / Year
vercel.com Logo
Vercel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 4+ years of experience managing technical teams, or 6+ as team technical lead in rapidly growing companies
  • Applied experience building and maintaining scaled abuse detection and restriction/checkpoint systems in a professional setting
  • People tell you that you communicate well and you are comfortable with uncertainty
  • You are excited by nurturing engineers and building engineering teams
  • You are located in the SF Bay Area
Job Responsibility
Job Responsibility
  • Hold a high bar for technical work and teamwork
  • Build rapport with each member of the team and support them as they level up their skills
  • Work closely with team leadership, our program manager, and trust & safety sub-teams to synthesize needs into engineering roadmaps
  • Review and write code along with the team
  • Participate in and manage the team's on-call rotation
  • Reduce abuse, fraud, and other harms on Vercel
What we offer
What we offer
  • Competitive compensation package, including equity
  • Inclusive Healthcare Package
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills
  • Flexible Time Off
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed
  • Fulltime
Read More
Arrow Right

Software Engineer - Trust & Safety

As a webhost, millions of project builds flow through Vercel each day, and the f...
Location
Location
United States , San Francisco
Salary
Salary:
194000.00 - 294000.00 USD / Year
vercel.com Logo
Vercel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 4+ years of experience managing technical teams, or 6+ as team technical lead in rapidly growing companies
  • Applied experience building and maintaining scaled abuse detection and restriction/checkpoint systems in a professional setting
  • Good communication skills and comfortable with uncertainty
  • Excitement for nurturing engineers and building engineering teams
  • Located in the SF Bay Area
Job Responsibility
Job Responsibility
  • Hold a high bar for technical work and teamwork
  • Build rapport with each member of the team and support them as they level up their skills
  • Work closely with team leadership, program manager, and trust & safety sub-teams to synthesize needs into engineering roadmaps
  • Review and write code along with the team
  • Participate in and manage the team's on-call rotation
  • Reduce abuse, fraud, and other harms on Vercel
What we offer
What we offer
  • Competitive compensation package, including equity
  • Inclusive Healthcare Package
  • Learn and Grow - mentorship and events to build network and skills
  • Flexible Time Off
  • Gear provided to do your role
  • WFH budget to outfit your space
  • Fulltime
Read More
Arrow Right

International Space Station (ISS) Software Safety Engineer

Astrion has an exciting opportunity for a International Space Station (ISS) Soft...
Location
Location
United States , Houston
Salary
Salary:
Not provided
astrion.us Logo
Astrion
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelors or higher degree in computer science or other software field
  • 3+ years related experience
  • Good understanding of software and computers
  • Good interpersonal skills
  • Good critical/analytical thinking skills
  • Must be a U.S. citizen and able to pass a public trust security clearance
Job Responsibility
Job Responsibility
  • Assure that software safety design and operations specifications and products meet International Space Station Program (ISSP), Safety & Mission Assurance (S&MA) software safety requirements
  • Assess the ISS software development, test, verification, and change products and identify problems and noncompliances
  • Ensure compliance with Computer Based Controls System Safety Requirements (SSP 50038B), ISS System Specifications (SSP 41000) and ISS Safety Requirements Document (50021) and applicable NASA standards (7150, 8719, 8739)
  • Prepare reports, present findings of evaluations, and provide recommendations to the NASA S&MA Software Team Manager
  • Participate in ISS on-orbit anomaly assessment process and evaluate safety compliance of proposed on-orbit software modifications
  • Participate in, and represent software S&MA assurance, as appropriate and as required in working groups, panels and boards
What we offer
What we offer
  • Competitive salaries
  • Continuing education assistance
  • Professional development
  • Multiple healthcare benefits package options
  • 401K with employer matching
  • Competitive time off policy along with a federally recognized holiday schedule
  • Fulltime
Read More
Arrow Right
New

Staff Software Engineer

You'll help build Confluent Cloud's AI capabilities — the layer that lets custom...
Location
Location
Canada
Salary
Salary:
225100.00 - 260500.00 CAD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of significant experience designing, building, and operating distributed systems or cloud-native backend infrastructure in production
  • Strong working knowledge of Kubernetes and distributed-systems patterns (control loops, API servers, high-scale control planes), plus the fundamentals — containerization, networking, resource isolation
  • Proficiency in at least one of Go, Java, or Python, and the willingness to work across all three
  • A track record of leading cross-team technical work: turning ambiguous requirements into designs others can rally behind
  • Excellent written and verbal communication — you can write a design doc that aligns people who don't report to you
Job Responsibility
Job Responsibility
  • Design and build the backend services (primarily Go, Java, and Python) that run AI and model inference on real-time data
  • Own features end to end — drafting the design, aligning stakeholders inside and outside the team, and driving the decision to a conclusion
  • Make the technical calls on systems that span teams: model lifecycle, inference routing, and agent execution
  • Own the quality of what you ship — code, test coverage, documentation, operability, and rollout safety
  • Make the engineers around you better through code review, design feedback, and being someone the team trusts with ambiguous, cross-cutting work
  • Participate in on-call for the services your team owns, and help keep the team's processes and rituals healthy
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
  • Offers Equity
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

The Principal Software Engineer is the senior-most hands-on technical leader for...
Location
Location
India , Chennai
Salary
Salary:
Not provided
rxglobal.com Logo
RX Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a senior technical leader across multiple teams/services within a bounded domain
  • Strong polyglot background (e.g., C#/.NET, Java, JavaScript/Node) and ability to choose fit-for-purpose technologies
  • Experience modernising systems: migrating from legacy architectures to cloud-native patterns, reducing technical debt, and decommissioning safely
  • Experience in systems analysis, design and a solid understanding of development, quality assurance and integration methodologies
  • Experience developing integrated solutions within a broad technical and business context of significant impact
  • Experience evaluating third-party services and platforms (security, cost, operations, integration complexity)
  • Experience leading cross‑team architectural change, platform adoption, or measurable improvements to reliability/cost/performance (with before/after metrics)
  • Familiarity with responsible AI usage in engineering workflows (policy/guardrails, data privacy, human‑in‑the‑loop review)
  • Bachelor’s/Master’s degree in Computer Science (or related) or equivalent professional experience
  • Expert software design skills: SOLID, DDD, event-driven architecture patterns, modular design, and maintainable codebases
Job Responsibility
Job Responsibility
  • Engineering Leadership & Culture: Create an environment where teams can do their best work by removing blockers, improving engineering practices, and contributing to a culture of psychological safety and high standards
  • Mentor and coach engineers across teams—especially senior engineers and emerging tech leads—in architecture, systems thinking, and operational excellence
  • Promote strong technical ownership ("you build it, you run it"), including operational readiness and post-incident learning
  • Support scalable knowledge-sharing mechanisms (e.g., tech talks, playbooks, templates, reference implementations)
  • Participate in hiring loops and help onboard new engineers into domain patterns and practices
  • Provide hands-on contributions where needed (prototypes, reference implementations, complex refactors, high-risk changes)
  • Guide teams in decomposition and sequencing to reduce delivery risk
  • support estimation/sizing and technical discovery
  • Leads through influence
  • demonstrates integrity, accountability, and constructive challenge
What we offer
What we offer
  • Comprehensive Health Insurance: Covers you, your immediate family, and parents
  • Enhanced Health Insurance Options: Competitive rates negotiated by the company
  • Group Life Insurance: Ensuring financial security for your loved ones
  • Group Accident Insurance: Extra protection for accidental death and permanent disablement
  • Flexible Working Arrangement: Achieve a harmonious work-life balance
  • Employee Assistance Program: Access support for personal and work-related challenges
  • Medical Screening: Your well-being is a top priority
  • Modern Family Benefits: Maternity, paternity, and adoption support
  • Long-Service Awards: Recognizing dedication and commitment
  • New Baby Gift: Celebrating the joy of parenthood
  • Fulltime
Read More
Arrow Right