Software Engineer, Scaled Abuse Job at OpenAI (San Francisco)

Senior Software Engineer, Anti-Abuse & Security

The Anti-Abuse team is the front line defending Replit's platform from exploitat...

Location

United States , Foster City

Salary:

190000.00 - 240000.00 USD / Year

Replit

Expiration Date

Until further notice

Requirements

4+ years of experience in security engineering, anti-abuse, trust & safety, or fraud detection
Strong programming skills in Python and/or TypeScript for building detection systems and automation
Experience with SQL and data analysis at scale (BigQuery, Snowflake, or similar)
Experience building or fine-tuning ML/LLM-based classifiers for security or abuse detection
Familiarity with prompt injection, jailbreaking, and other LLM-specific attack vectors
Ability to investigate complex abuse patterns and translate findings into automated defenses
Familiarity with common attack patterns: phishing infrastructure, account takeover, credential stuffing, resource abuse
Clear communication skills for working across Security, Support, Legal, and Engineering teams.

Job Responsibility

Design and implement LLM guardrails that detect abuse scenarios in AI-generated code and agent interactions
Build AI-powered detection systems that use LLMs to identify malicious patterns, classify threats, and automate response decisions
Build and operate abuse detection systems that identify phishing, cryptomining, account takeover, and financial fraud across millions of daily user actions
Design automated response mechanisms that enforce platform policies without manual intervention
Own the full abuse response lifecycle: detection, investigation, enforcement, and handling appeals alongside Support and Legal
Analyze attack patterns using BigQuery and Hex, turning investigation findings into new detection rules
Maintain and extend internal detection tools (Slurper, Netwatch) that continuously monitor user activity
Integrate and tune security scanners (SAST, SCA) in CI pipelines with tight performance SLAs
Track abuse trends, measure detection effectiveness, and adapt defenses as attack patterns evolve

What we offer

Competitive Salary & Equity
401(k) Program with a 4% match
Health, Dental, Vision and Life Insurance
Short Term and Long Term Disability
Paid Parental, Medical, Caregiver Leave
Commuter Benefits
Monthly Wellness Stipend
Autonomous Work Environment
In Office Set-Up Reimbursement
Flexible Time Off (FTO) + Holidays

Fulltime

Software Engineer II - Compromise & Fraud Protection

Our team focuses on protecting Azure Active Directory and Microsoft Account from...

Location

United States , Redmond

Salary:

102100.00 - 219200.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Job Responsibility

Design and develop large scale distributed software services and solutions
Designs and maintains assigned data tools that are used to transform, manage, and access data, scaling with efficiency and reduced time to new data insights
Deliver novel and innovative features for detecting and blocking accounts, applications and other entities indulging in fraudulent activities towards our users and services
Building and leveraging reputation models for entities
Opportunity to design and integrate machine learning models in production systems to identify and block abuse patterns to deliver real-time and near-real time protection
Adhere to and drive modern software engineering practices through design reviews
System design through well-defined interfaces across multiple components, code reviews, leveraging data/telemetry to make decisions
Develop “best-in-class” engineering for our services by ensuring that the services and the components are well-defined and modularized, secure, reliable, diagnosable, actively monitored and reusable
Gain a working understanding of Microsoft businesses and collaborate with mentors and leaders to contribute to cohesive, end-to-end experiences for our users
Collaborate with teams across Microsoft to deliver customer-facing features

Fulltime

Software Engineer, Trust & Safety (Distributed Systems)

You'll architect and scale the trust infrastructure that keeps 70M+ users safe w...

Location

United States , San Francisco

Salary:

180000.00 - 275000.00 USD / Year

Gamma

Expiration Date

Until further notice

Requirements

5+ years of backend engineering experience building scalable, high-traffic production systems
Strong systems thinking and experience building highly available web APIs
Strong proficiency in backend technologies (Node.js, Python, or similar) and databases (PostgreSQL, Redis)
Experience with event streaming systems (Redis, Kafka, or similar) and high-volume event pipelines
Hands-on experience implementing trust features like rate limiting, content detection, and fraud prevention
Track record shipping high-quality, complex applications under tight timelines
Product-minded approach with understanding of how technical decisions impact user experience and business metrics
Passion for security, user protection, and solving problems at scale

Job Responsibility

Own detection and prevention systems for fraud, abuse, spam, and malicious content across millions of daily users
Design and build scalable trust infrastructure including rate limiting, content scanning, anomaly detection, and account security
Architect distributed systems, APIs, and high-volume event pipelines that power real-time abuse detection at Gamma's scale
Help define and evolve the core data model and storage systems that underpin trust and safety across the product
Build tools that empower internal support teams to investigate and act on suspicious or malicious activity
Leverage AI/LLM-based detection to stay ahead of AI-generated abuse — phishing, fraud, and malicious content that's increasingly indistinguishable from legitimate activity
Build automated triage and investigation workflows that let a small team operate at the scale of a much larger one
Investigate and resolve complex security incidents with limited context
Partner with engineering and product to balance security with user experience
Shape Gamma's long-term trust and safety strategy and technical roadmap

What we offer

equity

Fulltime

Software Engineer II - Compromise & Fraud Prevention

Security represents the most critical priorities for our customers in a world aw...

Location

United States , Redmond

Salary:

100600.00 - 199000.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
2+ years of cloud service experience including, but not limited to Azure, GCP, and AWS
2+ years of experience in data analysis in systems including, but not limited to security data management, logging, or monitoring solutions
2+ years of experience building software systems, with a focus on large-scale, distributed platforms
2+ years’ experience working with high-scale, mission-critical SaaS products, including service operations
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Job Responsibility

Design and develop large scale distributed software services and solutions
Designs and maintains assigned data tools that are used to transform, manage, and access data, scaling with efficiency and reduced time to new data insights
Deliver novel and innovative features for detecting and blocking accounts, applications and other entities indulging in fraudulent activities towards our users and services
Building and leveraging reputation models for entities
Opportunity to design and integrate machine learning models in production systems to identify and block abuse patterns to deliver real-time and near-real time protection
Adhere to and drive modern software engineering practices through design reviews
System design through well-defined interfaces across multiple components, code reviews, leveraging data/telemetry to make decisions
Develop “best-in-class” engineering for our services by ensuring that the services and the components are well-defined and modularized, secure, reliable, diagnosable, actively monitored and reusable
Gain a working understanding of Microsoft businesses and collaborate with mentors and leaders to contribute to cohesive, end-to-end experiences for our users
Collaborate with teams across Microsoft to deliver customer-facing features

Fulltime

Senior Battery Test Engineer - Abuse

Archer is an aerospace company based in San Jose, California building an all-ele...

Location

United States , San Jose

Salary:

134000.00 - 174000.00 USD / Year

Archer Aviation

Expiration Date

Until further notice

Requirements

BS in Mechanical Engineering, Electrical Engineering, Chemical Engineering, or related field
8+ years of experience in cell and battery abuse testing within an engineering or manufacturing industry
High Voltage experience
Hands-on experience with cell test/data monitoring, battery module and/or pack test/data monitoring
Design experience of fixtures, test setups, and procuring parts
Experience with PCAN Explorer or CANalyzer applications and the HW used with the applications
Hands-on experience preparing samples for test
Experience successfully writing SOPs and Test Plans
Problem-solving skills
Good communication skills

Job Responsibility

Formulate, Lead, and Execute cell, module, and battery pack abuse testing to include Thermal Runaway, Short Circuit, Over-Temperature, Overcharge, and Overdischarge
Perform data analysis and create reports
Design sub-scale and full scale test rigs for Safety/Abuse tests requiring pcba/hardware and software development
Design and deploy custom thermal abuse test equipment and controllers
Design bespoke test equipment and test automation software to support cross functional battery R&D testing
Mechanical design of test rigs in NX CAD software
Development of LabVIEW, Python, and other test development tools
Support small scale buck and prototype builds
Support troubleshooting and preventative maintenance of battery test equipment and setups
Support failure review efforts

Fulltime

Software Engineer, Ads Integrity

We’re building the Ads Integrity team to ensure OpenAI can grow advertising in a...

Location

United States , San Francisco

Salary:

230000.00 - 385000.00 USD / Year

OpenAI

Expiration Date

Until further notice

Requirements

At least 6 years of professional software engineering experience
Experience setting up and maintaining production backend services and data pipelines
Comfortable operating as a generalist across distributed systems, data pipelines, and applied ML integrations
Have a humble attitude, an eagerness to help your colleagues, and a desire to do whatever it takes to make the team succeed
Are self-directed and enjoy figuring out the best way to solve a particular problem
Own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done
Care about AI Safety in production environments and have the expertise to build software systems that defend against abuse
Motivated by working on ads—not just growth, but the responsibility that comes with it
Experienced in trust, safety, integrity, fraud, abuse prevention, or risk-sensitive domains (ads experience is a strong plus)
Excited to work closely with product, policy, and other XFN partners to solve ambiguous, high-stakes problems

Job Responsibility

Design and build backend systems that ensure ads and advertisers meet safety, trust, and compliance standards
Develop mechanisms to verify advertiser identity (“know your customer”) and assess advertiser risk
Build and improve systems that evaluate ad content and landing pages for user safety and policy compliance
Help determine where and how ads are shown, ensuring placements are appropriate, contextual, and aligned with user trust—especially in conversational AI surfaces like ChatGPT
Partner cross-functionally with Core Ads, Integrity, and Personalization teams to balance growth goals with safety constraints
Contribute to ML and LLM-adjacent systems that support automated decision-making, classification, and risk detection
Shape technical direction, architecture, and best practices as the Ads Integrity organization scales

What we offer

Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
401(k) retirement plan with employer match
Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
Mental health and wellness support
Employer-paid basic life and disability coverage
Annual learning and development stipend to fuel your professional growth
Daily meals in our offices, and meal delivery credits as eligible

Fulltime

Backend Software Engineer - B2B Connectors

We’re looking for an infrastructure-focused engineer to build and operate the sy...

Location

United States , San Francisco; New York City

Salary:

230000.00 - 385000.00 USD / Year

OpenAI

Expiration Date

Until further notice

Requirements

5+ years of professional engineering experience (excluding internships) in infra / SRE / platform roles at tech and product-driven companies
Strong distributed systems fundamentals and production instincts (availability, latency, correctness, resilience)
Experience building and operating services with meaningful uptime and scale requirements (multi-region is a plus)
Proficient in one or more backend languages (e.g. Python, Rust) and comfortable working close to systems concerns (networking, storage, queueing)
Deep familiarity with observability (metrics, logs, tracing), incident management, and reliability engineering practices
Comfortable navigating ambiguous problem spaces and pushing pragmatic solutions into production

Job Responsibility

Design and operate the infrastructure that powers connector sync, indexing, and retrieval at scale (job orchestration, queues, storage, caching, backpressure)
Build the “control plane” primitives for connectors: rollout controls, configuration management, permissions, policy enforcement, and kill switches
Own reliability and operational excellence: SLOs, monitoring/alerting, incident response, postmortems, on-call health, and capacity planning
Create guardrails for safe multi-tenant execution: isolation boundaries, secrets handling, rate limits, abuse prevention, and blast-radius reduction
Partner with security and compliance teams to ensure enterprise requirements are met (audibility, least privilege, data retention, and secure-by-default architecture)
Improve developer velocity via internal tooling: local dev workflows, canary environments, load testing, and observability dashboards

What we offer

Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
401(k) retirement plan with employer match
Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
Mental health and wellness support
Employer-paid basic life and disability coverage
Annual learning and development stipend to fuel your professional growth
Daily meals in our offices, and meal delivery credits as eligible

Fulltime

Software Engineer, AI Safety

At OpenAI, we're dedicated to advancing artificial intelligence, and we know tha...

Location

United States , San Francisco

Salary:

185000.00 - 325000.00 USD / Year

OpenAI

Expiration Date

Until further notice

Requirements

Built and run production services in a high growth, rapidly scaling environment
Can debug live issues and restore systems quickly
Experience with content safety, fraud, or abuse, or are motivated and excited to work on present-day (“now-term”) AI safety
Experience with Python or with modern languages such as C++, Rust, or Go, and are able to quickly ramp up on Python
Understand the trade-offs of capabilities and risks and navigate them to deploy novel products and features safely
Can critically assess risks of a new product or feature and devise innovative solutions to mitigate these risks without harming the product experience
Pragmatic, knowing when to build a quick, good-enough fix, and when to invest in a robust, lasting solution
Possess strong project management skills, self-directed and can remove roadblocks to drive projects to completion with minimal guidance
Deployed classifiers or machine learning models, or are excited to learn about modern ML infra
Experience with technologies like Terraform, Kubernetes, Azure, Python, Postgres, and Kafka is valued

Job Responsibility

Architect, build, and maintain anti-abuse and content moderation infrastructure designed to protect us and end users from unwanted behavior
Work closely with our other engineers and researchers to utilize both industry standard and novel AI techniques to measure, monitor and improve AI models’ alignment to human values
Diagnose and remediate active incidents on the platform and build new tooling and infrastructure that address the root causes of system failure

What we offer

Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
401(k) retirement plan with employer match
Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
Mental health and wellness support
Employer-paid basic life and disability coverage
Annual learning and development stipend to fuel your professional growth
Daily meals in our offices, and meal delivery credits as eligible

Fulltime

Select Country

Software Engineer, Scaled Abuse

Job Description

Job Responsibility

Requirements

Nice to have

What we offer

Looking for more opportunities?