CrawlJobs Logo

Technical Program Manager – Adversarial Model Research

United States, San Francisco 207000.00 - 285000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

The Human Data team at OpenAI is responsible for identifying and mitigating risks in advanced AI systems by designing evaluations, surfacing vulnerabilities, and collaborating closely with researchers to strengthen model reliability and public trust. As a Technical Program Manager, you will lead initiatives that test the safety and robustness of OpenAI’s models through creative experimentation and structured evaluation. You’ll coordinate efforts across research and engineering teams to transform ambiguous risks into concrete research programs and influence future model development and deployment.

Job Responsibility

  • Lead programs that explore unexpected model behaviors and identify failure modes
  • Translate vague or emergent risk signals into clear priorities and actionable research plans
  • Design and run creative evaluations, experiments, and red-teaming campaigns
  • Collaborate with research, product, and deployment teams to integrate findings into model training and deployment cycles
  • Develop repeatable systems for tracking model performance and understanding emerging behavior patterns

Requirements

  • Strong experience in technical program management
  • Excellent organizational and communication skills
  • Familiarity with large language models, prompt engineering, or model evaluation techniques
  • Comfortable managing fast-paced, high-uncertainty projects and shaping them from the ground up
  • Creative and resourceful in devising new methods for testing model behavior and performance
  • Ability to effectively coordinate across technical and non-technical stakeholders to drive alignment and execution

What we offer

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Technical Program Manager – Adversarial Model Research

8 matching positions

Principal Technical Program Manager - Applied Science

The Applied Science team for GitHub Copilot sits at the intersection of frontier...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years
Job Responsibility
Job Responsibility
  • Partner with Applied Science researchers to translate cutting-edge evaluation research into production systems: adaptive testing (IRT), agent-centric co-evolution, adversarial benchmarking, and telemetry-driven benchmark generation
  • Lead the deprecation of saturated benchmarks and design their next-generation replacements — including procedurally-generated code evaluations that can't be memorized and adaptive testing systems that skip trivial questions for frontier models
  • Build GitHub's community benchmark submission program — enabling external researchers, enterprises, and open-source developers to contribute domain-specific evaluations — and publish GitHub's first external benchmark transparency reports showing how models perform on real developer workflows
  • Design and operationalize multi-tier evaluation frameworks — from fast automated regression suites and LLM-as-judge systems, through expert human evaluation, to production A/B testing — so teams can iterate in hours, not weeks
  • Design feedback-to-benchmark pipelines that convert thumbs-down signals, user frustrations, and support tickets into candidate regression tests — systematizing informal practices into scalable, automated systems
  • Establish evaluation as a first-class discipline across GitHub Copilot — creating the rituals, dashboards, and communication cadences that make evaluation results accessible and actionable for every team
  • Fulltime
Read More
Arrow Right

Principal Technical Program Manager

Copilot is evolving into an agentic system that can plan, reason, and execute ac...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience
  • 3+ years of experience managing cross-functional and/or cross-team projects
  • Proven ability to lead execution in high‑ambiguity environments where requirements, threats, and system behavior evolve rapidly
  • Solid systems thinking: ability to reason about execution paths, failure modes, and adversarial behavior
  • Track record of making sound technical tradeoffs and shipping durable solutions without relying on heavy process
  • Background in security engineering, distributed systems, applied research, or ML systems prior to or alongside TPM work
  • Experience delivering runtime detection, abuse prevention, or adaptive enforcement systems
  • Familiarity with agentic AI systems, LLM‑based products, or non‑deterministic execution environments
  • Experience partnering closely with offensive security or red‑team functions
  • Demonstrated ability to translate research, prototypes, or threat models into production‑grade systems
Job Responsibility
Job Responsibility
  • Own Delivery of In‑Product AI Threat Defenses
  • Translate Threat Models into Executable Systems
  • Drive Cross‑Cutting Technical Execution
  • Ensure Operability at Runtime
  • Fulltime
Read More
Arrow Right

Technical Solution Management Specialist - AI Evaluation, Research, and Technical Architecture Func.

With more than 45,000 employees and partners worldwide, the Customer Experience ...
Location
Location
United States , Redmond
Salary
Salary:
97600.00 - 188400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 4+ years experience in technical program management, preferably in AI, machine learning, research, data science, technical architecture, or customer experience domains. OR equivalent experience.
  • 2+ years of experience managing cross-functional and/or cross-team projects.
Job Responsibility
Job Responsibility
  • Define and communicate a future-state vision for AI evaluation, research quality, and technical architecture across the XIO AI Innovation Lab.
  • Develop and maintain technical blueprints for research, validation, evaluation, experimentation, and Test Kitchen-ready handoff capabilities.
  • Define and maintain related processes and playbooks for scaling pre 0-to-1 motions using the lab flow: Signal -> Research -> Validation -> Research Paper -> PoC Candidate -> Test Kitchen.
  • Influence technical roadmaps for consistent product evaluation frameworks and tooling.
  • Track best practices, Microsoft product updates, frontier AI research, and emerging AI trends to inform lab strategy and publication direction.
  • Ensure alignment of evaluation frameworks with business priorities and Responsible AI standards.
  • Build and scale multi-dimensional evaluation approaches for diverse lab-stage AI workloads, including chatbots, customer self-service agents, predictive models, and generative tools.
  • Develop automated testing frameworks, including synthetic scenario generation, adversarial stress-testing, and batch evaluation.
  • Implement lab-appropriate experimentation patterns, including offline evaluation, synthetic scenario testing, feature-flagged trials where appropriate, and monitoring plans for downstream PoC owners.
  • Partner with engineering, data science, and prototyping teams to integrate evaluation tools into prototype scaffolds, CI/CD pipelines where relevant, and Test Kitchen handoff plans.
  • Fulltime
Read More
Arrow Right

Artificial Intelligence Security Specialist EMEA

Citi, the leading global bank, has approximately 200 million customer accounts a...
Location
Location
United Kingdom , London; Belfast
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-7+ years for Assistant Vice President (C12 Mid - Senior Level)
  • 8-10+ years for Vice President (C13 Senior - Lead/Staff Level)
  • 10+ years for Senior Vice President (C14 Lead/Staff - Principal Level)
  • Depth in at least one of AI/ML engineering, offensive security, detection engineering, software engineering, or security research
  • Hands-on LLM API experience (context management, tool use, evaluation, failure modes) for AI/ML Engineering
  • Agentic systems design
  • AI safety at the infrastructure level
  • Vulnerability research, exploit development, or pen testing with real depth for Cyber Security
  • Detection engineering for novel attack patterns
  • Threat modelling (STRIDE, ATT&CK)
Job Responsibility
Job Responsibility
  • Depends on team: Offensive Security & Vulnerability Management — AI-assisted pen testing at a scale previously impossible
  • Automated exploit validation
  • Bridge the gap from 'AI found a vulnerability' to 'the application team has a PR to fix it'
  • AI & Emerging Technology Security — Define how the bank deploys AI safely
  • Security architecture and assurance for new implementations
  • Building the next generation of AI-powered tools for CISO colleagues
  • Test new models at the cutting edge of creation and influence
  • Cyber Security AI Services — Own the AI products CISO depends on in production — security assurance, cyber security operations, governance and controls, vulnerability assessment
  • Keep them reliable, evolve them fast
  • Cyber Security Operations — Detection, triage, and response for a world where adversaries use AI to find and exploit vulnerabilities faster than traditional detection can keep up
What we offer
What we offer
  • Business casual workplace
  • Hybrid working model (up to 2 days working at home per week)
  • Competitive base salary (annually reviewed)
  • 27 days annual leave (plus bank holidays)
  • Discretional annual performance related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Fulltime
Read More
Arrow Right

Artificial Intelligence Security Specialist EMEA

Artificial Intelligence Security Specialist EMEA at Citi. Working at Citi is far...
Location
Location
Hungary , Budapest
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on LLM API experience (context management, tool use, evaluation, failure modes)
  • Agentic systems design
  • AI safety at the infrastructure level, not just the prompt level
  • Vulnerability research, exploit development, or pen testing with real depth
  • Detection engineering for novel attack patterns
  • Threat modelling (STRIDE, ATT&CK)
  • Security architecture
  • You've built and operated production systems, not just prototypes
  • Strong Python and/or systems programming
  • Can digest dense technical research and turn it into actionable security recommendations
Job Responsibility
Job Responsibility
  • AI-driven vulnerability management
  • Security architecture for the AI era
  • Securing AI agents that can behave like insider threats
  • Offensive Security & Vulnerability Management — AI-assisted pen testing at a scale previously impossible
  • AI & Emerging Technology Security — Define how the bank deploys AI safely
  • Cyber Security AI Services — Own the AI products CISO depends on in production
  • Cyber Security Operations — Detection, triage, and response for a world where adversaries use AI
What we offer
What we offer
  • Cafeteria Program
  • Home Office Allowance (for colleagues working in hybrid work models)
  • Paid Parental Leave Program (maternity and paternity leave)
  • Private Medical Care Program and onsite medical rooms at our offices
  • Pension Plan Contribution to voluntary pension fund
  • Group Life Insurance
  • Employee Assistance Program
  • Access to a wide variety of learning and development programs, online course libraries and upskilling platforms, such as Udemy and Degreed
  • Flexible work arrangements to support you in managing work - life balance
  • Career progression opportunities across geographies and business lines
  • Fulltime
Read More
Arrow Right

Staff AI Security Engineer - (Agentic Systems)

Our mission is to protect, defend, and secure Uber’s products, infrastructure, a...
Location
Location
United States , New York; Seattle; San Francisco; Sunnyvale
Salary
Salary:
232000.00 - 258000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/MS Degree in Computer Science, Engineering, or a related field
  • 7+ years of industry experience in a software development or security engineering environment
  • Proficiency in programming languages such as Golang, Java, or Python
  • Deep understanding of distributed systems, high-availability, and high-performance system design
  • Hands-on experience with Cyber Defense such as incident response, investigation, and threat detection
Job Responsibility
Job Responsibility
  • AI-Driven Red Teaming Platform: Architect and implement the end-to-end AI-driven red teaming platform to automate threat intelligence processing, vulnerability research, and attack execution
  • Agentic Incident Response: Design and build autonomous security agents for threat hunting and incident triage/response to achieve defense at machine speed
  • Secure AI Environment: Define and maintain secure, air-gapped environments for the safe development and execution of advanced AI/ML models for adversary simulations
  • Technical Leadership: Set technical direction for specific projects by identifying priorities, managing expectations, and considering tradeoffs
  • Engineering Excellence: Champion best software engineering practices and empower teams to build a culture of quality and operational excellence
  • Cross-Functional Collaboration: Partner with IT, product, and various security teams to integrate security posture improvements across the entire environment
What we offer
What we offer
  • Eligible to participate in Uber's bonus program
  • May be offered an equity award & other types of comp
  • Eligible to participate in a 401(k) plan
  • Various benefits
  • Fulltime
Read More
Arrow Right

Mission Data Engineer

The successful candidate will assist the 350th Spectrum Warfare Group (350 SWG) ...
Location
Location
United States , Niceville
Salary
Salary:
Not provided
dcscorp.com Logo
DCS Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • U.S. Citizenship is required
  • A bachelor’s degree in electrical engineering or a related field, or equivalent experience in Electromagnetic Spectrum Operations related to relevant platforms
  • Active Top Secret Security Clearance with SCI Eligibility
  • 5+ years of experience related to mission data development, EW systems, or electromagnetic spectrum operations
  • Demonstrated ability to recognize and analyze problems, conduct research, summarize results, and make appropriate recommendations
  • Programming skills with knowledge of various software languages applicable to MD development, simulation, and analysis such as MATLAB, Python, and/or Java
  • Testing and debugging skills related to MD development, simulation execution, and MD validation and verification
  • Experience in the development and implementation of mission data on aircraft EW and/or defensive systems
  • Providing engineering and analysis in the following activities: developing and updating threat databases using Electronic Warfare Integrated Reprogramming (EWIR) tools, conducting, and reporting performance characterization assessments (PCAs)
  • designing and using computer-based tools to flag and extract threat system parametric for analyses
Job Responsibility
Job Responsibility
  • Function as the senior EW system engineer and technical lead responsible for the design, development, testing, evaluation, and engineering of MD on the applicable EW system
  • Serve as lead engineer and team manager during major EW system operational test and evaluation events, coordinating technical planning, execution, and reporting
  • Function as the senior system project engineer performing advanced systems engineering tasks and hardware/software design activities for EW equipment and associated devices
  • Act as the senior engineer with project management responsibility to direct and conduct research and development demonstrations for complex Electromagnetic Warfare systems
  • Gather, interpret, and program emitter definitions using EDG, Spectre, and other relevant software tools referencing appropriate intelligence sources
  • Understand and program ancillary Radar Warning Receiver parameters to ensure MD completeness and accuracy
  • Program, run, and debug electromagnetic environment simulations
  • Interpret test results and translate findings into engineering recommendations that ensure MD products meet customer performance objectives
  • Build prototype tools to support MD development and test efforts using suitable programming languages such as MATLAB, Python, and/or Java
  • Collaborate with all mission stakeholders to ensure MD design, development, and testing align with customer requirements and operational timelines
  • Fulltime
Read More
Arrow Right

Utility Engineer

The Utility Engineer’s primary responsibility is to perform general work as assi...
Location
Location
United States , San Francisco
Salary
Salary:
40.11 USD / Hour
veolianorthamerica.com Logo
Veolia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School Diploma/GED is required.
Job Responsibility
Job Responsibility
  • Changing of air filters in spaces where no fans or machinery are in operation
  • General cleaning of engineering spaces
  • Cleaning and painting of no-operating mechanical equipment, which has been shut down, locked out and tagged by a Journeyman Engineer
  • Perform general laborer work such as loading, unloading and moving materials, and running errands for the Engineering Department
  • Lamp replacement and cleaning of fixtures. This does not include repair or replacement of fixtures, electric cords, outlets or ballasts
  • Furniture moving, modular systems breakdown and set-up
  • Preventative Maintenance in all restrooms
  • Assist Journeyman Engineers whenever needed.
What we offer
What we offer
  • paid time off policies
  • health, dental, vision, life insurance
  • savings accounts
  • tuition reimbursement
  • paid volunteering
  • employer sponsored 401(k) plan
  • Fulltime
Read More
Arrow Right