CrawlJobs Logo
Perplexity Logo Perplexity · IT - Software Development

Model Behavior Architect

United States, San Francisco 180000.00 - 260000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

We're looking for a Model Behavior Architect to help build Perplexity's AI products and evaluations. You'll sit within our AI team and collaborate closely with research and product teams, designing prompt and context engineering strategies to deliver high quality user experiences across multiple domains and models. This role is equal parts craft and science. You'll develop a deep understanding of our answer engine by pressure-testing model capabilities and working across our AI infrastructure (including system and tool prompts, skills, and evaluations) to create a stellar product experience for our users. You'll serve as a go-to expert on prompting, model quality, and behavioral consistency across new product features and model releases.

Job Responsibility

  • Context Engineering: Design, test, and optimize context strategies and system prompts that shape answer engine behavior across products, features, and use cases
  • Evaluation Systems: Build automated and semi-automated evaluation pipelines that measure model quality, catch regressions, and scale across product surfaces
  • Model Launch Support: Partner with research and engineering to validate model behavior before and during rollouts, ensuring smooth transitions with no degradation
  • Research & Analysis: Identify inconsistencies and failure modes in model outputs through well-designed research projects — for both internal and production-facing systems
  • Cross-functional Collaboration: Work closely with design, product, and research teams to translate product goals into concrete model behavior requirements
  • Knowledge Sharing: Help engineers across teams build intuition for prompt design, context engineering, and evaluation best practices
  • Staying Current: Track the latest alignment, evaluation, and prompting techniques from industry and academia, and bring the best ideas back to the team

Requirements

  • Experience designing evaluations, benchmarks, or metrics for AI systems
  • Strong written and verbal communication skills, particularly in explaining complex concepts to diverse stakeholders
  • Ability to manage multiple concurrent projects in a fast-moving environment
  • Strong experience with Perplexity or other frontier AI models in production settings
  • Demonstrated experience with Python — you'll prototype, debug, automate, and build systems at scale
  • 3+ years of experience working with LLMs in a product or research setting

Nice to have

  • Experience with A/B testing or experimentation frameworks
  • Track record of improving AI system performance through systematic evaluation and iteration

What we offer

  • equity
  • health
  • dental
  • vision
  • retirement
  • fitness
  • commuter and dependent care accounts
Perplexity - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Model Behavior Architect

8 matching positions

Research Engineer Robotics (Systems)

Reality Labs Research (RL-R) brings together a diverse and highly interdisciplin...
Location
Location
United States , Redmond
Salary
Salary:
183997.00 - 257000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Bachelor's degree in Computer Science, Computer Engineering, Robotics, or related technical field (or equivalent practical experience)
  • 5+ years of experience in robotics engineering, including hands-on work with robotic platforms in industry or academic research settings
  • Demonstrated experience with machine learning systems in a robotics context (e.g., learned control policies, perception models, or ML-driven planning)
  • Full-stack systems engineering experience designing, building, and maintaining large-scale software-hardware systems
  • Track record of driving complex, ambiguous technical projects from conception through delivery with minimal direction
  • Experience communicating technical decisions and system designs to cross-functional stakeholders across research and engineering functions (e.g., design documents, technical reviews, project proposals)
Job Responsibility
Job Responsibility
  • Architect & Own Real-Time Robotic Systems: Design and maintain real-time dexterous manipulation pipelines that integrate perception, planning, and control across multiple robotic platforms. Drive architectural decisions that enable rapid research iteration at scale
  • Lead Data Capture & Retargeting Infrastructure: Architect motion capture integration, novel hardware prototypes, and human demonstration data collection systems. Build scalable processing pipelines for large multimodal datasets that enable efficient model training and real2sim transfer
  • Drive ML-Systems Integration: Deploy and iterate on learned control policies (imitation learning, MPC, reinforcement learning) within full robotic systems. Partner with research teams to bridge the gap between algorithmic advances and real-world system performance
  • Optimize Performance & System Reliability: Own runtime performance, debug complex system behaviors across the stack, and develop interactive demos and benchmarks that demonstrate research progress
  • Set Technical Direction: Identify and drive cross-cutting technical improvements. Influence roadmap and priorities through deep system understanding and proactive problem identification
  • Collaborate & Mentor Cross-Functionally: Work with diverse research and engineering teams to refine modules, drive end-to-end system improvements, and elevate the technical capabilities of the broader team
What we offer
What we offer
  • Bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Nxe Production Engineering Senior Manager

The Module Production Engineering Manager provides leadership across multiple te...
Location
Location
United States , Wilton
Salary
Salary:
Not provided
asml.com Logo
ASML
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor or Masters of Science degree in technical domain (e.g. mechanical / electrical / optical / chemical / industrial engineering, mechatronics, physics, or related field) with 10 years (BS) or 8+ years (MS) of relevant work experience in in a technical environment such as quality, manufacturing engineering, or related fields depending on internship experience, and leading a team of matrixed individuals, or 4+ yrs experience managing direct or indirect reports
  • Expert-level knowledge, analytical skills, project leadership experience, strong communication skills
Job Responsibility
Job Responsibility
  • Conduct routine 1:1 meetings with employees to enable career growth and stay in sync with performance and expectations
  • Guide multiple teams or engineering groups of multiple modules
  • mentor Technical Leads, Architects and senior engineers
  • Support work center-level capability planning based on Wilton factory requirements
  • Drive adoption of structured problem solving and continuous improvement in their domain
  • Promote a culture of proactive issue resolution, rather than reactive fire-fighting
  • Facilitate knowledge exchange between engineering, operations, and program management to accelerate learning and reduce silos
  • Encourage diversity and inclusion, leveraging varied perspectives to strengthen decision-making and innovation
  • Develop multi-quarter engineering roadmaps that support Wilton’s factory readiness, capacity, and technology transitions
  • Participate in the appropriate level Tier discussions influencing cross-module problem solving
  • Fulltime
Read More
Arrow Right
New

SoC Architect

WHAT YOU DO AT AMD CHANGES EVERYTHING  At AMD, our mission is to build great pro...
Location
Location
United States , San Jose
Salary
Salary:
200000.00 - 300000.00 USD / Year
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelors or Masters degree in computer engineering/Electrical Engineering
Job Responsibility
Job Responsibility
  • Lead SoC architecture: define processor complex, interconnect/NoC, memory controllers/DRAM topology, IOMMU hierarchy, security islands, and subsystem boundaries
  • write clear architecture specifications and drive reviews to closure
  • Own platform power & reset intent: specify PWROK/PWROKRAW/reset/iso sequencing across rails and domains
  • ensure asynchronous PWROK de‑assertion behavior meets EGADS and safety requirements
  • partner with board/VR teams and FCH/ART owners
  • SOC Features ownership: Define and drive SOC features
  • Static timing analysis definitions: work with IP, process and product teams to define STA strategies
  • High‑speed I/O architecture: architect PCIe Gen5/Gen6 RC/EP topologies, NTB links, Ethernet MAC/PHY integration, clocking, lane bifurcation, and PHY interfaces
  • align controller programming models with NBIO/SYSHUB wrappers
  • Performance, power, and reliability modeling: establish CAC targets for GFX/NPU, guard‑bands/aging models using ARO/RO monitors, and close V/F/tj operating points with mission profiles
  • Fulltime
Read More
Arrow Right
New

Applications Development Sr Programmer Analyst

The JAVA Full Stack Senior Developer role is an intermediate level position resp...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Excellent communication and collaboration skills, with the ability to articulate complex technical concepts to diverse audiences
  • 6+ years of professional experience in full-stack software development, with a proven track record of delivering complex, large-scale, enterprise-level applications
  • 6+ years of hands-on experience designing micro-service-based application
  • Strong hands-on experience with modern JavaScript frameworks, specifically React.js and TypeScript, for building sophisticated user interfaces
  • Deep proficiency in Java and the Spring Boot framework for building enterprise-grade microservices
  • Low-latency, scalable, high-throughput API development (Spring Boot, Hibernate/JPA)
  • Hands-on experience with a major cloud platform (AWS, Azure, or GCP) and containerization technologies (Docker, Kubernetes, OpenShift)
  • Familiarity with CI/CD pipelines (Jenkins, GitHub Actions) is essential
  • Problem-solving, troubleshooting, and clean code (Core Java, J2EE, Collections, Multithreading)
  • API integration (third-party libraries, security)
Job Responsibility
Job Responsibility
  • Utilize mature programming methodologies and languages, including Java Spring Boot and React.js, to deliver and maintain high-quality software solutions
  • Design, develop, test, and deploy end-to-end solutions, from responsive React.js front-end components to resilient Java Spring Boot microservices
  • Architect and implement RESTful APIs and expose backend functionality as MCP (Model Context Protocol) services to be consumed by AI agents
  • Deploy and manage applications within Citi's cloud environment (leveraging OpenShift/Kubernetes and AWS), integrating with cloud-native storage like S3 and enterprise databases like Oracle as a Service (OraaS)
  • Partner with and contribute to a cross-functional team of product managers, designers, and other engineers to translate business requirements into high-quality technical solutions
  • Evaluate and recommend new and emerging technologies, including the application of AI, to solve complex business problems
  • Ensure software components are designed and implemented to be of high quality, reusable, and easily maintainable
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Fulltime
Read More
Arrow Right
New

Senior Principal Architect

We are seeking a deeply technical Senior Principal Architects to define and driv...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in Computer Science or related technical field AND 15+ years of professional software engineering experience, or equivalent practical experience
  • 8+ years of senior technical leadership experience influencing engineers, technical leads, architects, applied scientists, or cross-functional engineering teams across complex platform or product areas
  • Proven experience architecting and delivering large-scale production systems with meaningful reliability, scalability, latency, correctness, availability, security, and operational requirements
  • Deep technical experience in one or more of the following platform areas: AI/ML systems, agentic systems, model-serving infrastructure, decisioning systems, distributed systems, data platforms, workflow platforms, risk platforms, security platforms, or Trust & Safety systems
  • Experience building or technically leading production AI/ML systems, including exposure to modern AI patterns such as LLM-based workflows, retrieval-augmented generation, model orchestration, automated reasoning, human-in-the-loop systems, AI-assisted operational tooling, or agentic workflows
  • Strong understanding of the engineering requirements for deploying AI or decision systems in production, including evaluation, observability, quality measurement, rollout safety, fallback behavior, latency/cost tradeoffs, drift detection, explainability, governance, and operational reliability
  • Experience designing high-integrity systems where decisions must be auditable, reproducible, explainable, governed, and secure, especially when handling sensitive signals, advertiser impact, policy enforcement, risk decisions, or compliance-sensitive workflows
  • Ability to drive clarity from ambiguity, define technical direction, create reusable platform abstractions, and influence execution across multiple teams without relying on direct management authority
  • Strong written and verbal communication skills, including the ability to explain architecture, tradeoffs, risks, sequencing, and technical strategy to senior engineering, science, product, policy, security, and business leaders
Job Responsibility
Job Responsibility
  • AI Platform Architecture and Technical Strategy
  • Define the long-term architecture for the Ads Trust & Safety AI Platform across ingestion, signal acquisition, entity intelligence, retrieval, model orchestration, agentic workflows, decisioning, enforcement, human review, audit, and measurement
  • Translate broad Trust & Safety, Risk, Fraud, Security, and Policy needs into reusable platform capabilities
  • Establish reference architectures, design principles, technical standards, and engineering patterns for high-integrity AI and decisioning systems
  • Drive architecture choices across latency, throughput, quality, cost, explainability, governance, reliability, and operational safety
  • Identify critical platform gaps and create a roadmap that balances near-term delivery with long-term leverage
  • Deep Research Agents and AI-Assisted Investigation
  • Architect platform for Deep Research Agents that investigate domains, landing pages, advertisers, business entities, ownership patterns, web presence, reputation, policy risk, and fraud signals
  • Architect workflows that combine retrieval, crawling, structured evidence extraction, LLM reasoning, policy grounding, risk scoring and human in the loop
  • Architect guardrails for agentic systems, including source provenance, confidence scoring, hallucination controls, audit logs, escalation paths, and human override
  • Fulltime
Read More
Arrow Right
New

Senior Java Technology Lead - Vice President

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree/University degree or equivalent experience, Master's degree preferred
  • 12+ years of relevant Technology experience in Application Development with at least 3+ years in technical leadership
  • Extensive experience in system analysis and in programming of software applications
  • Strong experience in implementing and delivering successful projects
  • Subject Matter Expert (SME) in Securities Financing Transactions Processing is a plus
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated Strong leadership skills
  • Consistently demonstrates clear and concise written and verbal communication
  • Strong core Java skills, JDBC/JPA, Restful web services
  • Strong Experience with frameworks like Hibernate, Junit, Spring Boot/Microservice-style application development
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Own end-to-end solution architecture, including application design, system patterns, data models, APIs, and integration strategies aligned to industry-specific requirements
  • Design and build highly scalable, resilient, and secure enterprise applications using modern architectural patterns (microservices, event-driven, cloud-native)
What we offer
What we offer
  • Discover the top benefits offered to our global workforce, designed to support your well-being, growth and work-life balance
  • Fulltime
Read More
Arrow Right

Member of Technical Staff, Microsoft Robotics

Overview Microsoft’s Discovery and Quantum (MDQ) division develops and delivers...
Location
Location
United States , Redmond
Salary
Salary:
165600.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements is required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Own the multi-year technical architecture for the Microsoft Robotics platform, setting the direction the broader engineering organization, partners, and customers build on, and holding that architecture coherent as it scales across teams and deployments.
  • Make the foundational design decisions that determine how robotics software, AI models, and cloud and edge components fit together, defining the core interfaces and engineering contracts other teams depend on.
  • Architect systems that meet demanding real-world constraints, balancing latency, throughput, compute efficiency, reliability, and cost across cloud and on-robot edge environments.
  • Lead the evaluation and validation strategy that gates what ships, establishing the benchmarks, test approach, and quality bar for autonomy, safety, and task performance across simulation, lab, and field, including safe-autonomy boundaries and human-in-the-loop fallback.
  • Drive the hardest cross-stack technical problems personally, taking on the integration failure modes that emerge where AI models meet production robots, and resolving them through rigorous root-cause analysis of system behavior and field data.
  • Connect classical robotics engineering with modern AI, partnering across foundation-model, perception, manipulation, locomotion, and simulation teams to bring learned capabilities into a common, production-grade platform rather than one-off integrations.
  • Establish the engineering bar for the team, owning design standards and review practices, leading the consequential technical reviews, and lifting the quality, testability, and operability of the systems that matter most.
  • Influence direction across MDQ, Microsoft Research, Azure, hardware and silicon partners, and customers without relying on formal authority, building technical consensus and aligning many teams on a single coherent platform strategy, including representing the platform in the open-source and standards community.
  • Multiply the team's output through technical leadership, mentoring senior and principal engineers and raising the technical ceiling of the organization rather than only its headcount.
  • Track the state of the art across embodied AI, robot learning, robotics middleware, and simulation, and decide deliberately how and when new techniques are incorporated into the platform.
  • Fulltime
Read More
Arrow Right

Senior Marketing Analyst

We are seeking a highly technical and strategic Senior Marketing Analyst to driv...
Location
Location
United States , Miami
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Statistics, Data Science, Economics, or a related field
  • 3–5+ years of experience in marketing analytics, preferably within eCommerce or complex B2C environments
  • Experience working with paid media channels (Google Ads, Meta, programmatic) and CRM/email platforms
  • 1–2+ years of hands-on experience with Adobe Customer Journey Analytics (CJA) and Adobe Journey Optimizer (AJO)
  • Advanced proficiency in Databricks for data manipulation and analysis
  • Strong understanding of multi-touch attribution methodologies (algorithmic, time-decay, custom models)
  • Experience conducting statistical analysis (correlation, regression) to evaluate campaign performance and customer behavior
Job Responsibility
Job Responsibility
  • Architect, maintain, and leverage Adobe Customer Journey Analytics (CJA), Adobe Journey Optimizer (AJO), and Databricks
  • Unify multiple data sources to enable holistic, cross-channel analysis
  • Develop and refine multi-touch attribution models
  • Analyze channel performance across conversion metrics including CPA, AOV, and ROAS
  • Evaluate performance by customer segment
  • Connect marketing spend across channels to key business outcomes (pipeline, revenue, CAC)
  • Provide recommendations for budget allocation and investment optimization
  • Partner with media agencies to assess campaign effectiveness and improve performance
  • Support website and app analytics to improve conversion rates
  • Lead A/B testing analysis across landing pages, creative, targeting, and offers
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
Read More
Arrow Right