CrawlJobs Logo

UX Engineer, LLM Experimentation Platform

arize.com Logo

Arize

Location Icon

Location:
United States

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

175000.00 - 200000.00 USD / Year

Job Description:

You'll work on our LLM evaluation and prompt experimentation platform, taking functional features and refining them into intuitive, polished experiences. We're a technical team building for technical users (ML engineers, researchers) who are drowning in complexity. Your job is to make that complexity manageable and maybe even enjoyable.

Job Responsibility:

  • Refine and iterate on UX for existing features
  • Watch real users struggle in Fullstory, identify friction points, and fix them
  • Prototype interaction alternatives rapidly (in Figma or code) to test different approaches
  • Work closely with our Senior engineers who own feature architecture
  • Own the 'feel' of the product: transitions, feedback, error handling, progressive disclosure
  • Build reusable interaction patterns that the team can leverage
  • Run lightweight usability tests to validate improvements

Requirements:

  • You've made products noticeably better through interaction refinement
  • You're comfortable with modern frontend frameworks and animation libraries
  • You've used session replay tools and incorporated user feedback into designs
  • You can work in Figma to prototype before committing to code
  • You think about edge cases, loading states, and empty states automatically
  • You've worked on complex tools (dev tools, data tools, B2B SaaS) where UX really matters

Nice to have:

You've built or contributed to design systems

What we offer:
  • competitive equity package
  • comprehensive benefits package, including medical, dental, vision
  • a 401(k) plan
  • unlimited paid time off
  • a generous parental leave plan
  • additional support for mental health and wellness
  • WFH monthly stipend to pay for co-working spaces

Additional Information:

Job Posted:
December 20, 2025

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for UX Engineer, LLM Experimentation Platform

Director of AI Engineering

We are entering a hyper-growth phase of AI innovation and are hiring a Director ...
Location
Location
Canada; United States
Salary
Salary:
300000.00 - 450000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10–15+ years in software engineering, with significant leadership experience owning AI/ML or applied LLM systems at scale
  • Proven history shipping LLM-powered features, agentic workflows, or AI assistants used by real customers in production
  • Deep understanding of LLM orchestration frameworks (LangChain, LlamaIndex), RAG pipelines, vector search, embeddings, and prompt engineering
  • Expert in backend & distributed systems (Python strongly preferred) and cloud infrastructure (AWS/GCP)
  • Strong experience with telemetry, observability, and cost-aware real-time inference optimizations
  • Demonstrated ability to lead senior engineers, define technical roadmaps, and deliver outcomes aligned to business metrics
  • Experience building or scaling teams working on experimentation, optimization, personalization, or ML-powered growth systems
  • Exceptional ability to simplify complex problems, set clear standards, and drive alignment across Product, Data, Design, and Engineering
  • Strong product sense, ability to weigh novelty vs. impact, focus on user value, and prioritize speed with guardrails
  • Fluent in integrating AI tools into engineering workflows for code generation, debugging, delivery velocity, and operational efficiency
Job Responsibility
Job Responsibility
  • Define the multi-year technical vision for Apollo’s AI stack, spanning agents, orchestration, inference, retrieval, and platformization
  • Prioritize high-impact AI investments by partnering with Product, Design, Research, and Data leaders to align engineering outcomes with business goals
  • Establish technical standards, evaluation criteria, and success metrics for every AI-powered feature shipped
  • Lead the architecture and deployment of long-horizon autonomous agents, multi-agent workflows, and API-driven orchestration frameworks
  • Build reusable, scalable agentic components that power GTM workflows like research, enrichment, sequencing, lead scoring, routing, and personalization
  • Own the evolution of Apollo’s internal LLM platform for high-scale, low-latency, cost-optimized inference
  • Oversee model-driven experiences for natural-language interfaces, RAG pipelines, semantic search, personalized recommendations, and email intelligence
  • Partner with Product & Design to build intuitive conversational UX that hides underlying complexity while elevating user productivity
  • Implement rigorous evaluation frameworks, including offline benchmarking, human-in-the-loop review, and online A/B experimentation
  • Ensure robust observability, monitoring, and safety guardrails for all AI systems in production
What we offer
What we offer
  • Equity
  • Company bonus or sales commissions/bonuses
  • 401(k) plan
  • At least 10 paid holidays per year
  • Flex PTO
  • Parental leave
  • Employee assistance program and wellbeing benefits
  • Global travel coverage
  • Life/AD&D/STD/LTD insurance
  • FSA/HSA
  • Fulltime
Read More
Arrow Right

Principal AI Engineer

We are looking for a Principal AI Engineer to lead the design and deployment of ...
Location
Location
United States
Salary
Salary:
200000.00 - 300000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of software engineering experience
  • at least 3 years in applied LLM or agentic AI systems (2023–present)
  • proven success in deploying LLM-powered products used by real users at scale
  • deep backend & systems engineering expertise with Python, distributed systems, and scalable APIs
  • familiarity with LangChain, LlamaIndex, or similar orchestration frameworks
  • experience with RAG pipelines, vector DBs, embedding models, and semantic search tuning
  • experience managing performance across cloud providers (e.g., AWS Bedrock, OpenAI, Anthropic, etc.)
  • demonstrated experience building multi-step agents, planning workflows, chaining reasoning steps, and integrating APIs with agent memory/state
  • comfort with advanced prompting strategies, few-shot and chain-of-thought reasoning, and embedding retrieval setups
  • strong understanding of AI system evaluation, human ratings, A/B experimentation, and feedback loop pipelines
Job Responsibility
Job Responsibility
  • Architect and lead the development of multi-agent systems capable of long-horizon planning, reasoning, and API orchestration
  • build reusable agentic components that integrate deeply into sales and marketing processes
  • own and evolve our in-house platform for scalable, low-latency, and cost-efficient LLM and agent deployments
  • lead design of interfaces powered by natural language understanding and retrieval-augmented generation (RAG)
  • build embedding-based, intent-aware search and personalization systems tuned to business user needs
  • drive innovation in personalized outreach generation using context-aware generation pipelines
  • tune inference pipelines, caching layers, and model selection logic for high-scale, cost-aware performance
  • define and drive robust offline and online testing methodologies (A/B, sandboxing, human evals) across agents and LLM flows
  • architect human-in-the-loop systems and telemetry to improve accuracy, UX, and explainability over time
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • 401(k) plan
  • at least 10 paid holidays per year
  • flex PTO
  • parental leave
  • employee assistance program
  • wellbeing benefits
  • global travel coverage
  • life/AD&D/STD/LTD insurance
  • Fulltime
Read More
Arrow Right
New

Senior Product Manager

The Response and conversation experiences (RCX) core team owns the user experien...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years experience as a Technical product / program manager shipping platforms or large‑scale user experiences
  • Systems thinking, demonstrated technical depth in APIs, contracts, front end engineering, telemetry and performance fundamentals
  • Experience building extensibility frameworks (plugins, SDKs, component kits)
  • Proven ability to design and operationalize product evaluation & instrumentation (quality metrics, automated gates, AB testing, scorecards)
  • Strong track record of driving partner integrations at scale across multiple teams
Job Responsibility
Job Responsibility
  • UX platform ownership: Define contracts, APIs, runtime controls and shared UX patterns that power Copilot across surfaces
  • UX extensibility: Land partner integrations across M365 apps, frameworks to add domain‑specific capabilities at scale
  • Instrumentation & evaluation: Frameworks to ensure faster metrics onboarding, automated LLM based evaluations of UX quality
  • Performance & reliability: Measurably improve product performance, memory management and live site handling
  • Agility: Own the products, tools, and processes to ensure faster experimentation
  • Fulltime
Read More
Arrow Right

Senior Design Technologist

At Capgemini Invent, we believe difference drives change. As inventive transform...
Location
Location
United States , San Francisco
Salary
Salary:
100000.00 - 150000.00 USD / Year
frog.co Logo
frog
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Professional experience designing and developing user interfaces, UX concepts, web sites and applications on a variety of platforms, frameworks, and methodologies
  • Ability to collaborate with a multi-disciplinary team of designers and strategists
  • A background in data management and manipulation to support data specific needs and concepts
  • Ability to communicate with clients directly and complete program and workstream tasks autonomously in some cases
  • Exceptional written and verbal communications skills along with experience in preparing and delivering documentation, proposals, presentations, and structured working sessions to all levels in a client organization
  • Bachelor’s Degree in the sciences, engineering, or creative discipline or equivalent experience
  • Proficiency in: Modern web front-end application development
  • Working within Cloud platforms (e.g., AWS, GCP, Azure, etc.)
  • Source control (e.g., GitHub, GitLab) and toolchain integrations
  • Third-party API integrations
Job Responsibility
Job Responsibility
  • Design Technologists at frog blend futurist vision and practical thinking, serving as hands-on organizers of technical insights, experiments, proofs, and models
  • Bridge the gap between creative design services, technology strategy, and software engineering
  • Drive technology platform research, experimentation, concept exploration, prototyping, and ideation within the creative process of designing user experiences
  • Leverage and manage data to support technical needs ranging from AI applications to impact assessments
  • Gather, ingest, and utilize data from diverse modalities to advance project goals
  • Identify and analyze current and emerging UX technology patterns and trends
  • Conduct in-depth investigations and experiments with new platforms and frameworks
  • Spot new opportunities for business value and UX innovation through technology enablers
  • Work closely with the creative team to translate design assets into user experience simulations, interactive prototypes, technical proofs-of-concept, and UI/presentation layers
  • Embrace a maker and tinkerer mindset—technically adept, passionate about design, and eager to tackle challenges hands-on
What we offer
What we offer
  • Flexible work
  • Healthcare including dental, vision, mental health, and well-being programs
  • Financial well-being programs such as 401(k) and Employee Share Ownership Plan
  • Paid time off and paid holidays
  • Paid parental leave
  • Family building benefits like adoption assistance, surrogacy, and cryopreservation
  • Social well-being benefits like subsidized back-up child/elder care and tutoring
  • Mentoring, coaching and learning programs
  • Employee Resource Groups
  • Disaster Relief
  • Fulltime
Read More
Arrow Right
New

Pat Testing Engineer

As a PAT Testing Engineer for BES Electrical, you will be carry out PAT Testing ...
Location
Location
United Kingdom , Crawley
Salary
Salary:
27742.00 - 35000.00 GBP / Year
besgroup.com Logo
BES Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Demonstrate a positive, diverse and inclusive attitude to both internal and external customers and colleagues
  • Flexible approach to working, able and willing to work overtime to cover workloads during busy periods
  • Hard-working, conscientious commercial engineer that takes satisfaction from delivering a great service to our prestigious client base
  • Good level of computer literacy
  • Full driving licence and own vehicle
Job Responsibility
Job Responsibility
  • Carry out PAT tests on electrical appliances to ensure they pass compliance checks
  • Ensure all appliances are properly labelled with Pass/Fail labels
  • Provide good customer service and be in the commercial industry
  • Carry out all and any necessary training within the field
  • Manage your time effectively to ensure work is carried out to a high standard in a timely manner
  • Ensure Health & Safety Procedures are followed
What we offer
What we offer
  • Annual car cash allowance
  • Company Pension Scheme
  • Annual salary review
  • 20 days annual leave plus 8 bank holidays
  • An extra day’s holiday to take on Christmas Eve each year
  • Opportunity for flexible working
  • Discounts and savings via our employee benefits portal
  • Health and wellbeing support via our Employee Assistance Programme
  • Company wide volunteering scheme
  • Fundraising support for your chosen charity
  • Fulltime
Read More
Arrow Right
New

Food Service Worker

The Food Service Worker will assist the manager with food/meal preparation; main...
Location
Location
United States , West Chester
Salary
Salary:
Not provided
aramark.co.uk Logo
Aramark UK
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Food Service Certificate as needed
  • Sufficient education or training to read, write, and follow verbal and written instructions
  • Be able to work quickly and concisely under pressure
Job Responsibility
Job Responsibility
  • Prepare quality food and baked goods according to a planned menu
  • Prepare a daily report that verifies transactions
  • Understand what is inclusive of a meal
  • Ensure storage of food in an accurate and sanitary manner
  • Serve food according to meal schedules, department policies and procedures
  • Use and care of kitchen equipment, especially knives
  • Timely preparation of a variety of food items, beverages
  • Add garnishments to ensure customer happiness and eye appeal
  • Coordinate and assist in major cleaning of refrigerators, freezers, and cooking and serving equipment
  • Adhere to all food safety regulations for sanitation, food handling, and storage
What we offer
What we offer
  • Complimentary lunch
  • support with uniform footwear
  • additional benefits
  • Parttime
Read More
Arrow Right
New

Administrative Assistant

Join a leading organization dedicated to delivering exceptional patient care and...
Location
Location
United States , Palo Alto
Salary
Salary:
45.80 - 50.89 USD / Hour
aquent.com Logo
Aquent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Be authorized to work in the United States
  • Not require sponsorship of any kind for the duration of the assignment
  • Be able to work on a W-2 basis
  • High school diploma
  • Typing speed of 30 words per minute
  • Proficiency in using multiple computer programs simultaneously
  • Excellent verbal and written communication skills
  • Strong customer service orientation
  • Self-motivated with the ability to effectively prioritize tasks
  • Ability to work comfortably at both stationary and mobile workstations, requiring periods of sitting and standing
Job Responsibility
Job Responsibility
  • Complete patient admission and registration processes in accordance with established policies and procedures
  • Obtain and accurately document required deductibles, co-payments, and deposits
  • Secure necessary patient signatures on all legal and administrative documents
  • Safeguard patient valuables following departmental guidelines
  • Perform timely scanning of all related documentation into the electronic system before the end of your shift
  • Utilize various online systems to obtain and verify insurance and patient demographic information
  • Prioritize tasks effectively during high-volume periods to maintain quality registrations, enhance customer service, and support operational efficiency
  • Foster strong cooperative relationships with both administrative and clinical staff, providing necessary documents and supplies promptly
  • Process updates and notifications from clinical teams in a timely manner
  • Collaborate effectively within a team environment, offering and seeking assistance as needed, and consistently producing high-quality work with minimal supervision
What we offer
What we offer
  • Subsidized health, vision, and dental plans
  • Paid sick leave
  • Retirement plans with a match
  • Fulltime
Read More
Arrow Right
New

Emerge Developer

Development of complex information systems in eMerge. Learning and expertise in ...
Location
Location
Israel , Holon
Salary
Salary:
Not provided
Sapiens
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Computer Science graduate – Must
  • SQL at a high level - Must
  • Ability to work both within a team and independently
  • Self-learning
  • Excellent interpersonal skills
Job Responsibility
Job Responsibility
  • Development of complex information systems in eMerge
  • Learning and expertise in SQL and with unique internal technology
  • Fulltime
Read More
Arrow Right