CrawlJobs Logo

UX Engineer, LLM Experimentation Platform

arize.com Logo

Arize

Location Icon

Location:
United States

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

175000.00 - 200000.00 USD / Year

Job Description:

You'll work on our LLM evaluation and prompt experimentation platform, taking functional features and refining them into intuitive, polished experiences. We're a technical team building for technical users (ML engineers, researchers) who are drowning in complexity. Your job is to make that complexity manageable and maybe even enjoyable.

Job Responsibility:

  • Refine and iterate on UX for existing features
  • Watch real users struggle in Fullstory, identify friction points, and fix them
  • Prototype interaction alternatives rapidly (in Figma or code) to test different approaches
  • Work closely with our Senior engineers who own feature architecture
  • Own the 'feel' of the product: transitions, feedback, error handling, progressive disclosure
  • Build reusable interaction patterns that the team can leverage
  • Run lightweight usability tests to validate improvements

Requirements:

  • You've made products noticeably better through interaction refinement
  • You're comfortable with modern frontend frameworks and animation libraries
  • You've used session replay tools and incorporated user feedback into designs
  • You can work in Figma to prototype before committing to code
  • You think about edge cases, loading states, and empty states automatically
  • You've worked on complex tools (dev tools, data tools, B2B SaaS) where UX really matters

Nice to have:

You've built or contributed to design systems

What we offer:
  • competitive equity package
  • comprehensive benefits package, including medical, dental, vision
  • a 401(k) plan
  • unlimited paid time off
  • a generous parental leave plan
  • additional support for mental health and wellness
  • WFH monthly stipend to pay for co-working spaces

Additional Information:

Job Posted:
December 20, 2025

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for UX Engineer, LLM Experimentation Platform

Director of AI Engineering

We are entering a hyper-growth phase of AI innovation and are hiring a Director ...
Location
Location
Canada; United States
Salary
Salary:
300000.00 - 450000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10–15+ years in software engineering, with significant leadership experience owning AI/ML or applied LLM systems at scale
  • Proven history shipping LLM-powered features, agentic workflows, or AI assistants used by real customers in production
  • Deep understanding of LLM orchestration frameworks (LangChain, LlamaIndex), RAG pipelines, vector search, embeddings, and prompt engineering
  • Expert in backend & distributed systems (Python strongly preferred) and cloud infrastructure (AWS/GCP)
  • Strong experience with telemetry, observability, and cost-aware real-time inference optimizations
  • Demonstrated ability to lead senior engineers, define technical roadmaps, and deliver outcomes aligned to business metrics
  • Experience building or scaling teams working on experimentation, optimization, personalization, or ML-powered growth systems
  • Exceptional ability to simplify complex problems, set clear standards, and drive alignment across Product, Data, Design, and Engineering
  • Strong product sense, ability to weigh novelty vs. impact, focus on user value, and prioritize speed with guardrails
  • Fluent in integrating AI tools into engineering workflows for code generation, debugging, delivery velocity, and operational efficiency
Job Responsibility
Job Responsibility
  • Define the multi-year technical vision for Apollo’s AI stack, spanning agents, orchestration, inference, retrieval, and platformization
  • Prioritize high-impact AI investments by partnering with Product, Design, Research, and Data leaders to align engineering outcomes with business goals
  • Establish technical standards, evaluation criteria, and success metrics for every AI-powered feature shipped
  • Lead the architecture and deployment of long-horizon autonomous agents, multi-agent workflows, and API-driven orchestration frameworks
  • Build reusable, scalable agentic components that power GTM workflows like research, enrichment, sequencing, lead scoring, routing, and personalization
  • Own the evolution of Apollo’s internal LLM platform for high-scale, low-latency, cost-optimized inference
  • Oversee model-driven experiences for natural-language interfaces, RAG pipelines, semantic search, personalized recommendations, and email intelligence
  • Partner with Product & Design to build intuitive conversational UX that hides underlying complexity while elevating user productivity
  • Implement rigorous evaluation frameworks, including offline benchmarking, human-in-the-loop review, and online A/B experimentation
  • Ensure robust observability, monitoring, and safety guardrails for all AI systems in production
What we offer
What we offer
  • Equity
  • Company bonus or sales commissions/bonuses
  • 401(k) plan
  • At least 10 paid holidays per year
  • Flex PTO
  • Parental leave
  • Employee assistance program and wellbeing benefits
  • Global travel coverage
  • Life/AD&D/STD/LTD insurance
  • FSA/HSA
  • Fulltime
Read More
Arrow Right

Principal AI Engineer

We are looking for a Principal AI Engineer to lead the design and deployment of ...
Location
Location
United States
Salary
Salary:
200000.00 - 300000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of software engineering experience
  • at least 3 years in applied LLM or agentic AI systems (2023–present)
  • proven success in deploying LLM-powered products used by real users at scale
  • deep backend & systems engineering expertise with Python, distributed systems, and scalable APIs
  • familiarity with LangChain, LlamaIndex, or similar orchestration frameworks
  • experience with RAG pipelines, vector DBs, embedding models, and semantic search tuning
  • experience managing performance across cloud providers (e.g., AWS Bedrock, OpenAI, Anthropic, etc.)
  • demonstrated experience building multi-step agents, planning workflows, chaining reasoning steps, and integrating APIs with agent memory/state
  • comfort with advanced prompting strategies, few-shot and chain-of-thought reasoning, and embedding retrieval setups
  • strong understanding of AI system evaluation, human ratings, A/B experimentation, and feedback loop pipelines
Job Responsibility
Job Responsibility
  • Architect and lead the development of multi-agent systems capable of long-horizon planning, reasoning, and API orchestration
  • build reusable agentic components that integrate deeply into sales and marketing processes
  • own and evolve our in-house platform for scalable, low-latency, and cost-efficient LLM and agent deployments
  • lead design of interfaces powered by natural language understanding and retrieval-augmented generation (RAG)
  • build embedding-based, intent-aware search and personalization systems tuned to business user needs
  • drive innovation in personalized outreach generation using context-aware generation pipelines
  • tune inference pipelines, caching layers, and model selection logic for high-scale, cost-aware performance
  • define and drive robust offline and online testing methodologies (A/B, sandboxing, human evals) across agents and LLM flows
  • architect human-in-the-loop systems and telemetry to improve accuracy, UX, and explainability over time
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • 401(k) plan
  • at least 10 paid holidays per year
  • flex PTO
  • parental leave
  • employee assistance program
  • wellbeing benefits
  • global travel coverage
  • life/AD&D/STD/LTD insurance
  • Fulltime
Read More
Arrow Right

Principal Product Designer, Trust

Trust Design shapes the systems that make Cash App safe, transparent, and access...
Location
Location
United States , Bay Area
Salary
Salary:
251600.00 - 377400.00 USD / Year
block.xyz Logo
Block
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in product or UX design
  • A portfolio demonstrating impact in trust, identity, access, or safety-related products
  • Experience designing for AI-driven or automated systems - where context, prediction, and user control intersect
  • Mastery in interaction, visual, and systems design, with proven ability to ship high-impact work
  • Fluency in LLM and agentic workflows, and curiosity about how AI reshapes product design
  • Exceptional storytelling and cross-functional communication skills
  • A growth mindset - curious, experimental, and adaptable to emerging tools and paradigms
Job Responsibility
Job Responsibility
  • Design for confidence and clarity, balancing customer safety, access, and autonomy in every experience
  • Create AI-native experiences, designing for and with LLMs, automation, and context-aware systems—translating their capabilities into intuitive and ethical products
  • Think systemically across complex domains like risk, identity, and security, bringing coherence to multi-surface ecosystems
  • Deliver high-craft design, caring deeply about detail - from motion and hierarchy to how systems scale seamlessly across platforms
  • Act as a mentor and multiplier, helping others grow through critique, modeling high craft, and instilling design principles that scale
  • Partner collaboratively with product, ML, data, and engineering to ship real outcomes - not just artifacts
What we offer
What we offer
  • Remote work
  • medical insurance
  • flexible time off
  • retirement savings plans
  • modern family planning
  • Fulltime
Read More
Arrow Right

Senior Design Technologist

At Capgemini Invent, we believe difference drives change. As inventive transform...
Location
Location
United States , San Francisco
Salary
Salary:
100000.00 - 150000.00 USD / Year
frog.co Logo
frog
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Professional experience designing and developing user interfaces, UX concepts, web sites and applications on a variety of platforms, frameworks, and methodologies
  • Ability to collaborate with a multi-disciplinary team of designers and strategists
  • A background in data management and manipulation to support data specific needs and concepts
  • Ability to communicate with clients directly and complete program and workstream tasks autonomously in some cases
  • Exceptional written and verbal communications skills along with experience in preparing and delivering documentation, proposals, presentations, and structured working sessions to all levels in a client organization
  • Bachelor’s Degree in the sciences, engineering, or creative discipline or equivalent experience
  • Proficiency in: Modern web front-end application development
  • Working within Cloud platforms (e.g., AWS, GCP, Azure, etc.)
  • Source control (e.g., GitHub, GitLab) and toolchain integrations
  • Third-party API integrations
Job Responsibility
Job Responsibility
  • Design Technologists at frog blend futurist vision and practical thinking, serving as hands-on organizers of technical insights, experiments, proofs, and models
  • Bridge the gap between creative design services, technology strategy, and software engineering
  • Drive technology platform research, experimentation, concept exploration, prototyping, and ideation within the creative process of designing user experiences
  • Leverage and manage data to support technical needs ranging from AI applications to impact assessments
  • Gather, ingest, and utilize data from diverse modalities to advance project goals
  • Identify and analyze current and emerging UX technology patterns and trends
  • Conduct in-depth investigations and experiments with new platforms and frameworks
  • Spot new opportunities for business value and UX innovation through technology enablers
  • Work closely with the creative team to translate design assets into user experience simulations, interactive prototypes, technical proofs-of-concept, and UI/presentation layers
  • Embrace a maker and tinkerer mindset—technically adept, passionate about design, and eager to tackle challenges hands-on
What we offer
What we offer
  • Flexible work
  • Healthcare including dental, vision, mental health, and well-being programs
  • Financial well-being programs such as 401(k) and Employee Share Ownership Plan
  • Paid time off and paid holidays
  • Paid parental leave
  • Family building benefits like adoption assistance, surrogacy, and cryopreservation
  • Social well-being benefits like subsidized back-up child/elder care and tutoring
  • Mentoring, coaching and learning programs
  • Employee Resource Groups
  • Disaster Relief
  • Fulltime
Read More
Arrow Right
New

Senior financial analyst- accounts receivable

Our client, a leading organization in the Insurance sector, is seeking an experi...
Location
Location
Canada , Markham
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
January 12, 2026
Flip Icon
Requirements
Requirements
  • A recognized Accounting designation is highly preferred (CGA, CMA, or CPA)
  • Proven, hands-on experience with accounting operations and reconciliations, particularly within a large data environment
  • Exceptional attention to detail and the ability to efficiently work with large amounts of data
  • Proficient problem-solving skills are essential, specifically the ability to rigorously investigate and resolve financial variances and reconciliation issues
  • Direct experience working with AR subledger systems and the Oracle Fusion financial platform
Job Responsibility
Job Responsibility
  • Execute full-cycle Accounts Receivable (AR) finance operations daily
  • Perform daily tracking of all AR activities and execute necessary month-end GL bookings specifically related to AR
  • Conduct monthly AR transactions reconciliation and reconcile AR positions at each period end
  • Prepare and process necessary journal bookings as part of the financial close process
  • Collaborate directly with Billing Operations teams to perform complex investigations and variance analysis
  • Assess the appropriateness of accounting operations for accounts receivables to ensure compliance and accuracy
  • Drive continuous improvement by identifying, documenting, and implementing process improvements for AR finance operations
What we offer
What we offer
  • 1-Year Contract: Secure, full-time contract role offering continuity and experience with a top-tier client
  • Impactful Role: Direct opportunity to implement process improvements and enhance the quality of core accounting operations
  • Executive Exposure: Work closely with operational teams and contribute to the accuracy of the General Ledger (GL)
  • Fulltime
Read More
Arrow Right
New

Credit and Collections Specialist

Randstad is searching for a Credit and Collections Specialist for one of our thr...
Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
January 15, 2026
Flip Icon
Requirements
Requirements
  • At least three years’ experience with high volume Collections
  • Experience communicating with clients regarding delinquent accounts
  • Experience preparing and sending collection e-mails
  • Experience obtaining information for clients
  • Experience negotiating payment plans
  • Experience researching, analyzing and resolving problems
  • Experience performing account reconciliations
  • Experience assisting appropriate billing issues
  • Experience reaching out to clients (call centre environment)
  • Strong understanding of accounting
Job Responsibility
Job Responsibility
  • Set payment collection goals and targets, and measure achievements
  • Monitor and collect past due by contacting clients via telephone or email
  • Ensure that the correct amounts are collected in a timely manner, resolve account discrepancies to secure client payments
  • Review accounts, client payments, credit history, and develop new or improved repayment terms
  • Ensure payment is applied correctly by performing account/payment reconciliations
  • Maintain and update accurately aging reports to minimize discrepancies, increasing collections and identifying uncollectible amounts
  • Handle internal and external customers inquiries and resolve account disputes or billing discrepancies to facilitate payment in timely manner
  • Maintain and update customer database ensuring accuracy and reliability of automated system for billing and receivable
  • Perform Credit Check for onboarding new clients as per company policy
  • Verify details and perform all due diligence before opening new accounts
What we offer
What we offer
  • Easily accessible by transit
  • Competitive hourly rate
  • Inclusive Team Culture
  • Unlimited Free Access to Udemy online training
  • Fulltime
Read More
Arrow Right
New

Parts and Components Specialist

Parts & Components Specialist – Estevan, SK. Are you an experienced Heavy Equipm...
Location
Location
Canada , Estevan
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
January 15, 2026
Flip Icon
Requirements
Requirements
  • Journeyperson Heavy Equipment Technician (HET) certification preferred
  • 3rd or 4th year apprentices may be considered
  • Previous experience repairing or troubleshooting Caterpillar general line components (asset)
  • Engine, hydraulic, or transmission rebuild experience (asset)
  • Familiarity with Caterpillar SIS/ET systems an advantage
  • Strong mechanical aptitude and a safety-first mindset
  • Excellent documentation, organizational, and communication skills
  • Valid Class 5 driver’s license with a clean abstract
Job Responsibility
Job Responsibility
  • Perform disassembly and assembly of Caterpillar components including transmissions, drives, brakes, pumps, and valves
  • Conduct detailed part and component inspections according to OEM reusability guidelines
  • Utilize Caterpillar SIS and ET daily for diagnostics, technical reference, and documentation
  • Complete all service documentation accurately and on time (inspection sheets, service reports, add sheets)
  • Collaborate with Service Supervisors, Lead Hands, and other internal teams to meet production and quality targets
  • Maintain a clean, safe, and organized work area while adhering to all safety procedures and standards
What we offer
What we offer
  • Competitive starting wage with bonus opportunities
  • Paid breaks, vacation, sick, and flex time
  • Comprehensive health, dental, and vision benefits
  • RRSP matching and Employee Share Purchase Plans
  • Tool and boot allowances + company-provided specialty tools
  • Relocation assistance or sign-on incentives may be available
  • CAT Dealer training and career advancement opportunities
  • Safety-first, team-oriented environment
  • Fulltime
Read More
Arrow Right
New

Senior executive - broadcast

Location
Location
India , Mumbai
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
January 08, 2026
Flip Icon
Requirements
Requirements
  • Bachelor’s degree
  • Minimum 5-7 years of experience in administration or office management
  • Strong organizational, multitasking, and time-management skills
  • Excellent written and verbal communication skills
  • Proficiency in MS Office (Word, Excel, PowerPoint) and office management software
  • Ability to work independently and as part of a team
  • Leadership and supervisory experience preferred
  • Strong problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Plan, organize, and oversee daily administrative operations and office activities
  • Manage office facilities, supplies, equipment, and vendor relationships
  • Prepare and review reports, presentations, and correspondence
  • Supervise and mentor administrative and support staff
  • Liaise with internal departments and external stakeholders to facilitate communication and collaboration
  • Handle confidential information with discretion and maintain records management systems
  • Assist in budget planning and monitor administrative expenditure
  • Support the execution of special projects and events as assigned by senior leadership
Read More
Arrow Right
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.