CrawlJobs Logo

Software Engineer, Evaluation Frontend

· Job Posted February 20, 2026
Apply Position
Job Link Share

Job Description

As an Evaluation Frontend Software Engineer, you will play a key role in helping us make modelling decisions based on experimental outcomes for our large language models (LLMs). Your primary focus will be on building tools to enable easy visualization and analysis of model evaluations which are stored in a central database. You will work closely with cross-functional teams, including researchers and engineers, to surface the insights that are necessary for the future development of our models. This role combines expertise in statistics, data science, frontend development and data visualization.

Job Responsibility

  • Design tools and visualizations that enable researchers and engineers to compare and analyse hundreds of model evaluations
  • Develop an understanding of the relative merits and limitations of each of our model evaluations, as well as suggest new facets of model evaluation

Requirements

  • Extremely strong software engineering skills
  • Strong statistical skills and experience evaluating scientific experiments related to data collection and model performance
  • Prior experience building front-end visualization systems and dashboards
  • Familiarity with ML systems evaluations
  • Proficiency in programming languages such as Python and ML frameworks (e.g., PyTorch, TensorFlow, JAX)
  • Excellent communication skills to collaborate effectively with cross-functional teams and present findings
  • One or more papers at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)

What we offer

  • An open and inclusive culture and work environment
  • Work closely with a team on the cutting edge of AI research
  • Weekly lunch stipend, in-office lunches & snacks
  • Full health and dental benefits, including a separate budget to take care of your mental health
  • 100% Parental Leave top-up for up to 6 months
  • Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
  • Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
  • 6 weeks of vacation (30 working days!)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer, Evaluation Frontend

8 matching positions

Software Engineer, Frontend / Full Stack (Trading)

We’re hiring a Senior Frontend / Fullstack Software Engineer to help build and o...
Location
Location
Salary
Salary:
200000.00 - 250000.00 USD / Year
phantom.app Logo
Phantom
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelors degree in Computer Science or related technical field or equivalent practical experience
  • 5+ years full-time software engineering experience
  • React / Typescript / React Native
  • Demonstrated interest in open and community-driven platforms
  • English language proficiency
Job Responsibility
Job Responsibility
  • Build and own the asset discovery experience across tokens, perpetuals, and prediction markets
  • Design, build, and scale systems that help users explore, evaluate, and engage with tradable assets
  • Feature development on web and mobile platforms (Phantom Extension, Phantom Terminal, mobile app)
  • Lead initiatives to add support for other blockchains and launch new products or infrastructure
  • Interface directly with end-users and developers to collect feedback
  • Work with the team to foster a culture of raising the bar with each new hire
What we offer
What we offer
  • Competitive salary and equity
  • Comprehensive insurance (medical/dental/vision) — 100% covered
  • Stipend for your ideal remote set-up
  • Flexible hours and a supportive remote environment
  • Unlimited vacation
  • 401(k) retirement plan
  • Monthly wellness benefit
  • Weekly meal benefit
  • Global off-sites
  • Fulltime
Read More
Arrow Right

Software Engineer, Frontend

As a Frontend Engineer at Mercor, you’ll join a small, product-driven engineerin...
Location
Location
United States , San Francisco
Salary
Salary:
130000.00 USD / Year
mercor.com Logo
Mercor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong coding fundamentals and proficiency in JavaScript/TypeScript (React + Next.js stack)
  • Understanding of frontend architecture, state management, and design patterns
  • Familiarity with APIs, data fetching, and performance optimization
  • Ability to thrive in ambiguous, fast-moving environments with high ownership
  • Strong design sense and empathy for end-users
  • Curiosity, grit, and a bias toward simple solutions to complex problems
  • Strong communication skills and ability to articulate technical and product tradeoffs
  • Excited and curious about Mercor
Job Responsibility
Job Responsibility
  • Design and build intuitive, performant user interfaces that scale across platforms
  • Integrate APIs and data flows seamlessly with backend systems
  • Collaborate with design and product teams to take concepts from wireframes to production
  • Write clean, maintainable React/TypeScript code and contribute to frontend documentation
  • Participate in design reviews, code reviews, and retrospectives
  • Solve complex product and technical challenges under real-world constraints
  • Contribute to systems that power training, evaluation, and scaling for leading AI labs
What we offer
What we offer
  • Generous equity grant vested over 4 years
  • A $20K relocation bonus (if moving to the Bay Area)
  • A $10K housing bonus (if you live within 0.5 miles of our office)
  • A $1K monthly stipend for meals
  • Free Equinox membership
  • Health insurance
  • Fulltime
Read More
Arrow Right

Senior Frontend Software Engineer

ActiveCampaign is the autonomous marketing platform for people at the heart of t...
Location
Location
United States , Chicago
Salary
Salary:
147600.00 - 180400.00 USD / Year
activecampaign.com Logo
ActiveCampaign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of hands-on experience with JavaScript, both in the browser and within CLI (Node.js) environments
  • Deep understanding of JavaScript and TypeScript fundamentals (closures, event loop, type narrowing, generics, etc.)
  • Strong, proven skills with React, specifically in high-growth environments with rapidly evolving needs
  • Expertise in micro-frontend architectures, including hands-on experience with Module Federation and modern build systems like Nx, Rspack, or Webpack
  • Command of Git and CI/CD pipelines, with a focus on streamlining deployment and ensuring high engineering standards
  • Experience with agentic coding and familiarity with monitoring tools like Grafana (including Faro)
  • A quality-driven mindset, featuring a strong focus on testing, ownership, and the ability to iterate repeatedly
  • Data literacy, including at least a basic knowledge of SQL with the ability to write queries for reading and writing data
  • Exceptional collaborative skills, with a proven ability to deliver value while navigating change in a fast-paced setting
Job Responsibility
Job Responsibility
  • Create and evolve new UI based on intricate designs and prototypes, ensuring technical feasibility and aesthetic precision
  • Develop and maintain Design System components to ensure a consistent, scalable, and high-quality user interface across the entire platform
  • Evaluate and optimize performance, meticulously analyzing browser rendering and API data loading to ensure peak efficiency
  • Collaborate cross-functionally with Product, Security, DevOps, DataOps, and SRE teams to drive integrated and influential technical solutions
  • Advocate for excellence by upholding rigorous coding standards, participating in deep code reviews, and mentoring others on best practices
  • Drive operational health by monitoring alerts and escalations to ensure all customer requirements are met with precision
  • Participate in an on-call rotation, ensuring the continuous reliability and stability of our mission-critical applications
What we offer
What we offer
  • Comprehensive Health & Wellness: Top-tier benefits package that includes a fully-covered High Deductible Health Plan (HDHP), complimentary access to telehealth services, and a free subscription to Calm
  • Growth & Development: Access to LinkedIn Learning, professional development programs, and career growth opportunities in a fast-growing organization
  • Generous Paid Time Off: Recharge and take the time you need to maintain work-life balance with open PTO
  • Total Rewards: Generous 401(k) matching with immediate vesting, quarterly perks with commuter and lunch benefits for hub based employees or a stipend for remote workers, and a four-week paid sabbatical with bonus after five years
  • Collaborative Culture: Work alongside brilliant, passionate colleagues in an environment that values innovation, teamwork, and mutual support
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Frontend

SafetyCulture engineers will work on new and existing products that directly imp...
Location
Location
Australia , Sydney
Salary
Salary:
Not provided
safetyculture.com Logo
SafetyCulture
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or related technical field, or equivalent practical experience
  • 7+ years relevant experience in software development and mentorship experience
  • Experience working with algorithms, data structures, complexity analysis
  • Proven experience of working on complex and large-scale projects that require high-level technical skills, creativity, and leadership
  • Proficiency with one or more general purpose programming languages including but not limited to: Typescript and React
  • Knowledge of best practices for the full software development life cycle
  • including coding standards, code reviews, source control management, build processes, testing, and operations
  • Track record of designing and building complex software and at scale systems and successfully delivering them to customers
  • Shows flexibility and creativity in building delightful user experiences
  • Demonstrate a good balance between big-picture thinking and nailing the details
Job Responsibility
Job Responsibility
  • Design, develop, test, deploy, maintain and improve software
  • Investigate design approaches, prototype new technology and evaluate technical feasibility
  • Write high quality distributed system software and perform peer code-review
  • Perform development and maintenance of key system features
  • Drive best practices and engineering excellence
  • Provide technical direction to the team and identify areas of focus
  • Establish architectural principles, selecting design patterns and mentoring team members on their appropriate application
  • Create and review software design documentation and mentor junior engineers
  • Create and review documentation and process regarding recurring issues, new standard operating procedure
  • Demonstrate strong expertise in front-end development and navigate the complexity in handling data and UI state
What we offer
What we offer
  • Equity with high growth potential, and a competitive salary
  • Access to professional and personal training and development opportunities
  • Participation in hackathons, workshops, and lunch & learn sessions
  • Community involvement, open source work, attending talks and events, and experimenting with new technologies
  • Fulltime
Read More
Arrow Right

Software Engineer II, FrontEnd

Earner Org represents the supply side of the marketplace, serving the needs of d...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Grit, drive and a deep feeling of ownership
  • Minimum 4+ years hands on experience in developing web applications deployed as scale
  • Familiarity with concepts of distributed systems
  • Experience analysing a feature in production using analytics and experiments
  • Experience collaborating on projects and working efficiently as part of a team
  • Thriving in ambiguity and having a go-getter attitude
Job Responsibility
Job Responsibility
  • Design, develop, test and deploy products and features for smooth earner experience
  • Collaborate with you fellow team members and other orgs such as Product and Ops
  • Help build web interfaces that are deployed at scale across all cities that Uber operates in
  • Design/architect, develop and/or test software applications using Uber's technology stack
  • Apply technical knowledge to evaluate complex development/projects and provide recommendations to resolve complex technical issues
  • You'll be very close to business concerns, working alongside Product Managers, Designers, Data Scientists and Operations team, to understand what's most important, and translating that to systems, designs, and code that best solves for today, as well as plans for tomorrow
  • You will build user-facing products - the work you do will impact all Earners in the Uber ecosystem. You will be responsible for the delivery of high quality products with fast iterations
Read More
Arrow Right

Software Engineer II, Frontend: Core Fleet Team

We're Vehicles Supplier team, building highly scalable and extensible solutions ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Grit, drive and a deep feeling of ownership
  • Minimum 4+ years hands on experience in developing web applications deployed as scale
  • Familiarity with concepts of distributed systems
  • Experience analysing a feature in production using analytics and experiments
  • Experience collaborating on projects and working efficiently as part of a team
  • Thriving in ambiguity and having a go-getter attitude
Job Responsibility
Job Responsibility
  • Design/architect, develop and/or test software applications using Uber's technology stack
  • Apply technical knowledge to evaluate complex development/projects and provide recommendations to resolve complex technical issues
  • Work alongside Product Managers, Designers, Data Scientists and Operations team to understand what's most important, and translating that to systems, designs, and code
  • Build user-facing products - the work you do will impact all Earners in the Uber ecosystem
  • Be responsible for the delivery of high quality products with fast iterations
  • Fulltime
Read More
Arrow Right

Software Engineer II - Frontend

SafetyCulture engineers will work on new and existing products that directly imp...
Location
Location
Australia , Sydney
Salary
Salary:
Not provided
safetyculture.com Logo
SafetyCulture
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience working across frontend & backend systems, ideally using technologies like React, Typescript, and gRPC
  • A track record of delivering user-facing features end-to-end, including participation in planning, implementation, and iteration
  • An understanding of how to balance usability, performance, and maintainability in your solutions
  • A growth mindset and a desire to continuously improve your skills, while contributing to team success through feedback and collaboration
  • A commitment to building quality features that meet customer needs and align with business goals
Job Responsibility
Job Responsibility
  • Contribute to the design, development, and operation of full-stack SaaS systems, including scalable APIs and responsive, performant UIs
  • Evaluate trade-offs in implementation approaches, involving others in decision-making and sharing your perspective
  • Use a modern tech stack that includes React, Typescript, gRPC, Golang, AWS
  • Collaborate with Product Managers, Designers, and Quality Engineers to build practical, user-focused solutions
  • Be expected to apply a practical understanding of AI technologies, identifying simple opportunities to leverage automation or intelligence in feature development
  • Contribute effectively within a high-performance team by delivering well-tested features, seeking feedback, and continuously improving your skills and workflows to support team excellence
  • Work in a hybrid working environment, including at our HQ based in Surry Hills, Sydney
  • Demonstrate SafetyCulture’s values: Think Customer, Open Honest Always, Better as a Team, Be Bold Bring Action
What we offer
What we offer
  • Equity with high growth potential, and a competitive salary
  • Access to professional and personal training and development opportunities
  • Participation in hackathons, workshops, and lunch & learn sessions
  • Community involvement, open source work, attending talks and events, and experimenting with new technologies
  • Fulltime
Read More
Arrow Right

Software Engineer, GeniusIQ

We are looking for a software engineer to work on the systems and applications t...
Location
Location
United States , Los Angeles
Salary
Salary:
160000.00 - 180000.00 USD / Year
geniussports.com Logo
Genius Sports
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience operating distributed systems
  • Experience building real-time, interactive web frontends
  • Experience designing APIs and integrating services
  • Experience managing relational databases (schema design, indexing strategies, query optimization, performance tuning, migrations, and availability considerations)
  • Bachelor’s degree in Computer Science or equivalent experience
Job Responsibility
Job Responsibility
  • Design and develop systems and applications that power our automated, real-time GeniusIQ products including tracking data, analytics and event feeds, video products, and officiating technologies
  • Implement features end-to-end across the stack, taking responsibility for the system lifecycle from configuring and managing on-premise hardware through reliable, real-time delivery of critical products to customers
  • Contribute to technical discussions, participate in architectural decision-making, and identify opportunities to improve scalability, automation, and operational efficiency as we expand across new leagues and sports globally
  • Design and maintain the foundational GeniusIQ platform that powers our live systems and supports development & iteration by other engineering teams building on this platform
  • Design and improve testing and release strategies for complex, distributed systems — including backend services, web applications, data pipelines, messaging and streaming services, real-time model inference systems, and on-site hardware components
  • Monitor, analyze, and continuously improve system performance, reliability, and scalability. Build solutions for simulating and replaying live inputs, system and metadata validation, automated evaluation and regression testing, and observability and alerting
  • Design and build mechanisms for enabling human or agent-in-the-loop workflows that validate, correct, and enhance outputs from the system
What we offer
What we offer
  • competitive salary and range of benefits
  • committed to supporting employee wellbeing and helping you grow your skills, experience and career
  • Fulltime
Read More
Arrow Right