This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
LMArena is seeking a Software Engineer to join our team and build the data pipelines and infrastructure that powers real-world AI evaluation. You'll play a crucial role in designing and building the data pipelines that process and analyze tens of millions user vote data, directly impacting how we understand and evaluate AI model performance. This role is ideal for someone who thrives in fast-moving environments and interested in building products to ensure accurate and fair evaluation of human preferences across different models, which will shape the direction of future AI development. As an early member of our data engineering team, you'll partner closely with researchers, engineers, and product leadership to retrieve valuable data and insights from human votes and feedback. You'll help us move fast while staying rigorous, improving data quality, scaling our infrastructure to new levels, and deepening our ability to compare frontier models and predict human preferences.
Job Responsibility:
Design and build robust data pipelines to ingest, process, and transform user vote data to features essential for model performance evaluation
Collaborate with researchers and product leadership to understand product goals and necessary data
Design and implement solutions to generate result dashboards and reports, providing useful information for the public, model providers, and researchers
Ensure the integrity, data quality, and reliability of the pipelines
Scale our data infrastructure to accommodate increasing data volumes and evolving analytical needs
Requirements:
5+ years of experience in software engineering, with a dedicated focus on data engineering and big data technologies
Proficiency in SQL and at least one programming language commonly used for data analysis (Python (preferred), Scala, R)
Hands-on experience with data processing and pipeline frameworks (Apache Spark, Ray Data, etc.) and at least one popular big data analytics platform (Databricks, Snowflake)
Demonstrated experience in designing, implementing, optimizing, and debugging production data pipelines
Nice to have:
Prior work in data analytics or datalake platforms
Experience in advanced data analysis tools, such as Delta lake, streaming tables
Exposure to machine learning is a plus
What we offer:
Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs
The opportunity to work on cutting-edge AI with a small, mission-driven team
A culture that values transparency, trust, and community impact