This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
This role sits at the intersection of legal practice and legal technology and plays an essential role in shaping the future of the product. In this role, you will bring a deep understanding of how attorneys work- their processes, use cases- to set the bar for how legal AI behaves, optimizing system prompts, designing evaluations, and ensuring every output aligns with real-world legal standards. You will be instrumental in measuring and continually improving the substantive accuracy and quality of the legal workflows and output the product produces. By blending legal domain expertise, data analysis, and workflow modeling, you'll help ensure our AI tools are accurate, practical, and user-aligned. This hands-on role involves close collaboration with engineering, product, and design to define AI performance metrics, and requires designing and curating datasets reflecting how legal teams interact with documents.
Job Responsibility:
Prompt Optimization & Workflow Development: Systematically discover and test prompt engineering best practices
Drive product enhancements by translating legal expertise into features
Collaborate with Engineering on LLM calls
Review and validate product outputs for quality
Translate client requests into concrete, testable prompts and evaluation criteria
Draft and iterate on system/developer prompts for AI systems
Benchmark Design and Evaluation: Assess foundational model performance and suitability for various legal tasks
Collaborate with Product and customers to optimize genAI legal workflows
Develop datasets that accurately model legal tasks
Lead the creation of cutting-edge legal AI evaluations
Dataset curation and labelling for testing
Data Analysis & Evaluation: Build and annotate complex legal datasets and document collections
Analyze model performance and iteratively improve AI solutions
Build metrics and reporting pipelines to monitor system quality and workflow performance
Analyze usage data to gauge effectiveness
Collaboration: Serve as the legal voice of quality
Provide domain-specific legal expertise that guides feature development and product roadmap decisions
Act as the bridge between technical teams and legal domain expertise
Share findings with cross-functional stakeholders
Ideate new products based on your deep understanding of legal teams’ pain points
Participate in customer calls and feedback sessions
Requirements:
3+ years of relevant legal experience, JD preferred
Exceptional written communication and a strong interest in the application of AI in the field of law
Familiarity with a coding/scripting language or coding agents (e.g., gemini-cli, claude code, codex-cli)
Experience with generative AI in legal work, including evaluation of outputs, design/interpretation of metrics, and abstracting legal reasoning into repeatable steps
Nice to have:
The ideal candidate is curious, detail-oriented, pragmatic, and able to bridge data science with product building, working cross-functionally to align data with user experience goals
What we offer:
Equity program
401(k) retirement plan with company matching
Health, dental, and vision
Flexible Spending Accounts for health and dependent care expenses
Paid parental leave and approximately 10 days (80 hours) per year of sick leave
Seventeen paid vacation days plus 11 federal holidays
Membership to Modern Health to help employees prioritize mental health and wellness
Annual allocation for Learning & Development opportunities and applicable professional membership dues
Company-sponsored life and disability insurance
Monthly home internet reimbursement
Select your preference of hardware (Mac or PC) and customize your desk setup
Enjoy a wide variety of snacks and beverages in the office
Bond over company-wide out-of-the-box events and fun activities with your team
Time off for company-sponsored volunteer events and 4 paid hours per quarter to volunteer at a charitable organization of your choice
Take advantage of learning and career development opportunities