CrawlJobs Logo
AquSag Technologies Logo AquSag Technologies · Education

Rubrics Expert

India, Noida · Job Posted March 21, 2026
Apply Position
Job Link Share

Job Description

Join our team as a Rubrics Expert and play a pivotal role in shaping the quality and impact of assessments across diverse learning environments. You’ll leverage your expertise in rubric design and validation to ensure fair, consistent, and actionable evaluations, directly influencing educational and professional development outcomes.

Job Responsibility

  • Design and develop robust, scalable scoring rubrics tailored to varying assessment needs and content areas
  • Establish and refine scoring methodologies, ensuring clarity, reliability, and alignment with learning objectives
  • Lead calibration sessions with assessors and subject matter experts to maintain scoring consistency and inter-rater reliability
  • Validate assessments and rubrics through data-driven analysis, pilot testing, and continuous quality control measures
  • Analyze performance data using advanced assessment analytics to pinpoint trends and inform rubric revisions
  • Develop clear, actionable feedback structures based on rubric results to support learner growth and achievement
  • Collaborate cross-functionally with instructional designers, educators, and stakeholders to drive assessment excellence

Requirements

  • Proven experience in rubric design
  • In-depth knowledge of scoring methodologies, calibration techniques, and assessment validation processes
  • Strong analytical skills to interpret performance data and inform rubric improvements
  • Demonstrated expertise in quality control and continuous improvement within assessment systems
  • Exceptional written and verbal communication skills, with a passion for clarity and detail
  • Ability to structure actionable, meaningful feedback based on rubric-driven evaluations
  • Self-motivated, process-oriented, and adaptable to remote collaboration

Nice to have

  • Experience with digital assessment tools, large-scale assessment projects, or remote teams
  • Background in professional development or training for educators and assessors
AquSag Technologies - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Rubrics Expert

8 matching positions

New

Subject Matter Expert

The Subject Matter Expert is a specialized role focused exclusively on quality e...
Location
Location
Canada; United States
Salary
Salary:
Not provided
scale.com Logo
Scale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep domain expertise in a specialized field (e.g., medicine, law, engineering, etc.)
  • Strong analytical skills with the ability to evaluate complex outputs against defined standards
  • Experience in quality assurance, auditing, or evaluation frameworks is preferred
  • Ability to produce clear, structured, and actionable feedback
  • High attention to detail and commitment to accuracy and consistency
Job Responsibility
Job Responsibility
  • Conduct structured audits of task outputs to evaluate accuracy, consistency, and adherence to project guidelines
  • Apply domain expertise to assess nuanced or complex work requiring specialized knowledge
  • Identify patterns of quality issues and flag systemic gaps impacting output standards
  • Define and refine quality benchmarks, scoring rubrics, and evaluation criteria based on project needs
  • Contribute to the development of gold standards and reference materials for high-quality outputs
  • Ensure quality frameworks reflect domain-specific rigor where applicable
  • Analyze audit results to generate actionable insights on quality trends and performance gaps
  • Provide structured reports with clear recommendations to improve overall output quality
  • Partner with internal stakeholders to calibrate on quality expectations and scoring consistency
  • Recommend improvements to workflows, guidelines, and evaluation processes based on audit findings
  • Parttime
Read More
Arrow Right

Event Security Program Manager

Waymo is an autonomous driving technology company with the mission to be the wor...
Location
Location
United States , Tempe
Salary
Salary:
152000.00 - 187000.00 USD / Year
waymo.com Logo
Waymo
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ Years of Relevant Experience: Progressive experience in corporate security program management focused on event security, corporate protective services, executive protection, or specialized hardware/prototype protection (e.g., trade shows/exhibitions)
  • Collaborative Advisory Mindset: Proven ability to operate as a support function, influencing outcomes and providing expert guidance without owning the final tactical production of the event
  • Workflow Design Expertise: Demonstrated track record of creating scalable SOPs or programmatic frameworks that manage a high volume of recurring requests
  • Intelligence Translation Skills: Experience converting threat intelligence data into practical, logistical recommendations for non-security stakeholders
  • Foundational Protective Knowledge: A strong understanding of executive protection and high-value asset security principles, applied through a programmatic and consultative lens
  • A Track Record of External Liaison: Proven experience professionally liaising with local, state, and federal law enforcement and municipal authorities to achieve tangible operational outcomes, such as securing specialized permits, coordinating public-space logistics, or establishing real-time information-sharing protocols
Job Responsibility
Job Responsibility
  • Architect Scalable Standards: Design and own the end-to-end 'Event Security Playbook,' including intake workflows, self-service risk rubrics, and SOPs that support a high volume of global events
  • Serve as a Strategic Security Consultant: Review event operational plans and provide formal risk-mitigation recommendations to ensure the safety of personnel and the security of proprietary hardware
  • Partner with Threat Intelligence: Collaborate with the Global Threat Intelligence (GTI) team to determine when formal assessments are required
  • translate threat assessments into actionable guidance for internal stakeholders
  • Optimize Internal Plans: Recommend risk-based adjustments to internal Waymo event schedules, logistics, or locations (e.g., modifying vehicle load-in/out windows or entrance strategies) to ensure alignment with security best practices
  • Verify External Security Posture: Liaise with venue security, law enforcement, and municipal authorities to align Waymo’s logistics with external security plans, securing tangible results such as optimized load-in/out windows, traffic mitigation agreements, or dedicated public-safety coordination
  • Support High-Stakes Assessments: Conduct technical 'advances' and targeted venue site visits as operationally required for high-visibility or high-risk events to gather precise data to inform bespoke risk-mitigation recommendations
What we offer
What we offer
  • Discretionary annual bonus program
  • Equity incentive plan
  • Generous Company benefits program
  • Health and wellness
  • Financial wellness
  • Flexibility and time off
  • Fulltime
Read More
Arrow Right

Research Engineer

As a Research Engineer at Mercor, you’ll work at the intersection of engineering...
Location
Location
United States , San Francisco
Salary
Salary:
130000.00 USD / Year
mercor.com Logo
Mercor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong applied research background, with a focus on post-training and/or model evaluation
  • Strong coding proficiency and hands-on experience working with machine learning models
  • Strong understanding of data structures, algorithms, backend systems, and core engineering fundamentals
  • Familiarity with APIs, SQL/NoSQL databases, and cloud platforms
  • Ability to reason deeply about model behavior, experimental results, and data quality
  • Excitement to work in person in San Francisco, five days a week (with optional remote Saturdays), and thrive in a high-intensity, high-ownership environment
Job Responsibility
Job Responsibility
  • Work on post-training and RLVR pipelines to understand how datasets, rewards, and training strategies impact model performance
  • Design and run reward-shaping experiments and algorithmic improvements (e.g., GRPO, DAPO) to improve LLM tool-use, agentic behavior, and real-world reasoning
  • Quantify data usability, quality, and performance uplift on key benchmarks
  • Build and maintain data generation and augmentation pipelines that scale with training needs
  • Create and refine rubrics, evaluators, and scoring frameworks that guide training and evaluation decisions
  • Build and operate LLM evaluation systems, benchmarks, and metrics at scale
  • Collaborate closely with AI researchers, applied AI teams, and experts producing training data
  • Operate in a fast-paced, experimental research environment with rapid iteration cycles and high ownership
What we offer
What we offer
  • Generous equity grant vested over 4 years
  • A $20K relocation bonus (if moving to the Bay Area)
  • A $10K housing bonus (if you live within 0.5 miles of our office)
  • A $1K monthly stipend for meals
  • Free Equinox membership
  • Health insurance
  • Fulltime
Read More
Arrow Right

R&D Systems & Lab Operations Specialist

Join our team as a R&D Systems & Lab Operations Specialist and play a pivotal ro...
Location
Location
India , Noida
Salary
Salary:
Not provided
aqusag.com Logo
AquSag Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven expertise with ELNs and LIMS, including workflow design and system configuration
  • Exceptional written and verbal communication skills to convey complex information clearly across diverse audiences
  • Strong analytical mindset and attention to detail in the review and optimization of digital lab processes
  • Experience translating laboratory protocols into structured, digital formats with robust traceability
  • Solid understanding of quality assurance principles in R&D settings
  • Ability to work independently and as part of a remote, expert-driven team
  • Demonstrated experience developing or reviewing rubrics for laboratory or scientific operations.
Job Responsibility
Job Responsibility
  • Review and refine rubrics to validate the accuracy and usability of laboratory processes within electronic lab environments
  • Translate experimental protocols into structured workflows using Electronic Lab Notebooks (ELNs) and Laboratory Information Management Systems (LIMS)
  • Assess and enhance the clarity of documentation to ensure written protocols are actionable, logical, and ready for digital adoption
  • Collaborate with cross-functional teams to identify workflow improvements and ensure realistic QA pairs that mirror everyday lab operations
  • Monitor and track protocol execution, providing feedback to ensure compliance with best practices in digital lab management
  • Champion quality assurance by identifying gaps, inconsistencies, and opportunities for automation in lab processes
  • Serve as a key contributor to the development of scalable and reproducible lab data management strategies.
  • Fulltime
Read More
Arrow Right

Product Manager

Join our team as a Product Manager and play a pivotal role in shaping complex, h...
Location
Location
India , Noida
Salary
Salary:
Not provided
aqusag.com Logo
AquSag Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 2+ years of hands-on product management experience, particularly with Calendar, Gmail, Mixpanel, and Slack
  • Demonstrated expertise in developing high-fidelity, realistic product experiences and task prompts
  • Strong proficiency in both written and verbal communication, with a keen attention to detail
  • Proven track record of collaborating within remote, cross-functional teams
  • Experience designing and applying rubrics to product development or assessment processes
  • Analytical mindset with the ability to make data-driven decisions using modern analytics tools
  • Self-motivated, organized, and able to thrive in a fast-paced, expert-driven environment
Job Responsibility
Job Responsibility
  • Design and develop high-fidelity product features and workflows using insights from advanced analytics platforms
  • Create and refine difficult, realistic task prompts to drive continuous product improvement and foster innovation
  • Collaborate closely with cross-functional teams, utilizing tools such as Slack, Gmail, and Calendar for seamless project execution
  • Analyze user data and feedback through Mixpanel and other analytics tools to inform product decisions
  • Establish and maintain detailed rubrics to evaluate product quality and team effectiveness
  • Demonstrate exceptional problem-solving skills in addressing complex product challenges and user needs
  • Champion clear, concise written and verbal communication across all levels of the organization
  • Fulltime
Read More
Arrow Right

Applied Scientist, Artificial General Intelligence, AGI Data Services

The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, ...
Location
Location
United States of America , Boston; Bellevue
Salary
Salary:
136000.00 - 184000.00 USD / Year
amazon.de Logo
Amazon Pforzheim GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's degree in computer science, mathematics, statistics, machine learning or equivalent quantitative field
  • Experience programming in Java, C++, Python or related language
  • Experience with SQL and an RDBMS (e.g., Oracle) or Data Warehouse
Job Responsibility
Job Responsibility
  • Lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows
  • Design auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks
  • Perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities
  • Develop and maintain LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment
  • Set up the configuration of data collection workflows and communicate quality feedback to stakeholders
What we offer
What we offer
  • health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
  • 401(k) matching
  • paid time off
  • parental leave
  • sign-on payments
  • restricted stock units (RSUs)
  • Fulltime
Read More
Arrow Right

Ai experience policy specialist

The GenAI Manual Evaluations team serve as Uber’s human-in-the-loop quality, saf...
Location
Location
United States , Phoenix
Salary
Salary:
21.70 USD / Hour
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ability to distill complex technical processes into clear, usable content
  • Strong understanding of support operations, AI tools, and agent workflows
  • Strong expertise in policy operations or support policy frameworks
  • A proactive, solutions-oriented mindset with attention to operational detail
  • Strong technical aptitude and willingness to quickly learn and manage new internal tools
Job Responsibility
Job Responsibility
  • Execute rubric-based evaluations on real interactions between Uber’s users (earners, riders, merchants) and our GenAI support products
  • Assess the accuracy, relevance, and overall customer experience of the responses provided by AI
  • Identify defects, edge cases, and gaps in the support experience and document findings into relevant and actionable insights for cross functional teams to action
  • Support the calibration and continuous improvement of various AI programs as we continue to scale to a larger audience
  • Become an SME of multiple tools & programs to provide comprehensive evaluations of varying interaction types
  • Communicate quickly and effectively to internal Uber members as needed
  • Become an expert on processes and may help with sophisticated problem solving
  • Follow process guides to complete tasks and provide support to various crucial initiatives
  • Work with your Team Lead and the Manual Evals Program team to escalate suggestions and issues for timely resolution
  • Serve as the policy SME for AI support experiences—ensuring automated outputs align with current policies and support standards
What we offer
What we offer
  • Eligible to participate in Uber's bonus program
  • Eligible to participate in a 401(k) plan
  • Various benefits
  • Fulltime
Read More
Arrow Right

Applied Scientist

The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, ...
Location
Location
United States , Boston; Bellevue
Salary
Salary:
136000.00 - 184000.00 USD / Year
Amazon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's degree in computer science, mathematics, statistics, machine learning or equivalent quantitative field
  • Experience programming in Java, C++, Python or related language
  • Experience with SQL and an RDBMS (e.g., Oracle) or Data Warehouse
Job Responsibility
Job Responsibility
  • Collaborate closely with core scientist team developing Amazon Nova models
  • Lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows
  • Design auditing strategies with detailed SOPs, quality metrics, and sampling methodologies
  • Perform expert-level manual audits
  • Conduct meta-audits to evaluate auditor performance
  • Provide targeted coaching to uplift overall quality capabilities
  • Develop and maintain LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment
  • Set up the configuration of data collection workflows
  • Communicate quality feedback to stakeholders
  • Have a direct impact on enhancing customer experiences through high-quality training and evaluation data
What we offer
What we offer
  • Sign-on payments
  • Restricted stock units (RSUs)
  • Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
  • 401(k) matching
  • Paid time off
  • Parental leave
Read More
Arrow Right