CrawlJobs Logo

Code Reviewer for LLM Data Training

· Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

We’re hiring a Code Reviewer with deep R expertise to review evaluations completed by data annotators assessing AI-generated R code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality.

Job Responsibility

  • Review and audit annotator evaluations of AI-generated R code
  • Assess if the R code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency

Requirements

  • 5–7+ years of experience in R development, QA, or code review
  • Strong knowledge of R syntax, debugging, edge cases, and testing
  • Comfortable using code execution environments and testing tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level

Nice to have

  • Experience in AI training, LLM evaluation, or model alignment
  • Familiarity with annotation platforms
  • Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines

What we offer

Contributions are paid weekly once approved

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Code Reviewer for LLM Data Training

8 matching positions

Senior Code Reviewer for LLM Data Training

We’re hiring Code Reviewers with deep Java expertise to review evaluations compl...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in Java development, QA, or code review
  • Strong knowledge of Java syntax, debugging, edge cases, and testing
  • Comfortable using code execution environments and testing tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Review and audit annotator evaluations of AI-generated Java code
  • Assess if the Java code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency
What we offer
What we offer
  • All contributions are paid weekly upon approval, ensuring consistent, reliable compensation
Read More
Arrow Right

Code Reviewer for LLM Data Training (SQL)

We are looking for a Code Reviewer with expertise in SQL to join our AI training...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in SQL development, QA, or code review
  • Strong understanding of core SQL concepts and development best practices
  • Experience with debugging, testing tools, and code execution environments
  • Strong analytical and critical thinking skills
  • Excellent written communication for documenting evaluations and feedback
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Audit annotator evaluations of AI-generated SQL responses
  • Verify if responses follow prompt requirements regarding query logic, joins, and correct SQL syntax
  • Evaluate SQL code for correctness, performance, security, and readability
  • Run and validate proof-of-work code submitted by annotators to confirm functionality
  • Ensure responses align with instruction-following expectations including style, tone, and clarity
  • Identify and document errors, omissions, or rating inconsistencies
  • Provide clear, constructive QA feedback based on rubric and guideline criteria
  • Collaborate with internal teams for clarifications on complex or ambiguous items
What we offer
What we offer
  • Contributions are paid weekly once approved
Read More
Arrow Right

Sr. SWE for Code Reviewing LLM Data Training (Ruby)

We're hiring a Code Reviewer with deep Ruby expertise to review evaluations comp...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in Ruby development, QA, or code review
  • Strong knowledge of Ruby syntax, metaprogramming, debugging, edge cases, and testing
  • Experience with RubyGems, testing frameworks (RSpec, Minitest), and the Ruby ecosystem
  • Comfortable using code execution environments and debugging tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Review and audit annotator evaluations of AI-generated Ruby code
  • Assess if the Ruby code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency
What we offer
What we offer
  • Paid weekly once approved
Read More
Arrow Right

Senior Software Engineer for Code Reviewing LLM Data Training

We're hiring a Code Reviewer with deep Swift expertise to review evaluations com...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in Swift development, QA, or code review
  • Strong knowledge of Swift syntax, memory management, debugging, edge cases, and testing
  • Experience with Xcode, testing frameworks, and the Swift/iOS ecosystem
  • Comfortable using code execution environments and debugging tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Review and audit annotator evaluations of AI-generated Swift code
  • Assess if the Swift code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency
What we offer
What we offer
  • Paid weekly once approved
Read More
Arrow Right

Sr. SWE for Code Reviewing LLM Data Training (SQL)

We are looking for a Code Reviewer with expertise in SQL to join our AI training...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in SQL development, QA, or code review
  • Strong understanding of core SQL concepts and development best practices
  • Experience with debugging, testing tools, and code execution environments
  • Strong analytical and critical thinking skills
  • Excellent written communication for documenting evaluations and feedback
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Audit annotator evaluations of AI-generated SQL responses
  • Verify if responses follow prompt requirements regarding query logic, joins, and correct SQL syntax
  • Evaluate SQL code for correctness, performance, security, and readability
  • Run and validate proof-of-work code submitted by annotators to confirm functionality
  • Ensure responses align with instruction-following expectations including style, tone, and clarity
  • Identify and document errors, omissions, or rating inconsistencies
  • Provide clear, constructive QA feedback based on rubric and guideline criteria
  • Collaborate with internal teams for clarifications on complex or ambiguous items
Read More
Arrow Right

Sr. SWE for Code Reviewing LLM Data Training (Rust)

We're hiring a Code Reviewer with deep Rust expertise to review evaluations comp...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in Rust development, QA, or code review
  • Strong knowledge of Rust syntax, ownership/borrowing system, debugging, edge cases, and testing
  • Experience with Cargo, testing frameworks, and the Rust ecosystem
  • Comfortable using code execution environments and debugging tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Review and audit annotator evaluations of AI-generated Rust code
  • Assess if the Rust code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency
What we offer
What we offer
  • Paid weekly once approved
Read More
Arrow Right

Senior Software Engineer for Code Reviewing LLM Data Training

We’re hiring Code Reviewers with deep Java expertise to review evaluations compl...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in Java development, QA, or code review
  • Strong knowledge of Java syntax, debugging, edge cases, and testing
  • Comfortable using code execution environments and testing tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Review and audit annotator evaluations of AI-generated Java code
  • Assess if the Java code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency
Read More
Arrow Right

Senior Software Engineer for Code Reviewing LLM Data Training

We’re hiring a Code Reviewer with deep R expertise to review evaluations complet...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in R development, QA, or code review
  • Strong knowledge of R syntax, debugging, edge cases, and testing
  • Comfortable using code execution environments and testing tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Review and audit annotator evaluations of AI-generated R code
  • Assess if the R code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency
Read More
Arrow Right