CrawlJobs Logo

Senior Software Engineer for Code Reviewing LLM Data Training

· Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

We’re hiring Code Reviewers with deep Java expertise to review evaluations completed by data annotators assessing AI-generated Java code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality.

Job Responsibility

  • Review and audit annotator evaluations of AI-generated Java code
  • Assess if the Java code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency

Requirements

  • 5–7+ years of experience in Java development, QA, or code review
  • Strong knowledge of Java syntax, debugging, edge cases, and testing
  • Comfortable using code execution environments and testing tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level

Nice to have

  • Experience in AI training, LLM evaluation, or model alignment
  • Familiarity with annotation platforms
  • Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer for Code Reviewing LLM Data Training

8 matching positions

Senior Software Engineer for Code Reviewing LLM Data Training

We're hiring a Code Reviewer with deep Swift expertise to review evaluations com...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in Swift development, QA, or code review
  • Strong knowledge of Swift syntax, memory management, debugging, edge cases, and testing
  • Experience with Xcode, testing frameworks, and the Swift/iOS ecosystem
  • Comfortable using code execution environments and debugging tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Review and audit annotator evaluations of AI-generated Swift code
  • Assess if the Swift code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency
What we offer
What we offer
  • Paid weekly once approved
Read More
Arrow Right

Senior Software Engineer for Code Reviewing LLM Data Training

We’re hiring a Code Reviewer with deep R expertise to review evaluations complet...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in R development, QA, or code review
  • Strong knowledge of R syntax, debugging, edge cases, and testing
  • Comfortable using code execution environments and testing tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Review and audit annotator evaluations of AI-generated R code
  • Assess if the R code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency
Read More
Arrow Right

Senior Software Engineer for Code Reviewing LLM Data Training

We're hiring a Code Reviewer with deep C/C++ expertise to review evaluations com...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in C/C++ development, QA, or code review
  • Strong knowledge of C/C++ syntax, memory management, debugging, edge cases, and testing
  • Experience with build systems (Make, CMake, etc.) and testing frameworks
  • Comfortable using code execution environments and debugging tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Review and audit annotator evaluations of AI-generated C/C++ code
  • Assess if the C/C++ code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency
What we offer
What we offer
  • Paid weekly once approved
Read More
Arrow Right

Senior Software Engineer for Code Reviewing LLM Data Training

We're hiring a Code Reviewer with deep Kotlin expertise to review evaluations co...
Location
Location
Salary
Salary:
Not provided
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–7+ years of experience in Kotlin development, QA, or code review
  • Strong knowledge of Kotlin syntax, coroutines, debugging, edge cases, and testing
  • Experience with Gradle, testing frameworks, and the Kotlin/JVM ecosystem
  • Comfortable using code execution environments and debugging tools
  • Excellent written communication and documentation skills
  • Experience working with structured QA or annotation workflows
  • English proficiency at B2, C1, C2, or Native level
Job Responsibility
Job Responsibility
  • Review and audit annotator evaluations of AI-generated Kotlin code
  • Assess if the Kotlin code follows the prompt instructions, is functionally correct, and secure
  • Validate code snippets using proof-of-work methodology
  • Identify inaccuracies in annotator ratings or explanations
  • Provide constructive feedback to maintain high annotation standards
  • Work within Project Atlas guidelines for evaluation integrity and consistency
What we offer
What we offer
  • Contributions are paid weekly once approved
Read More
Arrow Right

Senior Data Engineer

The YouVersion Senior Data Engineer is primarily responsible for shaping, implem...
Location
Location
United States , Edmond
Salary
Salary:
Not provided
life.church Logo
Life.Church
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data or software engineering experience building production-grade data systems
  • Bachelor's degree in Computer Science, Data, or a related field
  • Strong proficiency in SQL
  • Experience with Python, Go, Java, or similar general-purpose languages
  • Hands-on experience with warehouse design and modeling (e.g., BigQuery, Postgres, SQL Server, DBT)
  • Experience with Airflow, Pub/Sub, Fivetran, streaming platforms, or similar tools
  • Experience building data systems on GCP or comparable cloud environments
  • Experience integrating batch and real-time data sources
  • Experience preparing datasets for predictive, prescriptive, or classification models
  • Understanding of feature engineering concepts and data requirements for ML workflows
Job Responsibility
Job Responsibility
  • Deliver Trusted Data: Build and maintain reliable data pipelines that provide accurate, actionable data for analytics, experimentation, and decision-making
  • Own Data Systems: Plan, implement, and operate ingestion, ETL/ELT, and integration workflows with a focus on quality, scalability, and resilience
  • Partner Cross-Functionally: Collaborate with product, platform, analytics, and engineering teams to ensure relevant data is instrumented, collected, and usable
  • Enable ML & LLM Use Cases: Prepare and curate datasets suitable for predictive modeling, experimentation, and LLM-driven applications
  • Support Model Readiness: Design data pipelines and schemas that support training, evaluation, and inference workflows in partnership with ML-focused engineers
  • Advance Data Governance: Contribute to data governance, stewardship, privacy, and security best practices
  • Improve Observability: Build testing, monitoring, and alerting to ensure high data quality and early detection of issues
  • Optimize for Scale: Performance tune pipelines, queries, and storage for efficiency and stewardship
  • Document & Enable: Create clear documentation, diagrams, and data definitions to improve understanding across teams
  • Mentor Others: Lead and support junior and mid-level data engineers through code reviews, pairing, and guidance
What we offer
What we offer
  • Paid parental leave, including maternity, paternity, and adoption leave
  • Generous employer-paid leave for vacation, sick time, and other qualifying reasons
  • Innovative and comprehensive Medical, Dental, and Vision insurance
  • Life insurance policy at 2x annual salary at no cost
  • Short-Term and Long-Term disability covered at 100% for full-time qualified staff members
  • Comprehensive wellness and mental health benefits
  • Generous 401(k) retirement plan with up to 12.5% contribution in first year
  • $160 annually in development dollars for professional growth
  • Casual dress and work environment
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, AI & ML Ops

Hyundai AutoEver America seeks a seasoned Senior AI/ML Engineer to architect, de...
Location
Location
United States , Irvine
Salary
Salary:
103170.00 - 158873.00 USD / Year
haeaus.com Logo
Hyundai AutoEver America
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, AI, or related field
  • advanced degrees/certifications are a plus
  • 8+ years of software engineering experience, including 3+ years in AI/ML solution development
  • Proven experience designing and deploying LLM-based solutions, traditional ML models, RAG systems, and agent workflows
  • Strong expertise in Python, TensorFlow/PyTorch, Hugging Face, prompt engineering, vector databases, and AI orchestration
  • Hands-on experience with AWS SageMaker/Bedrock, Azure OpenAI, or Azure ML Studio, plus MLOps best practices (CI/CD, testing, model monitoring)
  • Proficiency in frontend frameworks (React), cloud-native deployment (Docker/Kubernetes), microservice APIs, and relational/NoSQL databases
Job Responsibility
Job Responsibility
  • Architect and develop scalable AI/ML and LLM-based systems, including RAG pipelines, agentic workflows, predictive models, and generative AI solutions
  • Build full‑stack AI applications, including React-based dashboards and front‑end interfaces integrated with backend services and cloud infrastructure
  • Develop data pipelines and ML Ops workflows using Python, SQL, AWS/Azure platforms, and monitoring tools to train, deploy, and optimize models
  • Lead cross-functional AI initiatives, deliver PoCs/MVPs, ensure compliance with AI governance, and integrate AI features into enterprise and user-facing systems
  • Provide technical leadership and mentorship, guiding standards, code reviews, model documentation, and best practices in AI/ML development
  • Continuously improve AI performance and reliability through prompt engineering, architecture enhancements, and data optimization
What we offer
What we offer
  • comprehensive medical/dental coverage
  • generous PTO
  • education assistance
  • annual merit increase eligibility
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

Our current work includes: Agentic pipelines — multi-step LLM systems with tool ...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
satalia.com Logo
Satalia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years shipping ML models to production — you've dealt with data drift, silent failures, retraining cadences, and the gap between offline metrics and business outcomes
  • Deep, demonstrable expertise in at least one of: NLP/LLMs, computer vision, recommender systems, or causal inference
  • Hands-on experience with LLM fine-tuning (LoRA, RLHF, DPO) or building LLM-powered systems (agents, RAG, structured generation)
  • Strong software engineering habits — version control, testing, code review, CI/CD
  • Comfort with ambiguity
  • Clear communication
Job Responsibility
Job Responsibility
  • Design and run training pipelines — data curation, model selection, hyperparameter search, ablation studies — and be accountable for model quality on live traffic
  • Build and maintain production inference services (latency budgets, batching strategies, quantisation, monitoring) that serve WPP's global client base
  • Architect agentic AI systems: define tool schemas, orchestration logic, evaluation criteria, and failure modes for multi-step LLM workflows
  • Work across the stack when needed — write the data pipeline, train the model, build the evaluation harness, deploy the service, and debug it when metrics drift
  • Set technical direction for your workstream: write design docs, make build-vs-buy decisions, and defend your approach with evidence
  • Mentor and set the quality standards for junior scientists
What we offer
What we offer
  • Enhanced pension
  • Life assurance
  • Income protection
  • Private healthcare
  • Remote working
  • Truly flexible working hours
  • Generous Leave - 27 days holiday plus bank holidays and enhanced family leave
  • Annual bonus
  • Impactful projects
  • People oriented culture
  • Fulltime
Read More
Arrow Right

Senior Engineer - AI Core Services

We are looking for passionate and skilled Software Developers to join our Core A...
Location
Location
United Kingdom , Cambridge
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in software engineering, preferably in platform or cloud-native service development using Microsoft and .NET technologies
  • Hands-on experience with Microsoft Azure and associated PaaS services (e.g., Azure Functions, AKS, API Management)
  • Strong expertise in RESTful API design, versioning, testing, and lifecycle management
  • Proficient in securing APIs, managing authentication/authorization and data privacy practices
  • Excellent problem-solving skills, with the ability to analyse complex technical challenges and propose scalable solutions
  • Experience working in Agile teams and collaborating across global R&D locations
  • Demonstrated ability to mentor junior team members fostering a culture of continuous learning and innovation
  • Demonstrated experience with AI frameworks, tools and Python
Job Responsibility
Job Responsibility
  • Build scalable, fault-tolerant cloud-native services on Microsoft Azure, ensuring high performance and reliability
  • Develop secure, well-documented public APIs and SDKs for consumption by internal and external developers
  • Collaborate with cross-functional teams to deliver end-to-end solutions across data pipelines, orchestration, and service APIs
  • Embed robust security controls to protect sensitive data and ensure secure access to AI services
  • Contribute to design reviews, code reviews, and architectural discussions to ensure engineering excellence
  • Mentor junior developers, encourage continuous learning, and contribute to a culture of innovation
  • Work with multiple teams to create AI solutions, which include AI model deployment, training, and AI tooling development
  • Fulltime
Read More
Arrow Right