This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
As an hourly paid, fully remote Ruby Engineer for AI Data Training, you will review AI-generated Ruby and Rails code or generate your own solutions, evaluate the reasoning quality and step-by-step problem-solving, and provide expert feedback that helps models produce answers that are accurate, logical, and clearly explained. You will assess solutions for readability, maintainability, and correctness; identify errors in MVC structure, domain modeling, or control flow; fact-check information; write high-quality explanations and model solutions that demonstrate idiomatic Ruby patterns; and rate and compare multiple AI responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate that provides AI training data for many of the world’s largest AI companies and foundation model labs, and your work will directly help improve the world’s premier AI models while giving you the flexibility of impactful, detail-oriented remote contract work.
Job Responsibility:
Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects
Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance
Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases
Requirements:
1–2+ years of professional Ruby programming experience in production environments
Strong understanding of Ruby on Rails, MVC architecture, and idiomatic Ruby patterns for structuring application code
Hands-on software engineering experience building and maintaining Ruby or Rails applications, with exposure to real-world production constraints
Ability to evaluate readability, maintainability, and logical correctness in Ruby and Rails code, including model, controller, and service-layer design
Significant experience using LLMs or AI coding assistants while programming, combined with a disciplined approach to validating and reviewing their output
Excellent English writing skills, capable of producing clear, structured, and pedagogical technical explanations and code reviews
Minimum Bachelor’s degree in Computer Science or a closely related technical field
Minimum C1 English proficiency and an extremely detail-oriented working style are required
Nice to have:
Previous experience with AI data training, large-scale code review, or evaluation of AI-generated technical content is strongly preferred
Highly preferred: experience with frameworks and tools such as Ruby on Rails, Sinatra, and RSpec in real projects
Preferred: merged PRs in Ruby open-source projects, experience with metaprogramming or test-heavy systems, and competitive programming exposure
What we offer:
Get rewarded with BTRST, Braintrust's cryptotoken, for inviting talent, taking a class—even signing up! Use token rewards to help shape the future of the platform