CrawlJobs Logo

Ruby Engineer - AI Training

usebraintrust.com Logo

Braintrust

Location Icon

Location:

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

50.00 - 90.00 USD / Hour

Job Description:

As an hourly paid, fully remote Ruby Engineer for AI Data Training, you will review AI-generated Ruby and Rails code or generate your own solutions, evaluate the reasoning quality and step-by-step problem-solving, and provide expert feedback that helps models produce answers that are accurate, logical, and clearly explained. You will assess solutions for readability, maintainability, and correctness; identify errors in MVC structure, domain modeling, or control flow; fact-check information; write high-quality explanations and model solutions that demonstrate idiomatic Ruby patterns; and rate and compare multiple AI responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate that provides AI training data for many of the world’s largest AI companies and foundation model labs, and your work will directly help improve the world’s premier AI models while giving you the flexibility of impactful, detail-oriented remote contract work.

Job Responsibility:

  • Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects
  • Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance
  • Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases

Requirements:

  • 1–2+ years of professional Ruby programming experience in production environments
  • Strong understanding of Ruby on Rails, MVC architecture, and idiomatic Ruby patterns for structuring application code
  • Hands-on software engineering experience building and maintaining Ruby or Rails applications, with exposure to real-world production constraints
  • Ability to evaluate readability, maintainability, and logical correctness in Ruby and Rails code, including model, controller, and service-layer design
  • Significant experience using LLMs or AI coding assistants while programming, combined with a disciplined approach to validating and reviewing their output
  • Excellent English writing skills, capable of producing clear, structured, and pedagogical technical explanations and code reviews
  • Minimum Bachelor’s degree in Computer Science or a closely related technical field
  • Minimum C1 English proficiency and an extremely detail-oriented working style are required

Nice to have:

  • Previous experience with AI data training, large-scale code review, or evaluation of AI-generated technical content is strongly preferred
  • Highly preferred: experience with frameworks and tools such as Ruby on Rails, Sinatra, and RSpec in real projects
  • Preferred: merged PRs in Ruby open-source projects, experience with metaprogramming or test-heavy systems, and competitive programming exposure
What we offer:

Get rewarded with BTRST, Braintrust's cryptotoken, for inviting talent, taking a class—even signing up! Use token rewards to help shape the future of the platform

Additional Information:

Job Posted:
February 04, 2026

Employment Type:
Parttime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Ruby Engineer - AI Training

Senior Product AI Engineer

You’ll join us to bring this framework to the next level, leading projects (AI, ...
Location
Location
Salary
Salary:
Not provided
wetravel.com Logo
WeTravel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of software engineering experience (ideally full-stack)
  • Strong engineering skills and proven experience in GenAI / LLM applications (i.e. built and launched LLM-enabled products to customers)
  • Proficiency with Ruby on Rails, or in at least two other languages Python/Go/Java/Kotlin/Node.js or .NET with desire to learn Ruby
  • Have experience and the desire to build user experiences (e.g. web front-ends)
  • Have experience building and working with distributed systems, microservices and event-driven architecture and demonstrate strong systems thinking and can design for scalability
  • Have experience with production systems, monitoring, and on-call responsibilities
  • Have excellent communication skills and experience working in multicultural, distributed teams
  • Take a pragmatic approach to using AI tools to improve productivity
  • Have experience leading projects
  • Proficiency with LLM providers and SDKs (e.g., OpenAI, Anthropic, Google, Meta)
Job Responsibility
Job Responsibility
  • Lead and build features end-to-end: from reviewing user interviews and product design, through architection and building systems to deployment and monitoring in production
  • Partner closely with our product team to discover user problems and shape their solutions - creating a world class experience for our organizers and travelers
  • Write high-quality, maintainable code across both backend (Ruby on Rails), and frontend (TypeScript/React)
  • Ensure our services are always on by building resilient applications, ensuring they are well monitored and mitigating incidents as an on-call/incident responder
  • Mentor teammates, grow the team's AI capacity, and contribute to WeTravel’s engineering practices and excellence
What we offer
What we offer
  • Generous "Time to Recharge" policy — enjoy unlimited paid time off to rest, recharge, and show up as your best self
  • Amsterdam Program – visit us in Amsterdam (HQ) for 2-4 weeks every year, staying in one of our WeTravel apartments
  • Work remotely for a maximum of 4 weeks per calendar year
  • Extensive paid family leave
  • Three paid volunteer days per year — take time to give back to causes you care about, on us
  • 2-week cross-functional onboarding program
  • Cutting-edge equipment and tools to set you up for success. Coverage for certain work-from-home (WFH) equipment
  • Cambly for colleagues for whom English is not their first language
  • Join an international, travel-loving team with a passion for adventure and innovation
  • Fulltime
Read More
Arrow Right

Software Engineer, AI

Software Engineer, AI — Code Evaluation & Training (Remote). RLHF in one line: G...
Location
Location
Salary
Salary:
30.00 - 70.00 USD / Hour
g2i.co Logo
G2i Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of professional software engineering experience in Ruby
  • Strong code-review instincts—you can spot logic errors, performance traps, and security issues quickly
  • Extreme attention to detail and excellent written communication skills
  • You enjoy reading documentation and language specs and thrive in an asynchronous, low-oversight environment
Job Responsibility
Job Responsibility
  • Help train large-language models (LLMs) to write production-grade code across a wide range of programming languages
  • Compare & rank multiple code snippets, explaining which is best and why
  • Repair & refactor AI-generated code for correctness, efficiency, and style
  • Inject feedback (ratings, edits, test results) into the RLHF pipeline and keep it running smoothly
  • Fulltime
Read More
Arrow Right

Senior Support Engineer

At Sentry, support is an engineering discipline. Our customers are developers bu...
Location
Location
Austria , Vienna
Salary
Salary:
60900.00 - 70000.00 EUR / Year
sentry.io Logo
Sentry
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in technical support or engineering, with a track record of solving high-complexity SaaS problems
  • Strong Coding Foundations: Proficiency in Python, JavaScript, or Ruby. You should be comfortable reading SDK source code and reproducing bugs
  • Modern Dev Stack Knowledge: Deep understanding of CI/CD, APIs, microservices, and observability/monitoring
  • AI Literacy: Practical familiarity with the AI stack: You understand how RAG works, why Context Windows matter, and how to debug a System Prompt
  • Exceptional Communication: The ability to explain complex architectural concepts to a human and write precise "system instructions" for an AI
Job Responsibility
Job Responsibility
  • Master the Sentry Ecosystem: Become a Platform Expert: Develop deep authority on Sentry’s features to guide customers through complex debugging workflows
  • Resolve Technical Inquiries: Answer inbound support requests with a focus on teaching and enabling developers, not just closing tickets
  • Troubleshoot SDK Implementations: Go beyond the UI to help developers instrument Sentry’s SDKs within their specific codebases and frameworks
  • Manage Bugs & Escalations: Triage and reproduce product bugs, serving as the bridge between customers and our Engineering teams
  • Pioneer AI-First Support: Train our AI Agents: Manage the performance of our support bots (Triage, Billing, and Technical), ensuring they provide accurate, high-quality assistance
  • Curate "AI-Ready" Knowledge: Write and structure documentation specifically optimized for RAG (Retrieval-Augmented Generation), ensuring our AI can easily find and use the right information
  • Design Human-in-the-Loop Flows: Define the logic for when an AI should hand off to a human, ensuring context is preserved so customers never have to repeat themselves
  • Monitor & Refine: Review AI responses for accuracy or hallucinations, creating examples of "perfect answers" to continuously fine-tune the model’s performance
  • Handle Complex "Edge Cases": Step in as the expert "Solutions Architect" for gray-area technical issues where AI reaches its limit
  • Drive Automation Strategy: Focus on solving problems at the source—building systems and content that resolve issues before a human ever needs to intervene
What we offer
What we offer
  • Offers Equity
  • Relocation support is available for this role
  • incentive compensation
  • equity grants
  • paid time off
  • group health insurance coverage
  • Fulltime
Read More
Arrow Right

Developer Support Engineer

At Sentry, support is an engineering discipline. Our customers are developers bu...
Location
Location
United States , San Francisco
Salary
Salary:
110000.00 - 150000.00 USD / Year
sentry.io Logo
Sentry
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in technical support or engineering, with a track record of solving high-complexity SaaS problems
  • Strong Coding Foundations: Proficiency in Python, JavaScript, or Ruby. You should be comfortable reading SDK source code and reproducing bugs
  • Modern Dev Stack Knowledge: Deep understanding of CI/CD, APIs, microservices, and observability/monitoring
  • AI Literacy: Practical familiarity with the AI stack: You understand how RAG works, why Context Windows matter, and how to debug a System Prompt
  • Exceptional Communication: The ability to explain complex architectural concepts to a human and write precise "system instructions" for an AI
Job Responsibility
Job Responsibility
  • Master the Sentry Ecosystem: Become a Platform Expert
  • Resolve Technical Inquiries
  • Troubleshoot SDK Implementations
  • Manage Bugs & Escalations
  • Pioneer AI-First Support: Train our AI Agents
  • Curate "AI-Ready" Knowledge
  • Design Human-in-the-Loop Flows
  • Monitor & Refine
  • Handle Complex "Edge Cases"
  • Drive Automation Strategy
What we offer
What we offer
  • Offers Equity
  • incentive compensation
  • equity grants
  • paid time off
  • group health insurance coverage
  • Fulltime
Read More
Arrow Right

AI/ML Engineer - Vice President

C13 Role - Senior AI/ML Engineer Vice President
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of relevant experience in Apps Development or systems analysis role
  • Extensive experience system analysis and in programming of software applications
  • Experience in managing and implementing successful projects
  • Subject Matter Expert (SME) in at least one area of Applications Development
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated leadership and project management skills
  • Consistently demonstrates clear and concise written and verbal communication
Job Responsibility
Job Responsibility
  • Designing, implementing, and maintaining secure and stable AI/ML solutions using leading AI technology frameworks, including conversational AI solutions
  • Aligning AI/ML use cases with business strategies and key performance indicators and other metrics
  • Hands on work with one of the major AI programming languages Java, Python, Ruby, etc.
  • Develop and maintain applications using Node.js and JavaScript, along with relevant frameworks
  • Working closely and lead software engineers to build new applications to run on AI/ML platforms
  • Perform data analysis, feature engineering, and NLP training to optimize model performance
  • Run what you build
  • Monitoring current and future trends and advancements in AI, machine learning, and other emerging technologies
  • Measure the performance & adjust
  • Provide vision for relevant technology systems, including those that support enterprise risk management and independent compliance applications, ensuring that engineers use blueprints, architecture, patterns, and design
  • Fulltime
Read More
Arrow Right

Federal Sales Engineer

LogicMonitor® is the AI-first hybrid observability platform powering the next ge...
Location
Location
United States , Washington DC
Salary
Salary:
108000.00 - 135000.00 USD / Year
logicmonitor.com Logo
LogicMonitor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or technical degree preferred
  • 5+ years experience in SysAdmin or Sales Engineering role
  • Able to articulate technology and product positioning to both business and technical users
  • Able to establish and maintain strong relationships throughout the sales cycle
  • Experience in Linux and or Windows/Network administration and operations including the following technologies desired: Virtualization (VMWare, Hyper-V, Xen Server, etc…)
  • Storage (Netapp, EMC, HPLeftHand, Dell Equallogic, etc…)
  • LoadBalancers (f5 bigIP, Netscaller, Barracuda, etc…)
  • WMI, PerfMon, JDBC, SNMP, SMTP, JMX
  • Webservers (IIS, Apache, Tomcat, etc…)
  • Active Directory
Job Responsibility
Job Responsibility
  • Perform SE duties on trial calls as scheduled by AEs
  • Trial optimization (proactively adding dashboards, creating sample reports, etc. for all trial prospects)
  • Lead technical/product training for new sales personnel on an ongoing basis
  • Day-to-day product/technical support for trial prospects
  • Log meetings and technical notes in SalesForce pertaining to the POV for each call (or onsite) with the customer
  • Demonstrates the technical aspects of how the product solves specific customer problems, and translates specific customer problems into technical solutions
  • Identifies all technical issues of assigned accounts to assure complete customer satisfaction through all stages of the sales process.
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • generous parental leave policies
  • access to our Employee Assistance Program and various Wellness programs
  • a 401K with company matching
  • a Lifestyle Spending Account
  • an unlimited vacation policy.
  • Fulltime
Read More
Arrow Right

Federal Sales Engineer

The mission of the Sales Engineer (SE) at LogicMonitor is to support the technic...
Location
Location
United States , Virginia Beach
Salary
Salary:
108000.00 - 135000.00 USD / Year
logicmonitor.com Logo
LogicMonitor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or technical degree preferred
  • 5+ years experience in SysAdmin or Sales Engineering role
  • Able to articulate technology and product positioning to both business and technical users
  • Able to establish and maintain strong relationships throughout the sales cycle
  • Experience in Linux and or Windows/Network administration and operations including the following technologies desired: Virtualization (VMWare, Hyper-V, Xen Server, etc…)
  • Storage (Netapp, EMC, HPLeftHand, Dell Equallogic, etc…)
  • LoadBalancers (f5 bigIP, Netscaller, Barracuda, etc…)
  • WMI, PerfMon, JDBC, SNMP, SMTP, JMX
  • Webservers (IIS, Apache, Tomcat, etc…)
  • Active Directory
Job Responsibility
Job Responsibility
  • Perform SE duties on trial calls as scheduled by AEs
  • Trial optimization (proactively adding dashboards, creating sample reports, etc. for all trial prospects)
  • Lead technical/product training for new sales personnel on an ongoing basis
  • Day-to-day product/technical support for trial prospects
  • Log meetings and technical notes in SalesForce pertaining to the POV for each call (or onsite) with the customer
  • Demonstrates the technical aspects of how the product solves specific customer problems, and translates specific customer problems into technical solutions
  • Identifies all technical issues of assigned accounts to assure complete customer satisfaction through all stages of the sales process.
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • generous parental leave policies
  • access to our Employee Assistance Program and various Wellness programs
  • a 401K with company matching
  • a Lifestyle Spending Account
  • an unlimited vacation policy.
  • Fulltime
Read More
Arrow Right

Federal Sales Engineer

The mission of the Sales Engineer (SE) at LogicMonitor is to support the technic...
Location
Location
United States , Raleigh, North Carolina
Salary
Salary:
108000.00 - 135000.00 USD / Year
logicmonitor.com Logo
LogicMonitor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or technical degree preferred
  • 5+ years experience in SysAdmin or Sales Engineering role
  • Able to articulate technology and product positioning to both business and technical users
  • Able to establish and maintain strong relationships throughout the sales cycle
  • Experience in Linux and or Windows/Network administration and operations including the following technologies desired: Virtualization (VMWare, Hyper-V, Xen Server, etc…)
  • Storage (Netapp, EMC, HPLeftHand, Dell Equallogic, etc…)
  • LoadBalancers (f5 bigIP, Netscaller, Barracuda, etc…)
  • WMI, PerfMon, JDBC, SNMP, SMTP, JMX
  • Webservers (IIS, Apache, Tomcat, etc…)
  • Active Directory
Job Responsibility
Job Responsibility
  • Perform SE duties on trial calls as scheduled by AEs
  • Trial optimization (proactively adding dashboards, creating sample reports, etc. for all trial prospects)
  • Lead technical/product training for new sales personnel on an ongoing basis
  • Day-to-day product/technical support for trial prospects
  • Log meetings and technical notes in SalesForce pertaining to the POV for each call (or onsite) with the customer
  • Demonstrates the technical aspects of how the product solves specific customer problems, and translates specific customer problems into technical solutions
  • Identifies all technical issues of assigned accounts to assure complete customer satisfaction through all stages of the sales process.
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • generous parental leave policies
  • access to our Employee Assistance Program and various Wellness programs
  • a 401K with company matching
  • a Lifestyle Spending Account
  • an unlimited vacation policy.
  • Fulltime
Read More
Arrow Right