CrawlJobs Logo

Software Engineer in Test (AI focus)

roku.com Logo

Roku

Location Icon

Location:
United Kingdom , Cambridge

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

Roku is changing how the world watches TV. Roku is the #1 TV streaming platform in the U.S., Canada, and Mexico, and we've set our sights on powering every television in the world. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform that connects the entire TV ecosystem. We connect consumers to the content they love, enable content publishers to build and monetize large audiences, and provide advertisers unique capabilities to engage consumers. From your first day at Roku, you'll make a valuable - and valued - contribution. We're a fast-growing public company where no one is a bystander. We offer you the opportunity to delight millions of TV streamers around the world while gaining meaningful experience across a variety of disciplines. About The Role: With millions of users worldwide, our products have earned a reputation for 'just working' seamlessly right out of the box, almost like magic. This seamless experience is no accident; it's a testament to our commitment to creating products that are not just intuitive but downright obvious. At the heart of this commitment is the Roku OS QA Team, dedicated to rigorously testing every product and feature to ensure we deliver the most reliable streaming media platform in the industry. Our mission is simple: help people effortlessly find and stream the content they love. We achieve this through cutting-edge technology and engineering, always putting the customer at the center of everything we do. About the Team: As part of our team, you'll leverage your diverse skills to support both Software Engineers and QA Engineers, tackling the daily challenges of their roles. Your specialist knowledge, combined with the use of AI technologies, will be invaluable in suggesting improvements to enhance quality and streamline workflows, ensuring we continue to exceed our customers' expectations.

Job Responsibility:

  • Contribute to tools and technology
  • Design, develop, and maintain AI-driven automation systems
  • Collaborate with data scientists, software engineers, and product teams to understand and deliver AI-based solutions
  • Build new tools and technology
  • Debug failing tests to improve the quality of automated test tools and frameworks
  • Conduct code reviews for improve code quality and optimization
  • Promote coding conventions and standards for code re-usability and cleanliness
  • Assist in monitoring and maintenance of critical systems

Requirements:

  • 3+ years of hands-on experience with automation systems
  • 3+ years of Python programming experience
  • 2+ years of experience developing test plans and test cases
  • Ability to write simple Python scripts to preprocess data or interact with ML APIs
  • Bachelor's degree in Computer Science or related
  • Excellent verbal and written communication skills
  • Experience working with remote teams
  • Some knowledge of continuous integration tools (Jenkins/Hudson, TeamCity, Maven, Gradle)
  • Hands on experience and proficiency in Linux/Unix systems
  • Ability to learn new technologies quickly
  • A self-directed professional able to work independently
  • Previous experience with Non-Functional Testing (Performance Testing, Stress Testing)
What we offer:
  • Global access to mental health and financial wellness support and resources
  • healthcare (medical, dental, and vision)
  • life
  • accident
  • disability
  • commuter
  • retirement options (401(k)/pension)

Additional Information:

Job Posted:
May 05, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer in Test (AI focus)

Senior Software Engineer - AI

Senior Software Engineer role focused on AI and data-driven systems to transform...
Location
Location
Sweden , Malmö
Salary
Salary:
Not provided
https://www.ikea.com Logo
IKEA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Software development principles
  • Programming language skills
  • Experience with Python (object-oriented)
  • Experience with REST-based frameworks like FastAPI
  • Frontend development skills
  • Cloud platform experience (Azure preferred)
  • Infrastructure-as-code experience (Terraform)
  • GitHub Actions for automation
  • Testing and quality focus
  • Experience with SSO, permissions, and access control
Job Responsibility
Job Responsibility
  • Design and develop cloud-based products
  • Build and evolve global application using AI and data
  • Enrich content with meaningful metadata
  • Create solutions for presenting and managing product information
  • Collaborate with cross-functional Agile team
  • Implement digital solutions for omnichannel content
  • Fulltime
Read More
Arrow Right

Senior AI Software Engineer

AnaVation is seeking a Senior Agentic-AI Software engineer to join our team that...
Location
Location
United States , Chantilly
Salary
Salary:
Not provided
anavationllc.com Logo
AnaVation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Active TS/SCI clearance within last 24 months
  • BA/BS in Computer Science or related field
  • BS + 10 Yrs or MS + 8 Yrs experience in computer science, AI, Machine Learning, or related field
  • 5+ years of experience in AI/ML development
  • At least 2 years focused on Agentic AI or autonomous systems
  • Proven track record of deploying production-grade AI systems
  • Strong problem-solving skills
  • Ability to work in a fast-paced, collaborative environment
Job Responsibility
Job Responsibility
  • Design, develop, and deploy advanced Agentic AI systems that autonomously perform complex tasks, make decisions, and interact with dynamic environments
  • Collaborate with cross-functional teams to deliver scalable, efficient, and ethical AI solutions
  • Architect and implement agentic AI systems capable of autonomous decision-making, task planning, and execution
  • Design and integrate multi-agent systems to solve complex problems
  • Develop and fine-tune large language models (LLMs) and reinforcement learning (RL) models
  • Implement robust APIs and interfaces to integrate AI agents with external systems
  • Optimize AI models for performance, scalability, and low-latency inference
  • Conduct rigorous testing, validation, and monitoring of AI agents
  • Collaborate with product managers, data scientists, and software engineers
  • Stay updated on latest advancements in Agentic AI, LLMs, and RL
What we offer
What we offer
  • Generous cost sharing for medical insurance for employee and dependents
  • 100% company paid dental insurance for employees and dependents
  • 100% company paid long-term and short term disability insurance
  • 100% company paid vision insurance for employees and dependents
  • 401k plan with generous match and 100% immediate vesting
  • Competitive Pay
  • Generous paid leave and holiday package
  • Tuition and training reimbursement
  • Life and AD&D Insurance
  • Fulltime
Read More
Arrow Right

Applied AI Engineer - AI Solutions

As an Applied AI Engineer, you’ll research and utilize state-of-the-art Gen AI a...
Location
Location
United States , Redwood City; San Francisco
Salary
Salary:
172000.00 - 300000.00 USD / Year
snorkel.ai Logo
Snorkel AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S. degree in a quantitative field such as Computer Science, Engineering, Mathematics, Statistics, or comparable degree/experience
  • 3+ years of customer-facing experience in the design and implementation of AI/ML solutions
  • Proficiency in Python, including strong grounding in software engineering fundamentals (e.g., modular design, testing, profiling, packaging) and experience with modern Python constructs and libraries for type validation and typed data modeling (e.g., pydantic), building type-safe systems (e.g., mypy), testing (e.g., pytest), packaging and environment configuration (e.g., poetry), API and service frameworks (e.g., FastAPI), serialization and structured data handling (e.g., msgspec), and orchestration tooling relevant to ML deployment (e.g., Ray, Airflow)
  • Expertise across the Applied AI stack, spanning classical ML libraries (e.g., scikit-learn), deep learning frameworks (e.g., PyTorch), foundation-model ecosystems (e.g., Hugging Face Transformers), vector/embedding tooling (e.g., FAISS), data processing frameworks (e.g., pandas, Spark), retrieval/RAG tooling (e.g., Chroma, Weaviate), synthetic dataset curation, evaluation workflows, and LLM orchestration, workflow, agent authoring tools (e.g., LlamaIndex, LangGraph, CrewAI)
  • Experience leading strategic, customer-facing initiatives and collaborating with business stakeholders to ensure ML solutions drive successful business outcomes, with a strong focus on teaching and enablement
  • Outstanding presentation skills to technical and executive audiences, whether impromptu on a whiteboard or using presentations and demos
  • Ability to work in a fast-paced environment and balance priorities across multiple projects at once
Job Responsibility
Job Responsibility
  • Partner with customers to build and deploy impactful Gen AI and machine learning solutions, from use case scoping and data exploration to model development and deployment. This may involve leveraging Snorkel Flow or designing custom approaches using state-of-the-art tools, with the goal of delivering real business value and informing the evolution of the Snorkel platform
  • Develop and implement state of the art AI systems such as retrieval-augmented generation (RAG), fine-tuning pipelines, prompt engineering recipes and agentic workflows
  • Create augmented real-world datasets and comprehensive evaluation workflows to ensure model reliability, transparency, and stakeholder trust. A data- and evaluation-first mindset is essential for success in this role
  • Forge and manage relationships with our customers’ leadership and stakeholders to ensure successful development and deployment of AI projects with Snorkel Flow
  • Collaborate closely with pre-sales Solutions and Product teams to map customer needs to existing capabilities, prioritize roadmap gaps, and guide successful project setup
  • Work with other Applied AI Engineers to standardize solutions and contribute to internal tooling and best practices
  • Lead stakeholder education on quantitative capabilities, helping them to understand the strengths and weaknesses of different approaches and what problems are best-suited for Snorkel AI
  • Serve as the voice of our customers for new AI paradigms, data science workflows, and share customer feedback to product teams
  • Conduct one-to-few and one-to-many enablement workshops to transfer knowledge to customers considering or already using Snorkel AI
  • Annual travel up to 25%
What we offer
What we offer
  • equity in the form of employee stock options
  • Fulltime
Read More
Arrow Right

Software Engineer

Software Engineer – Stealth AI Start-Up – Remote (US / Canada). I’m supporting a...
Location
Location
United States
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software engineering experience, ideally with exposure to developer tools, distributed systems, or high-performance applications
  • A strong academic foundation – typically demonstrated through excellent performance in a rigorous CS or engineering program
  • Great fit for someone coming from Big Tech who wants more ownership, autonomy, and direct product impact
  • Experience with compiled or systems-level languages (e.g., Rust, Go, C++, or similar) is a plus, but not required
  • Additional bonus experience with: Linux / shell development
  • Backend systems
  • GPU, graphics, or performance-oriented programming
  • Love building tools that improve developer workflows and productivity
  • Have strong engineering fundamentals and a user-focused mindset
  • Communicate clearly and collaborate well across teams
Job Responsibility
Job Responsibility
  • Build features across the full stack: design, development, testing, and deployment
  • Improve performance, reliability, and the end-to-end developer experience
  • Partner closely with engineering, product, growth, and marketing teams
  • Prototype new ideas and iterate quickly based on real user feedback
  • Mentor teammates and help shape a strong, high-quality engineering culture
  • Fulltime
Read More
Arrow Right

HPC/AI Software Engineering Intern

HPC/AI Software Engineering Intern role at Hewlett Packard Enterprise contributi...
Location
Location
United States , San Jose; Spring; Andover; Chippewa Falls
Salary
Salary:
40.00 - 46.00 USD / Hour
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Working towards a Master's and/or PhD degree with a focus in Computer Science, Information Systems, or equivalent
  • Experience or understanding of software systems design tools and languages
  • Good analytical and problem-solving skills
  • Understanding of design for software systems running on multiple platform types
  • Expertise and/or coursework in AI/HPC/networking a plus
Job Responsibility
Job Responsibility
  • Architects, designs, develops and debugs software programs for software enhancements and new products
  • Develops or augments software including operating systems, compilers, routers, networks, utilities, databases and Internet-related tools
  • Determines hardware compatibility and/or influences hardware design
  • Develops simulation models to influence architectural design
  • Codes and programs enhancements, updates, and changes for portions and subsystems of simulation and/or emulation software, systems software
  • Executes established test plans and protocols for assigned portions of code
  • identifies, logs, and debugs assigned issues
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

Senior AI Engineer

As a Senior AI Engineer on our AI Engineering team, you will be responsible for ...
Location
Location
Canada; United States
Salary
Salary:
160000.00 - 260000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of software engineering experience with a focus on production systems
  • 1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
  • Production LLM Applications: Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
  • Agent Development: Experience building multi-step AI agents, LLM chaining, and complex workflow automation
  • Prompt Engineering Expertise: Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
  • Python Proficiency: Expert-level Python skills for production AI systems
  • Backend Engineering: Strong experience building scalable backend systems, APIs, and distributed architectures
  • LangChain or Similar Frameworks: Experience with LangChain, LlamaIndex, or other LLM application frameworks
  • API Integration: Proven ability to integrate multiple APIs and services to create advanced AI capabilities
  • Production Deployment: Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)
Job Responsibility
Job Responsibility
  • Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
  • Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
  • Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
  • System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
  • Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
  • Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
  • Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • 401(k) plan
  • at least 10 paid holidays per year, flex PTO, and parental leave
  • employee assistance program and wellbeing benefits
  • global travel coverage
  • life/AD&D/STD/LTD insurance
  • FSA/HSA and medical, dental, and vision benefits
  • Fulltime
Read More
Arrow Right

Senior AI Engineer

We are seeking an innovative AI Engineer to join a brand new team focused on pro...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as an AI Engineer with a significant delivery history
  • Strong expertise in multiple programming languages & frameworks
  • Experience and proven experience in using quantitative testing practice applied to the field of AI/ML for actionable Go/No-Go decisions of delivering software to production
  • Demonstrated expertise of developing on a range of architectures, ideally up to and including container-based micro-services with focus on scalability, reliability, maintainability, and high performance
  • Good understanding of SQL and NoSQL databases
  • Excellent communication and collaboration skills
  • A growth mindset and willingness to learn and adapt in a fast-paced environment
  • Passion about site reliability engineering and its impact on product development
  • Being connected to latest technologies, like Generative AI, and keen to put them in practice.
Job Responsibility
Job Responsibility
  • Understand the landscape, tooling and procedures used by developers at Citi and look for opportunities to reduce toil and aid simplification using Gen AI based solutions
  • Apply classic AI and novel Gen AI evaluation methodology to raise the quality and reliability bar for the software that you will deliver, as well to manage and mitigate risks that are specific/inherent to this field
  • Advice on Evaluation metrics, devise and implement Quantitative Testing Plans, and help evolve the existing approaches to AI evaluation
  • Work with a wide variety of Citi technology teams and help them drive towards everything-as-code and a codified controls environment
  • Collaborate with product and engineering teams to design, build and maintain scalable and reliable web applications and services
  • Be hands-on with coding and software design to ensure adherence to high quality standards and best practices
  • Mentor and nurture other engineers to help them grow their skills and expertise
  • Support and drive cultural change, including instigating critical thinking about controls and processes and encouraging a culture of continuous improvement.
What we offer
What we offer
  • 27 days annual leave (plus bank holidays)
  • A discretional annual performance-related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources.
  • Fulltime
Read More
Arrow Right

Senior AI Engineer

As a Senior AI Engineer on our AI Engineering team, you will be responsible for ...
Location
Location
India
Salary
Salary:
Not provided
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of software engineering experience with a focus on production systems
  • 1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
  • Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
  • Experience building multi-step AI agents, LLM chaining, and complex workflow automation
  • Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
  • Expert-level Python skills for production AI systems
  • Strong experience building scalable backend systems, APIs, and distributed architectures
  • Experience with LangChain, LlamaIndex, or other LLM application frameworks
  • Proven ability to integrate multiple APIs and services to create advanced AI capabilities
  • Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)
Job Responsibility
Job Responsibility
  • Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
  • Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
  • Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
  • System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
  • Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
  • Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
  • Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions
What we offer
What we offer
  • Invest deeply in your growth, ensuring you have the resources, support, and autonomy to own your role and make a real impact
  • Collaboration is at our core—we’re all for one, meaning you’ll have a team across departments ready to help you succeed
  • We encourage bold ideas and courageous action, giving you the freedom to experiment, take smart risks, and drive big wins
Read More
Arrow Right