AI Engineer - Instrumentation Job at Arize

AI Product Engineer, New Grad

We are looking for exceptionally motivated new graduates to join our high-perfor...

Location

United States

Salary:

100000.00 - 135000.00 USD / Year

Arize

Expiration Date

Until further notice

Requirements

Taking ownership of complex problems from day one
Putting in the extra effort to learn new technologies rapidly
Pushing yourself outside your comfort zone regularly
Maintain high standards of code quality despite being new to the industry
Think critically about system and product design rather than just following instructions
Experience working with GraphQl or a comparable API technology
Experience working with ML, analytics, data science or data visualization products
Working knowledge of Machine Learning and/or Data Science
First-hand experience working with large language models (LLMs) or developing AI products

Job Responsibility

Part of the core team that drives AI product innovation
Understanding how some of the most impactful engineering teams are developing AI and LLM-powered applications
Building the right tools to enable them to do their best work
Working on product solutions ranging from clean APIs that magically instrument applications, interactive playgrounds for prompt engineering and agent development, or scaling up real-time evaluation infrastructure to handle millions of annotations per second
Diving into complex technical challenges like: Computing model evaluation metrics across billions of data points
Creating AI Agents that help customer troubleshoot their own applications
Building on top of a cutting-edge custom OLAP database
Implementing advanced dimensionality reduction techniques
Building systems that handle millions of annotations per second

What we offer

Competitive equity package
Comprehensive benefit package including: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave plan, others for mental and wellness support
WFH monthly stipend to pay for co-working spaces

Fulltime

New

Staff Software Engineer, AI & Automation

Mozilla is seeking a Staff Software Engineer to lead the next evolution of Servi...

Location

United States

Salary:

138000.00 - 217000.00 USD / Year

Mozilla

Expiration Date

Until further notice

Requirements

7+ years in IT engineering, enterprise applications, or service delivery
ITIL 4 Foundations certification (required)
Comfortable leading incident, problem, and change management (ITIL), measuring SLAs/SLOs, and using data to drive continuous service improvements
Demonstrated success owning platforms end-to-end, including lifecycle management, integrations, and adoption
Advanced proficiency in Python scripting — with proven experience developing, optimizing, and maintaining automation frameworks, APIs/webhooks, and integration logic across enterprise tools
Strong automation & scripting skills in one or more of: Python
with experience building APIs/webhooks, workflow engines, and chatbots
Advanced experience in AI & automation platforms (GenAI copilots, RPA, intelligent workflows), including security and governance guardrails for safe adoption
A builder’s mindset: bias for automation and documentation, empathy for end users, and a willingness to mentor Service Desk colleagues
Strong program/project management skills with proven ability to independently deliver initiatives

Job Responsibility

Roll out new collaboration and Enterprise GenAI capabilities: run pilots, manage change/comms, create guides, and deliver training that drives adoption and safety
Design and ship automations (scripts, workflows, chatbots, AI agents) to streamline provisioning/deprovisioning, entitlements, group lifecycle, and tier-1 deflection
Build monitoring and alerting for SaaS health and key workflows
lead incident, problem, and change practices to reduce MTTR and prevent recurrences
Define SLAs/SLOs, instrument CSAT and operational metrics, and run regular service reviews that turn data into improvements
Serve as technical escalation for complex tickets: drive resolution, perform root-cause analysis, and capture knowledge to uplevel the Service Desk
Maintain clean, current documentation: runbooks, KB articles, architecture diagrams, and admin playbooks
Champion a 'shift-left' model: expand self-service portals, guided flows, and AI virtual agents to improve velocity and user experience
Enterprise AI Security & Governance: implement guardrails for AI/automation usage, including access controls, data handling policies, compliance alignment, and ongoing risk monitoring
Cross-Functional Partnership: collaborate with People, Security, Finance, Legal, and Procurement to ensure platforms align with organizational goals

What we offer

Generous performance-based bonus plans
Rich medical, dental, and vision coverage
Generous retirement contributions with 100% immediate vesting
Quarterly all-company wellness days
Country specific holidays plus a day off for your birthday
One-time home office stipend
Annual professional development budget
Quarterly well-being stipend
Considerable paid parental leave
Employee referral bonus program

Fulltime

Staff Software Engineer, AI & Automation

Mozilla is seeking a Staff Software Engineer to lead the next evolution of Servi...

Location

United States; Canada

Salary:

128000.00 - 171000.00 CAD / Year

Mozilla

Expiration Date

Until further notice

Requirements

7+ years in IT engineering, enterprise applications, or service delivery
ITIL 4 Foundations certification (required)
Comfortable leading incident, problem, and change management (ITIL), measuring SLAs/SLOs, and using data to drive continuous service improvements
Demonstrated success owning platforms end-to-end, including lifecycle management, integrations, and adoption
Advanced proficiency in Python scripting — with proven experience developing, optimizing, and maintaining automation frameworks, APIs/webhooks, and integration logic across enterprise tools
Strong automation & scripting skills in one or more of: Python
with experience building APIs/webhooks, workflow engines, and chatbots
Advanced experience in AI & automation platforms (GenAI copilots, RPA, intelligent workflows), including security and governance guardrails for safe adoption
A builder’s mindset: bias for automation and documentation, empathy for end users, and a willingness to mentor Service Desk colleagues
Strong program/project management skills with proven ability to independently deliver initiatives

Job Responsibility

Roll out new collaboration and Enterprise GenAI capabilities: run pilots, manage change/comms, create guides, and deliver training that drives adoption and safety
Design and ship automations (scripts, workflows, chatbots, AI agents) to streamline provisioning/deprovisioning, entitlements, group lifecycle, and tier-1 deflection
Build monitoring and alerting for SaaS health and key workflows
lead incident, problem, and change practices to reduce MTTR and prevent recurrences
Define SLAs/SLOs, instrument CSAT and operational metrics, and run regular service reviews that turn data into improvements
Serve as technical escalation for complex tickets: drive resolution, perform root-cause analysis, and capture knowledge to uplevel the Service Desk
Maintain clean, current documentation: runbooks, KB articles, architecture diagrams, and admin playbooks
Champion a 'shift-left' model: expand self-service portals, guided flows, and AI virtual agents to improve velocity and user experience
Enterprise AI Security & Governance: implement guardrails for AI/automation usage, including access controls, data handling policies, compliance alignment, and ongoing risk monitoring
Cross-Functional Partnership: collaborate with People, Security, Finance, Legal, and Procurement to ensure platforms align with organizational goals

What we offer

Generous performance-based bonus plans to all eligible employees
Rich medical, dental, and vision coverage
Generous retirement contributions with 100% immediate vesting (regardless of whether you contribute)
Quarterly all-company wellness days where everyone takes a pause together
Country specific holidays plus a day off for your birthday
One-time home office stipend
Annual professional development budget
Quarterly well-being stipend
Considerable paid parental leave
Employee referral bonus program

Fulltime

New

Sr AI Engineer

At Schwab, you’re empowered to make an impact on your career. Here, innovative t...

Location

United States , Austin

Salary:

150000.00 - 175000.00 USD / Year

Charles Schwab

Expiration Date

January 11, 2026

Requirements

8+ years of data engineering experience, with 4+ years as a hands-on senior engineer
4+ years developing scalable workflows and data pipelines that interface with large and complex datasets
3+ years designing and implementing solutions utilizing Artificial Intelligence components such as NLP, LLMs, or machine learning techniques
Bachelor’s degree in Computer Science, Data Engineering, Mathematics, Analytics, or related field
2+ years working hands-on with containers and cloud-native platforms

Job Responsibility

Building the next generation Generative AI solutions that shape the future of technology at Schwab
Contribute to the development and deployment of AI products that are instrumental in driving data-informed business decisions and elevating client experiences
Collaborate across teams to deliver scalable, secure, and high-performing AI systems that align with Schwab’s innovation strategy and operational goals

What we offer

401(k) with company match and Employee stock purchase plan
Paid time for vacation, volunteering, and 28-day sabbatical after every 5 years of service for eligible positions
Paid parental leave and family building benefits
Tuition reimbursement
Health, dental, and vision insurance
Bonus or incentive opportunities

Fulltime

New

AI Quality Lead

As the AI Quality Lead for the Artificial Intelligence Center of Excellence (AI ...

Location

United States of America , Lincolnshire, Illinois

Salary:

100000.00 - 160000.00 USD / Year

Alight Solutions

Expiration Date

Until further notice

Requirements

Experience leading or building quality engineering or testing programs (AI/ML experience is a plus, but not required)
Ability to design and implement test strategies, automation frameworks, and quality standards
Excellent communication and leadership skills
ability to work cross-functionally and influence stakeholders.
Experience with LLM, RAG, agentic, or classic ML systems
Familiarity with test automation frameworks, CI/CD pipelines, and evaluation tools (promptfoo, TruLens, Ragas)
Knowledge of fairness, explainability, safety, and security standards (e.g., OWASP Top 10, MITRE ATLAS, Fairlearn, AIF360)
Experience with data integrity, lineage, and observability (OpenTelemetry, New Relic, OpenLineage)
Familiarity with AI infrastructure, orchestration, data integrity, deployments, and model registry practices
Knowledge of international standards and regulatory frameworks for Responsible AI

Job Responsibility

Design and implement the unified AI Quality strategy and SOP, scaling controls by risk tier (Tier 1–3)
Define and own success metrics, risk tiering, acceptance criteria, and operating thresholds for AI solutions
Lead the development of golden/adversarial test suites (prompt injection, misuse, safety, bias, functional automation)
Oversee the creation and maintenance of schema-level UI/API tests, agent contracts, and observability instrumentation
Own the org-wide evaluation harnesses (e.g., promptfoo, TruLens, Ragas), CI gating, and red-team playbooks
Manage independent spot checks, factsheets, registry entries, and evidence for governance and audit
Collaborate with Product Owners, Developers, SRE/Observability, and Governance to ensure compliance and operational excellence
Drive continuous improvement in fairness, explainability, safety, security, and operational SLOs
Mentor and grow the AI Quality team, including onboarding and coaching junior engineers

What we offer

Flexible working arrangements
Variety of health coverage options
Wellbeing and support programs
Retirement plans
Vacation and sick leave
Maternity, paternity & adoption leave
Continuing education and training
Voluntary benefit options

Fulltime

New

Sr Software Engineering Lead

At Schwab, you’re empowered to make an impact on your career. Here, innovative t...

Location

United States , Austin

Salary:

150000.00 - 175000.00 USD / Year

Charles Schwab

Expiration Date

January 11, 2026

Requirements

8+ years of software development experience, with 4+ years as a hands-on senior engineer
Bachelor’s degree in Computer Science or related field
5+ years building complex products from scratch, nurturing them in production, and ensuring operational reliability
3+ years developing applications and data pipelines interfacing with large datasets
5+ years working with containers and cloud-native applications, operationalizing them in the public cloud with infrastructure as code

Job Responsibility

Building the next generation Generative AI solutions that shape the future of technology at Schwab
Contribute to the development and deployment of AI products that are instrumental in driving data-informed business decisions and elevating client experiences
Collaborate across teams to deliver scalable, secure, and high-performing AI systems that align with Schwab’s innovation strategy and operational goals

What we offer

401(k) with company match and Employee stock purchase plan
Paid time for vacation, volunteering, and 28-day sabbatical after every 5 years of service for eligible positions
Paid parental leave and family building benefits
Tuition reimbursement
Health, dental, and vision insurance
Bonus or incentive opportunities

Fulltime

New

Software Engineer, Developer Productivity

We are looking for a Software Engineer, Developer Productivity to shape the way ...

Location

United States , San Francisco Bay Area

Salary:

140000.00 - 265000.00 USD / Year

Glean

Expiration Date

Until further notice

Requirements

Strong software engineering background (Java, Go, Python, or similar)
Experience with build systems (Bazel strongly preferred
Buck, Blaze, Gradle, or Maven acceptable)
Hands-on with CI/CD systems (GitHub Actions, Buildkite, Jenkins, etc.)
Familiarity with Docker/Kubernetes, cloud runners, and distributed build/test environments
Strong debugging skills and an interest in solving workflow bottlenecks
Passion for multiplying the effectiveness of other engineers

Job Responsibility

Develop and maintain our Bazel monorepo with support for multiple languages
Improve build hermeticity, caching, reproducibility, and dependency management
Extend Bazel with custom rules, macros, and integrations
Operate and optimize pipelines on GitHub Actions, Kubernetes, and cloud runners
Reduce CI latency through remote execution, caching, and parallelization
Instrument pipelines with telemetry and dashboards to measure speed, reliability, and cost
Build tools and workflows (CLI utilities, IDE plugins, GitHub bots) that improve day-to-day developer experience
Automate debugging of flaky tests and CI failures
Simplify onboarding and local dev environments
Enable engineers to integrate AI-powered coding assistants (e.g. GitHub Copilot, Cursor, Claude) into daily workflows

What we offer

Medical, Vision, and Dental coverage
generous time-off policy
opportunity to contribute to your 401k plan
home office improvement stipend
annual education and wellness stipends
healthy lunches daily

Fulltime

New

Delivery Quality Engineer, AI Business

As a Delivery Quality Engineer within Prolific AI Data Services, you will be the...

Location

Mexico , Mexico City

Salary:

Not provided

Prolific

Expiration Date

Until further notice

Requirements

5+ years of experience in quality engineering, data or annotation quality, analytics engineering, trust and integrity, or ML/LLM evaluation operations
Strong proficiency in Python and SQL, with comfort applying statistical concepts such as sampling strategies, confidence levels, and agreement metrics
A proven track record of turning ambiguous or messy quality problems into clear metrics, automated checks, and durable process improvements
Strong quality systems thinking, with the ability to translate complex edge cases into clear rules, tests, rubrics, and governance mechanisms
Hands-on experience instrumenting workflows and implementing pragmatic automation that catches quality and integrity issues early
Demonstrated ability to influence cross-functional teams (Product, Engineering, Operations, Client teams) and drive change without direct authority
Strong customer empathy, with a clear understanding of what “useful, trustworthy data” means for research, AI training, and evaluation use cases

Job Responsibility

Own end-to-end quality design for Prolific managed service studies, including rubrics, acceptance criteria, defect taxonomies, severity models, and clear definitions of done
Define, implement, and maintain quality measurement systems, including sampling plans, golden sets, calibration protocols, agreement targets, adjudication workflows, and drift detection
Build and deploy automated quality checks and launch gates using Python and SQL, such as schema and format validation, completeness checks, anomaly detection, consistency testing, and label distribution monitoring
Design and run launch readiness processes, including pre-launch checks, pilot calibration, ramp criteria, full-launch thresholds, and pause/rollback mechanisms
Partner with Product and Engineering to embed in-study quality controls and authenticity checks into workflows, tooling, and escalation paths
Write and continuously improve guidelines and training materials to keep participants, reviewers, and internal teams aligned on evolving quality standards
Investigate quality and integrity issues end to end, running root-cause analysis across guidelines, UX, screening, training, and operations, and driving corrective and preventive actions (CAPAs)
Build dashboards and operating cadences to track defect rates, rework, throughput versus quality trade-offs, integrity events, and SLA adherence
Lead calibration sessions and coach QA leads and reviewers to improve decision consistency, rubric application, and overall quality judgement
Translate one-off quality fixes into repeatable, scalable playbooks across customers, programs, and study types

What we offer

competitive salary
benefits
remote working
impactful, mission-driven culture
equity
opportunity to earn a cash variable element, such as a bonus or commission

Fulltime

AI Engineer - Instrumentation

Arize

Location:
United States

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
December 06, 2025

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for AI Engineer - Instrumentation

AI Product Engineer, New Grad

Staff Software Engineer, AI & Automation

Staff Software Engineer, AI & Automation

Sr AI Engineer

AI Quality Lead

Sr Software Engineering Lead

Software Engineer, Developer Productivity

Delivery Quality Engineer, AI Business

AI Engineer - Instrumentation

Arize

Location:United States

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:December 06, 2025

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for AI Engineer - Instrumentation

AI Product Engineer, New Grad

Staff Software Engineer, AI & Automation

Staff Software Engineer, AI & Automation

Sr AI Engineer

AI Quality Lead

Sr Software Engineering Lead

Software Engineer, Developer Productivity

Delivery Quality Engineer, AI Business

Location:
United States

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
December 06, 2025