CrawlJobs Logo

Staff Infrastructure Software Engineer, Enterprise AI

scale.com Logo

Scale

Location Icon

Location:
United States , New York

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

216200.00 - 270250.00 USD / Year

Job Description:

Scale GP is building the next generation of enterprise-grade Generative AI products. Our platform provides APIs for knowledge retrieval, inference, and evaluation, enabling customers to build and deploy powerful Agentic workflows for Enterprise use cases. We're looking for a Senior Infrastructure Software Engineer to build and scale our core infrastructure in a fast-paced environment. This team is key to our mission, directly enabling the deployment of these agentic flows for our customers.This is a unique opportunity for an infrastructure leader who is passionate about defining the future of AI deployments. You will be at the forefront of the industry, solving complex, bleeding-edge problems in scalability, security, and developer efficiency. You will architect and implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail.

Job Responsibility:

  • Define the architectural patterns for our multi-cloud infrastructure to support secure, reliable, and scalable Agentic workflows for enterprise customers
  • Lead the infrastructure roadmap with a strong focus on compliance, privacy, and security standards, including designing change management and data isolation strategies
  • Own the development and maintenance of our best-in-class Agentic observability platform (logging, metrics, tracing, and analytics) to proactively ensure system health and enable rapid incident response
  • Drive developer efficiency by building automated tooling and championing Infrastructure-as-Code (IaC) paradigms throughout the engineering organization
  • Solve the toughest engineering problems related to multi-tenancy, data isolation, and high-performance inference at a massive scale, taking end-to-end ownership across the full product lifecycle

Requirements:

  • Proven experience in a senior role
  • 5+ years of full-time software engineering experience
  • Deep understanding of modern infrastructure practices, including CI/CD, IaC (e.g., Terraform, Helm Charts), container orchestration (e.g., Kubernetes) and observability platforms (e.g., Datadog, Prometheus, Grafana)
  • Extensive experience with at least one major cloud provider (AWS, Azure, or GCP)
  • Strong knowledge of security and compliance in enterprise environments, with a focus on access management, data isolation, and customer-specific VPC setups
  • Proficiency in Python or JavaScript/TypeScript, and SQL

Nice to have:

Hands-on experience and a passion for working with Agents, LLMs, vector databases, and other emerging AI technologies

What we offer:
  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO
  • equity based compensation
  • additional benefits such as a commuter stipend

Additional Information:

Job Posted:
February 20, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Staff Infrastructure Software Engineer, Enterprise AI

Staff Software Engineer, AI Runtime

We’re seeking a Staff Software Engineer to help power the future of agentic AI w...
Location
Location
United States
Salary
Salary:
185000.00 - 215000.00 USD / Year
apollographql.com Logo
Apollo GraphQL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expertise in agent-to-tool orchestration, routing, and coordination in scalable, fault-tolerant systems
  • Deep expertise in Rust programming language
  • Strong background in distributed systems, server architecture, and high-performance backend development
  • Proven experience with protocol design, message routing, and server-side orchestration frameworks
  • Experience building and maintaining robust runtime infrastructure that supports AI-driven workflows and enables reliable agent-to-tool interactions
  • Proven experience with protocol design, message routing, and building server-side frameworks that enable scalable, reliable multi-tool agent workflows
  • Hands-on experience with observability, monitoring, and debugging frameworks for complex systems
  • Passion for clean, maintainable code, high system reliability, and scalable architecture
  • Experience in strategic system design, making architectural trade-offs, and planning for long-term scalability and maintainability
  • Strong technical leadership and mentorship, including guiding junior engineers and driving engineering best practices across teams
Job Responsibility
Job Responsibility
  • Architect and scale an enterprise AI/MCP Server and Gateway that powers multi-agent workflows across Apollo, including routing, orchestration, and integration boundaries
  • Design and implement robust server infrastructure to ensure reliability, performance, and security at scale
  • Build and maintain tools for agent discovery, communication, and coordination
  • Define deployment strategies and runtime optimizations to maximize efficiency and minimize operational overhead
  • Develop frameworks and patterns that enable seamless multi-agent collaboration and AI-driven orchestration
  • Integrate observability, logging, and monitoring for full visibility into server and agent behavior
  • Explore and implement AI-enhanced developer workflows to optimize orchestration and agent interactions
  • Collaborate with teams across Apollo to ensure the MCP Server meets evolving product and developer needs
What we offer
What we offer
  • Offers Equity
  • Choice of 3 Anthem Blue Cross medical plans (California residents can also choose from an additional 2 Kaiser medical plans)
  • Dental and Vision benefits are provided by Sun Life Financial
  • Fulltime
Read More
Arrow Right

Staff AI Engineer

As a Staff AI Engineer you will get to play with petabyte data gathered from a m...
Location
Location
Salary
Salary:
Not provided
balbix.com Logo
Balbix
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ph.D./M.S. in Computer Science or Electrical Engineering with hands-on software engineering experience
  • 5+ years of experience in the field of Machine Learning and programming in Python
  • Expertise in programming concepts and building large scale systems
  • Knowledge of state-of-the-art algorithms combined with expertise in statistical analysis and modeling
  • Robust understanding of NLP, Probabilistic Graphical Models, Deep Learning with graphs structures, model explainability, etc.
  • Foundational knowledge of probability, statistics and linear algebra
Job Responsibility
Job Responsibility
  • Design and develop an ensemble of classical and deep learning algorithms for modeling complex interactions between people, software, infrastructure and policies in an enterprise environment
  • Design and implement algorithms for statistical modeling of enterprise cybersecurity risk
  • Apply data-mining, AI and graph analysis techniques to address a variety of problems including modeling, relevance and recommendation
  • Build production quality solutions that balance complexity and performance
  • Participate in the engineering life-cycle at Balbix, including designing high quality ML infrastructure and data pipelines, writing production code, conducting code reviews and working alongside our infrastructure and reliability teams
  • Drive the architecture and the usage of open source software library for numerical computation such as TensorFlow, PyTorch, and ScikitLearn
  • Fulltime
Read More
Arrow Right
New

Staff Software Engineer, Embedded Experience

At Harvey, we’re transforming how legal and professional services operate — not ...
Location
Location
United States , San Francisco
Salary
Salary:
238000.00 - 312000.00 USD / Year
harvey.ai Logo
Harvey
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of professional software engineering experience, with deep expertise in backend or backend-leaning fullstack development
  • A strong track record of designing and building scalable, production-grade systems—including backend systems, APIs, services, and infrastructure for complex, distributed, or latency-sensitive applications—in SaaS or high-growth environments
  • Comfort working close to the product surface and directly with customers, translating qualitative feedback into technical solutions
  • Strong communication skills and the ability to collaborate effectively across engineering, product, design, and customer-facing teams
  • Excellent context-switching abilities and comfort operating in ambiguous, exploratory problem spaces
  • A bias toward ownership and action
Job Responsibility
Job Responsibility
  • Own and lead the backend architecture for Harvey’s embedded experiences, including integrations with enterprise platforms like Microsoft Word and Outlook
  • Design and build scalable, reliable backend systems and APIs that support AI-powered workflows across diverse customer environments
  • Partner directly with customers to deeply understand their workflows, validate hypotheses, and translate insights into durable, extensible product features
  • Drive technical decisions in a high-autonomy environment, where problem definition, scope, and success metrics are often shaped by the team rather than handed down
  • Collaborate closely with frontend engineers, product managers, and designers to shape cohesive, high-quality embedded experiences
  • Navigate ambiguity and help define new products and technical foundations for customer segments that are new to Harvey
  • Mentor engineers and raise the bar on system design, code quality, and engineering judgment across the team
What we offer
What we offer
  • Offers Equity
  • Offers Bonus
  • Comprehensive health, dental and vision coverage
  • retirement benefits (401k match up to 4%)
  • flexible PTO
  • Fulltime
Read More
Arrow Right
New

Staff Software Engineer, Embedded Experience

The Embedded Experience team operates like an internal innovation lab at Harvey,...
Location
Location
United States , New York
Salary
Salary:
238000.00 - 312000.00 USD / Year
harvey.ai Logo
Harvey
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of professional software engineering experience, with deep expertise in backend or backend-leaning fullstack development
  • A strong track record of designing and building scalable, production-grade systems—including backend systems, APIs, services, and infrastructure for complex, distributed, or latency-sensitive applications—in SaaS or high-growth environments
  • Comfort working close to the product surface and directly with customers, translating qualitative feedback into technical solutions
  • Strong communication skills and the ability to collaborate effectively across engineering, product, design, and customer-facing teams
  • Excellent context-switching abilities and comfort operating in ambiguous, exploratory problem spaces
  • A bias toward ownership and action
Job Responsibility
Job Responsibility
  • Own and lead the backend architecture for Harvey’s embedded experiences, including integrations with enterprise platforms like Microsoft Word and Outlook
  • Design and build scalable, reliable backend systems and APIs that support AI-powered workflows across diverse customer environments
  • Partner directly with customers to deeply understand their workflows, validate hypotheses, and translate insights into durable, extensible product features
  • Drive technical decisions in a high-autonomy environment, where problem definition, scope, and success metrics are often shaped by the team rather than handed down
  • Collaborate closely with frontend engineers, product managers, and designers to shape cohesive, high-quality embedded experiences
  • Navigate ambiguity and help define new products and technical foundations for customer segments that are new to Harvey
  • Mentor engineers and raise the bar on system design, code quality, and engineering judgment across the team
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • retirement benefits (401k match up to 4%)
  • flexible PTO
  • equity plan
  • bonus
  • Fulltime
Read More
Arrow Right
New

Staff Software Engineer, Full-Stack - Enterprise Gen AI

Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform provi...
Location
Location
United States , New York; San Francisco; Seattle
Salary
Salary:
248400.00 - 310500.00 USD / Year
scale.com Logo
Scale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience developing frontend or fullstack applications in a modern tech stack
  • Strong proficiency in Next.js, React, TypeScript, and Tailwind, with an eye for building polished, user-friendly interfaces
  • Experience working on high-visibility, customer-facing applications and making trade-offs between speed and quality in fast-paced environments
  • A passion for AI and experience working on interactive AI applications, agent-based systems, or data-rich web platforms
  • Familiarity with backend technologies such as FastAPI, PostgreSQL, GraphQL, and cloud infrastructure like AWS, Azure, or GCP
  • A track record of collaborating cross-functionally with design, product, and ML teams to bring AI-powered applications to life
Job Responsibility
Job Responsibility
  • Build and enhance user-facing AI applications for major enterprise customers, including high-profile media and Fortune 500 companies
  • Develop and refine features for Scale’s GenAI Platform, empowering businesses to build, deploy, and manage AI-driven agents
  • Design, build, and optimize polished, high-performance UIs using Next.js, React, TypeScript, and Tailwind
  • Work closely with product managers, designers, and AI/ML teams to create seamless, intuitive, and impactful user experiences
  • Integrate frontend applications with backend services, working with APIs, authentication systems, and cloud-based infrastructure
  • Ship features at a rapid pace while maintaining a high level of code quality, performance, and accessibility
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO
  • commuter stipend
  • equity
  • Stock Options
  • Fulltime
Read More
Arrow Right
New

Staff Software Engineer, Full Stack

At Harvey, we’re transforming how legal and professional services operate — not ...
Location
Location
Canada , Toronto
Salary
Salary:
Not provided
harvey.ai Logo
Harvey
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ YoE (post-BS/MS) in a product focused full-stack software engineering role
  • Experience with React, Typescript, CSS (we use TailwindCSS), Python, or related
  • Track record of building fast-growing SaaS products by leveraging PWA technologies
  • Track record of shipping highly intuitive products, strong attention to detail
  • Experience building backend platforms that can support multiple product lines
  • Strong programming skills and general Computer Science knowledge
Job Responsibility
Job Responsibility
  • Design and build foundational infrastructure including authentication, permissions, feature flagging, notifications, and document management integrations
  • Build and evolve Harvey’s internal product platform, accelerating development across multiple product lines and engineering teams
  • Lead development of enterprise-facing features, such as secure multi-party collaboration, cross-organization workflows, and robust admin controls
  • Maintain high standards for security, privacy, and system reliability, particularly in handling sensitive legal data
  • Collaborate cross-functionally with product, AI, design, and GTM teams to deliver delightful, enterprise-ready experiences
What we offer
What we offer
  • Be part of building something special as a founding member of our Toronto team
  • Structured hybrid working arrangement: 3 days in our Toronto office, 2 days working from home
  • Relocation assistance to new employees
  • Fulltime
Read More
Arrow Right

Director – Senior Engineering Manager in Enterprise Technology

The Senior Engineering Manager is a senior management level position within Ente...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of relevant leadership and delivery experience in an Engineering focused role with extensive experience in global business, functional and people management
  • Experience working in Financial Services or a large complex and/or global environment
  • Exposure to working with AI-assisted software development models, and experience implementing Gen AI use cases
  • Experience providing leadership for scaled agile release trains preferred
  • program management experience helpful
  • Demonstrated ability to influence remote, senior stakeholders including senior business executives
  • Experience in tracking and monitoring delivery, productivity and organizational health metrics
  • Experience planning, forecasting and managing technology budgets at team level, including project tracking and governance
  • Demonstrated systems thinking, critical analysis and design thinking skills
  • Ability to work in a globally matrixed environment and partner with virtual teams and external partners
Job Responsibility
Job Responsibility
  • Lead and manage a set of engineering teams to deliver business and technology value, working with peers and partners. Actively speed up and improve engineering practices ensuring higher levels of productivity and quality
  • Define and implement the workforce strategy creating an organization of happy, productive, engaged, co-located engineering teams comprised of direct and supplier staff located globally, including workforce planning, hiring, performance and pay management, and exits
  • Implement career development frameworks and processes for the team, providing coaching, mentoring and development of engineering and related job families
  • Be a great partner, but also hold your peers (Product, UX, Architecture) accountable for partnering with you in delivery
  • Actively participate as a stakeholder in Product discussions, providing valuable input on product roadmap and requirements and advocating for initiatives such as technical debt reduction, modernization of technology assets, and improvements in ways of working​
  • Be a strong advocate for and drive the adoption of modern engineering practices including scaled agile, DevOps, CI/CD and automation, and build a culture of engineering and continuous improvement, with a focus on velocity, quality and agility
  • Stay abreast of domain and industry developments and advocate relevant technology strategies as appropriate, including the use of AI, cloud, data technologies, and third-party products, and drive a culture of innovation
  • Recommend and evaluate SaaS or third-party products as appropriate and manage existing SaaS and third-party products, licenses and vendor relationships. Work with third party product vendors to design, implement and upgrade risk-compliant, secure, fit for purpose products with the right architecture, infrastructure and monitoring
  • Develop and implement the technology roadmap and strategy and provide ownership for technology products, working in partnership with the product team, peers, business stakeholders, and technology partners
  • Build productive relationships with business counterparts and support the execution of key programs working in partnership with business, infrastructure and security teams
  • Fulltime
Read More
Arrow Right

Senior Specialist IT AV Technology

Our IT team plays a critical role in enabling collaboration and innovation acros...
Location
Location
United States of America , Somerville
Salary
Salary:
82000.00 - 111315.00 USD / Year
about.puma.com Logo
Puma Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-7+ years in enterprise AV/UC environments, with at least 3 years in a senior or architect-level role
  • CTS-D or CTS-I (AVIXA), Crestron Certified Programmer, Cisco Collaboration certifications, ITIL
  • Deep expertise in AV-over-IP, video codecs, DSP programming, and network protocols
  • Hands-on experience with Microsoft Teams Rooms, Zoom Rooms, Polycom, Cisco Webex
  • Working knowledge of video production and audio mixing software (e.g., editing platforms, virtual audio mixers, and sound‑design tools) to support high‑quality multimedia content creation and live event streams
  • Strong leadership, vendor management, and executive communication skills
  • Bachelor’s in Computer Science, Electrical Engineering, or related field
Job Responsibility
Job Responsibility
  • Architect and implement enterprise AV solutions for conference rooms, executive boardrooms, showrooms and event spaces
  • Define AV standards, governance, and lifecycle management strategies
  • Evaluate emerging technologies (AR/VR collaboration, AI-driven AV analytics, unified communication hardware and software) for adoption
  • Configure and manage AV control systems (Crestron, AMX), video conferencing platforms (Microsoft Teams Rooms), and integrated collaboration tools
  • Oversee AV network integration, QoS, and security compliance
  • Perform troubleshooting for complex AV and unified communications issues
  • Primary technical contact for in-office digital signage (AppSpace & Vidari)
  • Lead AV infrastructure projects from concept to deployment, including budgeting, vendor selection, and risk management
  • Coordinate global rollouts of AV standards and technologies
  • Collaborate with remote IT, end users and vendors on events like regional town halls, sales meetings, product launch events
What we offer
What we offer
  • Bonus
  • Benefits
  • Fulltime
Read More
Arrow Right