CrawlJobs Logo
Scale Logo Scale · IT - Software Development

Infrastructure Software Engineer, Enterprise GenAI

United States, San Francisco 216200.00 - 270250.00 USD / Year · Job Posted March 04, 2026
Apply Position
Job Link Share

Job Description

Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our core infrastructure in a fast-paced environment. The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems. You will implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail.

Job Responsibility

  • Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers
  • Implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
  • Collaborate with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs
  • Deliver experiments at a high velocity and level of quality to engage our customers
  • Work across the entire product lifecycle from conceptualization through production
  • Be able, and willing, to multi-task and learn new technologies quickly

Requirements

  • 4+ years of full-time engineering experience, post-graduation
  • Experience scaling products at hyper growth startups
  • Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies
  • Proficient in Python or Javascript/Typescript, and SQL
  • Experience with Kubernetes
  • Experience with major cloud providers (AWS, Azure, GCP)
  • Excellent communication skills with the ability to explain technical concepts to both technical and non-technical audiences

What we offer

  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO
  • commuter stipend
  • equity grant
Scale - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Infrastructure Software Engineer, Enterprise GenAI

8 matching positions

Software Engineer, Enterprise

At Scale AI, we’re not just building AI tools—we’re pioneering the next era of e...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
scale.com Logo
Scale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience developing large-scale backend or infrastructure systems, with a strong emphasis on distributed services, reliability, and scalability
  • Proficiency in Python or TypeScript, with experience designing high-performance APIs and backend architectures using frameworks such as FastAPI, Flask, Express, or NestJS
  • Deep familiarity with cloud infrastructure (AWS and Azure preferred), including container orchestration (Kubernetes, Docker) and Infrastructure-as-Code tools like Terraform
  • Experience managing data systems such as relational and NoSQL databases (PostgreSQL, DynamoDB, etc.) and building pipelines for data-intensive applications
  • Hands-on experience with GenAI applications, model integration, or AI agent systems—understanding how to deploy, evaluate, and scale AI workloads in production
  • Strong understanding of observability, CI/CD, and security best practices for running services in enterprise or multi-tenant environments
  • Ability to balance rapid iteration with production-grade quality, shipping reliable backend systems in fast-paced environments
  • Collaborative mindset, working closely with ML, infra, and product teams to bring complex GenAI systems into production at enterprise scale
Job Responsibility
Job Responsibility
  • Design, build, and scale backend systems that power enterprise GenAI products, focusing on reliability, performance, and deployment across both Scale’s and customers’ infrastructure
  • Develop core services and APIs that integrate AI models and enterprise data sources securely and efficiently, enabling production-scale AI adoption
  • Architect scalable distributed systems for data processing, inference, and orchestration of large-scale GenAI workloads
  • Optimize backend performance for latency, throughput, and cost—ensuring AI applications can operate at enterprise scale across hybrid and multi-cloud environments
  • Manage and evolve cloud infrastructure (AWS, Azure, or GCP), driving automation, observability, and security for large-scale AI deployments
  • Collaborate with ML and product teams to bring cutting-edge GenAI models into production through efficient APIs, model serving systems, and evaluation frameworks
  • Continuously improve reliability and scalability, applying strong engineering practices to make AI systems robust, maintainable, and enterprise-ready
Read More
Arrow Right

Software Engineer (Backend), Enterprise

At Scale AI, we’re not just building AI tools—we’re pioneering the next era of e...
Location
Location
Hungary , Budapest
Salary
Salary:
Not provided
scale.com Logo
Scale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience developing large-scale backend or infrastructure systems, with a strong emphasis on distributed services, reliability, and scalability
  • Proficiency in Python or TypeScript, with experience designing high-performance APIs and backend architectures using frameworks such as FastAPI, Flask, Express, or NestJS
  • Deep familiarity with cloud infrastructure (AWS and Azure preferred), including container orchestration (Kubernetes, Docker) and Infrastructure-as-Code tools like Terraform
  • Experience managing data systems such as relational and NoSQL databases (PostgreSQL, DynamoDB, etc.) and building pipelines for data-intensive applications
  • Hands-on experience with GenAI applications, model integration, or AI agent systems—understanding how to deploy, evaluate, and scale AI workloads in production
  • Strong understanding of observability, CI/CD, and security best practices for running services in enterprise or multi-tenant environments
  • Ability to balance rapid iteration with production-grade quality, shipping reliable backend systems in fast-paced environments
  • Collaborative mindset, working closely with ML, infra, and product teams to bring complex GenAI systems into production at enterprise scale
Job Responsibility
Job Responsibility
  • Design, build, and scale backend systems that power enterprise GenAI products, focusing on reliability, performance, and deployment across both Scale’s and customers’ infrastructure
  • Develop core services and APIs that integrate AI models and enterprise data sources securely and efficiently, enabling production-scale AI adoption
  • Architect scalable distributed systems for data processing, inference, and orchestration of large-scale GenAI workloads
  • Optimize backend performance for latency, throughput, and cost—ensuring AI applications can operate at enterprise scale across hybrid and multi-cloud environments
  • Manage and evolve cloud infrastructure (AWS, Azure, or GCP), driving automation, observability, and security for large-scale AI deployments
  • Collaborate with ML and product teams to bring cutting-edge GenAI models into production through efficient APIs, model serving systems, and evaluation frameworks
  • Continuously improve reliability and scalability, applying strong engineering practices to make AI systems robust, maintainable, and enterprise-ready
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, Full-Stack - Enterprise Gen AI

Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform provi...
Location
Location
United States , New York; San Francisco; Seattle
Salary
Salary:
248400.00 - 310500.00 USD / Year
scale.com Logo
Scale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience developing frontend or fullstack applications in a modern tech stack
  • Strong proficiency in Next.js, React, TypeScript, and Tailwind, with an eye for building polished, user-friendly interfaces
  • Experience working on high-visibility, customer-facing applications and making trade-offs between speed and quality in fast-paced environments
  • A passion for AI and experience working on interactive AI applications, agent-based systems, or data-rich web platforms
  • Familiarity with backend technologies such as FastAPI, PostgreSQL, GraphQL, and cloud infrastructure like AWS, Azure, or GCP
  • A track record of collaborating cross-functionally with design, product, and ML teams to bring AI-powered applications to life
Job Responsibility
Job Responsibility
  • Build and enhance user-facing AI applications for major enterprise customers, including high-profile media and Fortune 500 companies
  • Develop and refine features for Scale’s GenAI Platform, empowering businesses to build, deploy, and manage AI-driven agents
  • Design, build, and optimize polished, high-performance UIs using Next.js, React, TypeScript, and Tailwind
  • Work closely with product managers, designers, and AI/ML teams to create seamless, intuitive, and impactful user experiences
  • Integrate frontend applications with backend services, working with APIs, authentication systems, and cloud-based infrastructure
  • Ship features at a rapid pace while maintaining a high level of code quality, performance, and accessibility
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO
  • commuter stipend
  • equity
  • Stock Options
  • Fulltime
Read More
Arrow Right
New

Senior Software Engineer (Golang) - AI Products

We are Citi’s Application, Platform and Engineering group, a start-up with the e...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 9+ Years of Hands-on experience
  • Mastery of Modern Stacks: Expert-level fluency in Golang and Python
  • Cloud-Native & Infrastructure: Deep expertise in the Kubernetes ecosystem, container orchestration, and modern security paradigms
  • Applied GenAI: Understanding of language models, embeddings models and RAG architectures
  • AI Infrastructure: Proven experience designing control planes, sandboxing systems for AI experimentation, and managing large-scale vector stores and search algorithms
  • Data Engineering: Extensive experience in large-scale ETL development and data pipeline architecture
  • Security & Governance: Experience maintaining and/or contributing to bug bounty, responsible disclosure programs, and AI safety/guardrail implementations
  • Startup Agility: Experience leading technical initiatives within fast-paced startup environments or driving startup-like agility within a large enterprise
Job Responsibility
Job Responsibility
  • Engineering at scale: You will build scaled, robust services and platforms centred around generative AI, including developing CLIs, SDKs, runtimes and more
  • Thought Leadership: Drive architectural vision and lead the 0-1 build of foundational, enterprise-grade AI platforms and products
  • System Design: Design and build high-quality, highly reliable, and secure distributed systems with developer and user experience at the center
  • Strategic Direction: Create 'firsts' in the Generative AI space for Citi, acting as a core member of the team that defines the strategic technical direction for the entire bank
  • Scale & Iterate: Continually iterate and scale Generative AI products to handle massive throughput, whilst anticipating and listening to the complex needs of internal customers
  • Cross-Org Influence: Drive technical alignment across multiple engineering organizations, breaking down silos to deliver cohesive AI capabilities
  • Fulltime
Read More
Arrow Right
New

Senior Software Engineer, AI

We are a leading global provider of financial information services, insights, da...
Location
Location
United Kingdom , London
Salary
Salary:
60000.00 - 70000.00 GBP / Year
https://www.randstad.com Logo
Randstad
Expiration Date
July 10, 2026
Flip Icon
Requirements
Requirements
  • 7+ years of professional experience designing, developing, and deploying production-grade applications, with 5+ years specifically in full-stack enterprise software engineering
  • Advanced Python programming with strong backend development capabilities
  • Proven experience developing and deploying intelligent conversational AI systems using RAG architectures, Model Context Protocol (MCP), AI-enabled search, vector databases, and LLM integration
  • Hands-on experience building GenAI applications using LangChain and LangGraph (agent architecture design, state management, and graph-based workflow orchestration)
  • Solid understanding of ML algorithms, FastAPI, PyTorch/TensorFlow, MLflow, MLOps practices, containerization (Docker, Kubernetes/AWS EKS), and cloud services (AWS Bedrock, SageMaker, Azure AI Search)
  • Excellent communication and collaboration skills, with the ability to translate complex technical concepts for diverse, cross-functional stakeholders
Job Responsibility
Job Responsibility
  • Lead GenAI Development: Spearhead the creation of enterprise chatbot platforms, evaluation frameworks, agentic workflows, RAG architectures, and MCP implementations
  • Pioneer Innovation: Act as a hands-on engineer bridging the gap between research breakthroughs and production-ready capabilities to generate tangible business value
  • Build Robust Infrastructure: Develop enterprise-scale APIs (FastAPI) and architect comprehensive cloud-based AI infrastructure on AWS/Azure optimized for scalability and performance
  • Demonstrate Full-Stack Excellence: Apply your expertise across the entire technology stack to seamlessly integrate AI capabilities into user-facing products and backend systems
What we offer
What we offer
  • Transformative AI Impact: Design and deploy production-ready GenAI platforms, multi-agent systems, and intelligent automation that reshape products in real-time
  • Cutting-Edge Tech Stack: Experiment with the latest LLMs, architect RAG implementations, design sophisticated agentic systems, and develop Model Context Protocol (MCP) servers
  • Enterprise Scale: Build GenAI solutions across multiple business units while creating unified patterns and reusable component frameworks
  • Dynamic Culture: Work at the intersection of advanced engineering and product development within a collaborative, innovation-driven environment
  • Fulltime
!
Read More
Arrow Right

Software Engineer II

Location
Location
India , Chennai
Salary
Salary:
Not provided
appian.com Logo
Appian Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Design: To lead the re-design of our translation platform, ensuring it is immutable, secure, and resilient against high-volume traffic
  • GenAI & Translation Mastery: A deep interest in integrating LLMs (via AWS Bedrock) and automated translation services to provide a seamless localized experience for end customers
  • DevOps Ownership: A "builder" mindset toward end-to-end CI/CD pipelines, automating every phase of the development lifecycle to achieve true continuous delivery
  • Strategic Problem Solving: Strong debugging skills to resolve complex distributed systems issues, paired with the soft skills needed to mentor teams and lead cross-functional initiatives
  • Product-Centric Engineering: Experience building software in an enterprise SaaS environment with a focus on delivering direct value to the end customer through Python
  • Python Expert: 3-5 Years of experience with High proficiency in Java with a proven track record of designing and delivering customer-facing features (experience with Golang or Python is a plus)
  • AWS Power User: Advanced experience with AWS infrastructure, specifically with AWS Bedrock or similar AI/ML integration services
  • CI/CD Architect: Strong end-to-end knowledge of pipeline creation, deployment automation, and infrastructure-as-code
  • System Observability: Familiarity with monitoring and performance tools
  • Education: Bachelors in computer science, Engineering, or equivalent professional experience
What we offer
What we offer
  • health coverage
  • Employee Assistance Program (EAP) with free mental health support
  • life and disability insurance
  • Employee Stock Purchase Program (ESPP)
  • retirement/pension plan
  • wellness dollars
  • tuition reimbursement
  • family-forming benefits
  • Fulltime
Read More
Arrow Right

Principal, Software Engineer

Building the right technology foundation for Infrastructure & platforms is vital...
Location
Location
United States of America , Sunnyvale
Salary
Salary:
143000.00 - 286000.00 USD / Year
walmart.com Logo
Walmart
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of software engineering experience with proven expertise in building developer-facing tools and platforms
  • Deep understanding of developer experience (DevEX) principles and productivity optimization
  • Production experience integrating LLM/GenAI capabilities into enterprise systems and understanding technologies like Model Context Protocol (MCP), A2A protocol, etc.
  • Hands-on experience with AI coding assistants (Claude Code, GitHub Copilot, Cursor, Gemini CLI, or similar)
  • Strong systems design skills for building scalable, resilient backend and frontend services
  • Exceptional communication and collaboration skills, with the ability to lead architectural discussions, mentor peers, and influence technical direction across multiple teams
  • Proficiency in modern development tools and infrastructure (CICD, Trunk Based Development, CLI frameworks, IDE extensions, API design)
  • Extensive experience in full-stack software development with proficiency in React, Java, JavaScript, Python, and related frameworks
  • Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years experience in software engineering or related area
  • Option 2: 7 years experience in software engineering or related area
Job Responsibility
Job Responsibility
  • Design and implement Wibey Web features, App integrations and extensions that provide seamless AI-assisted development workflows
  • Design scalable front-end and back-end systems to support a web interface capable of accommodating thousands of developers
  • Build integration with internal tools using industry standard protocols like MCP and A2A
  • Drive Innovation
  • Create agentic solutions that intelligently automate developer workflows: code generation, testing, PR reviews, documentation, and deployment
  • Implement quality benchmarking frameworks to measure AI-generated code correctness and developer productivity impact
  • Design enterprise governance controls that balance developer velocity with security and compliance requirements
  • Lead and Collaborate
  • Partner with product managers, platform engineers, and security teams to define and execute the Wibey roadmap
  • Establish engineering best practices and quality standards for AI-assisted development
What we offer
What we offer
  • Health benefits include medical, vision and dental coverage
  • Financial benefits include 401(k), stock purchase and company-paid life insurance
  • Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting
  • Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement
  • Live Better U education benefit program
  • Performance-based bonus awards
  • Stock
  • Fulltime
Read More
Arrow Right

Staff Software Engineer

At NetApp, we have a history of helping customers turn challenges into business ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
netapp.com Logo
NetApp
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Python, Go Lang, Java and REST APIs to create AI-augmented workflows for data classification and engineering
  • Cloud Native Infrastructure: Depth in microservices-based SaaS architectures and cloud storage platforms (AWS)
  • AI/ML & GenAI: Hands-on experience with frameworks like PyTorch, and Hugging Face
  • ability to build next-generation data solutions for AI workloads
  • Problem-Solving: Proven ability to resolve critical system issues and optimize performance for massive enterprise workloads
  • Act as a functional expert for complex domains, such as Storage As a Service, CloudOps, or AI-driven data infrastructure
  • Lead high-impact, cross-team projects that influence the product roadmap and long-term strategy
  • Design scalable, optimized solution architectures and guide the development of next-generation data services
  • Serve as a 'coach and culture bearer,' providing technical guidance and peer reviews to help grow junior engineers (IC1–IC4)
  • Work across organizational boundaries to align technical capabilities with business goals and customer needs
Job Responsibility
Job Responsibility
  • Own Every Moment at NetApp
  • collaborate with passionate teams, tackle real-world challenges, and see your impact in how customers transform and grow
  • As a Staff Software Engineer in the Keystone organization, you will be a technical leader and a force multiplier
  • you will set the technical vision for critical components of our platform
  • design elegant, scalable, and resilient solutions to our most complex architectural challenges
  • influence and mentor engineers across the organization
  • thrive on solving ambiguous problems, driving technical excellence, and building systems that operate at a massive scale
What we offer
What we offer
  • Volunteer time off - 40 hours of paid volunteer time each year
  • Well-being - Employee Assistance Program, fitness, and mental health resources to help employees be their best
  • Time away - Paid time off for vacation and to recharge
Read More
Arrow Right