CrawlJobs Logo

Staff Software Engineer, AI

United States, New York 193000.00 - 242000.00 USD / Year · Job Posted June 09, 2026
Apply Position
Job Link Share

Job Description

As an AI Staff Engineer you'll play a crucial role in developing and refining our product’s AI. You'll report directly to our VP of Engineering and work closely with our engineering and product teams to enhance our AI capabilities and drive innovation in our fin-tech AI platform.

Job Responsibility

  • Utilize the best-in-class models available on the market to deliver meaningful solutions for our clients, bringing them from the idea stage all the way to production
  • Collaborate with the team to integrate AI solutions into our existing production processes
  • Design and implement scalable AI system architecture handling including model orchestration, caching strategies, and fallback mechanisms
  • Evaluate and implement new AI technologies and methodologies to keep WiseLayer and BlackLine at the cutting edge

Requirements

  • 4+ years of experience as a Full Stack Software Engineer or a similar role developing, shipping, and testing of software within a well-established enterprise, bonus points if at a fast growth enterprise
  • Bachelor's degree in Computer Science, Engineering or a related field
  • Demonstrated experience working with production LLM APIs (OpenAI, Anthropic, Google, etc.) including handling rate limits, cost optimization, and performance monitoring in live systems (not just vibe coding)
  • Clear experience utilizing frameworks like RAG in production applications to further enhance the foundational models for proprietary applications and datasets
  • Experience with AI system testing methodologies including model evaluation, A/B testing of AI features, and monitoring model performance in production
  • Experience with data pipelines and ETL/ELT processes (given our data-intensive AI workflows)

Nice to have

Prior working experience with appliances such as firewalls, routers and load balancers.

What we offer

  • short-term and long-term incentive programs
  • robust offering of benefit and wellness plans

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Staff Software Engineer, AI

8 matching positions

Staff Software Engineer, AI

Credit Genie is a mobile-first financial wellness platform designed to help indi...
Location
Location
United States , Pittsburgh; Philadelphia; Plymouth Meeting; New York
Salary
Salary:
150000.00 - 250000.00 USD / Year
creditgenie.com Logo
Credit Genie
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A Software Engineer with 5+ years of industry experience
  • Strong foundations in multiple programming languages (Python, Java, TypeScript, etc.)
  • Hands-on experience with cloud platforms (AWS, GCP, or Azure)
  • Experienced at designing and implementing distributed, production-grade systems
  • Comfortable with system design, APIs, version control, Infrastructure as Code, and testing
  • Curious, motivated, and eager to expand into AI/ML
  • Collaborative and excited by fast-moving, problem-solving environments
Job Responsibility
Job Responsibility
  • Lead the design and implementation of highly available, scalable backend services and APIs that serve and integrate our AI models and applications into production systems
  • Architect and optimize the services and data pipelines essential for deploying, monitoring, and maintaining real-time AI inferencing and retrieval at scale
  • Collaborate with AI and ML Engineers to improve model deployment, monitoring, and experimentation workflows (MLOps/AIOps)
  • Drive technical excellence, setting high standards for code quality, system reliability, and performance
  • Mentor and guide other engineers on best practices for building robust backend systems in an AI-focused environment
  • Have fun working on hard and highly impactful problems
What we offer
What we offer
  • Offers Equity
  • Offers Bonus
  • Comprehensive medical, vision, and dental coverage
  • 401(k) retirement plan with company match
  • Short & long term disability insurance
  • Life insurance
  • Flexible PTO
  • 100% company-paid medical, dental, and vision coverage for you and your dependents on your first day of employment
  • Receive up to $100 per month in fitness reimbursement or enjoy a complimentary full membership to LifeTime Fitness or Equinox
  • 401(k) with a 3.5% match and immediate vesting
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, AI

GoodLeap’s Business Solutions Business Unit is redefining how installers and hom...
Location
Location
United States , Roseville; Austin; Lehi; Plano; San Mateo; West Palm Beach
Salary
Salary:
173000.00 - 200000.00 USD / Year
goodleap.com Logo
GoodLeap
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in backend development
  • At least 2+ years working with AI/ML solutions or LLM
  • Experience working with vector databases, embeddings, and semantic search
  • Familiarity with MLOps, CI/CD for AI pipelines, and AI observability tools
  • Strong experience in Node.js, TypeScript, GraphQL, and REST APIs
  • Deep familiarity with AWS architecture — especially Lambda, ECS, S3, DynamoDB, API Gateway, and Step Functions
  • Experience building and integrating LLM features (e.g., via OpenAI, Claude, Vertex AI, or similar), including prompt design, vector storage, and retrieval strategies
  • Fluency in system design principles, scalability, reliability, fault-tolerance
  • Ability to drive clarity and make architectural tradeoffs, balancing idealism with pragmatism
  • Strong communication and collaboration skills, able to work effectively across product and engineering orgs
Job Responsibility
Job Responsibility
  • Design and lead backend architecture that supports AI/ML-powered features across mobile and API surfaces
  • Own end-to-end technical strategy for embedding LLMs, embedding stores, and personalized content delivery
  • Partner with product and design to scope features, validate feasibility, and ensure execution aligns with business impact
  • Build tools and services to help other team members experiment and ship AI-enhanced features responsibly and efficiently
  • Influence engineering standards and promote excellence in observability, performance, and security
  • Mentor engineers across teams, helping them level up in areas of backend architecture, AI integration, and delivery quality
  • Collaborate with cross-functional partners across QA, Mobile, Data Science, Product, and Marketing
What we offer
What we offer
  • Opportunities for growth and advancement within the company
  • May be eligible for a bonus
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, AI

As an AI Staff Engineer you'll play a crucial role in developing and refining ou...
Location
Location
United States , New York
Salary
Salary:
193000.00 - 242000.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience as a Full Stack Software Engineer or a similar role developing, shipping, and testing of software within a well-established enterprise
  • Bachelor’s degree in Computer Science, Engineering or a related field
  • Demonstrated experience working with production LLM APIs (OpenAI, Anthropic, Google, etc.) including handling rate limits, cost optimization, and performance monitoring in live systems
  • Clear experience utilizing frameworks like RAG in production applications to further enhance the foundational models for proprietary applications and datasets
  • Experience with AI system testing methodologies including model evaluation, A/B testing of AI features, and monitoring model performance in production
  • Experience with data pipelines and ETL/ELT processes
Job Responsibility
Job Responsibility
  • Utilize the best-in-class models available on the market to deliver meaningful solutions for our clients, bringing them from the idea stage all the way to production
  • Collaborate with the team to integrate AI solutions into our existing production processes
  • Design and implement scalable AI system architecture handling including model orchestration, caching strategies, and fallback mechanisms
  • Evaluate and implement new AI technologies and methodologies to keep WiseLayer and BlackLine at the cutting edge
What we offer
What we offer
  • short-term and long-term incentive programs
  • robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, Managed AI - AI Platform

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'...
Location
Location
United States , San Francisco, CA; Sunnyvale, CA
Salary
Salary:
208725.00 - 253000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree in Computer Science/Engineering
  • 8-10+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
  • Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects quickly
  • Experience with Generative AI (LLMs, Multimodal) and familiar with AI infrastructure (training, inference, ETL pipelines)
  • Proficient with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD
Job Responsibility
Job Responsibility
  • Lead the design and implementation of core AI services, including: Resilient fault-tolerant queues for efficient task distribution
  • Model catalogs for managing and versioning AI models
  • Scheduling mechanisms optimized for cost and performance
  • Architect and scale infrastructure to handle millions of API requests per second
  • Implement robust monitoring and alerting to ensure system health and 24/7 availability
  • Collaborate closely with product management, business strategy, and other engineering teams to define the AI platform roadmap
  • Influence the long-term vision and architectural decisions of the platform
  • Contribute to open-source AI frameworks and actively participate in the AI community
  • Prototype and rapidly iterate on emerging technologies and new features
What we offer
What we offer
  • Restricted Stock Units in a fast growing, well-funded technology company
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right

Staff Software Engineer - AI Applications

We build simple yet innovative consumer products and developer APIs that shape h...
Location
Location
United States , San Francisco
Salary
Salary:
228360.00 - 369800.00 USD / Year
plaid.com Logo
Plaid
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong SWE fundamentals (system design, APIs, etc.)
  • Hands-on experience working with LLMs to build products and shipping them to product with iterating with real user feedback - including but not limited to: Prompt engineering
  • Fine-tuning
  • Retrieval augmented generation (RAG)
  • Semantic search - vector database and embedding models
  • Agent orchestration framework
  • Evaluation and monitoring framework of open-ended tasks
  • Streaming and SSE
  • Common UX and design patterns for GenAI-powered products
  • Strong debugging and monitoring experience for production systems
Job Responsibility
Job Responsibility
  • Work with other AI engineers, software engineers and machine learning engineers to architect, design and implement GenAI-powered products and features
  • Collaborate across functions to understand user needs, propose and implement AI-powered solutions where they’re expected to have the highest impact
  • Design and execute rapid experiments to push the boundaries on potential business impact from emerging AI capabilities, with a focus on minimal viable testing approaches
  • Balance creative exploration of possibilities with rigorous evaluation of technical feasibility, product potential and business impact
  • Fulltime
Read More
Arrow Right

Member of Technical Staff - Software Engineer (AI infra)

Microsoft AI is looking for a Member of Technical Staff - Software Engineer to h...
Location
Location
Switzerland , Zürich
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, or related technical discipline AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with generative AI
  • Experience with distributed computing
Job Responsibility
Job Responsibility
  • Develop and tune the pretraining scalable software for Nvidia GB200 72NVL CX8 and AMD MIxxx architectures
  • Benchmark GB200 and AMD MIxxx GPU clusters
  • Gather data and insights to develop the pretraining compute roadmap
  • Care deeply about conversational AI and its deployment
  • Actively contribute to the development of AI models that are powering our innovative products
  • Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively
  • Enjoy working in a fast-paced, design-driven, product development cycle
  • Embody our Culture and Values
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, AI Agent Platform

The Geico AI Agent Platform team is seeking an exceptional Staff Software Engine...
Location
Location
United States , Chevy Chase; New York City
Salary
Salary:
115000.00 - 260000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Engineering, Mathematics, or a related field
  • an advanced degree (master’s or Ph.D.) is highly desirable
  • 6+ years of hands-on experience in designing, implementing, and maintaining multi-tenant AIML systems and platforms in production environments
  • 6+ years of experience working with cloud platforms such as Azure and AWS
  • Extensive expertise in designing and deploying large-scale data pipelines and real-time inference systems and managing the end-to-end AI Agent and/or AIML system development lifecycles, including configuration, evaluation, monitoring, observability and AuthN/AuthR considerations
  • 6+ years of experience working with common backend systems & tools (e.g, Kubernetes, Temporal, OpenSearch, PostgreSQL, Redis, Neo4J, etc.)
  • Deep understanding of Docker, container optimization, and multi-stage builds
  • Experience with Prometheus, Grafana, Open Telemetry and distributed tracing
  • 3+ years of experience building front-end web applications using frameworks such as React and/or Next.JS
  • Deep proficiency in programming languages such as Python, Java, Go, etc., with a strong emphasis on coding excellence
Job Responsibility
Job Responsibility
  • Architect and implement scalable multi-tenant backend systems for building AI agent workflows, including agent configuration, offline evaluation, synthetic data generation, workflow simulation, agent marketplace, etc. using Azure Kubernetes Service (AKS), FastAPI, etc., ensuring economy of scale and control cost of maintenance
  • Collaborate with Design team to architect and implement frontend experiences and workflows for onboarding both technical and non-technical stakeholders, maximizing user adoption and successful AI agent development
  • Develop observability frameworks to ensure 99.9%+ uptime for AI agent platforms through robust monitoring, alerting, and incident response procedures
  • Evaluate and (if desirable) integrate cutting-edge GenAI frameworks, libraries and vendors to maintain a state-of-the-art technology stack, including hybrid cloud solutions with AWS/GCP as backup or specialized use cases
  • Architect and implement scalable, high-performance machine learning platforms and systems capable of processing large data volumes and supporting real-time decision making and workflows
  • Oversee the end-to-end lifecycle of AI agent applications, ensuring robust testing, deployment, and ongoing monitoring
  • Ensure adherence to company production readiness standards, security protocols, and regulatory compliance throughout the development lifecycle
  • Continuously optimize platform performance, reducing latency and improving throughput for AI agent workloads
  • Design and implement backup, recovery, and business continuity plans for hosted platform applications & services
  • Design and maintain robust CI/CD pipelines for ML model deployment using Azure DevOps, GitHub Actions, and MLOps tools
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right

Senior Staff Software Engineer - AI

GEICO is seeking an experienced Engineer with a passion for building high-perfor...
Location
Location
United States , Seattle, WA; Austin, TX; Palo Alto, CA; Chicago, IL; Dallas, TX
Salary
Salary:
110000.00 - 230000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience building and deploying ML systems in production with cross-functional engineering teams
  • Fluency in at least two modern languages such as Python, Go, Java, C++, or C# including object-oriented design
  • Experience architecting multi-component ML platforms using open-source/cloud-agnostic components: Datastores: PostgreSQL, NoSQL (MongoDB, Cassandra, CosmosDB) Streaming: Kafka, Flink, or Spark Streaming
  • Experience with end-to-end ML lifecycle: version control, CI/CD, Kubernetes, testing, monitoring, and production support
  • Experience with cloud providers (Azure, AWS or GCP) in production ML environments
  • Experience with observability tools and distributed systems monitoring, logging, tracing, and root cause analysis
  • Experience building multi-agent systems using LLMs and agentic frameworks (e.g., LangChain, LangGraph, AutoGen, Semantic Kernel, CrewAI)
  • Hands-on experience with RAG, semantic search, and vector databases (e.g., Milvus, pgvector, Qdrant, ElasticSearch)
  • Experience designing human-in-the-loop workflows and safety controls for autonomous systems
  • Strong architecture and design skills with ability to influence technical direction and roadmap
Job Responsibility
Job Responsibility
  • Design and build a multi-agent AI platform where specialized agents autonomously detect, diagnose, and resolve issues through agent-to-agent (A2A) collaboration
  • Develop intelligent agents using LLMs and agentic frameworks that coordinate detection, diagnostic, remediation, and knowledge tasks with minimal human intervention
  • Define agent interaction protocols, A2A communication standards, and evaluation frameworks for agent decision quality and autonomous action safety
  • Architect vector database solutions (Milvus, pgvector, Qdrant) for semantic search and RAG to enable context-aware agent decision-making
  • Build end-to-end ML pipelines for severity classification, anomaly detection, failure pattern recognition, and impact forecasting using observability data
  • Establish scalable orchestration infrastructure for multi-agent workflows with CI/CD, automated evaluation, canary releases, and rollback strategies
  • Implement monitoring for agent interactions, A2A communication patterns, decision quality, data drift, and system reliability
  • Lead technical architecture ensuring scalability, observability, and integration with existing alerting, logging, and monitoring systems
  • Define standards for agent safety, explainability, governance, and human-in-the-loop controls for high-impact automated actions
  • Partner with SRE, Product, and Engineering teams to translate reliability goals into measurable ML objectives and maintain pragmatic technical roadmaps
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right