CrawlJobs Logo
SingleStore Logo SingleStore · IT - Software Development

Software Engineer (AI Platforms)

India · Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

We are looking for a Software Engineer to design and implement core platform capabilities for AI/ML and AI Agents in SingleStore Cloud. You’ll work on services that enable model/tool orchestration (e.g. MCP style tool discovery and execution), agent workflows, retrieval pipelines (embeddings/vector search), evaluation/observability, and secure multi tenant operations. You will likely find yourself using Go and Python, Kubernetes, cloud primitives, and the right tools for the job, while applying solid AI/ML fundamentals to make correct engineering decisions.

Job Responsibility

  • Build and evolve backend services that power AI features: agent orchestration, tool execution, retrieval/RAG pipelines, and model serving integrations
  • Design APIs and control plane workflows for AI platform components (tenant-aware, secure by default, observable)
  • Implement MCP style tool discovery / integration patterns so agents can safely call tools, connectors, and internal services
  • Work closely with product managers, designers, customers, and partner engineering teams to deliver high quality AI experiences
  • Engineer for reliability and scale: latency, cost controls, rate limiting, fallbacks, rollouts, and incident response readiness
  • Establish best practices around evaluation: offline test sets, regression detection, prompt/model/version tracking, and quality gates
  • Contribute to secure AI by design approaches: permissions, data access boundaries, prompt injection defenses, and auditability
  • Mentor junior engineers and contribute to a welcoming, high ownership team environment

Requirements

  • Strong software engineering skills with experience in distributed systems (Go, Python, or similar)
  • Experience building cloud native services: Kubernetes, containers, service-to-service APIs, CI/CD
  • 4+ years of experience working on a SaaS product or production platform
  • Solid understanding of AI/ML fundamentals: Supervised learning basics (training vs inference, overfitting, evaluation metrics, classification, anomaly detection, forecasting, regression etc.)
  • LLM basics (tokens, context windows, prompting, tool/function calling concepts)
  • Embeddings + vector search fundamentals (similarity, indexing tradeoffs, retrieval pitfalls)
  • Strong debugging and problem-solving skills, including incident-style troubleshooting across services and infrastructure
  • Intellectual curiosity about investigating issues that impact product quality, reliability, latency, and business metrics
  • Passion for building robust, maintainable systems in a fast-paced, team-oriented environment

Nice to have

  • Hands on experience with AI agents and orchestration frameworks (tool calling, workflows, planners/executors)
  • Practical experience with RAG systems, reranking, grounding, and evaluation strategies
  • Experience with model serving patterns (batch/online inference, caching, streaming responses)
  • Knowledge of security considerations for AI systems (data isolation, RBAC, prompt injection threats, audit logs)
  • Familiarity with vector databases or vector capabilities in modern data platforms
  • Experience with observability stacks (structured logging, metrics, tracing) and SLO driven engineering
SingleStore - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer (AI Platforms)

8 matching positions

Software Engineer II and Senior Software Engineer - AI Compilers

The AI Frameworks team at Microsoft develops the AI software used to train and d...
Location
Location
United States , Mountain View
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Invent and implement innovative compiler features and advanced optimization passes, leveraging tools such as LLVM, MLIR, Torch Dynamo, and Triton
  • Develop code generation techniques for new hardware platforms
  • Design and develop cutting edge AI software in C++ and Python
  • Optimize AI workloads
  • Design new programming abstractions for AI
  • Collaborate broadly across multiple disciplines from hardware architects to ML developers
  • Identify requirements, plan and design solutions, estimate effort, and schedule deliverables
  • Help establish and drive the adoption of outstanding coding standards and patterns and help enhance our inclusive engineering culture
  • Embody Microsoft's culture and values
  • Fulltime
Read More
Arrow Right

Software Product Engineer, AI Platforms

Carex is partnering with a FinTech industry partner to hire a Software Product E...
Location
Location
United States , Madison
Salary
Salary:
Not provided
carexconsulting.com Logo
Carex Consulting Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience building modern web applications with React and TypeScript
  • Full-stack development experience with modern APIs and backend services
  • A builder mindset with a passion for creating, experimenting, and solving problems
  • Demonstrated ownership and initiative through professional projects, startups, side projects, GitHub activity, or other hands-on work
  • Ability to thrive in a fast-paced, high-expectation startup environment
  • Strong communication skills and product-oriented thinking
  • Adaptability, curiosity, and enthusiasm for learning quickly
Job Responsibility
Job Responsibility
  • Own and drive development for key product areas within the platform
  • Build full-stack features using TypeScript, React/Next.js, Node.js, PostgreSQL, and tRPC
  • Collaborate closely with engineering, product, and design teams in rapid iteration cycles
  • Help evolve and scale platform architecture as products and systems grow
  • Partner directly with users to understand workflows and improve customer experiences
  • Contribute to AI-powered workflow automation and intelligent tooling initiatives
  • Help elevate engineering standards through strong ownership, communication, and execution
  • Operate with high autonomy while maintaining transparency and accountability
  • Support future growth initiatives and potentially expand into people leadership responsibilities
  • Fulltime
Read More
Arrow Right

Senior Software Engineer – Gen AI Platforms

We are Citi's Application, Platform and Engineering group, a start-up with the e...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 9+ Years of Hands-on experience
  • Go microservices
  • React 19+/TypeScript
  • OpenShift/Kubernetes
  • MongoDB/Redis/S3
  • REST/gRPC/WebSockets
  • Claude/Gemini/proprietary LLMs
  • OAuth/JWT/Vault
  • GitOps CI/CD
  • Prometheus/Grafana/ELK
Job Responsibility
Job Responsibility
  • Build scaled, robust services and platforms centred around generative AI, including developing CLIs, SDKs, runtimes and more
  • Drive architectural vision and lead the 0-1 build of foundational, enterprise-grade AI platforms and products
  • Design and build high-quality, highly reliable, and secure distributed systems with developer and user experience at the center
  • Create 'firsts' in the Generative AI space for Citi, acting as a core member of the team that defines the strategic technical direction for the entire bank
  • Continually iterate and scale Generative AI products to handle massive throughput, whilst anticipating and listening to the complex needs of internal customers
  • Drive technical alignment across multiple engineering organizations, breaking down silos to deliver cohesive AI capabilities
  • Fulltime
Read More
Arrow Right

Principal Software Engineer – Gen AI Platforms

We are Citi’s Application, Platform and Engineering group, a start-up with the e...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 14+ Years of Hands on experience is a must have
  • Expert-level fluency in Golang is a must-have
  • Deep experience building concurrent, high-throughput systems
  • Deep expertise in the Kubernetes ecosystem, container orchestration, and modern security paradigms
  • Understanding of language models, fine-tuning methodologies, and RAG architectures, JIT context retrieval strategies
  • Proven experience designing control planes, sandboxing systems for AI experimentation, and managing large-scale vector stores and search algorithms
  • Extensive experience in large-scale ETL development and data pipeline architecture
  • Experience maintaining and/or contributing to bug bounty, responsible disclosure programs, and AI safety/guardrail implementations
  • Experience leading technical initiatives within fast-paced startup environments or driving startup-like agility within a large enterprise
Job Responsibility
Job Responsibility
  • Engineering at scale: You will build scaled, robust services and platforms centred around generative AI. This may also include developing CLIs, SDKs, runtimes and more
  • Thought Leadership: Drive architectural vision and lead the 0-1 build of foundational, enterprise-grade AI platforms and products
  • System Design: Design and build high-quality, highly reliable, and secure distributed systems with developer and user experience at the center
  • Strategic Direction: Create "firsts" in the Generative AI space for Citi, acting as a core member of the team that defines the strategic technical direction for the entire bank
  • Scale & Iterate: Continually iterate and scale Generative AI products to handle massive throughput, whilst anticipating and listening to the complex needs of internal customers
  • Cross-Org Influence: You must be able to drive technical alignment across multiple engineering organizations, breaking down silos to deliver cohesive AI capabilities
  • Fulltime
Read More
Arrow Right

Sr Staff AI Software Engineer (CORA AI)

Idira is looking for a Senior AI Software Engineer to join our Generative AI fou...
Location
Location
Israel , Petah Tikva
Salary
Salary:
Not provided
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree with 15 years of experience, or Master's degree with 12 years of experience, or PhD with 8 years of experience
  • Extensive experience in software engineering, with a focus on building and deploying production-grade systems
  • Proven experience with cloud platforms, particularly AWS services
  • Strong programming skills in languages such as Python
  • Hands-on experience with machine learning, deep learning, and Large Language Models (LLMs)
  • Experience with the full software development lifecycle (design, development, testing, deployment, maintenance)
Job Responsibility
Job Responsibility
  • Design, develop, and deploy scalable AI agents and shared infrastructure for GenAI capabilities
  • Manage the full software development lifecycle, from prototyping to production-grade, observable systems
  • Collaborate with product managers, researchers, and engineers to translate ideas into robust and scalable services
  • Work hands-on with large language models (LLMs), agentic frameworks, and a broad range of AWS services
  • Implement strong telemetry, evaluation metrics, and feedback loops to continuously improve AI solutions
  • Champion operational excellence through pragmatic experimentation, iteration, and solid design
Read More
Arrow Right

Senior Software Engineer, Managed AI - AI model LifeCycle

The Senior Software Engineer for the Model LifeCycle team will contribute to bui...
Location
Location
United States , San Francisco
Salary
Salary:
172425.00 - 209000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Experience delivering production-ready features
  • Familiarity with essential cloud-based services (e.g., compute, storage, networking)
  • Familiarity with Generative AI (Large Language Models, Multimodal)
  • Experience with AI infrastructure components (training, inference)
  • 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
Job Responsibility
Job Responsibility
  • Implement and maintain systems for fine-tuning large foundation models (SFT, PEFT, LoRA, adapters), including multi-node orchestration, checkpointing, failure recovery, and cost-efficient scaling
  • Implement and maintain end-to-end training pipelines for Large Language Models
  • Implement components for distillation and reinforcement learning pipelines (e.g., preference optimization, policy optimization, reward modeling)
  • Develop and maintain core agent execution infrastructure
  • Implement features for dataset, model, and experiment management, focusing on versioning, lineage, evaluation, and reproducible fine-tuning
  • Work closely with Senior Engineers and Principal Engineers, as well as product and platform teams, to implement system abstractions and APIs
  • Contribute to technical discussions on training runtimes, scheduling, storage, and model lifecycle management
  • Engage with the open-source LLM ecosystem
What we offer
What we offer
  • Restricted Stock Units
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, Managed AI - AI Platform

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'...
Location
Location
United States , San Francisco, CA; Sunnyvale, CA
Salary
Salary:
208725.00 - 253000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree in Computer Science/Engineering
  • 8-10+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
  • Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects quickly
  • Experience with Generative AI (LLMs, Multimodal) and familiar with AI infrastructure (training, inference, ETL pipelines)
  • Proficient with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD
Job Responsibility
Job Responsibility
  • Lead the design and implementation of core AI services, including: Resilient fault-tolerant queues for efficient task distribution
  • Model catalogs for managing and versioning AI models
  • Scheduling mechanisms optimized for cost and performance
  • Architect and scale infrastructure to handle millions of API requests per second
  • Implement robust monitoring and alerting to ensure system health and 24/7 availability
  • Collaborate closely with product management, business strategy, and other engineering teams to define the AI platform roadmap
  • Influence the long-term vision and architectural decisions of the platform
  • Contribute to open-source AI frameworks and actively participate in the AI community
  • Prototype and rapidly iterate on emerging technologies and new features
What we offer
What we offer
  • Restricted Stock Units in a fast growing, well-funded technology company
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Managed AI - AI Platform

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'...
Location
Location
United States , San Francisco, CA; Sunnyvale, CA
Salary
Salary:
172425.00 - 209000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree in Computer Science/Engineering
  • 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
  • Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects quickly
  • Experience with Generative AI (LLMs, Multimodal) and familiar with AI infrastructure (training, inference, ETL pipelines)
  • Proficient with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD
Job Responsibility
Job Responsibility
  • Lead the design and implementation of core AI services, including: Resilient fault-tolerant queues for efficient task distribution
  • Model catalogs for managing and versioning AI models
  • Scheduling mechanisms optimized for cost and performance
  • Architect and scale infrastructure to handle millions of API requests per second
  • Implement robust monitoring and alerting to ensure system health and 24/7 availability
  • Collaborate closely with product management, business strategy, and other engineering teams to define the AI platform roadmap
  • Influence the long-term vision and architectural decisions of the platform
  • Contribute to open-source AI frameworks and actively participate in the AI community
  • Prototype and rapidly iterate on emerging technologies and new features
What we offer
What we offer
  • Restricted Stock Units
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right