Software Product Engineer, AI Platforms Job at Carex Consulting Group (Madison)

Senior Software Engineer, AI Product

As a Senior Applied AI Engineer at Vanta, you will play a crucial role in shapin...

Location

United States

Salary:

207000.00 - 244000.00 USD / Year

Vanta

Expiration Date

Until further notice

Requirements

At least 7 years of industry experience as a software engineer
You’ve shipped LLM-backed products and have experience with prompting, RAG, and/or agent frameworks
You have experience designing, building, and scaling full-stack applications, including backend systems, APIs, and frontend interfaces
You have familiarity with TypeScript, React, and Node.js, or a willingness to learn
You have experience improving AI systems, creating eval sets, and driving quality hill-climbing
You have experience mentoring other engineers and collaborating with product and design
You have worked at rapidly scaling startups and large companies, especially with environments that prioritize a bias for action
You are action-driven, willing to roll up your sleeves and engage directly with users
You aren’t afraid to put on your product hat
While you bring strong opinions, you prioritize building a platform that meets users where they are

Job Responsibility

Work cross-functionally to design and implement AI-powered features to deliver customer value and integrate LLMs with Vanta’s existing products and systems
Instrument evaluations, guardrails, and monitoring, and review customer usage to continually improve quality
Collaborate with AI Platform engineers shaping foundational AI systems and tooling that accelerate product teams
Make pragmatic tradeoffs that consider business priorities, user experience, and a sustainable technical foundation
Mentor engineers, champion good technical and product instincts, and model a collaborative, high-ownership engineering culture

What we offer

Offers Equity
medical benefits
401(k) plan
other company perk programs
Comprehensive medical, dental, and vision coverage, with 100% of employee-only benefit premiums covered for most medical plans
16 weeks fully-paid Parental Leave for all new parents
Health & wellness stipend
Remote workspace, internet, and cellphone stipend
Commuter benefits for team members who report to the SF and NYC office
Family planning benefits

Fulltime

Software Engineer (AI Platforms)

We are looking for a Software Engineer to design and implement core platform cap...

Location

India

Salary:

Not provided

SingleStore

Expiration Date

Until further notice

Requirements

Strong software engineering skills with experience in distributed systems (Go, Python, or similar)
Experience building cloud native services: Kubernetes, containers, service-to-service APIs, CI/CD
4+ years of experience working on a SaaS product or production platform
Solid understanding of AI/ML fundamentals: Supervised learning basics (training vs inference, overfitting, evaluation metrics, classification, anomaly detection, forecasting, regression etc.)
LLM basics (tokens, context windows, prompting, tool/function calling concepts)
Embeddings + vector search fundamentals (similarity, indexing tradeoffs, retrieval pitfalls)
Strong debugging and problem-solving skills, including incident-style troubleshooting across services and infrastructure
Intellectual curiosity about investigating issues that impact product quality, reliability, latency, and business metrics
Passion for building robust, maintainable systems in a fast-paced, team-oriented environment

Job Responsibility

Build and evolve backend services that power AI features: agent orchestration, tool execution, retrieval/RAG pipelines, and model serving integrations
Design APIs and control plane workflows for AI platform components (tenant-aware, secure by default, observable)
Implement MCP style tool discovery / integration patterns so agents can safely call tools, connectors, and internal services
Work closely with product managers, designers, customers, and partner engineering teams to deliver high quality AI experiences
Engineer for reliability and scale: latency, cost controls, rate limiting, fallbacks, rollouts, and incident response readiness
Establish best practices around evaluation: offline test sets, regression detection, prompt/model/version tracking, and quality gates
Contribute to secure AI by design approaches: permissions, data access boundaries, prompt injection defenses, and auditability
Mentor junior engineers and contribute to a welcoming, high ownership team environment

Principal Software Engineer - Product Platforms

We’re looking for a Principal Software Engineer to help define and build shared,...

Location

Finland , Helsinki

Salary:

Not provided

AlphaSense

Expiration Date

Until further notice

Requirements

Extensive experience as a senior staff/principal-level software engineer working on applications and backend systems
Experience building product platforms or shared services consumed by multiple product teams
Proven track record of designing, building, and operating APIs at scale
Strong hands-on experience with RESTful APIs
Some experience with GraphQL (design, usage, or operating in production)
Deep understanding of system design, performance, reliability, and evolution over time
Strong bias toward hands-on contribution and ownership of real systems
Ability to influence technical direction across teams through credibility and execution

Job Responsibility

Act as a technical owner and force multiplier for API-first architecture across the company
Design, build, and evolve high-scale APIs used by internal teams, external customers, and intelligent agents
Lead the development of agentic workflows, including orchestration, state management, tooling, and integration patterns
Drive API standards, design principles, and best practices through hands-on work and technical reviews
Tackle complex cross-team problems where requirements are ambiguous, and constraints are real
Partner with Product, Platform, and SRE teams to ensure APIs are reliable, observable, secure, and scalable
Identify and reduce systemic technical risks while enabling teams to move faster
Mentor senior engineers and raise the technical bar through example, not hierarchy

What we offer

Playing a part in the story of a fast growing company
Interesting career opportunities and training
Relocation support for single employees, couples and families
Flexible working arrangements
Private healthcare services from Terveystalo
2 weeks of vacation granted up front, and possibility to use vacation days as they accrue
Access to gym room, gaming room, free parking near the office, mobile phone, Lunch benefit, mobile plan, home internet, remote work equipment, and many more

Fulltime

Senior Golang Engineer - AI Product & Platforms

We are Citi's Application, Platform and Engineering team, a start-up with the ex...

Location

United Kingdom , London

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Golang expertise essential
Deep-dive Golang engineering expertise from building high-performance, large-scale production systems
Production system builder – proven track record of architecting and building large-scale, high-availability production applications and business-facing platforms from the ground up using Go
Advanced Go expertise – deep proficiency in Go's concurrency model (goroutines, channels, select), memory management, profiling, and performance tuning for latency-sensitive systems
Microservices and API design – extensive experience designing, building, and maintaining RESTful and gRPC APIs with a focus on clean contracts, versioning, and backward compatibility in high-traffic production systems
HashiCorp Vault and secrets management – experience integrating with Vault for dynamic credentials, secrets engines, and enterprise-scale secrets management within Go services
Enterprise authentication & authorization – designing and implementing OAuth, JWT, RBAC, and complex identity systems with fine-grained access controls in business-critical applications
Cloud-native and Kubernetes expertise – building, deploying, and operating containerized Go applications in Kubernetes, leveraging service meshes, Helm charts, and cloud-native patterns at enterprise scale
AI/ML platform engineering – experience building backend infrastructure and APIs that serve AI/ML models, manage inference pipelines, and support LLM-powered applications at scale
Observability and reliability engineering – implementing comprehensive logging, metrics, distributed tracing, and alerting to ensure system health and rapid incident resolution

Job Responsibility

Build AI-powered products from 0-1 – Engineer production-grade, business-facing AI platforms with clean, performant, and maintainable Go code from day one
Design and build high-performance backend services – Architect and implement low-latency, high-throughput microservices in Go that operate reliably at planetary scale
Design and build developer tools and frameworks – Create reusable libraries, SDKs, and internal tooling in Go that accelerate development across fast-paced engineering teams
Tackle complex distributed systems challenges – Design solutions for concurrency, fault tolerance, data consistency, and service orchestration across large-scale distributed environments
Champion engineering excellence – Drive best practices in code quality, testing strategies, CI/CD pipelines, and observability to maintain velocity without sacrificing reliability
Mentor and elevate the team – Guide other engineers on Go idioms, system design patterns, performance optimization, and building software that scales

What we offer

27 days annual leave (plus bank holidays)
A discretional annual performance related bonus
Private Medical Care & Life Insurance
Employee Assistance Program
Pension Plan
Paid Parental Leave
Special discounts for employees, family, and friends

Fulltime

Senior Software Engineer - AI Adoption Product

We are building a small foundational team of engineers to build and iterate on o...

Location

United Kingdom , London

Salary:

Not provided

Multiverse

Expiration Date

Until further notice

Requirements

Experience working in cross-functional product teams (typically 5+ years, but we welcome strong candidates with equivalent experience)
Ability to design, develop, and maintain new products from scratch
Excited about working on greenfield projects
Comfortable choosing the right tools for the job—our stack includes Python, TypeScript, React, Elixir, AWS
Skilled at working across the development lifecycle—from requirements to deployment and ongoing support
Collaborative, with experience mentoring or supporting other team members

Job Responsibility

Build and iterate on our new adoption platform
Working closely together with our AI Adoption Team to build new features from scratch, quickly iterating to improve them as we get customer feedback and continue to evolve our offer

What we offer

27 days holiday, plus 5 additional days off: 1 life event day, 2 volunteer days, 2 company-wide wellbeing days and 8 bank holidays per year
Private medical Insurance with Bupa, a medical cashback scheme, life insurance, gym membership & wellness resources through Wellhub and access to Spill - all in one mental health support
Hybrid work offering - we collaborate in the London office 3 days per week
Work-from-anywhere scheme - you'll have the opportunity to work from anywhere, up to 10 days per year
Team fun - weekly socials, company wide events and office snacks

Fulltime

Senior Software Engineer (Golang) - AI Product- Vice Presidents

We are Citi’s Application, Platform and Engineering group, a start-up with the e...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Go microservices, React 19+/TypeScript, OpenShift/Kubernetes, MongoDB/Redis/S3, REST/gRPC/WebSockets, Claude/Gemini/proprietary LLMs, OAuth/JWT/Vault, GitOps CI/CD, Prometheus/Grafana/ELK
11+ Years of Hands-on experience
Expert-level fluency in Golang and Python
Deep expertise in the Kubernetes ecosystem, container orchestration, and modern security paradigms (e.g., Gatekeeper, zero-trust)
Understanding of language models, embeddings models and RAG architectures
Proven experience designing control planes, sandboxing systems for AI experimentation, and managing large-scale vector stores and search algorithms
Extensive experience in large-scale ETL development and data pipeline architecture
Experience maintaining and/or contributing to bug bounty, responsible disclosure programs, and AI safety/guardrail implementations
Experience leading technical initiatives within fast-paced startup environments or driving startup-like agility within a large enterprise
Bachelor's degree in Computer Science, Software Engineering, or related technical field, or equivalent practical experience

Job Responsibility

Build scaled, robust services and platforms centred around generative AI, including developing CLIs, SDKs, runtimes and more
Drive architectural vision and lead the 0-1 build of foundational, enterprise-grade AI platforms and products
Design and build high-quality, highly reliable, and secure distributed systems with developer and user experience at the center
Create 'firsts' in the Generative AI space for Citi
Continually iterate and scale Generative AI products to handle massive throughput
Drive technical alignment across multiple engineering organizations, breaking down silos to deliver cohesive AI capabilities

Fulltime

Senior Software Engineer – Gen AI Platforms

We are Citi's Application, Platform and Engineering group, a start-up with the e...

Location

India , Bengaluru

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

9+ Years of Hands-on experience
Go microservices
React 19+/TypeScript
OpenShift/Kubernetes
MongoDB/Redis/S3
REST/gRPC/WebSockets
Claude/Gemini/proprietary LLMs
OAuth/JWT/Vault
GitOps CI/CD
Prometheus/Grafana/ELK

Job Responsibility

Build scaled, robust services and platforms centred around generative AI, including developing CLIs, SDKs, runtimes and more
Drive architectural vision and lead the 0-1 build of foundational, enterprise-grade AI platforms and products
Design and build high-quality, highly reliable, and secure distributed systems with developer and user experience at the center
Create 'firsts' in the Generative AI space for Citi, acting as a core member of the team that defines the strategic technical direction for the entire bank
Continually iterate and scale Generative AI products to handle massive throughput, whilst anticipating and listening to the complex needs of internal customers
Drive technical alignment across multiple engineering organizations, breaking down silos to deliver cohesive AI capabilities

Fulltime

Principal Software Engineer – Gen AI Platforms

We are Citi’s Application, Platform and Engineering group, a start-up with the e...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

14+ Years of Hands on experience is a must have
Expert-level fluency in Golang is a must-have
Deep experience building concurrent, high-throughput systems
Deep expertise in the Kubernetes ecosystem, container orchestration, and modern security paradigms
Understanding of language models, fine-tuning methodologies, and RAG architectures, JIT context retrieval strategies
Proven experience designing control planes, sandboxing systems for AI experimentation, and managing large-scale vector stores and search algorithms
Extensive experience in large-scale ETL development and data pipeline architecture
Experience maintaining and/or contributing to bug bounty, responsible disclosure programs, and AI safety/guardrail implementations
Experience leading technical initiatives within fast-paced startup environments or driving startup-like agility within a large enterprise

Job Responsibility

Engineering at scale: You will build scaled, robust services and platforms centred around generative AI. This may also include developing CLIs, SDKs, runtimes and more
Thought Leadership: Drive architectural vision and lead the 0-1 build of foundational, enterprise-grade AI platforms and products
System Design: Design and build high-quality, highly reliable, and secure distributed systems with developer and user experience at the center
Strategic Direction: Create "firsts" in the Generative AI space for Citi, acting as a core member of the team that defines the strategic technical direction for the entire bank
Scale & Iterate: Continually iterate and scale Generative AI products to handle massive throughput, whilst anticipating and listening to the complex needs of internal customers
Cross-Org Influence: You must be able to drive technical alignment across multiple engineering organizations, breaking down silos to deliver cohesive AI capabilities

Fulltime

Select Country

Software Product Engineer, AI Platforms

Job Description

Job Responsibility

Requirements

Nice to have

Looking for more opportunities?