CrawlJobs Logo
Apollo Solutions Logo Apollo Solutions · IT - Software Development

Senior AI Platform Engineer

United States, Boston Employment contract 150000.00 - 250000.00 USD / Year · Job Posted June 28, 2026
Apply Position
Job Link Share

Job Description

A leading financial services organisation is building a firm-wide AI Engineering capability to enable productivity and advanced agentic solutions for developers, business teams, and end users. This role focuses on designing and delivering a secure, scalable, and compliant AI platform that supports enterprise-wide adoption of AI technologies.

Job Responsibility

  • Design, build, and operate the core AI platform, including managed LLM inference services such as Amazon Bedrock
  • Manage model access, versioning, and intelligent routing across foundation models
  • Develop and maintain shared integration layers including MCP servers, registries, gateways, and authorization services
  • Build AI data pipelines and dashboards to track usage, adoption, and cost efficiency
  • Design infrastructure supporting AI-assisted developer environments, office productivity tools such as Microsoft 365 and Excel, and agentic AI frameworks
  • Develop reusable AI components including RAG pipelines, vector databases, and model integration patterns
  • Deliver scalable, production-grade platforms that are easy for engineering teams to adopt
  • Embed security controls across the full AI lifecycle in partnership with Security Engineering
  • Implement safeguards to prevent unsafe or destructive agent behaviour, including IAM policies, sandboxing, and network restrictions
  • Enforce a default-deny security model with strict access controls and human approval workflows for sensitive actions
  • Build pre-execution guardrails using policy engines and validation hooks
  • Ensure secure infrastructure boundaries using VPC endpoints and PrivateLink with no public internet egress
  • Maintain full auditability, traceability, and regulatory compliance across AI systems
  • Enable self-service onboarding for teams with role-based access controls
  • Implement cost management frameworks including quota management, usage tracking, and chargeback models
  • Operate centrally managed AI services across the organisation
  • Define and promote reference architectures and best practices
  • Support consistent and scalable adoption of AI across the firm

Requirements

  • 10+ years of experience in platform, infrastructure, or systems engineering
  • Proven experience building and operating enterprise-scale platforms across AWS and on-prem environments
  • Hands-on experience running LLM-based workloads in production
  • Strong expertise in Amazon Bedrock and Azure OpenAI
  • Experience designing MCP servers, registries, gateways, and authorization flows
  • Experience building agentic AI systems including tool use, function calling, RAG, and human-in-the-loop workflows
  • Proven ability to build developer-facing platforms with a focus on usability, reliability, and standardisation
  • Strong background implementing AI security controls in regulated or high-security environments
  • Excellent communication and stakeholder management skills
  • Ability to collaborate across security, application, and infrastructure teams
Apollo Solutions - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior AI Platform Engineer

8 matching positions

Senior AI Platform Engineer

We’re looking for a Senior AI Platform Engineer to build the shared systems that...
Location
Location
Canada; United States , Montreal; Toronto; Vancouver; SF
Salary
Salary:
Not provided
getmaintainx.com Logo
MaintainX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in Python backend engineering + systems design experience
  • Experience shipping AI-powered or LLM-integrated backend systems
  • Comfort working across multiple layers (services, data, infrastructure, AI tooling)
  • Experience with cloud infrastructure (AWS/GCP/Azure) and IaC (Terraform/Pulumi)
  • Experience with distributed systems and asynchronous processing
  • Have familiarity with AI or data-heavy services where reliability and cost matter at scale
Job Responsibility
Job Responsibility
  • Build and operate scalable backend services and internal APIs for the AI platform
  • Integrate LLMs and AI tool execution into reliable, production-ready workflows
  • Own production reliability for AI platform infrastructure through observability, alerting, and incident response
  • Improve performance and cost efficiency of AI runtimes through profiling, tuning, and capacity planning
  • Contribute to shared infra: CI/CD, observability, deployments
What we offer
What we offer
  • Competitive salary and meaningful equity opportunities
  • Healthcare, dental, and vision coverage
  • 401(k) / RRSP enrollment program
  • Take what you need PTO
Read More
Arrow Right

Senior Lead Ai Engineer (Mlx, Agentic Ai, Gen Ai Platform Services)

Location
Location
United States , San Francisco; New York; San Jose; Cambridge; McLean
Salary
Salary:
229900.00 - 286200.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
  • At least 6 years of experience programming with Python, Go, Scala, or Java
Job Responsibility
Job Responsibility
  • Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One
  • Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
  • Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
  • Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems
  • Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • Fulltime
Read More
Arrow Right

Ai Engineer Ii & Senior Ai Engineer - Getting Customers Ready For Ai

Security represents the most critical priorities for our customers in a world aw...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Must pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, build, and improve AI-powered solutions, including machine learning models, LLM-based applications, RAG systems, and agentic workflows that solve customer and business challenges
  • Develop and operate scalable data pipelines, ETL processes, training datasets, and AI infrastructure to support model development, deployment, and lifecycle management
  • Deploy, monitor, and optimize AI systems using MLOps practices, leveraging telemetry and feedback to improve performance, reliability, security, and scalability
  • Transform large-scale, multi-source data into contextual intelligence, automation, and decision-support capabilities that drive customer and business outcomes
  • Build and integrate AI capabilities into applications, services, APIs, and platforms to deliver end-to-end customer experiences
  • Contribute to AI readiness initiatives through frameworks, metrics, telemetry, and solutions that help customers securely adopt and operationalize AI technologies
  • Demonstrate a builder mindset by rapidly prototyping, experimenting, and iterating on AI solutions while navigating ambiguity and evolving requirements
  • Partner across engineering, data science, product, and customer teams to translate complex problems into practical, AI-driven solutions
  • Write maintainable, well-tested code and contribute to engineering excellence through documentation, operational rigor, governance, and adherence to security, compliance, and Responsible AI practices
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior ML Platform Engineer, AI Platform

We are seeking a skilled and passionate ML Platform Engineer to join our team an...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years in backend software development
  • at least 2+ years focus on AI/ML Platform or MLOps infrastructure
  • deep expertise in MLOps practices, including automated deployment pipelines, model optimization, and production lifecycle management
  • proven experience designing and implementing low-latency model serving solutions
  • proficiency in Python
  • skill in writing high-quality, maintainable code
  • experience in design and development of large-scale distributed, high concurrency, low-latency inference, high availability systems
  • excellent communication and mentoring abilities
  • a relevant degree in Computer Science, Mathematics or related fields
Job Responsibility
Job Responsibility
  • Platform Development: Design, build, and maintain the end-to-end MLOps platform using Kubernetes and Cloud Services
  • Infrastructure as Code (IaC): Use Terraform or similar tools to manage, provision, and scale all ML-related infrastructure securely and efficiently
  • Pipeline Automation: Implement and optimize CI/CD/CT (Continuous Integration, Delivery, Training) pipelines to automate model training, testing, packaging, and deployment using tools like Argo and Kubeflow Pipelines
  • Serving Infrastructure: Build highly available, low-latency, and high-throughput model serving infrastructure
  • Observability: Implement robust monitoring, alerting, and logging solutions to track infrastructure health, model performance, and data/model drift
  • Tooling & Support: Evaluate, integrate, and support ML tools such as Feature Stores and distributed model training pipelines
  • Security & Compliance: Ensure platform security, implement RBAC (Role-Based Access Control), and manage secrets for sensitive data and production environments
  • Collaboration: Work closely with Data Scientists and ML Engineers to understand their needs and provide technical guidance on best practices for scaling their models
  • Fulltime
Read More
Arrow Right

Senior Lead AI Engineer (Gen AI Platform Services)

At Capital One, we are creating responsible and reliable AI systems, changing ba...
Location
Location
United States , San Jose, California; New York, New York
Salary
Salary:
250800.00 - 286200.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
  • At least 6 years of experience programming with Python, Go, Scala, or Java
Job Responsibility
Job Responsibility
  • Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One
  • Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
  • Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
  • Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems
  • Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Managed AI - AI Platform

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'...
Location
Location
United States , San Francisco, CA; Sunnyvale, CA
Salary
Salary:
172425.00 - 209000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree in Computer Science/Engineering
  • 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
  • Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects quickly
  • Experience with Generative AI (LLMs, Multimodal) and familiar with AI infrastructure (training, inference, ETL pipelines)
  • Proficient with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD
Job Responsibility
Job Responsibility
  • Lead the design and implementation of core AI services, including: Resilient fault-tolerant queues for efficient task distribution
  • Model catalogs for managing and versioning AI models
  • Scheduling mechanisms optimized for cost and performance
  • Architect and scale infrastructure to handle millions of API requests per second
  • Implement robust monitoring and alerting to ensure system health and 24/7 availability
  • Collaborate closely with product management, business strategy, and other engineering teams to define the AI platform roadmap
  • Influence the long-term vision and architectural decisions of the platform
  • Contribute to open-source AI frameworks and actively participate in the AI community
  • Prototype and rapidly iterate on emerging technologies and new features
What we offer
What we offer
  • Restricted Stock Units
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right

Senior AI Platform Engineer - Data and Knowledge

We’re hiring a Senior AI Platform Engineer (Knowledge & Data) to build and own t...
Location
Location
Salary
Salary:
Not provided
getmaintainx.com Logo
MaintainX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in Python backend engineering and systems design experience
  • Experience shipping AI-powered or LLM-integrated backend systems
  • Experience with vector DBs (Qdrant/Pinecone/Chroma/etc.)
  • Understanding of embeddings, chunking, and retrieval strategies
  • Experience building search or retrieval systems over unstructured data
  • Comfort working across multiple layers (services, data, infra, AI tooling)
Job Responsibility
Job Responsibility
  • Build scalable backend services and internal APIs for the AI platform
  • Integrate LLMs and retrieval into reliable, production-ready workflows
  • Build knowledge ingestion pipelines for LLMs (documents, APIs, semi-structured data)
  • Design chunking and embedding approaches together with vector DB data models and indexing strategies
  • Implement retrieval pipelines (semantic, keyword, hybrid) and caching
  • Contribute to shared infrastructure: CI/CD, observability, deployments
What we offer
What we offer
  • Competitive salary and meaningful equity opportunities
  • Healthcare, dental, and vision coverage
  • 401(k) / RRSP enrollment program
  • Take what you need PTO
Read More
Arrow Right

Senior Platform Engineer - AI Team

The Internal Platform is a pivotal foundation that accelerates product developme...
Location
Location
Spain , Barcelona
Salary
Salary:
Not provided
docplanner.com Logo
DocPlanner GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience with Kubernetes
  • Experience with CI/CD tools like GH Actions, Argo CD and Argo Rollouts
  • Experience building secure, scalable, and high-availability environments on AWS
  • Experience with Python apps at scale
  • Experience working with GPUs and distributing workloads
  • Comfortable scripting or developing tools in Bash or Go
  • You can communicate in English (both spoken and written - min. B2 level)
  • Growth mindset
Job Responsibility
Job Responsibility
  • Design, implement, and manage AI Platform architecture
  • Control AI-related costs, including models, GPUs, and other resources
  • Work closely with Product teams to provide technical expertise and propose innovative solutions
  • Guarantee highly available AI services through best practices and automation
  • Collaborate with ML teams to operationalize AI models and integrate them into systems
  • Troubleshoot critical issues and continuously optimize system performance
  • Provide day-to-day support to team members and contribute to knowledge sharing
What we offer
What we offer
  • Flexible remuneration and benefits system via Flexoh, which includes: restaurant card, transportation card, kindergarten, and training tax savings
  • Remote or hybrid work model with our hub in Barcelona
  • Flexible working hours
  • Summer intensive schedule during July and August (work 7 hours, finish earlier)
  • 23 paid holidays, with exchangeable local bank holidays
  • Additional paid holiday on your birthday or work anniversary
  • Private healthcare plan with Adeslas for you and subsidized for your family (medical and dental)
  • Access to hundreds of gyms for a symbolic fee in partnership for you and your family with Andjoy
  • Access to iFeel, a technological platform for mental wellness offering online psychological support and counseling
  • Free English and Spanish classes
  • Fulltime
Read More
Arrow Right