CrawlJobs Logo

Software Architect - Ai Platform

United States, New York City · Job Posted May 27, 2026
Apply Position
Job Link Share

Job Description

We are building an agentic mesh network for US healthcare, deploying multimodal systems that can autonomously handle non-clinical tasks and with seamless execution between entities. Our founding team is ex-Palantir with direct experience delivering mission-critical software to HHS, NIH, and other federal institutions. We are based in New York City and work in-office every day. We operate with an extremely flat structure. We ship, we learn, we compound.

Job Responsibility

  • Define the architecture of the systems that power autonomous agent orchestration across the most critical vertical within our country
  • Own entire subsystems — from protocol design to production deployment — with the autonomy and accountability of a technical co-founder
  • Agent runtime architecture — designing the execution engine, task scheduling, state management, exception handling, and human-escalation pathways that the entire platform runs on
  • Multi-agent orchestration layer — the coordination primitives, tool-use frameworks, and real-time decision-making pipelines that process clinical documents, voice interactions, and multimodal healthcare data at institutional scale
  • Federated interoperability protocols that enforce data residency while enabling cross-entity agent collaboration
  • Platform abstractions — APIs, SDKs, and workflow primitives that allow both internal and external teams to deploy agents on the platform

Requirements

  • 5+ years building production distributed systems
  • You have designed, shipped, and operated infrastructure that runs at institutional scale
  • You've made architectural bets that held up — and learned from the ones that didn't

What we offer

Top-of-market cash compensation plus significant founding-team equity

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Architect - Ai Platform

8 matching positions

AI Performance Architect

AI Performance Architect role at Hewlett Packard Enterprise focusing on designin...
Location
Location
United States
Salary
Salary:
106000.00 - 243000.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's degree or PhD in Computer Science, Information Systems, or equivalent
  • 1-5 years' experience
  • Experience working on computer systems, HPC and AI applications
  • Deep expertise in current and emerging AI paradigms
  • Expertise in multiple software systems design tools and languages
  • Strong analytical and problem-solving skills
  • Designing software systems running on multiple platform types
  • Software systems testing methodology, including writing and execution of test plans, debugging, and testing scripts and tools
  • Excellent written and verbal communication skills
  • mastery in English
Job Responsibility
Job Responsibility
  • Designs enhancements, updates, and programming changes for portions and subsystems of systems software
  • Analyzes design and determines coding, programming, and integration activities required
  • Writes and executes complete testing plans, protocols, and documentation
  • Leads a project team of other software systems engineers
  • Collaborates and communicates with management and development partners
  • Represents the software systems engineering team for development projects
  • Provides guidance and mentoring to less-experienced staff members
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

AI Architect

We are looking for a highly skilled AI Architect to join a leading digital trans...
Location
Location
Luxembourg , Leudelange
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree or equivalent in IT or related fields
  • extensive experience as an IT Architect or AI Software Engineer focused on productivity-enhancing platforms
  • proficient in AI/ML frameworks such as TensorFlow, PyTorch, OpenAI technologies, and knowledge of AI patterns including Retrieval-Augmented Generation (RAG)
  • skilled in software development using Python, TypeScript, and integrating AI into developer environments and IDEs
  • demonstrated ability to produce technical documentation and conduct developer training sessions
  • experience with cloud AI services (AWS, Azure) and vector databases is highly desirable
Job Responsibility
Job Responsibility
  • design and prototype AI-powered platforms and APIs tailored for developers
  • identify and apply AI techniques to solve complex business and technical challenges
  • develop comprehensive technical documentation and training modules for AI tools
  • plan scalable AI solutions and propose innovative applications to improve developer workflows
  • collaborate closely with cross-functional teams to align AI services with organizational goals
What we offer
What we offer
  • access to Sopra Steria training and personal development academy
  • a company car lease or mobility budget
  • a company laptop and mobile phone
  • private health insurance coverage
  • meal vouchers
  • social security and pension plan
  • competitive salary
  • 26 holiday days
  • Fulltime
Read More
Arrow Right

Solution Architect - Gen AI & Integration

The Solution Architects are part of the Architecture practice within the CTO org...
Location
Location
Salary
Salary:
Not provided
admiralgroup.co.uk Logo
Admiral Group Plc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with anyone API Management & Gateway platform
  • Experience with one or more major Integration Platform such as TIBCO, MuleSoft, Dell Boomi, Azure Integration Services etc.
  • Experience in designing data retrieval pipelines (RAG), implementing autonomous LLM orchestration frameworks, and Model Evaluation Services (MES) frameworks
  • Experience in Prompt Management - Strategic approach to prompt versioning, testing, and lifecycle management within production environment
  • Strong knowledge of integration security best practices
  • Experience with data exchange formats and transformation techniques
  • Experience in designing RESTFul APIs and Event-Driven Architectures
  • Experience of applying integration pattern and strong knowledge of architecture styles
  • Understanding of software delivery pipelines and how solution fits into CI/CD practices
  • Experience designing and deploying integration solutions within atleast one major cloud environments
Job Responsibility
Job Responsibility
  • Together with Lead Solution Architects, provide strong technical solutions for value streams, own those solutions from ideation to delivery, and ensure that business value can be realised through the correct implementation of the solutions
  • Lead and contribute to governance forums, ensuring solutions adhere to established standards and patterns, identifying and controlling divergences, and escalating where necessary
  • Build productive relationships with technical and business stakeholders to maintain alignment of technology and business strategies
  • Contribute to and help maintain a detailed understanding of the architecture for the value stream
  • Produce documentation of a high-quality and to a detailed level, ensuring that all decision points, building blocks, principles, rationale, roadmaps, and all interdependencies are understood, documented, and communicated across value streams
  • Contribute to the architecture repository using the Admiral architecture modelling tools and language
  • Write, or contributes to, articles, and papers and speak at conferences, user groups, or specialist subject groups on topics involved in Architecture. Play a leading role in special interest groups concerned with specialist field
  • Promote Architecture within Admiral and closely associated organisations
  • Support innovation by research, create and communicate reports, strategies and industry insights about emerging technologies, products, services, methods and techniques and their potential impacts, threats, and opportunities
  • Keep the Head of Solution Architecture and the CTO management team informed and escalate where appropriate
What we offer
What we offer
  • Everyone receives 33 days holiday (including bank holidays) when they join us, increasing the longer you stay with us, up to a maximum of 38 days (including bank holidays). You also have the option to buy or sell up to an additional five days of annual leave
  • eligible for up to £3,600 of free shares each year after one year of service
  • Financial & Mortgage Advice
  • 24-Hour Ecare
  • Cycle to Work Scheme
  • Annual Holiday Allowance
  • Flexible Working
  • Simply Health
  • Private Health Cover
  • Critical Illness Cover
  • Fulltime
Read More
Arrow Right

AI Solution Architect

Andersen is hiring an AI Solution Architect in Germany to design and integrate s...
Location
Location
Germany
Salary
Salary:
Not provided
andersenlab.com Logo
Andersen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in software engineering for 10+ years with at least 3-4 years in AI/ML solution design
  • Strong expertise in designing LLM/GenAI architectures, including model selection, serving, orchestration and scaling
  • Practical experience with Python and modern AI frameworks (PyTorch, TensorFlow, JAX)
  • Deep understanding of transformer models, embeddings, vector search and RAG architectures
  • Experience designing agent-based systems and AI orchestration frameworks (LangGraph, LangChain, AutoGen or equivalents)
  • Hands-on experience with MLOps practices, model lifecycle management, versioning and monitoring
  • Knowledge of vector databases (FAISS, Milvus, Pinecone, Chroma) and search optimization techniques
  • Experience designing high-availability AI inference services using vLLM, Triton, TensorRT or similar serving technologies
  • Solid understanding of cloud environments for AI workloads (AWS/GCP/Azure), GPU/accelerator usage and cost optimization
  • Ability to translate business requirements into AI solution architectures, integration patterns and technical specifications
Job Responsibility
Job Responsibility
  • Defining the overall architecture and technical strategy for AI/GenAI systems, ensuring scalability, robustness and alignment with organizational standards
  • Selecting appropriate models, frameworks, serving stacks and infrastructure components for AI workloads
  • Designing end-to-end RAG, vector search and agent-based AI solutions, including data flows, orchestration logic and system boundaries
  • Overseeing model lifecycle processes: training, fine-tuning, evaluation, deployment, monitoring and continuous improvement
  • Providing architectural guidance to development teams and ensuring consistent implementation across projects
  • Preparing architectural documentation, diagrams, guidelines and decision records
  • Collaborating with security, data, infrastructure and product teams to ensure compliance, reliability and performance
  • Evaluating new AI technologies, tools and frameworks and assessing their relevance for the organization's ecosystem
  • Reviewing complex incidents, performance issues and design flaws, providing direction for remediation and optimization
  • Supporting procurement and vendor evaluation for AI platforms, hosting, data systems or model providers
What we offer
What we offer
  • Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others
  • The opportunity to change the project and/or develop expertise in an interesting business domain
  • Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant
  • Guarantee of professional, financial, and career growth
  • The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities
  • Access to the corporate training portal
  • Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies)
  • Certification compensation (AWS, PMP, etc)
  • Referral program
  • English courses
Read More
Arrow Right

Senior Software Engineer, AI

As a Senior AI Engineer on our Core AI team, you will be a cornerstone of FloQas...
Location
Location
India , Pune
Salary
Salary:
Not provided
floqast.com Logo
FloQast
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional software engineering experience
  • 3+ years focused on building backend for production applications
  • Mastery of Python
  • Familiarity with some AI application frameworks, context engineering, and scalable system design for AI products
  • Expertise in designing products that integrate with multiple technologies, APIs, and data sources in cloud-native environments (AWS preferred)
  • Strong desire to develop deep hands-on experience with LLM APIs, retrieval-augmented generation (RAG), conversational AI, document processing, and MCP integrations
  • Proven ability to lead tech product initiatives, establish technical standards and communicate complex system designs to both technical and business stakeholders
Job Responsibility
Job Responsibility
  • Architect and lead development of production AI products including intelligent chatbots, document processing systems, and agentic workflows using Python and modern AI frameworks
  • Design and implement our centralized AI platform including model routing, provider management, vector search, and AI application frameworks with seamless MCP (Model Context Protocol) integrations
  • Build scalable AI products that integrate with diverse technologies including accounting systems, document repositories, and external APIs while maintaining robust monitoring and observability
  • Master context engineering and system design for AI applications, ensuring optimal information retrieval, context assembly, and multi-turn conversation management
  • Collaborate with Product, Engineering, and Security teams to ensure AI products are robust, compliant, and aligned with business objectives in the regulated accounting space
  • Provide technical leadership and mentorship to the growing AI team, establishing best practices for AI product development, deployment, and governance
  • Fulltime
Read More
Arrow Right

AI Solutions Architect

Strategic AI Architecture & Innovation; Project Leadership & Execution; Technica...
Location
Location
Qatar , Doha
Salary
Salary:
Not provided
beyond.ai Logo
Beyond Limits
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s in computer science, Software Engineering, or related
  • 10+ years managing software engineering, AI, or data analytics projects in Oil & Gas or similar heavy industries
  • Demonstrated success in managing and aligning diverse stakeholders
  • Communication: Articulate technical concepts—architecture diagrams, code quality metrics—to both technical and non technical audiences
  • Analytical: Extract insights from performance metrics, error rates, and project KPIs to drive continuous improvement
  • Problem Solving: Quickly diagnose system failures, code regressions, and data pipeline issues, and lead resolution
  • Deep expertise in Agile methodologies (Scrum, Kanban) and a solid grasp of Waterfall practices
  • Hands-on experience with tools such as Jira, Confluence, CI/CD pipelines (e.g., Jenkins, GitLab CI), and cloud platforms (OCI, GCP)
  • Solid understanding of the architectural and operational differences between cloud-native and on-premises software environments
  • Fluent in both Arabic and English
Job Responsibility
Job Responsibility
  • Design & Integration: Lead the design of scalable AI architectures that seamlessly integrate with existing enterprise systems, directly addressing complex industrial challenges
  • Customization & Prototyping: Develop tailored AI models and proof-of-concept prototypes that demonstrate clear business value and operational impact
  • Feasibility Analysis: Conduct technical feasibility assessments to validate solution designs and ensure alignment with strategic business requirements
  • End-to-End Management: Oversee the full lifecycle of AI projects—from initial scoping and conceptualization to deployment and post-implementation support—ensuring timely delivery and budget adherence
  • Stakeholder Collaboration: Engage closely with client representatives, internal R&D teams, and technical staff to maintain clear communication and alignment on objectives, deliverables, and timelines
  • Risk & Quality Assurance: Implement effective risk management strategies while maintaining rigorous quality standards throughout project execution
  • Pre-Sales Expertise: Serve as the technical authority during pre-sales activities, articulating the capabilities of Beyond Limits’ platforms, frameworks, and products to prospective clients
  • Partner Selection & Training: Identify and select the right delivery partners, then train and support them on our technologies to ensure they meet our high technical standards
  • Collaborative Oversight: Work in close partnership with delivery leads and external developers to manage project development, ensuring seamless integration and successful client outcomes
  • Strategic Advisory: Provide high-level consulting on AI strategies and digital transformation roadmaps that empower clients to gain competitive advantages
Read More
Arrow Right

Sr. Staff Software Engineer - Advanced Analytics Platform

At DISQO, we’re redefining how companies turn data into decisions. Our mission i...
Location
Location
United States , Los Angeles, Glendale
Salary
Salary:
200000.00 - 240000.00 USD / Year
disqo.com Logo
DISQO
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of professional software engineering experience
  • 5+ years architecting or building high-performance data systems or analytics platforms
  • 3+ years of product Rust experience
  • Deep expertise in Rust and strong experience in Java
  • Proven track record building large-scale data analytics or OLAP systems from the ground up
  • Deep understanding of columnar data engines, vectorized execution, and query/dataframe optimization
  • Hands-on experience with performance engineering, profiling, and hardware-aware optimization
  • Strong expertise with AWS - designing, deploying, and optimizing large-scale data and compute systems in the cloud
  • A systems-thinking mindset
  • Thrives in a fast-moving, startup environment
Job Responsibility
Job Responsibility
  • Architect and deliver a high-performance Advanced Analytics Engine
  • Design and build an Agentic AI system that leverages this Advanced Analytics Engine
  • Partner with product, engineering and data teams to power agentic AI analytics systems
  • Profile, benchmark, and optimize Rust components
  • Leverage AWS cloud services to architect scalable, reliable, and cost-efficient analytics infrastructure
  • Shape the evolution of DISQO’s broader data platform and its integration across our product ecosystem
  • Mentor and guide engineers
  • Contribute to open-source or internal frameworks that advance analytical systems and distributed computation
What we offer
What we offer
  • 100% covered Medical/Dental/Vision for employee
  • Equity
  • 401K
  • Generous PTO policy
  • Flexible workplace policy
  • Team offsites, social events & happy hours
  • Life Insurance
  • Health FSA
  • Commuter FSA (for hybrid employees)
  • Catered lunch and fully stocked kitchen
  • Fulltime
Read More
Arrow Right

Staff Software Engineer, Core AI

As a Staff AI Engineer on our Core AI team, you will be a cornerstone of FloQast...
Location
Location
United States , San Jose
Salary
Salary:
164000.00 - 246000.00 USD / Year
floqast.com Logo
FloQast
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of professional software engineering experience
  • 4+ years focused on building backend for production applications
  • Mastery of Python
  • Familiarity with some AI application frameworks, context engineering, and scalable system design for AI products
  • Expertise in designing products that integrate with multiple technologies, APIs, and data sources in cloud-native environments (AWS preferred)
  • Strong desire to develop deep hands-on experience with LLM APIs, retrieval-augmented generation (RAG), conversational AI, document processing, and MCP integrations
  • Proven ability to lead tech product initiatives, establish technical standards and communicate complex system designs to both technical and business stakeholders
Job Responsibility
Job Responsibility
  • Architect and lead development of production AI products including intelligent chatbots, document processing systems, and agentic workflows using Python and modern AI frameworks
  • Design and implement our centralized AI platform including model routing, provider management, vector search, and AI application frameworks with seamless MCP (Model Context Protocol) integrations
  • Build scalable AI products that integrate with diverse technologies including accounting systems, document repositories, and external APIs while maintaining robust monitoring and observability
  • Master context engineering and system design for AI applications, ensuring optimal information retrieval, context assembly, and multi-turn conversation management
  • Collaborate with Product, Engineering, and Security teams to ensure AI products are robust, compliant, and aligned with business objectives in the regulated accounting space
  • Provide technical leadership and mentorship to the growing AI team, establishing best practices for AI product development, deployment, and governance
What we offer
What we offer
  • Medical
  • Dental
  • Vision
  • Family Forming benefits
  • Life & Disability Insurance
  • Unlimited Vacation
  • Fulltime
Read More
Arrow Right