CrawlJobs Logo

AI / ML Engineer, Software Engineering

iCapital Network

Location Icon

Location:
United States , New York

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

180000.00 - 220000.00 USD / Year

Job Description:

iCapital is seeking an experienced and forward-thinking AI/ML Engineer Vice President with a strong engineering background and experience leading technical teams. The ideal candidate thrives at the intersection of AI/ML systems engineering, platform development, and intelligent agent design. This individual will play a key role in building and scaling AI capabilities across our platform, with a focus on production-grade systems rather than data science. If you are passionate about developing systems that go beyond traditional ML models—systems that can reason, plan, and act in dynamic environments using tools, APIs, and memory—this is the role for you. While this is primarily a hands-on engineering position, this role will also provide technical leadership, mentor junior engineers, and collaborate cross-functionally to shape our AI strategy and execution.

Job Responsibility:

  • Design, build, and optimize scalable AI/ML infrastructure and services powering intelligent features across our platform
  • Lead the development of AI agents capable of autonomous decision-making, task execution, and multi-step reasoning across internal and customer-facing applications
  • Architect and implement modular agent frameworks by integrating tools, APIs, and memory systems for dynamic and context-aware behavior
  • Collaborate with product, data, and infrastructure teams to embed AI capabilities into production systems
  • Drive the architecture and development of ML pipelines, model serving frameworks, and real-time inference systems
  • Evaluate and integrate state-of-the-art AI tools and frameworks to accelerate development and deployment
  • Provide technical mentorship and guidance to engineers, contributing to team growth and best practices
  • Partner with Data Science teams to operationalize models, ensuring a smooth transition from experimentation to production
  • Contribute to technical roadmaps and help define long-term AI/ML platform and agent strategy
  • Optimize agent performance for latency, reliability, and safety in production environments
  • Stay current with the latest research and tools in LLMs, multi-agent systems, and cognitive architectures
  • Contribute to the development of internal libraries, best practices, and reusable components for agentic systems

Requirements:

  • 8+ years of experience in software engineering, with at least 2+ years focused on AI/ML systems
  • Proven experience in building and deploying ML models in production environments
  • Hands-on experience with AI agent frameworks (e.g., LangChain, Semantic Kernel, AutoGen, or custom-built systems)
  • Strong understanding of the ML lifecycle, including data pipelines, model training, evaluation, deployment, and monitoring
  • Familiar with MLOps tools such as MLflow, Kubeflow, or SageMaker
  • Deep understanding of LLM orchestration, prompt engineering, tool use, and memory architectures
  • Familiar with various LLM inference engines such as vLLM or SGLang
  • Experience in integrating agents with APIs, databases, and external systems
  • Familiar with retrieval-augmented generation (RAG), vector databases, and knowledge graphs
  • Experience deploying AI systems in cloud environments (AWS, GCP, Azure) and utilizing containerization tools (Docker, Kubernetes)
  • Demonstrated ability to lead projects or small teams, with excellent communication and collaboration skills
  • Bachelor’s or master’s degree in computer science, engineering, or a related field

Nice to have:

  • Experience with LLMs, generative AI, or multi-agent systems in production is a plus
  • Background in distributed systems or real-time data processing is a plus
  • Experience in the finance industry is a plus
What we offer:
  • Equity for all full-time employees
  • Annual performance bonus
  • Employer matched retirement plan
  • Generously subsidized healthcare with 100% employer paid dental, vision, telemedicine, and virtual mental health counseling
  • Parental leave
  • Unlimited paid time off (PTO)

Additional Information:

Job Posted:
February 01, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for AI / ML Engineer, Software Engineering

AI Software Engineer III

Planet DDS is a leading provider of a platform of cloud-based solutions that emp...
Location
Location
United Kingdom , Glasgow
Salary
Salary:
Not provided
planetdds.com Logo
Planet DDS
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-7 years of professional software engineering experience
  • At least 4 years in AI/ML-focused roles
  • Bachelor’s or Master’s degree in Computer Science, Machine Learning, Artificial Intelligence, or related field
  • Experience working in a SaaS or enterprise software environment
  • Publications or contributions to open-source AI/ML projects
  • Exposure to reinforcement learning, generative AI (LLMs, diffusion models), or real-time inference systems
Job Responsibility
Job Responsibility
  • Design, develop, and deploy AI and machine learning models in production environments
  • Architect scalable solutions that integrate AI capabilities into our products and services
  • Collaborate with data scientists, product managers, and backend/front-end engineers to translate prototypes into reliable, maintainable code
  • Own end-to-end development of AI systems, including data ingestion, model training, evaluation, and deployment
  • Implement best practices in model versioning, monitoring, and continuous improvement
  • Contribute to the evolution of our AI/ML infrastructure, including CI/CD pipelines and MLOps tools
  • Stay current on advancements in AI, ML, and deep learning and assess their applicability to business needs
  • Ensure AI solutions are ethical, interpretable, and aligned with regulatory requirements
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - ML Infrastructure

We build simple yet innovative consumer products and developer APIs that shape h...
Location
Location
United States , San Francisco
Salary
Salary:
180000.00 - 270000.00 USD / Year
plaid.com Logo
Plaid
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of industry experience as a software engineer, with strong focus on ML/AI infrastructure or large-scale distributed systems
  • Hands-on expertise in building and operating ML platforms (e.g., feature stores, data pipelines, training/inference frameworks)
  • Proven experience delivering reliable and scalable infrastructure in production
  • Solid understanding of ML Ops concepts and tooling, as well as best practices for observability, security, and reliability
  • Strong communication skills and ability to collaborate across teams
Job Responsibility
Job Responsibility
  • Design and implement large-scale ML infrastructure, including feature stores, pipelines, deployment tooling, and inference systems
  • Drive the rollout of Plaid’s next-generation feature store to improve reliability and velocity of model development
  • Help define and evangelize an ML Ops “golden path” for secure, scalable model training, deployment, and monitoring
  • Ensure operational excellence of ML pipelines and services, including reliability, scalability, performance, and cost efficiency
  • Collaborate with ML product teams to understand requirements and deliver solutions that accelerate experimentation and iteration
  • Contribute to technical strategy and architecture discussions within the team
  • Mentor and support other engineers through code reviews, design discussions, and technical guidance
What we offer
What we offer
  • medical, dental, vision, and 401(k)
  • Fulltime
Read More
Arrow Right

Middle/Senior AI, ML Engineer

Join us at Provectus to be a part of a team that is dedicated to building cuttin...
Location
Location
Salary
Salary:
Not provided
provectus.com Logo
Provectus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Comfortable with standard ML algorithms and underlying math
  • Strong hands-on experience with LLMs in production, RAG architecture, and agentic systems
  • AWS Bedrock experience strongly preferred
  • Practical experience with solving classification and regression tasks in general, feature engineering
  • Practical experience with ML models in production
  • Practical experience with one or more use cases from the following: NLP, LLMs, and Recommendation engines
  • Solid software engineering skills (i.e., ability to produce well-structured modules, not only notebook scripts)
  • Python expertise, Docker
  • English level - strong Intermediate
  • Excellent communication and problem-solving skills
Job Responsibility
Job Responsibility
  • Create ML models from scratch or improve existing models
  • Collaborate with the engineering team, data scientists, and product managers on production models
  • Develop experimentation roadmap
  • Set up a reproducible experimentation environment and maintain experimentation pipelines
  • Monitor and maintain ML models in production to ensure optimal performance
  • Write clear and comprehensive documentation for ML models, processes, and pipelines
  • Stay updated with the latest developments in ML and AI and propose innovative solutions
Read More
Arrow Right

Middle/senior AI, ML Engineer

Join us at Provectus to be a part of a team that is dedicated to building cuttin...
Location
Location
Salary
Salary:
Not provided
provectus.com Logo
Provectus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Comfortable with standard ML algorithms and underlying math
  • Strong hands-on experience with LLMs in production, RAG architecture, and agentic systems
  • AWS Bedrock experience strongly preferred
  • Practical experience with solving classification and regression tasks in general, feature engineering
  • Practical experience with ML models in production
  • Practical experience with one or more use cases from the following: NLP, LLMs, and Recommendation engines
  • Solid software engineering skills (i.e., ability to produce well-structured modules, not only notebook scripts)
  • Python expertise, Docker
  • English level - strong Intermediate
  • Excellent communication and problem-solving skills
Job Responsibility
Job Responsibility
  • Create ML models from scratch or improve existing models
  • Collaborate with the engineering team, data scientists, and product managers on production models
  • Develop experimentation roadmap
  • Set up a reproducible experimentation environment and maintain experimentation pipelines
  • Monitor and maintain ML models in production to ensure optimal performance
  • Write clear and comprehensive documentation for ML models, processes, and pipelines
  • Stay updated with the latest developments in ML and AI and propose innovative solutions
Read More
Arrow Right

Middle/Senior AI, ML Engineer

Join us at Provectus to be a part of a team that is dedicated to building cuttin...
Location
Location
Salary
Salary:
Not provided
provectus.com Logo
Provectus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Comfortable with standard ML algorithms and underlying math
  • Strong hands-on experience with LLMs in production, RAG architecture, and agentic systems
  • AWS Bedrock experience strongly preferred
  • Practical experience with solving classification and regression tasks in general, feature engineering
  • Practical experience with ML models in production
  • Practical experience with one or more use cases from the following: NLP, LLMs, and Recommendation engines
  • Solid software engineering skills (i.e., ability to produce well-structured modules, not only notebook scripts)
  • Python expertise, Docker
  • English level - strong Intermediate
  • Excellent communication and problem-solving skills
Job Responsibility
Job Responsibility
  • Create ML models from scratch or improve existing models
  • Collaborate with the engineering team, data scientists, and product managers on production models
  • Develop experimentation roadmap
  • Set up a reproducible experimentation environment and maintain experimentation pipelines
  • Monitor and maintain ML models in production to ensure optimal performance
  • Write clear and comprehensive documentation for ML models, processes, and pipelines
  • Stay updated with the latest developments in ML and AI and propose innovative solutions
Read More
Arrow Right

Senior Software Engineer – AI

NStarX is seeking a highly skilled Senior Software Engineer – AI with a strong f...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
nstarxinc.com Logo
NStarX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field (PhD is a plus)
  • 9+ years of experience in AI/ML engineering or related roles
  • 3+ years of experience in Generative AI with team leadership responsibilities
  • Proven track record of production-grade ML and GenAI model development and deployment
  • Programming: Python (preferred)
  • GenAI Frameworks: Hugging Face Transformers, Diffusers, LangChain, TGI
  • Serving & Inference: FastAPI, gRPC, NVIDIA Triton, TorchServe
  • Cloud Platforms: AWS (SageMaker, EKS), GCP (Vertex AI, GKE), Azure (Azure ML, AKS)
  • MLOps & DevOps: Kubeflow, MLflow, GitHub Actions, Jenkins, Helm, Terraform
  • Optimization Techniques: Model quantization, distillation, pipeline and tensor parallelism
Job Responsibility
Job Responsibility
  • Design, develop, and deploy machine learning models and AI algorithms to address complex business challenges
  • Lead and mentor a team of AI/ML engineers, ensuring quality and scalability in solution design and implementation
  • Collaborate closely with cross-functional teams including data scientists, software engineers, product managers, and UX designers
  • Lead the development and deployment of Generative AI applications across text, code, image, and audio modalities using state-of-the-art LLMs
  • Design and implement CI/CD pipelines for the GenAI model lifecycle including training, validation, packaging, and deployment
  • Apply best practices for model performance tuning, cost optimization, and scalable deployment in cloud and hybrid environments
  • Develop prompt engineering, fine-tuning strategies (LoRA, QLoRA, PEFT), and evaluation protocols tailored to business use cases
  • Stay current with emerging trends in AI, ML, and Generative AI and drive adoption across teams
  • Document processes, model architectures, and deployment strategies for traceability and knowledge sharing
  • Work closely with cross-functional teams to gather requirements and deliver high-quality solutions
What we offer
What we offer
  • Competitive salary aligned with market standards
  • Opportunities for professional development and skill enhancement
  • A collaborative and innovative work environment
  • Fulltime
Read More
Arrow Right

Software Engineer, AI Infrastructure

As a Software Engineer on our AI Infrastructure team, you will help design the c...
Location
Location
United States , New York, NY; San Mateo, CA
Salary
Salary:
Not provided
fireworks.ai Logo
Fireworks AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
  • 3 years of experience in software engineering, with a focus on infrastructure or machine learning systems
  • Strong programming skills in Python, Go, or a similar language
  • Proven experience in ML infrastructure and tooling (e.g., PyTorch, MLflow, Vertex AI, SageMaker, Kubernetes, etc.)
  • Basic understanding of LLM knowledge (e.g., context length, disaggregated prefill, KV cache memory estimation, etc)
Job Responsibility
Job Responsibility
  • Contribute to the design and development of scalable backend infrastructure that supports distributed training, inference, and data pipelines
  • Build and maintain core backend services such as LLM CI/CD pipeline, control plane, and model serving systems
  • Support performance optimization, cost efficiency, and reliability improvements across compute, storage, and networking layers
  • Building frameworks and safeguards to ensure Fireworks AI has the best model quality in the industry
  • Collaborate with performance, training, and product teams to translate research and product needs into infrastructure solutions
  • Participate in code reviews, technical discussions, and continuous integration and deployment processes
What we offer
What we offer
  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure
  • Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally
  • Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results
  • Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation
  • Fulltime
Read More
Arrow Right

Principal ML/AI Software Engineer

We are looking for a Principal Engineer experienced in the ML/AI domain to drive...
Location
Location
Turkey
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in Machine Learning engineering, including hands-on work with training/inference pipelines, prompt engineering, and ML systems, demonstrating deep expertise in applied ML
  • Proven track record of tech-leading AI/ML products from conception to launch
  • Strong platform mindset - experience building reusable tools/infras to accelerate AI development
  • Strong programming skills in any OOO programming language - we’re open to candidates from different tech backgrounds
  • Excellent communication and collaboration skills
Job Responsibility
Job Responsibility
  • Define the technical vision and roadmap for AI Foundation and NextGen
  • End-to-end ownership - from prototyping and development to production
  • Hands-on work in prompt engineering, model iteration, and training/inference systems
  • Collaborate with Product, Engineering, Data Science, and UX to align on priorities and deliver measurable impact
  • Facilitate product and technical decisions, ensuring alignment with business goals
  • Drive platformization of AI/ML systems to improve scalability, reliability, and adoption across teams
  • Partner with customer teams to understand needs, build relationships, and expand the scope of AI adoption
  • Explore and apply state-of-the-art AI/ML techniques to solve novel product challenges
  • Evaluate in-house model development vs. third-party APIs for ML/AI solutions
  • Establish best practices for AI development, quality measurement, monitoring, and scalability
What we offer
What we offer
  • Health and wellbeing resources
  • Paid volunteer days
Read More
Arrow Right