CrawlJobs Logo

Staff Software Engineer - AI/ML Infra

United States, Chevy Chase 115000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Platform Engineer to build and scale our machine learning infrastructure with a focus on Large Language Models (LLMs) and AI applications. This role combines deep technical expertise in cloud platforms, container orchestration, and ML operations with strong leadership and mentoring capabilities. You will be responsible for designing, implementing, and maintaining scalable, reliable systems that enable our data science and engineering teams to deploy and operate LLMs efficiently at scale. The candidate must have excellent verbal and written communication skills with a proven ability to work independently and in a team environment.

Job Responsibility

  • Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
  • Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
  • Design, implement, and maintain feature stores for ML model training and inference pipelines
  • Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
  • Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
  • Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
  • Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
  • Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
  • Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
  • Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases
  • Design and maintain robust CI/CD pipelines for ML model deployment using Azure DevOps, GitHub Actions, and MLOps tools
  • Implement automated model training, validation, deployment, and monitoring workflows
  • Set up comprehensive observability using Prometheus, Grafana, Azure Monitor, and custom dashboards
  • Continuously optimize platform performance, reducing latency and improving throughput for ML workloads
  • Design and implement backup, recovery, and business continuity plans for ML platforms
  • Mentor junior engineers and data scientists on platform best practices, infrastructure design, and ML operations
  • Lead comprehensive code reviews focusing on scalability, reliability, security, and maintainability
  • Design and deliver technical onboarding programs for new team members joining the ML platform team
  • Establish and champion engineering standards for ML infrastructure, deployment practices, and operational procedures
  • Create technical documentation, runbooks, and deliver internal training sessions on platform capabilities
  • Work closely with data scientists to understand requirements and optimize workflows for model development and deployment
  • Collaborate with product engineering teams to integrate ML capabilities into customer-facing applications
  • Support research teams with infrastructure for experimenting with cutting-edge LLM techniques and architectures
  • Present technical solutions and platform roadmaps to leadership and cross-functional stakeholders

Requirements

  • Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
  • 8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
  • 3+ years of hands-on experience with machine learning infrastructure and deployment at scale
  • 2+ years of experience working with Large Language Models and transformer architectures
  • Proficient in Python
  • strong skills in Go, Rust, or Java preferred
  • Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
  • Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
  • Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
  • Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)
  • Hands-on experience with inference optimization using vLLM, TensorRT-LLM, Triton Inference Server, or similar
  • Advanced experience with Azure DevOps, GitHub Actions, Jenkins, or similar CI/CD platforms
  • Proficiency with Terraform, ARM templates, Pulumi, or CloudFormation
  • Deep understanding of Docker, container optimization, and multi-stage builds
  • Experience with Prometheus, Grafana, ELK stack, Azure Monitor, and distributed tracing
  • Knowledge of both SQL and NoSQL databases, data warehousing, and vector databases
  • Demonstrated track record of mentoring engineers and leading technical initiatives
  • Experience leading design reviews with focus on compliance, performance, and reliability
  • Excellent ability to explain complex technical concepts to diverse audiences
  • Strong analytical and troubleshooting skills for complex distributed systems
  • Experience managing cross-functional technical projects and coordinating with multiple stakeholders

Nice to have

  • Master’s degree in computer science, Machine Learning, or related field
  • 8+ years of platform engineering or infrastructure experience
  • Experience with Staff Engineer or Tech Lead roles in ML/AI organizations
  • Background in distributed systems and high-performance computing
  • Open-source contributions to ML infrastructure projects or LLM frameworks
  • Multi-Cloud Experience: Hands-on experience with Azure, AWS (SageMaker, EKS) and/or GCP (Vertex AI, GKE)
  • Experience with specialized hardware (A100s, H100s, TPUs, TEEs) and optimization
  • RLHF & Fine-tuning: Experience with Reinforcement Learning from Human Feedback and LLM fine-tuning workflows
  • Experience with Milvus, Pinecone, Weaviate, Qdrant, or similar vector storage solutions
  • Deep experience with MLflow, Kubeflow, DataRobot, or similar platforms
  • Understanding of AI safety principles, model governance, and regulatory compliance
  • Background in regulated industries with understanding of data privacy requirements
  • Experience supporting ML research teams and academic partnerships
  • Deep understanding of GPU optimization, memory management, and high-throughput systems

What we offer

  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Staff Software Engineer - AI/ML Infra

8 matching positions

Staff Software Engineer - AI/ML Infra

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Pl...
Location
Location
United States , Palo Alto
Salary
Salary:
90000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
  • 8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
  • 3+ years of hands-on experience with machine learning infrastructure and deployment at scale
  • 2+ years of experience working with Large Language Models and transformer architectures
  • Proficient in Python
  • strong skills in Go, Rust, or Java preferred
  • Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
  • Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
  • Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
  • Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)
Job Responsibility
Job Responsibility
  • Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
  • Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
  • Design, implement, and maintain feature stores for ML model training and inference pipelines
  • Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
  • Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
  • Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
  • Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
  • Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
  • Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
  • Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right
New

Receipt And Distribution Operative

We are seeking an organized and driven Receipt & Distribution Operative to join ...
Location
Location
United Kingdom , Canterbury
Salary
Salary:
13.45 GBP / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
July 13, 2026
Flip Icon
Requirements
Requirements
  • A proactive individual with great organizational skills and the ability to manage workloads effectively on your own initiative
  • Excellent verbal and written communication skills with a strong, customer-focused mindset
  • Strong IT proficiency, with the ability to quickly learn and navigate new purchasing, finance, and electronic demand systems
  • Physical capability to safely undertake manual handling, as the role involves moving heavy loads and roll cages around a busy hospital environment
  • A good basic standard of education, including Maths & English to GCSE Level (or equivalent)
  • Previous experience in store keeping, supply chain, or hospital logistics is highly desirable but not essential
Job Responsibility
Job Responsibility
  • Receive & Process: You will efficiently check, receipt, and distribute incoming medical goods and equipment, ensuring timely delivery directly to wards and departments
  • Stock Management: Assist with reordering and putting away stock, utilizing Electronic Demand Capture (EDC) systems to process requisitions and maintain highly accurate inventory levels
  • Logistics & Manual Handling: Safely operate equipment such as pallet trucks and roll cages for the movement of heavy loads. You will be responsible for prioritizing and delivering urgent and temperature-controlled items within strict time frames
  • Customer Support: Act as the first point of contact for clinical and support staff, dealing promptly with any queries and ensuring smooth day-to-day supply chain management
  • Quality & Compliance: Maintain accurate system records, including Goods Received Notes (GRN), process returns, and ensure strict compliance with all Health & Safety, COSHH, and Manual Handling regulations
What we offer
What we offer
  • Impactful Work: The opportunity to be the logistical lifeline that ensures our frontline clinical teams have the critical tools they need to save lives
  • Dynamic Environment: Join a supportive and fast-paced team where your work makes a visible, daily difference to the running of the hospital
  • Fulltime
!
Read More
Arrow Right

Semh Support Assistants

We are currently recruiting SEMH Support Assistants to work within specialist sc...
Location
Location
United Kingdom , Surrey
Salary
Salary:
92.50 - 130.00 GBP / Day
pinktile.co.uk Logo
Pink Tile Education Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Patient, calm and emotionally resilient individuals
  • Strong communicators who can build positive relationships
  • People passionate about supporting young people's wellbeing
  • A supportive, caring or mentoring mindset
  • Must have the right to work in the UK or hold a valid work visa
  • Provide suitable references for pre-employment checks
  • Hold an enhanced DBS on the Children's Workforce (or Children's & Adults') update service, or be willing to obtain one
Job Responsibility
Job Responsibility
  • Supporting pupils 1:1 and in small groups
  • Helping young people regulate emotions and manage behaviour positively
  • Encouraging engagement, confidence, and routine
  • Working closely with teachers and pastoral teams
  • Providing a calm, consistent and supportive presence in school
What we offer
What we offer
  • Pay includes 12.07% holiday pay
  • Fulltime
Read More
Arrow Right

Paraplanner

Brook Street (UK) Limited is delighted to be recruiting a Paraplanner for our Be...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
brookstreet.co.uk Logo
Brook-St Hiredonline
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Must have worked within a Financial Advisor/ Wealth management practice for at least 3 years
  • Have level 4 qualification or be working towards it
  • Knowledge of investments, pensions and protection products
  • Achieved or working towards Diploma level Financial Services qualifications
Job Responsibility
Job Responsibility
  • Provide Administration support to the Financial Advisers
  • Organising client files for meetings, preparation of valuations and product research
  • Submission of new business applications, monitoring through to completion
  • Ability to process Pension transfers and replacement business
  • Accurate inputting onto systems. Maintaining and ensuring completeness of client files for compliance purposes
  • Prepare draft suitability reports for clients
  • Liaising with clients and professional bodies
  • Managing/updating business pipeline and all client files
  • Organising appointment diary and advisor meetings
  • General Administration duties
  • Fulltime
Read More
Arrow Right

National Account Manager

The UK's #1 tomato brand needs a National Account Manager. Top 4 grocery experie...
Location
Location
United Kingdom , London
Salary
Salary:
65000.00 GBP / Year
marvelfmcg.co.uk Logo
Marvel FMCG
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Top 4 grocery experience essential
  • You've sat across the table from a Top 4 buyer and held your own
  • Knows how grocery really works
  • Entrepreneurial
  • Commercially sharp
  • Doesn't need hand-holding
  • Top 4 experience is a must
Job Responsibility
Job Responsibility
  • Running Top 4 grocery accounts end to end — JBPs, range reviews, promotional planning, the lot
  • Hitting commercial targets without someone looking over your shoulder every five minutes
  • Spotting opportunities in the market before someone else does and making a compelling case for them
  • Working with distributors and a small, sharp internal team to get things executed properly
  • Getting under the skin of your customers and building relationships that open doors, not just orders
  • Fulltime
Read More
Arrow Right

Echo Technologist

MedPro Healthcare Staffing, a Joint Commission-certified staffing agency, is see...
Location
Location
United States , Miami
Salary
Salary:
Not provided
medprostaffing.com Logo
MedPro Healthcare Staffing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Successful completion of an accredited training course in cardiac technology
  • Successful completion of an accredited training course in cardiac ultrasound
  • Interpretation skills to facilitate a comprehensive examination and an accurate preliminary interpretation
  • Successful completion of a cardiac echocardiography technology program (graduate of cardiac echocardiography technology program)
Job Responsibility
Job Responsibility
  • Under the direction of the supervising physicians in the Non-Invasive Cardiology Lab, prepares patient for examination, performs all 2-dimensional echoes, M-mode and Doppler studies
  • Prepare preliminary interpretation of those studies
  • Prepare and maintain records patient to echo studies
  • Assist supervising physicians with the training of residents, fellows, faculty and other physicians
  • Knowledge of multiple echocardiography platforms and technology
  • Ability to read, interprets, apply, and or follow physicians orders, policies, procedures, or written and verbal instructions
What we offer
What we offer
  • Weekly pay and direct deposit
  • Full coverage of all credentialing fees
  • Private housing or housing allowance
  • Group Health insurance for you and your family
  • Company-paid life and disability insurance
  • Travel reimbursement
  • 401(k) matching
  • Unlimited Referral Bonuses up to $1,000
  • Fulltime
Read More
Arrow Right

Clinical Product Expert

TULSA-PRO clinical product experts support the widespread adoption and utilizati...
Location
Location
United States , Houston
Salary
Salary:
Not provided
profoundmedical.com Logo
Profound Medical
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree or higher in physics/engineering, experience in interventional procedures, or advanced credential (RRA), is an asset
  • Certification and experience as an MRI technologist
  • Experience and expertise in MRI, preferably including hands-on scanning in a clinical environment (for example as an MRI technologist)
  • Technical experience with medical devices in a clinical, research, or industry environment, preferably involving in-bore interventions or therapeutic ultrasound
  • Familiarity with clinical, scientific, and technical advances in the field of MR-guided therapeutic procedures
  • Excellent teacher and communicator of complex technical and medical information in oral, written, and visual formats
  • Team player with a strong work ethic, has the self-motivation and focus to organize and prioritize activities, builds credibility by holding themselves to the highest standards of honesty and personal integrity
  • Ability to build rapport quickly, as well as to establish trust and maintain effective relationships with a wide variety of external and internal stakeholders
  • Has the energy and resilience to be an agent of change by disseminating information and changing the standard of care in men's health
  • Must have a valid passport and be willing to travel 100% of the time, including nights and weekends, sometimes with short notice
Job Responsibility
Job Responsibility
  • Guide physicians and staff during TULSA procedures at hospitals and imaging centers in their region based on best practices from expert sites and from the latest clinical literature
  • Troubleshooting first-of-a-kind situations in the field, which requires in-depth understanding of the technology and its application to urology, as well as the humility and confidence to work collaboratively and effectively under pressure
  • Assist physicians with TULSA-PRO patient selection and pre-treatment planning
  • Perform detailed post-treatment case reviews, including analyses of treatment workflow and patient outcomes for the sites they support, identifying rate-limiting steps and areas for improvement to coach physicians and their teams towards more efficient procedures and optimal patient outcomes across a wide variety of prostate disease states
  • Partner with our engineering teams to provide feedback and field testing of new hardware and software features
  • Partner with our sales and marketing teams to educate potential new customers, contribute to patient and physician education events, recommend solutions to streamline the initiation of new sites, and identify areas where we can help existing customers offer TULSA to more patients
  • Serve as the voice of customer in identifying and prioritizing the most impactful areas of improving the technology by developing close relationships with physicians that use TULSA-PRO, and by leveraging their own experience in related disciplines
  • Fulltime
Read More
Arrow Right

MRI Technologist

MedPro Healthcare Staffing, a Joint Commission-certified staffing agency, is see...
Location
Location
United States of America , Bradenton
Salary
Salary:
Not provided
medprostaffing.com Logo
MedPro Healthcare Staffing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Completion of a two year approved School of Radiologic Technology
  • Valid state radiology registration as required by state law
  • Eighteen months of MRI Tech experience preferred, ideally in a critical care setting.
  • Registry by the American Registry of Radiologic Technology.
Job Responsibility
Job Responsibility
  • MRI technologists utilize their knowledge of anatomy, physiology and the principles of MRI to safely and efficiently operate MRI scanners, assisting in the diagnosis of disease and injury.
  • Ensure the safety of patients, staff and visitors who come in contact with the powerful magnetic field of a MRI scanner.
  • Position patients and coils on a table that slides inside the MRI scanner.
  • Inject contrast media as required.
  • Set appropriate technical parameters, operate MRI scanners and related equipment, and observe image data on computer monitors during scans.
  • Be familiar with the differences from a normal image and an abnormal image.
  • Recognize and respond to life threatening situations.
  • Assure compliance with federal, state, and local technical and professional regulations and accepted practiced guidelines.
  • Delivers quality, cost effective patient care in a professional manner.
  • Works effectively to maintain an environment of excellence, which is patient focused, providing timely, compassionate, quality patient care.
What we offer
What we offer
  • Weekly pay and direct deposit
  • Full coverage of all credentialing fees
  • Private housing or housing allowance
  • Group Health insurance for you and your family
  • Company-paid life and disability insurance
  • Travel reimbursement
  • 401(k) matching
  • Unlimited Referral Bonuses up to $1,000
  • Fulltime
Read More
Arrow Right