CrawlJobs Logo

Staff Software Engineer - AI/ML Infra

geico.com Logo

Geico

Location Icon

Location:
United States , Palo Alto

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

90000.00 - 300000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Platform Engineer to build and scale our machine learning infrastructure with a focus on Large Language Models (LLMs) and AI applications. This role combines deep technical expertise in cloud platforms, container orchestration, and ML operations with strong leadership and mentoring capabilities. You will be responsible for designing, implementing, and maintaining scalable, reliable systems that enable our data science and engineering teams to deploy and operate LLMs efficiently at scale. The candidate must have excellent verbal and written communication skills with a proven ability to work independently and in a team environment.

Job Responsibility:

  • Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
  • Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
  • Design, implement, and maintain feature stores for ML model training and inference pipelines
  • Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
  • Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
  • Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
  • Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
  • Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
  • Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
  • Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases
  • Design and maintain robust CI/CD pipelines for ML model deployment using Azure DevOps, GitHub Actions, and MLOps tools
  • Implement automated model training, validation, deployment, and monitoring workflows
  • Set up comprehensive observability using Prometheus, Grafana, Azure Monitor, and custom dashboards
  • Continuously optimize platform performance, reducing latency and improving throughput for ML workloads
  • Design and implement backup, recovery, and business continuity plans for ML platforms
  • Mentor junior engineers and data scientists on platform best practices, infrastructure design, and ML operations
  • Lead comprehensive code reviews focusing on scalability, reliability, security, and maintainability
  • Design and deliver technical onboarding programs for new team members joining the ML platform team
  • Establish and champion engineering standards for ML infrastructure, deployment practices, and operational procedures
  • Create technical documentation, runbooks, and deliver internal training sessions on platform capabilities
  • Work closely with data scientists to understand requirements and optimize workflows for model development and deployment
  • Collaborate with product engineering teams to integrate ML capabilities into customer-facing applications
  • Support research teams with infrastructure for experimenting with cutting-edge LLM techniques and architectures
  • Present technical solutions and platform roadmaps to leadership and cross-functional stakeholders

Requirements:

  • Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
  • 8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
  • 3+ years of hands-on experience with machine learning infrastructure and deployment at scale
  • 2+ years of experience working with Large Language Models and transformer architectures
  • Proficient in Python
  • strong skills in Go, Rust, or Java preferred
  • Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
  • Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
  • Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
  • Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)
  • Hands-on experience with inference optimization using vLLM, TensorRT-LLM, Triton Inference Server, or similar
  • Advanced experience with Azure DevOps, GitHub Actions, Jenkins, or similar CI/CD platforms
  • Proficiency with Terraform, ARM templates, Pulumi, or CloudFormation
  • Deep understanding of Docker, container optimization, and multi-stage builds
  • Experience with Prometheus, Grafana, ELK stack, Azure Monitor, and distributed tracing
  • Knowledge of both SQL and NoSQL databases, data warehousing, and vector databases
  • Demonstrated track record of mentoring engineers and leading technical initiatives
  • Experience leading design reviews with focus on compliance, performance, and reliability
  • Excellent ability to explain complex technical concepts to diverse audiences
  • Strong analytical and troubleshooting skills for complex distributed systems
  • Experience managing cross-functional technical projects and coordinating with multiple stakeholders

Nice to have:

  • Master’s degree in computer science, Machine Learning, or related field
  • 8+ years of platform engineering or infrastructure experience
  • Experience with Staff Engineer or Tech Lead roles in ML/AI organizations
  • Background in distributed systems and high-performance computing
  • Open-source contributions to ML infrastructure projects or LLM frameworks
  • Multi-Cloud Experience: Hands-on experience with Azure, AWS (SageMaker, EKS) and/or GCP (Vertex AI, GKE)
  • Experience with specialized hardware (A100s, H100s, TPUs, TEEs) and optimization
  • RLHF & Fine-tuning: Experience with Reinforcement Learning from Human Feedback and LLM fine-tuning workflows
  • Experience with Milvus, Pinecone, Weaviate, Qdrant, or similar vector storage solutions
  • Deep experience with MLflow, Kubeflow, DataRobot, or similar platforms
  • Understanding of AI safety principles, model governance, and regulatory compliance
  • Background in regulated industries with understanding of data privacy requirements
  • Experience supporting ML research teams and academic partnerships
  • Deep understanding of GPU optimization, memory management, and high-throughput systems
What we offer:
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year

Additional Information:

Job Posted:
February 21, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Geico - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Staff Software Engineer - AI/ML Infra

Staff Software Engineer - AI/ML Infra

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Pl...
Location
Location
United States , Chevy Chase; New York City; Palo Alto
Salary
Salary:
115000.00 - 300000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
  • 8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
  • 3+ years of hands-on experience with machine learning infrastructure and deployment at scale
  • 2+ years of experience working with Large Language Models and transformer architectures
  • Proficient in Python
  • strong skills in Go, Rust, or Java preferred
  • Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
  • Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
  • Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
  • Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)
Job Responsibility
Job Responsibility
  • Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
  • Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
  • Design, implement, and maintain feature stores for ML model training and inference pipelines
  • Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
  • Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
  • Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
  • Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
  • Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
  • Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
  • Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right

Head Housekeeper

At Avery Healthcare, we are all about supporting the people who care for our res...
Location
Location
United Kingdom , Burley in Wharfedale
Salary
Salary:
14.00 GBP / Hour
averyhealthcare.co.uk Logo
Avery Healthcare Group Ltd.
Expiration Date
April 20, 2026
Flip Icon
Requirements
Requirements
  • Experience in cleaning and managing laundry in a public setting
  • Knowledge of health and safety, particularly moving and handling techniques, fire safety, and COSHH assessments
  • Demonstrate compassion and commitment to the delivery of high-quality housekeeping/laundry service to residents
  • Demonstrate the ability to lead, supervise and develop teams
Job Responsibility
Job Responsibility
  • Oversee the housekeeping and laundry cleaning service in support of the hospitality services function to ensure a high-quality and comprehensive care service is delivered to residents
  • Carrying out all cleaning duties as per the housekeeping job description
  • Preparing orders for Home Manager approval for all cleaning materials with approved suppliers whilst complying with procedures to maintain appropriate stock levels and control and ensuring good quality products are purchased within agreed budget limits
  • Monitoring standards of work of the housekeeping and laundry team to always maintain high cleanliness standards
  • Supervising and directing the work of the housekeeping team, providing instruction and demonstration to new staff on cleaning tasks and materials
  • Fulltime
Read More
Arrow Right

District Support Pharmacist

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Hartville
Salary
Salary:
60.00 - 76.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
May 22, 2026
Flip Icon
Requirements
Requirements
  • Active Pharmacist License in the state where the Store is located
  • Active National Provider Identifier (NPI)
  • Not on the DEA Excluded Parties list
  • Ability to travel within a reasonable radius to support market staffing as business needs require
  • Regular and predictable attendance, including nights and weekends
  • Ability to complete required training within designated timeframe
  • Attention and Focus: Ability to concentrate on a task over a period of time
  • Ability to pivot quickly from one task to another to meet patient and business needs
  • Ability to confirm prescription information and label accuracy, ensuring patient safety
  • Customer Service and Team Orientation: Actively look for ways to help people, and do so in a friendly manner
Job Responsibility
Job Responsibility
  • Traveling the district to fill pharmacist shifts as scheduled by the District Performance Coordinator (DPC)
  • overseeing the pharmacy and serving as the Pharmacy Manager’s proxy during bench shifts without overlap
  • Supporting safe and accurate prescription fulfillment by following—and directing the pharmacy team to follow—pharmacy workflow procedures and utilizing the safety guardrails at every workstation
  • Assumes Pharmacy Manager’s day-to-day duties when serving as the only or the primary pharmacist-on-duty
  • Contributing to positive patient experiences by showing empathy and genuine care and coaching the pharmacy team to do the same: demonstrating compassionate care, collaborating with the patient’s total healthcare team, and proactively resolving insurance and/or medication issues
  • Proactively offering and delivering immunizations to keep patients healthy
  • engaging and supporting Pharmacy Technicians to learn to immunize
  • Supporting the effective management of pharmacy inventory in all pharmacies worked by following—and guiding the pharmacy team to follow—all inventory best practices, with a special focus on protecting cold chain products for our patients and our business
  • Remaining flexible for both scheduling and business needs, while contributing to a safe, inclusive, and engaging team dynamic
  • Maintaining relevant clinical and technical skills for the job as the industry evolves (including but not limited to company-required trainings and CMEs)
What we offer
What we offer
  • Affordable medical plan options
  • a 401(k) plan (including matching company contributions)
  • an employee stock purchase plan
  • No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
  • Benefit solutions that address the different needs and preferences of our colleagues including paid time off, flexible work schedules, family leave, dependent care resources, colleague assistance programs, tuition assistance, retiree medical access and many other benefits depending on eligibility
  • Fulltime
Read More
Arrow Right

Medical Biller

We are seeking a detail-oriented and motivated professional to join our team as ...
Location
Location
United States , Eugene
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with medical billing systems and workflows
  • Familiarity with basic medical coding and terminology is beneficial
  • Excellent organizational skills and keen attention to detail
  • Strong written and verbal communication abilities
Job Responsibility
Job Responsibility
  • Accurately process medical billing and claims submissions
  • Monitor and follow up on outstanding payments or claims
  • Assist in resolving billing discrepancies and issues
  • Maintain well-organized records and documentation
  • Work collaboratively with internal teams to ensure adherence to procedures and compliance standards
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
Read More
Arrow Right

Wellbeing and Activities Assistant

At Avery Healthcare, we are all about supporting the people who care for our res...
Location
Location
United Kingdom , York
Salary
Salary:
12.22 GBP / Hour
averyhealthcare.co.uk Logo
Avery Healthcare Group Ltd.
Expiration Date
April 18, 2026
Flip Icon
Requirements
Requirements
  • Have effective communication skills, verbal and written
  • Demonstrate understanding of the role interaction plays in the general well-being of people
  • Have a positive attitude toward older people and a commitment to providing stimulating, quality activities and social events
  • Have previously worked with older people in a residential nursing Dementia setting
  • A DBS Disclosure check
  • Proof of eligibility to work in the UK
Job Responsibility
Job Responsibility
  • Support the Wellbeing Coordinator in providing a wide range of activities to engage and stimulate the resident's physical, cognitive, and social well-being
  • Maintaining a safe living and working environment, contributing to the positive and professional image of the home
  • Reporting any changes in residents’ physical or emotional condition to the Wellbeing and Activity Coordinator, Home Manager, and the care staff
  • Supporting with ordering and preparing supplies for upcoming activities as directed
  • Supporting establishing links with the local community (e.g., schools, spiritual groups, museums/libraries) to encourage access to the wider community and promote intergenerational activity
  • Fulltime
Read More
Arrow Right

HR Generalist

We are looking for a dedicated HR Generalist to join a reputable financial insti...
Location
Location
United States , Westbrook
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Associate's or Bachelor's degree in Human Resources, Business Administration, or a related field
  • Minimum of 3 years of experience in human resources roles, including payroll and recruiting
  • Proficiency in using ADP or similar payroll systems
  • Strong knowledge of employment laws and HR compliance requirements
  • Experience managing employee benefits programs and resolving related issues
  • Excellent organizational and communication skills
  • Ability to work onsite for the first six months, with potential for a hybrid schedule afterward
  • Reside within a commutable distance to Westbrook, Maine
Job Responsibility
Job Responsibility
  • Manage payroll processing efficiently, ensuring accuracy and compliance with organizational policies
  • Coordinate recruitment efforts, including sourcing, screening, and interviewing candidates to meet staffing needs
  • Facilitate employee onboarding and maintain accurate employee records for seamless integration into the company
  • Administer employee benefits programs, including health, dental, vision, and retirement plans, while addressing inquiries
  • Ensure compliance with employment laws and regulations by conducting training sessions and maintaining updated policies
  • Provide support in employee relations matters, fostering a positive and productive work environment
  • Collaborate with leadership to address HR-related initiatives and develop strategies for workforce development
  • Maintain HR systems and databases, ensuring data integrity and accessibility
  • Offer guidance and support to employees regarding HR policies and procedures
  • Participate in efforts to enhance the hybrid work model after the initial onsite period
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Staff Accountant

Robert Half has partnered with a well-respected locally owned company in Auburn ...
Location
Location
United States , Auburn
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Accounting, Finance, Business or similar
  • 3+ years full-cycle General Ledger accounting experience
  • Reconciliations
  • Month-End close
  • Financial Statements
  • Advanced Excel
  • Eager to learn industry and grow to Controller in 7 years
What we offer
What we offer
  • Health
  • Dental
  • Vision
  • 401k with match
  • paid vacation
  • holidays
  • employee discount
  • Fulltime
Read More
Arrow Right

Account Manager

You will join our client as an Account Manager for North America, working in the...
Location
Location
United States
Salary
Salary:
Not provided
vankaizen.com Logo
Van Kaizen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Highly organized, detail-oriented, and persuasive
  • Proven track record of developing and implementing efficient processes
  • Experience managing operator accounts in the Interactive casino field
  • Proven ability to achieve financial targets and grow wallet share
  • Strong leadership, management, and presentation skills
  • Contract negotiation experience and excellent communication
  • Proficient in Microsoft Office and data analysis tools
  • Able to operate effectively at multiple organizational levels
  • Bachelor’s degree in business, marketing, finance, or related field is advantageous
Job Responsibility
Job Responsibility
  • Build strong relationships with customers and internal teams to drive revenue
  • Travel regularly to meet US customers and attend industry events
  • Develop and execute account plans to achieve and exceed revenue targets
  • Conduct regular business reviews to drive actions and growth
  • Onboard new operators with the right game packages, positioning, and promotions
  • Use data and KPIs to identify growth opportunities and inform strategy
  • Negotiate contracts, renewals, and extensions with operators
  • Represent the company at events and build a strong market presence
What we offer
What we offer
  • Be part of a team that values excellence with a dash of fun and offers opportunities to grow, travel, and learn within a supportive environment
Read More
Arrow Right
Remote jobs Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog Salaries About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy