CrawlJobs Logo

Staff Software Engineer - AI/ML Infra

United States, Palo Alto 90000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Platform Engineer to build and scale our machine learning infrastructure with a focus on Large Language Models (LLMs) and AI applications. This role combines deep technical expertise in cloud platforms, container orchestration, and ML operations with strong leadership and mentoring capabilities. You will be responsible for designing, implementing, and maintaining scalable, reliable systems that enable our data science and engineering teams to deploy and operate LLMs efficiently at scale. The candidate must have excellent verbal and written communication skills with a proven ability to work independently and in a team environment.

Job Responsibility

  • Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
  • Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
  • Design, implement, and maintain feature stores for ML model training and inference pipelines
  • Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
  • Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
  • Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
  • Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
  • Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
  • Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
  • Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases
  • Design and maintain robust CI/CD pipelines for ML model deployment using Azure DevOps, GitHub Actions, and MLOps tools
  • Implement automated model training, validation, deployment, and monitoring workflows
  • Set up comprehensive observability using Prometheus, Grafana, Azure Monitor, and custom dashboards
  • Continuously optimize platform performance, reducing latency and improving throughput for ML workloads
  • Design and implement backup, recovery, and business continuity plans for ML platforms
  • Mentor junior engineers and data scientists on platform best practices, infrastructure design, and ML operations
  • Lead comprehensive code reviews focusing on scalability, reliability, security, and maintainability
  • Design and deliver technical onboarding programs for new team members joining the ML platform team
  • Establish and champion engineering standards for ML infrastructure, deployment practices, and operational procedures
  • Create technical documentation, runbooks, and deliver internal training sessions on platform capabilities
  • Work closely with data scientists to understand requirements and optimize workflows for model development and deployment
  • Collaborate with product engineering teams to integrate ML capabilities into customer-facing applications
  • Support research teams with infrastructure for experimenting with cutting-edge LLM techniques and architectures
  • Present technical solutions and platform roadmaps to leadership and cross-functional stakeholders

Requirements

  • Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
  • 8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
  • 3+ years of hands-on experience with machine learning infrastructure and deployment at scale
  • 2+ years of experience working with Large Language Models and transformer architectures
  • Proficient in Python
  • strong skills in Go, Rust, or Java preferred
  • Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
  • Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
  • Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
  • Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)
  • Hands-on experience with inference optimization using vLLM, TensorRT-LLM, Triton Inference Server, or similar
  • Advanced experience with Azure DevOps, GitHub Actions, Jenkins, or similar CI/CD platforms
  • Proficiency with Terraform, ARM templates, Pulumi, or CloudFormation
  • Deep understanding of Docker, container optimization, and multi-stage builds
  • Experience with Prometheus, Grafana, ELK stack, Azure Monitor, and distributed tracing
  • Knowledge of both SQL and NoSQL databases, data warehousing, and vector databases
  • Demonstrated track record of mentoring engineers and leading technical initiatives
  • Experience leading design reviews with focus on compliance, performance, and reliability
  • Excellent ability to explain complex technical concepts to diverse audiences
  • Strong analytical and troubleshooting skills for complex distributed systems
  • Experience managing cross-functional technical projects and coordinating with multiple stakeholders

Nice to have

  • Master’s degree in computer science, Machine Learning, or related field
  • 8+ years of platform engineering or infrastructure experience
  • Experience with Staff Engineer or Tech Lead roles in ML/AI organizations
  • Background in distributed systems and high-performance computing
  • Open-source contributions to ML infrastructure projects or LLM frameworks
  • Multi-Cloud Experience: Hands-on experience with Azure, AWS (SageMaker, EKS) and/or GCP (Vertex AI, GKE)
  • Experience with specialized hardware (A100s, H100s, TPUs, TEEs) and optimization
  • RLHF & Fine-tuning: Experience with Reinforcement Learning from Human Feedback and LLM fine-tuning workflows
  • Experience with Milvus, Pinecone, Weaviate, Qdrant, or similar vector storage solutions
  • Deep experience with MLflow, Kubeflow, DataRobot, or similar platforms
  • Understanding of AI safety principles, model governance, and regulatory compliance
  • Background in regulated industries with understanding of data privacy requirements
  • Experience supporting ML research teams and academic partnerships
  • Deep understanding of GPU optimization, memory management, and high-throughput systems

What we offer

  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Staff Software Engineer - AI/ML Infra

8 matching positions

Staff Software Engineer - AI/ML Infra

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Pl...
Location
Location
United States , Chevy Chase; New York City; Palo Alto
Salary
Salary:
115000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
  • 8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
  • 3+ years of hands-on experience with machine learning infrastructure and deployment at scale
  • 2+ years of experience working with Large Language Models and transformer architectures
  • Proficient in Python
  • strong skills in Go, Rust, or Java preferred
  • Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
  • Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
  • Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
  • Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)
Job Responsibility
Job Responsibility
  • Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
  • Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
  • Design, implement, and maintain feature stores for ML model training and inference pipelines
  • Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
  • Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
  • Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
  • Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
  • Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
  • Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
  • Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right

Risk Management Intern

The Risk Management Intern supports the organization’s risk and quality initiati...
Location
Location
United States , Louisville
Salary
Salary:
Not provided
atriaseniorliving.com Logo
Atria Senior Living
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently enrolled in a four-year university or college preferred
  • If currently enrolled in school, must maintain a 3.0 cumulative GPA (4.0 scale)
  • Must successfully complete all Atria specified training programs
  • Proficient in basic Microsoft applications such as Word, Excel, and Outlook
  • Experience demonstrating teamwork and critical thinking skills to accomplish tasks
  • Strong customer service, detail orientation, multi-tasking, organizational and follow-up skills
  • Strong communication skills, both written and verbal
Job Responsibility
Job Responsibility
  • Prepare and distribute daily workers’ compensation claim reports to the Risk Department accurately and in a timely manner
  • Track, monitor, and provide updates on items related to Risk Management and Quality Enhancement initiatives
  • Process check requests and ensure invoices are submitted accurately and within established timelines
  • Report property damage incidents to the ownership group promptly and with appropriate documentation
  • Compile and distribute monthly reports to community leadership
  • Support and complete special projects as assigned
  • Complete state-specific forms related to workers compensation claims
  • May perform other duties as needed and/or assigned
What we offer
What we offer
  • Competitive Pay
  • Paid Holidays & PTO
  • Comprehensive Health Plans
  • Career Advancement Opportunities
  • Tuition Reimbursement
  • Employee Loyalty Rewards Program
  • Retirement Savings Plan with Employer Match
  • Rewards & Recognition
  • Health & Safety
  • Parttime
Read More
Arrow Right

Long Haul Dispatcher

Transport Bourassa, a fast-growing company, is looking for a Long-Haul Dispatche...
Location
Location
Canada , Saint-Jean-sur-Richelieu
Salary
Salary:
Not provided
bourassa.ca Logo
TRANSPORT BOURASSA INC.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bilingual (spoken and written) for communication with clients
  • Ability to manage multiple priorities in a dynamic environment
  • Strong judgment and quick decision-making skills
  • Experience in a similar role (an asset)
  • Proficiency with transportation management tools (TMS, GPS, etc.)
  • Strong team spirit and solution-oriented mindset
Job Responsibility
Job Responsibility
  • Coordinate long-haul truck movements efficiently and accurately
  • Optimize loads, timelines, and overall transportation productivity
  • Monitor delivery and pickup statuses to meet client agreements and deadlines
  • Work closely with operations and logistics teams
  • Maintain constant communication with drivers and clients
  • Ensure high service levels and compliance with federal transportation regulations
  • Perform any other related tasks as assigned
What we offer
What we offer
  • Group and dental insurance (50% of premiums paid by the employer)
  • Subsidized daycare reserved for employees, located on-site
  • 3 weeks of vacation after 2 years
  • Employer contributions to a retirement savings plan (RRSP)
  • On-site gym accessible 24/7
  • Various rewards throughout the year (Christmas gifts, team lunches, etc.)
  • A Christmas party you won’t want to miss!
  • Fulltime
Read More
Arrow Right

Sous Chef

In the role of Sous Chef and member of the Dining Services team, you will be res...
Location
Location
United States , Derry
Salary
Salary:
24.00 - 28.80 USD / Hour
atriaseniorliving.com Logo
Atria Senior Living
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High school diploma or equivalent
  • Minimum 2 years' experience in industry or full-service restaurant cooking
  • Effective communication in English and excellent customer service skills
  • Experience mentoring and directing others
  • Ability to prepare and follow recipes
  • General knowledge of and ability to conform to sanitation and safe food handling practices
  • Basic Computer skills
Job Responsibility
Job Responsibility
  • Prepare nutritious, appetizing, and attractive meals for residents and ensure a smooth, efficient and safe operation of the kitchen
  • Review menus and food-production instructions and prepare meals following Holiday menus and recipes while ensuring portion-control standards
  • Oversee preparation and set-up of service to serve nutritious food, attractively garnished in a punctual manner
  • Follow food safe handling procedures in preparation as well as proper procedures for covering, labeling, dating, and storing food
  • Accurately complete logs in a timely manner i.e., refrigerator, freezer and production sheets
  • Follow Holiday sanitation standards by effectively cleaning while working, including preparation and serving areas, pots and pans, kitchen surfaces, walls, and floors, using appropriate cleaning schedules and charts
  • In absence of the Executive Chef, oversee the food service staff and overall kitchen operations
  • Focus on resident satisfaction and resolve any food-compliant issues as needed
  • Perform administrative duties including menu planning, ordering, receiving, invoice processing, inventory, end-of-month report, staffing and payroll if needed
  • Other duties as assigned
What we offer
What we offer
  • Competitive Pay
  • Paid Holidays & PTO
  • Comprehensive Health Plans
  • Career Advancement Opportunities
  • Tuition Reimbursement
  • Employee Loyalty Rewards Program
  • Retirement Savings Plan with Employer Match
  • Rewards & Recognition
  • Health & Safety
  • Fulltime
Read More
Arrow Right

Class 1 Driver

Available positions in local, Ontario, and the United States. Based out of our t...
Location
Location
Canada , Saint-Jean-sur-Richelieu
Salary
Salary:
Not provided
bourassa.ca Logo
TRANSPORT BOURASSA INC.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Valid Class 1 driver's license
  • Good knowledge of the territory
  • Good physical endurance
  • Autonomy and strong organizational skills
  • Professional and safety-oriented attitude
Job Responsibility
Job Responsibility
  • Perform deliveries and pickups
  • Secure and properly fasten loads
  • Assist with loading and unloading when required
  • Conduct vehicle inspections and report any issues
  • Use a mobile device
  • Provide professional customer service
  • Perform trailer switches or movements (depending on the position)
  • Carry out any other related tasks as needed
What we offer
What we offer
  • Competitive salary
  • Group and dental insurance (50% paid by employer)
  • Employer-matched RRSP
  • 10 sick days
  • 3 paid personal days
  • 3 weeks of vacation after 2 years
  • Uniform provided
  • Modern, well-maintained trucks washed every two weeks
  • Garage and dispatch open 24/7
  • Gym and daycare (located at 800 Dijon Street, Saint-Jean-sur-Richelieu)
Read More
Arrow Right

Waitstaff

Location
Location
United States , Missoula
Salary
Salary:
11.00 - 13.20 USD / Hour
atriaseniorliving.com Logo
Atria Senior Living
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Basic reading, writing, and math skills
  • Effective verbal and written English skills
  • General knowledge of sanitation and safe food handling practices
  • No experience needed
Job Responsibility
Job Responsibility
  • Set and clear tables, take residents’ dining orders, and provide the highest level of customer service
  • Review menus with residents and acquaint new residents with dining at Atria
  • Assist with the preparation, delivery, and cleanup of daily meals, banquets, and special events
  • Create a strong sense of teamwork with your colleagues and positive relationships with residents
  • Clean and sanitize carpet, tables, chairs, condiment containers, and equipment used in the dining room
What we offer
What we offer
  • Competitive Pay
  • Paid Holidays & PTO
  • Comprehensive Health Plans
  • Career Advancement Opportunities
  • Tuition Reimbursement
  • Employee Loyalty Rewards Program
  • Retirement Savings Plan with Employer Match
  • Rewards & Recognition
  • Health & Safety
  • Parttime
Read More
Arrow Right

Sr. Data Entry Clerk

We are looking for a detail-oriented Sr. Data Entry Clerk to support a Contract ...
Location
Location
United States , Phoenix
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Demonstrated experience in data entry or computer-based record management in a high-volume environment
  • Strong proficiency with Microsoft Excel and the ability to manage, sort, and review structured datasets
  • Experience performing data validation and identifying inconsistencies or missing information
  • Ability to conduct basic market research and interpret findings from collected data
  • Excellent attention to detail and a consistent approach to maintaining data accuracy
  • Strong organizational skills with the ability to manage multiple tasks and deadlines effectively
  • Clear written communication skills for coordinating with contributors and resolving data issues.
Job Responsibility
Job Responsibility
  • Build and maintain accurate records within a shared database environment designed for collaboration across multiple users
  • Create and manage data collection forms that allow external contributors to submit information without needing direct database access
  • Review incoming submissions from forms and separate or flag those entries for follow-up validation and quality checks
  • Enter, update, and verify large volumes of information with a high degree of accuracy and consistency
  • Analyze collected data to help identify organizations that provide lower-cost veterinary care within their surrounding markets
  • Support research efforts by comparing pricing and geographic coverage patterns to establish meaningful affordability benchmarks
  • Use Excel and related data tools to organize findings, track progress, and prepare clean datasets for review
  • Work with internal stakeholders and external partners to clarify incomplete entries and resolve discrepancies in submitted information
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Waitstaff

Location
Location
United States , Palmdale
Salary
Salary:
17.27 - 20.72 USD / Hour
atriaseniorliving.com Logo
Atria Senior Living
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Basic reading, writing, and math skills
  • Effective verbal and written English skills
  • General knowledge of sanitation and safe food handling practices
  • No experience needed
Job Responsibility
Job Responsibility
  • Set and clear tables, take residents’ dining orders, and provide the highest level of customer service
  • Review menus with residents and acquaint new residents with dining at Atria
  • Assist with the preparation, delivery, and cleanup of daily meals, banquets, and special events
  • Create a strong sense of teamwork with your colleagues and positive relationships with residents
  • Clean and sanitize carpet, tables, chairs, condiment containers, and equipment used in the dining room
What we offer
What we offer
  • Competitive Pay
  • Paid Holidays & PTO
  • Comprehensive Health Plans
  • Career Advancement Opportunities
  • Tuition Reimbursement
  • Employee Loyalty Rewards Program
  • Retirement Savings Plan with Employer Match
  • Rewards & Recognition
  • Health & Safety
  • Parttime
Read More
Arrow Right