CrawlJobs Logo

Staff Software Engineer - AI/ML Infra

geico.com Logo

Geico

Location Icon

Location:
United States , Chevy Chase

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

115000.00 USD / Year

Job Description:

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Platform Engineer to build and scale our machine learning infrastructure with a focus on Large Language Models (LLMs) and AI applications. This role combines deep technical expertise in cloud platforms, container orchestration, and ML operations with strong leadership and mentoring capabilities. You will be responsible for designing, implementing, and maintaining scalable, reliable systems that enable our data science and engineering teams to deploy and operate LLMs efficiently at scale. The candidate must have excellent verbal and written communication skills with a proven ability to work independently and in a team environment.

Job Responsibility:

  • Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
  • Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
  • Design, implement, and maintain feature stores for ML model training and inference pipelines
  • Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
  • Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
  • Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
  • Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
  • Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
  • Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
  • Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases
  • Design and maintain robust CI/CD pipelines for ML model deployment using Azure DevOps, GitHub Actions, and MLOps tools
  • Implement automated model training, validation, deployment, and monitoring workflows
  • Set up comprehensive observability using Prometheus, Grafana, Azure Monitor, and custom dashboards
  • Continuously optimize platform performance, reducing latency and improving throughput for ML workloads
  • Design and implement backup, recovery, and business continuity plans for ML platforms
  • Mentor junior engineers and data scientists on platform best practices, infrastructure design, and ML operations
  • Lead comprehensive code reviews focusing on scalability, reliability, security, and maintainability
  • Design and deliver technical onboarding programs for new team members joining the ML platform team
  • Establish and champion engineering standards for ML infrastructure, deployment practices, and operational procedures
  • Create technical documentation, runbooks, and deliver internal training sessions on platform capabilities
  • Work closely with data scientists to understand requirements and optimize workflows for model development and deployment
  • Collaborate with product engineering teams to integrate ML capabilities into customer-facing applications
  • Support research teams with infrastructure for experimenting with cutting-edge LLM techniques and architectures
  • Present technical solutions and platform roadmaps to leadership and cross-functional stakeholders

Requirements:

  • Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
  • 8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
  • 3+ years of hands-on experience with machine learning infrastructure and deployment at scale
  • 2+ years of experience working with Large Language Models and transformer architectures
  • Proficient in Python
  • strong skills in Go, Rust, or Java preferred
  • Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
  • Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
  • Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
  • Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)
  • Hands-on experience with inference optimization using vLLM, TensorRT-LLM, Triton Inference Server, or similar
  • Advanced experience with Azure DevOps, GitHub Actions, Jenkins, or similar CI/CD platforms
  • Proficiency with Terraform, ARM templates, Pulumi, or CloudFormation
  • Deep understanding of Docker, container optimization, and multi-stage builds
  • Experience with Prometheus, Grafana, ELK stack, Azure Monitor, and distributed tracing
  • Knowledge of both SQL and NoSQL databases, data warehousing, and vector databases
  • Demonstrated track record of mentoring engineers and leading technical initiatives
  • Experience leading design reviews with focus on compliance, performance, and reliability
  • Excellent ability to explain complex technical concepts to diverse audiences
  • Strong analytical and troubleshooting skills for complex distributed systems
  • Experience managing cross-functional technical projects and coordinating with multiple stakeholders

Nice to have:

  • Master’s degree in computer science, Machine Learning, or related field
  • 8+ years of platform engineering or infrastructure experience
  • Experience with Staff Engineer or Tech Lead roles in ML/AI organizations
  • Background in distributed systems and high-performance computing
  • Open-source contributions to ML infrastructure projects or LLM frameworks
  • Multi-Cloud Experience: Hands-on experience with Azure, AWS (SageMaker, EKS) and/or GCP (Vertex AI, GKE)
  • Experience with specialized hardware (A100s, H100s, TPUs, TEEs) and optimization
  • RLHF & Fine-tuning: Experience with Reinforcement Learning from Human Feedback and LLM fine-tuning workflows
  • Experience with Milvus, Pinecone, Weaviate, Qdrant, or similar vector storage solutions
  • Deep experience with MLflow, Kubeflow, DataRobot, or similar platforms
  • Understanding of AI safety principles, model governance, and regulatory compliance
  • Background in regulated industries with understanding of data privacy requirements
  • Experience supporting ML research teams and academic partnerships
  • Deep understanding of GPU optimization, memory management, and high-throughput systems
What we offer:
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year

Additional Information:

Job Posted:
February 21, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:
PREMIUM
More languages and countries
+ Unlock 31695 hidden job offers
Languages
English Čeština Deutsch Ελληνικά Español Français +15
Countries
United States United Kingdom India Canada Australia +
See plans
Plans from $2.99 / month

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Staff Software Engineer - AI/ML Infra

Staff Software Engineer - AI/ML Infra

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Pl...
Location
Location
United States , Palo Alto
Salary
Salary:
90000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Engineering, or related technical field (or equivalent experience)
  • 8+ years of software engineering experience with focus on infrastructure, platform engineering, or MLOps
  • 3+ years of hands-on experience with machine learning infrastructure and deployment at scale
  • 2+ years of experience working with Large Language Models and transformer architectures
  • Proficient in Python
  • strong skills in Go, Rust, or Java preferred
  • Proven experience working with open source LLMs (Llama 2/3, Qwen, Mistral, Gemma, Code Llama, etc.)
  • Proficient in Kubernetes including custom operators, helm charts, and GPU scheduling
  • Deep expertise in Azure services (AKS, Azure ML, Container Registry, Storage, Networking)
  • Experience implementing and operating feature stores (Chronon, Feast, Tecton, Azure ML Feature Store, or custom solutions)
Job Responsibility
Job Responsibility
  • Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
  • Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
  • Design, implement, and maintain feature stores for ML model training and inference pipelines
  • Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
  • Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
  • Design and implement ML platforms using DataRobot, Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure Container Instances
  • Develop and maintain infrastructure using Terraform, ARM templates, and Azure DevOps
  • Implement cost-effective solutions for GPU compute, storage, and networking across Azure regions
  • Ensure ML platforms meet enterprise security standards and regulatory compliance requirements
  • Evaluate and potentially implement hybrid cloud solutions with AWS/GCP as backup or specialized use cases
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right
New

Contracts Manager - Traditional Accounts

In your role, you will report to the Director of Contracts, Traditional Accounts...
Location
Location
Canada , Dorval
Salary
Salary:
Not provided
bombardier.com Logo
Bombardier
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Law, or Commerce, Business Administration or equivalent
  • strong business acumen combined with at least five (5) years of contract drafting, negotiation and/or contract management experience
  • strong interpersonal and communication skills and can advocate with confidence and diplomacy
  • excellent analytical, organizational and time-management skills
  • take initiative, make sound decisions and are detail oriented
  • strong leadership and have the ability to work autonomously with minimal direction
  • thrive in a deadline-driven, results-oriented environment and have the flexibility to adapt to rapidly changing priorities
  • high level of proficiency in MS Word, Excel, and PowerPoint
  • bilingual in French and English
Job Responsibility
Job Responsibility
  • Support aircraft delivery objectives by providing ongoing commercial and/or legal support to internal and external customers
  • Support and manage aircraft purchase payment inflow objectives by overseeing the contractual payment schedule, invoicing customers in accordance therewith and ensuring appropriate follow-through to successful and timely receipt of funds
  • Drive business results by anticipating risks and, in concert with internal stakeholders, initiate creative and effective mitigation plans to protect aircraft delivery schedules as well as payment inflows
  • Lead negotiations and draft an array of contractual documents including amendments, assignments, escrow agreements, letter agreements and service agreements
  • Engage with management to raise unresolved contractual risks in a timely way
  • Liaise with internal stakeholders, including Deal Management, Sales, Legal Services, Finance, Tax, Risk Management, Program Management and Customer Account Management to ensure rigorous contract compliance and adherence to corporate policies, all while delivering an exceptional customer experience
  • Serve as key resource to the business and internal stakeholders on complex matters and critical issues related to the interpretation, analysis and execution of and under the aircraft purchase agreement
  • Initiate correspondence to customers in accordance with the purchase agreement and ensure appropriate follow-up
  • Participate in customer meetings as well as departmental and program reviews, as required
  • Contribute to process improvement and governance activities related to the functions of the department
What we offer
What we offer
  • Insurance plans (Dental, medical, life insurance, disability, and more)
  • Competitive base salary
  • Retirement savings plan
  • Employee Assistance Program
  • Tele Health Program
  • Fulltime
Read More
Arrow Right
New

Service Advisor II

We are looking for a Service Advisor to join our team. The ideal candidate will ...
Location
Location
United States , Port Richey
Salary
Salary:
22.00 USD / Hour
meineke.com Logo
Meineke
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High school diploma or GED required bachelor’s degree preferred
  • Valid state-issued driver’s license and clean driving record are required
  • Successful completion of a pre-employment drug and background screening
  • At least two years of experience as an automotive service writer or service advisor is required. Experience as an automotive service manager is preferred
  • Deep understanding of automotive technology, automotive service technician job duties, and automotive repair services is required
Job Responsibility
Job Responsibility
  • Manage a team of automotive service professionals to ensure a high level of employee morale and customer satisfaction while maintaining profitability
  • Ensure repairs and maintenance tasks are completed in a timely manner
  • Mentor employees on best practices for improving sales and customer service techniques
  • Oversee day-to-day operations of the service department
  • Manage the flow of service department paperwork, including manuals, invoices, repair orders, and maintenance records
  • Overseeing service advisors
  • Addressing customer inquiries
  • Managing required documentation
What we offer
What we offer
  • Bonus based on performance
  • Competitive salary
  • Dental insurance
  • Health insurance
  • Opportunity for advancement
  • Paid time off
  • Profit sharing
  • Training & development
  • Vision insurance
  • Career Advancement
  • Fulltime
Read More
Arrow Right
New

Software Engineer

We are looking for an experienced Software Engineer to join our team in Columbus...
Location
Location
United States , Columbus
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 7 years of software engineering experience within an Agile development environment
  • Strong hands-on experience with C# and the .NET platform
  • Experience building web applications with Microsoft Blazor
  • Solid knowledge of Entity Framework for application data management
  • Experience developing responsive web interfaces using JavaScript, HTML, and CSS
  • Working knowledge of Microsoft SQL Server and relational database concepts
  • Ability to balance new development work with application support responsibilities
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable applications using C# and the .NET ecosystem
  • Create interactive user interfaces with Microsoft Blazor to deliver modern web experiences
  • Develop and optimize data access layers with Entity Framework and Microsoft SQL Server
  • Produce responsive front-end components using JavaScript, HTML, and CSS for consistent usability across devices
  • Partner with Agile team members to plan work, participate in iterative delivery, and support continuous improvement
  • Troubleshoot application issues, resolve defects, and provide ongoing production support for business-critical systems
  • Contribute to code reviews, testing efforts, and technical documentation to support maintainable software delivery
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • company 401(k) plan
Read More
Arrow Right
New

Support Worker

Consensus is not just a care provider – we’re a community of amazing people dedi...
Location
Location
United Kingdom , Retford
Salary
Salary:
12.76 - 13.02 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Values are most important
  • May be new to care or have experience as Mental Health Support Worker, Care Worker, Healthcare Assistant or Care Assistant
Job Responsibility
Job Responsibility
  • Help the people we support to engage in meaningful opportunities and activities – empowering them to enjoy a great life filled with amazing experiences
  • Get involved in the community, support during leisure and social activities, and celebrate special occasions
  • Communicate appropriately, considering individual communication needs, and helping people to communicate effectively with others, too
What we offer
What we offer
  • Career Ladder: A starting salary of £12.76 per hour, our dedicated career ladder provides clear opportunities for your future progression and earn up to £13.02 per hour
  • Learning & Development: Support your personal and professional growth with training and qualifications to enable you to achieve your full potential
  • Financial Benefits: Life Assurance of twice your annual basic salary, withdraw a percentage of your wages with Wagestream, access to a Blue Light Discount Card
  • Health & Wellbeing: From confidential telephone counselling, dedicated wellbeing support and an Employee Assistance Programme
  • Induction & Training: Following your Free DBS check your journey will begin with a 3-day online induction before heading to the service to get started
  • Fulltime
Read More
Arrow Right
New

Car Delivery Driver

As a Car Delivery Driver, you’ll be the face of Domino’s in your local community...
Location
Location
United Kingdom , Bury
Salary
Salary:
10.85 - 12.71 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Full, valid UK or International driving licence
  • Own a reliable, roadworthy car with valid MOT, tax, and insurance
  • Smartphone for delivery app use
  • Good knowledge of the local area
  • Friendly, reliable, and able to work independently
  • Able to work flexible hours, including evenings and weekends
  • Previous experience is a bonus, but not essential as we’ll give you all the training you need
Job Responsibility
Job Responsibility
  • Deliver pizzas and menu items to customers promptly and safely
  • Provide excellent customer service at every doorstep
  • Operate your vehicle in accordance with road safety regulations
  • Use the Domino’s Delivery App on your smartphone to manage orders
  • Support the in-store team during quieter delivery periods (e.g. cleaning, restocking, folding boxes)
  • Represent Domino’s positively in the community
What we offer
What we offer
  • Competitive hourly pay + per-delivery payment + tips
  • 28 days paid holiday per year (includes BH, pro rata for part time)
  • Flexible working hours to suit your lifestyle
  • Staff discount on our delicious food (we know you were looking for this!)
  • Occasional Business Use insurance provided whilst out driving (store can provide more details)
  • Staff meals (conditions apply)
  • Company pension scheme (where eligible)
  • Family Leave policies in place
  • Paid training and clear career progression pathway with linked pay increases
  • Supportive, inclusive, and fun team environment
  • Parttime
Read More
Arrow Right
New

Car Delivery Driver

As a Car Delivery Driver, you’ll be the face of Domino’s in your local community...
Location
Location
United Kingdom , Redruth
Salary
Salary:
10.85 - 12.71 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Full, valid UK or International driving licence
  • Own a reliable, roadworthy car with valid MOT, tax, and insurance
  • Smartphone for delivery app use
  • Good knowledge of the local area
  • Friendly, reliable, and able to work independently
  • Able to work flexible hours, including evenings and weekends.
Job Responsibility
Job Responsibility
  • Deliver pizzas and menu items to customers promptly and safely
  • Provide excellent customer service at every doorstep
  • Operate your vehicle in accordance with road safety regulations
  • Use the Domino’s Delivery App on your smartphone to manage orders
  • Support the in-store team during quieter delivery periods (e.g. cleaning, restocking, folding boxes)
  • Represent Domino’s positively in the community.
What we offer
What we offer
  • Competitive hourly pay + per-delivery payment + tips
  • 28 days paid holiday per year (includes BH, pro rata for part time)
  • Flexible working hours to suit your lifestyle
  • Staff discount on our delicious food
  • Occasional Business Use insurance provided whilst out driving
  • Staff meals (conditions apply)
  • Company pension scheme (where eligible)
  • Family Leave policies in place
  • Paid training and clear career progression pathway with linked pay increases
  • Supportive, inclusive, and fun team environment
Read More
Arrow Right
New

Sql + Adf Developer

JD of Data Engineer ( SQL + ADF Developer )
Location
Location
India , Remote
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong proficiency in SQL, including advanced query optimization and stored procedures
  • Hands-on experience with Azure Data Factory (ADF) for building and managing data pipelines
  • Exposure to Azure ecosystem components such as Data Lake, Synapse, and related services
  • Solid understanding of ETL concepts and data integration best practices
  • Ability to troubleshoot and optimize ADF workflows for performance and reliability
  • Familiarity with version control systems (Git) and CI/CD pipelines for data solutions
  • Knowledge of data governance, security, and compliance within cloud environments
  • Strong analytical and problem-solving skills with attention to detail
  • Excellent communication skills and ability to work effectively in a 2 PM–11 PM IST shift
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust ETL pipelines using Azure Data Factory (ADF) for data integration
  • Write and optimize complex SQL queries for data extraction, transformation, and loading across large datasets
  • Implement data workflows and orchestrations in ADF, ensuring scalability and reliability
  • Collaborate with data architects and analysts to deliver high-quality data solutions aligned with business needs
  • Monitor and troubleshoot ADF pipelines, resolving failures and optimizing performance
  • Ensure data security, compliance, and governance standards are met within the Azure environment
  • Perform performance tuning for SQL queries and ADF activities to meet SLA requirements
  • Document ETL processes, pipeline configurations, and data flow diagrams for transparency and maintainability
  • Support production deployments and provide on-call assistance during the 2 PM–11 PM IST shift
  • Continuously explore and implement best practices for Azure-based data engineering solutions
  • Fulltime
Read More
Arrow Right