CrawlJobs Logo

Senior Infra Engineer

United States, San Francisco · Job Posted March 13, 2026
Apply Position
Job Link Share

Job Description

Join us and help shape the future of AI by architecting next-generation knowledge systems. The Infra team at LlamaIndex owns the foundations that our product is built upon as well as many of the tools that enable engineers to develop, ship, and observe their code. We are responsible for designing, building, and scaling core infrastructure that powers a high-volume data platform for AI applications. We are looking for team members who love building enabling systems that empower our engineers and power our rapidly growing product.

Job Responsibility

  • Collaborate with other engineering teams to build and maintain foundational systems that empower developers and support the company's rapid growth
  • Design and implement scalable infrastructure solutions for various deployment models, including SaaS, single-tenant, and private deployments
  • Manage and optimize cloud resources and Kubernetes clusters for cost-effectiveness and performance
  • Enable external customer deployment success through maintaining clear infrastructure boundaries and principles
  • Optimize and improve the release and deployment processes to enhance efficiency and reliability
  • Ensure compliance with relevant regulations and implement robust security measures across different deployment environments

Requirements

  • 5+ years of engineering experience
  • Worked on Platform or Infrastructure teams on significant projects involving infrastructure components (Terraform/CDKTF, Kubernetes, Helm, test infrastructure, release management, observability, etc.)
  • Experience in optimizing cloud resource utilization
  • Proficient in tuning Kubernetes clusters and cloud resources for cost and performance efficiency
  • Willing to build LlamaIndex’s engineering culture as we grow
  • You can balance speed and pragmatism and build the appropriate solutions for each stage of the company’s growth

Nice to have

  • Experience building out infrastructure from the ground up at a fast-growing startup
  • Experience with observability tools like Prometheus, Grafana, and New Relic
  • Experience with GitOps tools like ArgoCD and Flux for continuous deployment
  • Experience with security compliance and audits in cloud environments such as SOC2
  • Familiar with Python, Postgres, multi-cloud deployments

What we offer

  • Competitive base salary and equity compensation
  • Comprehensive medical/dental/vision coverage for you and your family
  • Unlimited paid time off policy
  • Daily catered lunch and snacks in the San Francisco office

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Infra Engineer

8 matching positions

Senior DevOps Infra Engineer

BioCatch is the leader in Behavioral Biometrics, a technology that leverages mac...
Location
Location
Israel , TLV
Salary
Salary:
Not provided
biocatch.com Logo
BioCatch
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience as SRE /DevOps engineer
  • 5+ years of experience with cloud environments such as Azure, GCP or AWS
  • Proficiency in programming languages such as Python
  • Proven experience working with Kubernetes in production environments
  • Linux distributions familiarity: Ubuntu / CentOS
  • Solid understanding of computer networking fundamentals and cloud security principles
  • CDN and DNS systems – AWS CloudFront / Azure Front door
  • Deep Understanding of web servers (Nginx preferred)
  • Experience with logging monitoring services (such as Prometheus, Grafana, Datadog and Coralogix)
  • Experience working with Infrastructure as Code (IaC) tools (Terraform preferred)
Job Responsibility
Job Responsibility
  • Build and maintain a scalable cloud infrastructure in Production (Azure, GCP)
  • Troubleshoot and fix Production infrastructure/platform issues
  • Proactively and continuously improve Production stability and robustness to assure our infrastructure components are always up and available
  • Develop end to end projects in order to make our infrastructure better in large-scale including design, implementation, and ongoing maintenance
  • Monitor and optimize cloud costs associated with data infrastructure and processes
  • Fulltime
Read More
Arrow Right

Senior DevOps Infra Engineer

We are seeking a highly skilled and passionate DevOps Engineer to join our team ...
Location
Location
India , Pune; Bangalore
Salary
Salary:
Not provided
3pillarglobal.com Logo
3Pillar Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ Years of IT Experience required
  • 4+ Years of experience as a DevOps Engineer
  • Strong hands-on experience with Infrastructure as Code (IaC) tools (e.g., Terraform, CloudFormation)
  • Practical experience with CI/CD pipelines and automation tools (e.g., Jenkins, GitLab CI/CD, GitHub Actions)
  • Good understanding of AWS core services (EC2, VPC, S3, IAM, etc.)
  • Familiarity with version control systems such as Git
  • Basic scripting knowledge (e.g., Python, Bash, PowerShell)
  • Enthusiasm for learning and applying new DevOps tools and cloud technologies
  • Strong background in cloud technologies (AWS, Azure, GCP)
  • Solid understanding of Linux administration, containerization, and Kubernetes
Job Responsibility
Job Responsibility
  • Implement and maintain Infrastructure as Code (IaC) using tools such as Terraform or CloudFormation
  • Build and manage CI/CD pipelines for automated code deployment using tools like Jenkins, GitLab CI, or GitHub Actions
  • Support infrastructure provisioning, configuration management, and application deployment in AWS environments
  • Collaborate with development and operations teams to ensure smooth and secure deployment processes
  • Monitor and troubleshoot build and deployment issues
  • Contribute to improving automation, documentation, and best practices across environments
  • Learn and apply DevOps security principles, containerization, and orchestration tools as part of skill development
  • Fulltime
Read More
Arrow Right

Senior DevOps Engineer, Server Infra

We are looking for an experienced DevOps Engineer to join our Server Infra team ...
Location
Location
United Kingdom; Finland , London; Helsinki
Salary
Salary:
Not provided
supercell.com Logo
Supercell
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience with Linux, shell scripting, and at least one scripting language
  • Experience with cloud platforms such as AWS and infrastructure-as-code tooling
  • Experience building and operating large-scale distributed systems
  • Knowledge of how to design reusable and composable patterns
  • Familiarity with Kubernetes in production environments
  • Ability to read and understand existing backend systems, including Java-based services
  • Strong communication skills and ability to work across teams
  • A proactive, self-directed approach with a strong sense of ownership
Job Responsibility
Job Responsibility
  • Contribute to best practices across cloud security, governance, reliability, and availability
  • Develop, maintain, and improve cloud infrastructure patterns and related tooling used by game teams
  • Develop, maintain, and improve the observability platform used by game teams
  • Iterate on and improve deployment tooling to support live operations at scale
  • Collaborate closely with server engineers and game teams to improve systems and workflows
  • Share learnings across teams to improve reliability and operational excellence
  • Participate in on-call rotations to support production environments, when needed
What we offer
What we offer
  • Relocation support
  • Compensation and benefits structured to allow you to enjoy your time
  • Freedom and independence
  • Supportive work environment and resources
  • Fulltime
Read More
Arrow Right

Senior Software Engineer-AI Infra

The Artificial Intelligence Performance team at Microsoft develops AI software t...
Location
Location
United States , Mountain View
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Job Responsibility
Job Responsibility
  • Identify and drive improvements to end-to-end inference performance of OpenAI and other state-of-the-art LLMs
  • Measure, benchmark performance on Nvidia/AMD GPUs and first party Microsoft silicon
  • Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities ranging from the model level to the systems and silicon level to improve customer experience and reduce the footprint of the computing fleet
  • Enable fast time to market of LLMs/models and their deployments at scale by building SW tools that afford velocity in porting models on new Nvidia and AMD GPUs
  • Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Communicate and collaborate with our partners both internal and external
  • Embody Microsoft's Culture and Values
  • Fulltime
Read More
Arrow Right

Senior Engineer – (Systems Engineering, Enterprise Infra & Platform Support)

The Senior Infrastructure & Platform Support Engineer provides end-to-end techni...
Location
Location
United States , Chevy Chase
Salary
Salary:
80000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience leading engineering efforts or owning internal, enterprise-scale platforms and working directly with enterprise customers
  • Familiarity with enterprise application lifecycle (selection, deployment, user adoption, decommission, integration layers)
  • Strong background in enterprise infrastructure supporting Windows and Linux systems, including builds, configuration, hardening, and troubleshooting
  • Advanced skills with Windows Server, Active Directory, authentication protocols (Kerberos / LDAP / SAML / OAuth), and Azure AD/identity integrations
  • Solid Linux administration experience (Ubuntu, RHEL, or equivalent), with certifications preferred
  • Proficiency in automation and scripting (PowerShell, Bash, Python)
  • Strong understanding of networking fundamentals: TCP/IP, DNS, DHCP, routing, VPNs, firewalls, load balancers, VLANs, and secure connectivity
  • Hands-on experience with cloud platforms (Azure/AWS), hybrid environments, virtualization (vSphere/Hyper-V), and containers (Docker, Kubernetes)
  • Knowledge of monitoring and observability tools, such as Prometheus, Grafana, or equivalent solutions
  • Familiarity with database concepts, performance tuning, and integration of MySQL/PostgreSQL/SQL Server/Oracle with enterprise systems
Job Responsibility
Job Responsibility
  • Provide technical leadership to ensure strong engineering standards and operational excellence
  • Support, configure, and maintain both Linux and Windows server platforms, including application servers, integration components, and system services
  • Design and implement infrastructure solutions for workplace technologies including but not limited to digital mailroom, physical security & safety, and real estate facility management technology platforms—covering on-prem systems, hybrid setups, and SaaS applications
  • Build production-ready configurations emphasizing reliability, maintainability, scalability, and testability
  • Lead incident response, troubleshooting, root-cause analysis, and drive ongoing performance optimization
  • Execute DevOps activities including CI/CD pipeline management, automation scripting, monitoring setup, and Infrastructure as Code
  • Ensure platform observability through logging, alerting, dashboards, and automated health checks
  • Apply secure design practices, compliance controls, network segmentation, encryption, and access management
  • Manage platform lifecycle activities such as patching, upgrades, capacity planning, backups, disaster recovery and identifying opportunities for automation and standardization
  • Collaborate with cross-functional teams, vendors, and senior engineers, communicating clearly with technical and non-technical stakeholders
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right

Search Backend Infra Engineer

Perplexity is looking for a Backend/Infrastructure Engineer Intern to support ou...
Location
Location
Serbia , Belgrade
Salary
Salary:
Not provided
perplexity.ai Logo
Perplexity
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Working towards a degree in Computer Science, Engineering, or a related field, or equivalent practical experience
  • Familiarity with at least one programming language such as Go, Rust, or C/C++, through coursework or projects
  • Basic understanding or exposure to cloud infrastructure (e.g. AWS) and Linux systems is a plus, not a requirement
  • Interest in infrastructure, distributed systems, or backend engineering, with willingness to learn about CI/CD, monitoring, and performance
  • A proactive and curious learner who enjoys collaborating in a fast-paced, innovative environment
Job Responsibility
Job Responsibility
  • Build and maintain infrastructure that supports high-performance search systems, with mentorship from senior engineers
  • Design internal tools and automation to improve developer workflows and operational efficiency
  • Support the design, deployment, and monitoring of cloud-native systems on AWS
  • Contribute to improving CI/CD pipelines, testing infrastructure, and release processes
  • Debug and optimize Linux-based services, containers, and backend systems
  • Contribute to product codebases, primarily using Rust, Go or C++
  • Fulltime
Read More
Arrow Right

Founding Senior Engineer

Domu.ai is a voice-AI startup powering collections and servicing for major finan...
Location
Location
United States , San Francisco
Salary
Salary:
Not provided
silver.dev Logo
Silver.dev
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 3 years of experience in a startup
  • Were the first hire at another company
  • Were part of a startup post-Series A from the beginning of the company
  • Comfortable building full-stack features
  • Care about product, not just code
  • Have owned something meaningful end-to-end in the past (a product module, an infra refactor, etc)
  • Resourceful and comfortable with ambiguity
  • Figure things out
Job Responsibility
Job Responsibility
  • Take ownership of the entire product and make decisions at the product level
  • Talk with customers
  • Do what others don’t want to do (e.g., telephony)
  • Encourage the team to improve continuously
  • Make architectural decisions
  • Help shape the engineering culture
  • Ensure our DX is exceptional and makes it easy to ship day 1
  • Spend a significant portion of your time coding (likely over 80%)
What we offer
What we offer
  • Visa sponsorship for the United States
  • Housing in San Francisco
  • Relocation to San Francisco
  • End-to-end support for immigration, interview preparation, and counseling
  • Fulltime
Read More
Arrow Right

Senior Engineer - Networking/ P2P

As a Senior Engineer on the PoS Engineering team at Polygon Labs, you’ll focus o...
Location
Location
Salary
Salary:
Not provided
polygon.technology Logo
Polygon Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in systems or infrastructure engineering, ideally working on distributed systems or blockchain clients
  • Deep expertise in Go (Golang), with strong knowledge of networking libraries, protocols (TCP/UDP), and debugging tools
  • Demonstrated ability to solve complex problems in live production systems with a proactive, ownership-first mindset
  • Experience working on peer-to-peer networking protocols or low-level infrastructure systems
  • Comfortable working in a remote, asynchronous environment across time zones (EMEA, East Coast US, or South America preferred)
Job Responsibility
Job Responsibility
  • Design, implement, and optimize peer-to-peer networking components in the Bor, Erigon, and Heimdall clients
  • Analyze and improve network stability by identifying peering bottlenecks, protocol edge cases, or propagation inefficiencies
  • Investigate incidents and contribute to root cause analysis (RCA) efforts related to network partitions, peer discovery failures, or gossip performance issues
  • Collaborate closely with internal protocol and infra teams to align client behavior with network goals
  • Contribute to client documentation and architecture discussions around networking layers and system resilience
  • Stay up to date with trends and developments in distributed systems and peer-to-peer infrastructure
What we offer
What we offer
  • Remote first global workforce
  • Industry leading Medical, Dental and Vision health insurance
  • Company matching 401k with 3% match
  • $1,500 Home Office Set Up Allowance (life-time max)
  • $75 Monthly internet or phone reimbursement
  • Flexible Time Off
  • Company issued laptop
  • Egg freezing, mental health, and employee wellness benefits
  • Fulltime
Read More
Arrow Right