CrawlJobs Logo

Senior Infra Engineer

llamaindex.ai Logo

LlamaIndex

Location Icon

Location:
United States , San Francisco

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

Join us and help shape the future of AI by architecting next-generation knowledge systems. The Infra team at LlamaIndex owns the foundations that our product is built upon as well as many of the tools that enable engineers to develop, ship, and observe their code. We are responsible for designing, building, and scaling core infrastructure that powers a high-volume data platform for AI applications. We are looking for team members who love building enabling systems that empower our engineers and power our rapidly growing product.

Job Responsibility:

  • Collaborate with other engineering teams to build and maintain foundational systems that empower developers and support the company's rapid growth
  • Design and implement scalable infrastructure solutions for various deployment models, including SaaS, single-tenant, and private deployments
  • Manage and optimize cloud resources and Kubernetes clusters for cost-effectiveness and performance
  • Enable external customer deployment success through maintaining clear infrastructure boundaries and principles
  • Optimize and improve the release and deployment processes to enhance efficiency and reliability
  • Ensure compliance with relevant regulations and implement robust security measures across different deployment environments

Requirements:

  • 5+ years of engineering experience
  • Worked on Platform or Infrastructure teams on significant projects involving infrastructure components (Terraform/CDKTF, Kubernetes, Helm, test infrastructure, release management, observability, etc.)
  • Experience in optimizing cloud resource utilization
  • Proficient in tuning Kubernetes clusters and cloud resources for cost and performance efficiency
  • Willing to build LlamaIndex’s engineering culture as we grow
  • You can balance speed and pragmatism and build the appropriate solutions for each stage of the company’s growth

Nice to have:

  • Experience building out infrastructure from the ground up at a fast-growing startup
  • Experience with observability tools like Prometheus, Grafana, and New Relic
  • Experience with GitOps tools like ArgoCD and Flux for continuous deployment
  • Experience with security compliance and audits in cloud environments such as SOC2
  • Familiar with Python, Postgres, multi-cloud deployments
What we offer:
  • Competitive base salary and equity compensation
  • Comprehensive medical/dental/vision coverage for you and your family
  • Unlimited paid time off policy
  • Daily catered lunch and snacks in the San Francisco office

Additional Information:

Job Posted:
March 13, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
LlamaIndex - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Infra Engineer

Senior Backend Infra Engineer

Engineering Excellence is a CTO formed organization/team of top-tier experts tas...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in software engineering, hands-on experience in either Node.js, Java or Go
  • Hands-on experience developing high-performance solutions following Agile methodologies
  • 2+ years in K8s hands on experience
  • Self-motivated with the ability to work independently as well as a team member with minimal oversight
  • B.S.c in Computer Sciences\ Software Engineering
Job Responsibility
Job Responsibility
  • Lead the design, coding and implementation for a core, large scale, developer platform
  • Mentor and guide team members on how to engineer according to coding standards various tasks
  • Design developer platform for huge scale and resilience
What we offer
What we offer
  • Generous holiday allowance starting at 22 days
  • Private medical insurance packages
  • Employee Assistance Program
  • Fulltime
Read More
Arrow Right

Senior DevOps Infra Engineer

BioCatch is the leader in Behavioral Biometrics, a technology that leverages mac...
Location
Location
Israel , TLV
Salary
Salary:
Not provided
biocatch.com Logo
BioCatch
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience as SRE /DevOps engineer
  • 5+ years of experience with cloud environments such as Azure, GCP or AWS
  • Proficiency in programming languages such as Python
  • Proven experience working with Kubernetes in production environments
  • Linux distributions familiarity: Ubuntu / CentOS
  • Solid understanding of computer networking fundamentals and cloud security principles
  • CDN and DNS systems – AWS CloudFront / Azure Front door
  • Deep Understanding of web servers (Nginx preferred)
  • Experience with logging monitoring services (such as Prometheus, Grafana, Datadog and Coralogix)
  • Experience working with Infrastructure as Code (IaC) tools (Terraform preferred)
Job Responsibility
Job Responsibility
  • Build and maintain a scalable cloud infrastructure in Production (Azure, GCP)
  • Troubleshoot and fix Production infrastructure/platform issues
  • Proactively and continuously improve Production stability and robustness to assure our infrastructure components are always up and available
  • Develop end to end projects in order to make our infrastructure better in large-scale including design, implementation, and ongoing maintenance
  • Monitor and optimize cloud costs associated with data infrastructure and processes
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We build simple yet innovative consumer products and developer APIs that shape h...
Location
Location
United States , San Francisco
Salary
Salary:
180000.00 - 270000.00 USD / Year
plaid.com Logo
Plaid
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of dedicated data engineering experience, solving complex data pipelines issues at scale
  • Experience building data models and data pipelines on top of large datasets (in the order of 500TB to petabytes)
  • Value SQL as a flexible and extensible tool, and are comfortable with modern SQL data orchestration tools like DBT, Mode, and Airflow
  • Experience working with different performant warehouses and data lakes
  • Redshift, Snowflake, Databricks
  • Experience building and maintaining batch and realtime pipelines using technologies like Spark, Kafka
  • Appreciate the importance of schema design, and can evolve an analytics schema on top of unstructured data
  • Excited to try out new technologies and like to produce proof-of-concepts that balance technical advancement and user experience and adoption
  • Like to get deep in the weeds to manage, deploy, and improve low level data infrastructure
  • Empathetic working with stakeholders
Job Responsibility
Job Responsibility
  • Understanding different aspects of the Plaid product and strategy to inform golden dataset choices, design and data usage principles
  • Have data quality and performance top of mind while designing datasets
  • Leading key data engineering projects that drive collaboration across the company
  • Advocating for adopting industry tools and practices at the right time
  • Owning core SQL and python data pipelines that power our data lake and data warehouse
  • Well-documented data with defined dataset quality, uptime, and usefulness
What we offer
What we offer
  • medical
  • dental
  • vision
  • 401(k)
  • equity
  • commission
  • Fulltime
Read More
Arrow Right

Senior Cloud Engineer

The Senior Cloud Engineer is responsible for the development, delivery and perfo...
Location
Location
United States , Wilton
Salary
Salary:
Not provided
asml.com Logo
ASML
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Information Technology, Computer Science or Engineer. Master’s degree a plus
  • 8 years related and proven experience in large technical software development environments
  • Linux (RHEL, Centos)
  • Networking – Architecture (TCP/IP UDP)
  • Ticketing system – (Service now)
  • Monitoring systems - (Splunk)
  • Application management experience (Atlassian Stack - JIRA, Confluence, Wiki, Bitbucket)
  • Storage knowledge (NFS, SMB, CIFS, ZFS, NAS)
  • Scripting language (Python, Bash, Perl)
  • SW Developer tools (IDE, code quality checkers, review tool, etc.)
Job Responsibility
Job Responsibility
  • Collaborates with teams across various projects and customers on feasibilities and applications' customizations
  • Responsible for SW build and development support activities for systems local or remote, which includes installation, software patch, system security, data backup, storage management, VM, and problem analysis activities
  • Performs remote troubleshooting through diagnostic techniques and pertinent questions
  • Provides Support process by serving as Tier 1 / Tier 2 point of contact and owner of problem/incident
  • Logs all customer requests and updates calls utilizing the designated call handling and tracking system
  • Define improvement proposals that focus on system performance and process efficiency for end-users
  • Investigate and implement non-standard changes with a limited scope
  • Support / take ownership of requests from engineering and help to solve these requests
  • Ensures all IT standard processes and procedures and Service Level Agreements are met
  • Other duties as assigned
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - ERP Systems

Own the internal software stack that runs sales, manufacturing, and supply chain...
Location
Location
United States , Palo Alto
Salary
Salary:
150000.00 - 221000.00 USD / Year
1x.tech Logo
1X Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ yrs full-stack (Python + JS)
  • React + PostgreSQL/MySQL
  • End-to-end ownership: design → deploy → iterate
  • ERP integration experience (Odoo, NetSuite, or SAP)
  • Can explain complex systems to non-engineers
Job Responsibility
Job Responsibility
  • Architect and ship full-stack web apps (React + Python)
  • Extend ERP (Odoo/NetSuite) for custom manufacturing workflows
  • Design data models, REST/GraphQL APIs, and real-time dashboards
  • Integrate with PLM, MES, and warehouse systems
  • Harden CI/CD, infra (Docker/K8s), and observability
  • Translate ops pain into production-grade code
What we offer
What we offer
  • Health, dental, and vision insurance
  • 401(k) with company match
  • Paid time off and holidays
  • Fulltime
Read More
Arrow Right

Senior Security Engineer

We’re looking for a Senior Security Engineer to join the Platform Team at Flanks...
Location
Location
Spain , Barcelona
Salary
Salary:
50000.00 - 70000.00 EUR / Year
flanks.io Logo
Flanks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep experience in ethical hacking, pentesting, and secure software design
  • Strong knowledge of Python, JavaScript, Kubernetes, and GCP
  • Ability to understand code, automate security tasks, and design scalable defenses
  • Hands-on with cloud security, appsec, and infra security
  • Self-driven, curious, and collaborative — a true security builder
  • Professional proficiency in both English and Spanish to collaborate effectively in our bilingual environment
Job Responsibility
Job Responsibility
  • Continuously evolve our tools, practices, and culture of security
  • Lead security initiatives across our stack (apps, infrastructure, and processes)
  • Perform pentesting, vulnerability assessments, and incident response
  • Define and implement security controls derived from business processes
  • Collaborate with teams to design secure architectures and validate security requirements
  • Work with auditors and clients to communicate our security posture clearly
What we offer
What we offer
  • A cool office between Sants Estació and Plaça Espanya with stunning views of Barcelona
  • Flexible working hours and hybrid work options
  • Paid day off on your birthday
  • Weekly fresh fruit, coffee, and tea on tap
  • Friday happy hours after our all-hands meetings
  • Team-building events to bond and have fun
  • Health insurance and flexible compensation with Alan
  • A digital canteen, thanks to Nora Real Food, subsidised at 50%
  • A yearly training budget to keep growing
  • Fulltime
Read More
Arrow Right

Senior Software Engineer – ML Model Compliance & Automation

We are seeking a highly skilled and motivated Senior Software Engineer to lead t...
Location
Location
India , Jaipur
Salary
Salary:
Not provided
infoobjects.com Logo
InfoObjects
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience Required: 3 - 7 yrs
  • GoLang (preferred)
  • Python (preferred)
  • Bash
  • MLOps Tools: KitOps, MLModelCI, MLflow, ONNX, TensorFlow, PyTorch, Docker
  • SBOM & Security: Syft, Grype, Trivy, CycloneDX, SPDX
  • CI/CD: GitHub Actions, GitLab CI, Jenkins, ArgoCD
  • Infra: Kubernetes, Docker, Helm, Terraform
  • Cloud: AWS, GCP, Azure (EKS/GKE/ECS preferred)
  • Version Control: Git, GitOps
Job Responsibility
Job Responsibility
  • Model Packaging & Artifact Management: Design and implement workflows for packaging ML models using KitOps, ONNX, MLflow, or TensorFlow SavedModel
  • Manage model artifact versioning, registries, and reproducibility
  • Ensure artifact integrity, consistency, and traceability across CI/CD pipelines
  • Model Profiling & Optimization: Automate model profiling (latency, size, ops) using MLModelCI, TorchServe, or ONNX Runtime
  • Apply quantization, pruning, and format conversions (e.g., FP32→INT8) for optimization
  • Embed profiling and optimization checks into CI/CD pipelines to assess deployment readiness
  • Compliance & SBOM Generation: Develop pipelines to generate and validate SBOMs for ML models
  • Implement compliance checks for licensing, vulnerabilities, and security using CycloneDX, SPDX, Syft, or Trivy
  • Validate schema, dependencies, and runtime environments for production readiness
  • Cloud Integration & Deployment: Automate model registration, endpoint creation, and monitoring setup in AWS/GCP/Azure
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Cloud Infrastructure

The Cloud Infrastructure Engineering team builds and manages the foundational bl...
Location
Location
Australia
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant software development industry experience building and operating scalable, fault-tolerant, distributed systems
  • Software development experience in Go, C/C++, Java, or another OOP language
  • Experience with cloud technologies such as AWS, Azure, or GCP, including infrastructure-as-code (IaC) tools such as Terraform or CloudFormation
  • Experience developing cloud infrastructure services, preferably with Kubernetes
  • Experience developing cloud native edge or service mesh services, preferably with envoy and Istio
  • Experience leading and shipping large scope technical projects in collaboration with multiple experienced engineers
  • Understanding of network topologies, protocols, and security principles, such as VPNs, firewalls, and load balancers
  • Knowledge of cloud security best practices, including encryption, access controls, and compliance standards like SOC2 and GDPR
  • You have excellent communication skills and the ability to work well within a global team
  • You are a strong problem-solver and have solid production debugging skills
Job Responsibility
Job Responsibility
  • Architect and build a robust, scalable, and highly available distributed infrastructure
  • Build a cutting-edge cloud-native platform on top of the public cloud, and automate our cloud resource management
  • Work closely with our ClickHouse core database development team, and security team and partner with them to produce the SAS offering
  • Work on routing and traffic components to improve the reliability and scalability of our cloud service
  • Systematically improve availability by applying industry and distributed systems best practices
  • Design and build security components & tooling: firewall, PKI and certificate infra, zero trust network, etc.
  • Improve performance and cost efficiency of our infrastructure
What we offer
What we offer
  • Flexible work environment - ClickHouse is a globally distributed company and remote-friendly. We currently operate in 20 countries
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites
Read More
Arrow Right