Software Engineer, Infrastructure Jobs (On-site work)

Senior/Staff Software Engineer sought to design core components of a next-generation knowledge retrieval system for the AI era. You will build scalable search and retrieval infrastructure, leveraging vector databases and hybrid retrieval to power enterprise-grade agentic systems. Ideal for expert...

We are seeking a Software Engineer with a systems mindset to build and evolve the core infrastructure powering the future of AI software engineering. You will design, ship, and own critical services, including a high-throughput sandbox scheduler and Gvisor-based runtime, ensuring speed and reliab...

Join our small, high-impact team in NYC as an Infrastructure Engineer. You'll scale our AWS backbone using Terraform and Kubernetes to support heavy compute and data workloads. Strong Python skills and a focus on reliability in distributed systems are key. This is a builder role with significant ...

Join Microsoft's CoreAI team in Redmond as a Senior Software Engineer specializing in AI Infrastructure. You will design and develop critical distributed services in C# for large-scale AI training and inference. This role requires a strong background in computer science and experience with cloud-...

Join Plaid in New York as a Senior Software Engineer specializing in ML Infrastructure. You will design and build scalable ML platforms, including feature stores and inference systems, to accelerate model development. We seek an expert with 5+ years in ML/AI infrastructure and a strong background...

Join Scale AI's Enterprise GenAI team as an Infrastructure Software Engineer. Build and scale a multi-cloud platform (AWS, Azure, GCP) for regulated industries. Leverage your expertise in Kubernetes, Python/TypeScript, and LLMs in a fast-paced startup environment. Enjoy comprehensive benefits and...

Join Scale AI's Public Sector team as a Software Engineer focused on Infrastructure & Security. Design secure, scalable backend systems for high-impact AI solutions, requiring an active clearance and full-stack/cloud-native expertise. Enjoy comprehensive benefits while working from key US hubs li...