Technical Lead Jobs

Spectro Cloud

Location:
United States, San Jose

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

At Spectro Cloud, we are in search of a talented individual to become an integral part of our Engineering team, playing a pivotal role in shaping the future of our cutting-edge Palette platform. As a software engineer within our organization, you will be at the forefront of building an always-on, self-healing, and declarative platform specifically engineered for the management of both infrastructure and applications. You will have the opportunity to contribute significantly by designing, optimizing, and streamlining GoLang-based microservices and AI-powered capabilities that serve as the foundation of our platform. Proficiency in Kubernetes is required - it lies at the very heart of our contemporary cloud-native, data center and edge solutions.

Job Responsibility:

Building production-grade AI systems - designing, implementing, and maintaining LLM-powered applications, agentic AI workflows, and RAG pipelines across multiple product use-cases
Actively participate in guided technical labs covering prompt engineering, vector databases, LLM deployment tooling, multi-agent orchestration, fine-tuning strategies, and evaluation techniques
Develop, refine, and operationalize LLM solutions, including prompt design, retrieval strategies, embedding pipelines, LangChain/LangGraph workflows, and API integrations using Python, Hugging Face, FastAPI, and similar frameworks
Ensuring the seamless operation of our platform through a combination of automation, scripting, and rigorous testing
Stay ahead of emerging AI trends - small models, efficient inference (vLLM/TensorRT), multimodal systems, on-device LLMs - and recommend tools, frameworks, or integrations that enhance our platform
Work closely with cross-functional teams to create scalable, dependable, and secure solutions that push boundaries
Stay current with industry trends and emerging technologies, thereby ensuring that our solutions remain innovative and ahead of the curve

Requirements:

Bachelor's degree in Computer Science or related technical field
8+ years of software development experience (or 6+ years with a Master's degree)
Strong LLM/GenAI fundamentals: Solid understanding of large language models, prompt engineering, embeddings, vector search, RAG systems, and lightweight fine-tuning (LoRA/PEFT preferred)
Python expertise: Proficiency in Python and hands-on experience with AI/ML libraries such as Hugging Face, PyTorch, LangChain, LangGraph, FastAPI, or similar frameworks
LLM deployment experience: Familiarity with Kubernetes-based inference stacks including vLLM, llm-d, TensorRT, PyTorch Serve, or comparable deployment frameworks
Proficiency in at least one modern programming language such as Go, Java, or equivalent
Solid understanding of containerization and orchestration concepts, including Kubernetes
Deep understanding of microservices architecture and REST API design principles
Experience designing and building scalable, cloud-native applications
Analytical problem-solving: Ability to debug model outputs, improve retrieval accuracy, optimize latency, and iterate quickly through experiments
Cloud & AI ecosystem knowledge: Experience with AI/agent frameworks (LangChain, AutoGen, LlamaIndex) and cloud platforms (AWS, Azure, GCP, etc.)
Familiarity with virtual machine usage and integration within software solutions
Comfortable working in Linux-based environments and using common command-line tools

Nice to have:

Experience with Cluster-API or deploying AI models to edge devices (NVIDIA Jetson, x86 edge nodes, ARM platforms) is a plus
Exposure to Kubernetes-native developer tooling, observability, or MLOps pipelines is a plus
Kubernetes certification (CKA or CKAD) is a plus

Additional Information:

Job Posted:
December 12, 2025

Work Type:

Hybrid work

View All Jobs In This Company

Job Link Share:

Technical Lead