LLM Platform Engineer Job at Whatnot (San Francisco)

Job Description

Join the Future of Commerce with Whatnot. Whatnot is the largest live shopping platform in North America and Europe to buy, sell, and discover the things you love. We’re re-defining e-commerce by blending community, shopping, and entertainment into a community just for you. We’re looking for builders–intellectually curious, highly entrepreneurial engineers eager to shape the future of AI and ML at Whatnot. You’ll design and scale the core infrastructure that powers large language model applications across the company, working side by side with machine learning scientists to bring cutting-edge models into production and unlock entirely new product experiences. This means building systems that make AI dependable and fast at scale–from building retrieval systems to more effectively ground LLM responses in Whatnot’s business context to developing scalable LLM evaluation frameworks and human-in-the-loop feedback mechanisms.

Job Responsibility

Own the infrastructure powering LLMs across critical business surfaces– supporting growth, recommendations, trust and safety, fraud, seller tooling, and more
Create robust and scalable LLM evaluation frameworks to measure model performance, guide iteration, and prevent regression via CI/CD
Deploy RAG systems and MCP servers to more effectively ground LLM responses in Whatnot’s business context while enforcing rigorous PII controls
Design efficient human-in-the-loop feedback pipelines that can be used to inform scalable LLM evaluation
Bridge the gap between research and production, helping to transform experimental ideas into scalable solutions
Stretch beyond your comfort zone to take on new technical challenges as we scale AI across Whatnot’s ecosystem

Requirements

4+ years of professional experience developing machine learning systems and algorithms
Bachelor’s degree in Computer Science, Statistics, Applied Mathematics or a related technical field, or equivalent work experience
3+ years of software engineering experience building and maintaining production systems for consumer-scale loads
1+ years of professional experience developing software in Python
Ability to work autonomously and drive initiatives across multiple product areas and communicate findings with leadership and product teams
Experience with operational, search, and key-value databases such as PostgreSQL, DynamoDB, Elasticsearch, Redis
Firm grasp of visualization tools for monitoring and logging e.g. DataDog, Grafana
Familiarity with cloud computing platforms and managed services such as AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Apache Kafka, Flink
Professionalism around collaborating in a remote working environment and well tested, reproducible work
Exceptional documentation and communication skills

What we offer

Flexible Time off Policy and Company-wide Holidays (including a spring and winter break)
Health Insurance options including Medical, Dental, Vision
Work From Home Support
Home office setup allowance
Monthly allowance for cell phone and internet
Care benefits
Monthly allowance for wellness
Annual allowance towards Childcare
Lifetime benefit for family planning, such as adoption or fertility expenses
Retirement
401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
Monthly allowance to dogfood the app
Parental Leave
16 weeks of paid parental leave + one month gradual return to work

Whatnot - All Job Offers

Select Country

LLM Platform Engineer

Job Description

Job Responsibility

Requirements

What we offer

Looking for more opportunities?

LLM Platform Engineer

Azure Data Science Platform Engineer (AI)

Data Platform Engineer (Ai-Enabled)

Platform Engineer with AI

Vp Platform Engineer

Ai Platform Engineer

Ai Platform Engineer

Principal Data Genai Platform Engineer - Senior Vice President

Platform Engineer (ai/llm Infrastructure)

Our AI answers in your language