Gen AI Solutions Product Architect, Citi

Citi

Location:
United States, Irving ▼
New York
Rutherford

Category:
IT - Software Development

Contract Type:
Employment contract

Salary:

156160.00 - 234240.00 USD / Year

Save Job

Apply Position

Job Description:

Drive the development of a modular, reusable Gen AI product suite that enables cross-functional teams to deploy AI solutions rapidly without deep business context. Architect plug-and-play Gen AI modules and foster an open-source-like community for contributions. This role demands a blend of product strategy, technical architecture, and cross-functional collaboration to ensure solutions are scalable, user-friendly, and aligned with enterprise needs.

Job Responsibility:

Define the product vision and roadmap for reusable Gen AI modules
Architect parameterized, business-agnostic solutions that abstract complexity
Design APIs and microservices to expose modules as reusable components
Standardize patterns across use cases
Integrate LLM workflows with traditional ML and enterprise systems
Optimize performance of Gen AI components and ensure scalability
Partner with business teams to map their needs to pre-built modules
Build developer tools to help teams self-serve
Foster an open-source-like community
Develop documentation, tutorials, and sandbox environments for testing modules
Train teams on best practices
Track metrics: Module reuse rate, contribution volume, time-to-deploy for new use cases

Requirements:

Hands-on experience with LLM integration (e.g., OpenAI, Anthropic, Llama 2) and frameworks (LangChain, LlamaIndex)
Expertise in RAG workflows: Document chunking (sentence transformers), vector DBs (Pinecone, FAISS), and hybrid search
Familiarity with text-to-SQL systems, few-shot/chain-of-thought prompting, and traditional ML (clustering with scikit-learn, PyTorch)
Proficiency in Python, API design (FastAPI, Flask), and cloud platforms (AWS Sagemaker, Azure AI)
Experience with CI/CD, containerization (Docker), and infrastructure-as-code (Terraform)
Frontend integration (React/Streamlit for config UIs) and middleware (message queues, auth systems like R2D2)
Proven track record of building reusable ML/API products or internal platforms
Ability to translate business problems into technical requirements
Agile/Scrum methodology and tools (Jira, GitHub Issues)
Strong communication to bridge technical and non-technical stakeholders
Community-building skills to drive adoption and contributions
Pragmatic problem-solving
Bachelor's/University degree in Computer Science, Data Engineering, Cloud Computing, Technology or a related field, or equivalent experience

Nice to have:

Experience with open-source projects (contributor/maintainer)
Knowledge of LLMOps tools (PromptLayer, Weights & Biases)
Background in enterprise integration (SSO, RBAC, logging/monitoring)

What we offer:

Medical, dental & vision coverage
401(k)
Life, accident, and disability insurance
Wellness programs
Paid time off packages including vacation, sick leave, and paid holidays
Discretionary and formulaic incentive and retention awards

Additional Information:

Job Posted:
August 27, 2025

Expiration:
September 02, 2025

Employment Type:

Fulltime

Work Type:

Hybrid work

View All Jobs In This Company

Job Link Share:

Gen AI Solutions Product Architect