CrawlJobs Logo
Citi Logo Citi · IT - Software Development

Principal Generative AI Engineer

Canada, Mississauga 145100.00 - 217700.00 USD / Year · Job Posted March 20, 2026
Apply Position
Job Link Share

Job Description

We are seeking an exceptional Principal Generative AI Engineer to join our team as a highly influential Individual Contributor. This is a pivotal, deeply hands-on role for a truly seasoned software engineer with a profound passion for Generative AI, Large Language Models (LLMs), and agentic frameworks. You will be instrumental in defining, leading the architecture, and personally building and deploying real-world, commercial production systems that tackle the most complex and ambiguous enterprise challenges, moving beyond proofs-of-concept to deliver strategic, firm-wide impact.

Job Responsibility

  • Define & Lead Architecture: Set the technical vision and architect sophisticated Generative AI applications, LLM-powered solutions, and intricate agentic frameworks
  • Strategize & Pioneer Automation with Agents: Drive the strategic direction for intelligent agent-based automation
  • Establish Containerization Best Practices: Possess expert-level comfort and leadership in container technologies, specifically defining and implementing best practices for deploying and managing mission-critical applications within OpenShift environments
  • Drive Strategic Technical Direction & Ownership: Own and drive critical technical initiatives from conception to production, influencing broad technical strategy and standards across multiple teams and product lines
  • Elevate Engineering Excellence: Act as a key driver for engineering excellence, establishing and upholding rigorous software development best practices
  • Innovate & Shape the Future: Stay at the absolute forefront of Generative AI, actively identifying strategic opportunities, exploring bleeding-edge models, techniques, and frameworks
  • Technical Thought Leadership: Act as a go-to technical expert, providing deep technical leadership, guidance, and mentorship across the organization
  • Overcome Ambiguity & Deliver: Thrive in an agile, fast-paced environment, taking ownership of highly ambiguous and complex problems
  • Lead Responsible AI Implementation: Architect and champion the implementation of robust guardrails, ethical considerations, and responsible AI governance into all solutions

Requirements

  • 10+ years of progressive professional software engineering experience, with a significant portion dedicated to designing, building, and delivering highly scalable and impactful enterprise-grade solutions in commercial production environments, tackling complex, ambiguous challenges
  • Mastery in Python is non-negotiable, with a profound understanding of its ecosystem for advanced AI/ML development, complex data engineering, and robust backend services
  • Expert-level, hands-on experience with Generative AI concepts, Large Language Models (LLMs), transformer architectures, RAG, and advanced agentic frameworks (e.g., LangChain, LangGraph, Google ADK, Optionally AutoGen, CrewAI, LlamaIndex, Semantic Kernel)
  • Deep and strategic expertise with containerization and orchestration technologies, specifically OpenShift, including leading deployment strategies and troubleshooting complex production issues
  • Demonstrated ability to architect, lead development, and deploy highly performant, large-scale AI/ML systems, defining their long-term technical strategy and ensuring operational excellence
  • Exceptional understanding of modern software development principles, clean code practices, distributed systems, advanced data structures, and algorithms, with the ability to apply them to novel problems
  • Proficiency with Relational (preferably, PostgreSQL) and Vector (preferably, pgvector) databases
  • Bachelor’s degree in Computer Science, Information Technology or Engineering is required
  • a Master's degree is preferred

Nice to have

  • Proficiency in additional programming languages such as Java, JavaScript/TypeScript, or Golang, especially in polyglot microservices architectures
  • Experience with specific frameworks like Spring (AI, Boot), N8N, or Flask, contributing to their core development or strategic usage
  • Familiarity with messaging and integration platforms such as Kafka or JMS/MQ, including architectural patterns for high-throughput, fault-tolerant systems
  • Experience leading UI development with modern frameworks like React JS or StreamLit for complex, interactive AI applications
  • Practical experience in model risk management, defining and implementing enterprise-wide AI guardrails, and establishing end-user adoption pathways for Generative AI solutions
  • A proven track record of contributing to open-source projects, presenting at industry conferences, or publishing relevant research/whitepapers in AI/ML

What we offer

  • Define the Future & Impact at Scale: Lead critical, high-visibility projects that are transforming a global enterprise
  • Pioneer Cutting-Edge Technology: Drive the adoption and implementation of the latest Generative AI models, advanced agentic frameworks, and cloud-native technologies, amplified by state-of-the-art AI-assisted development tools like Devin and Copilot
  • Exceptional Growth & Technical Leadership: A culture of continuous learning, technical thought leadership, and opportunities to drive significant technical innovation
  • Benefit from extensive learning resources including Udemy for Business and Pluralsight
  • Highly Collaborative & Influential Environment: Join a highly skilled, passionate team where your technical expertise and strategic vision will be highly valued
  • Flexible Work Environment: Embrace a hybrid working model, balancing productive in-office collaboration (3 days) with the flexibility of working from home (up to 2 days)
  • Global Scale & Challenge: Tackle the most complex problems at a massive global scale
Citi - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principal Generative AI Engineer

8 matching positions

Principal Research Engineer - Generative AI - AI Frontiers

The AI Frontiers lab at Microsoft Research is charted with ambitious research go...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelors in Computer Science or relevant field AND 6+ years related experience
  • OR Master's Degree in Computer Science or related field AND 4+ years related experience
  • OR Doctorate in Computer Science or related field AND 3+ years related experience
  • OR equivalent experience
  • 1+ year(s) experience developing with Python and Pytorch/JAX
  • Familiarity with architecture and optimizations for large language models
  • Hands-on work in debugging and profiling Pytorch distributed code
  • Basic understanding of working of CUDA kernels
  • Familiarity with pre-training, mid-training and/or post-training pipelines for language and/or multimodal models
  • Foundational understanding of reinforcement learning and key challenges in the field
Job Responsibility
Job Responsibility
  • Design, develop, execute, and implement technology research projects in collaboration with other researchers, engineers, and product groups
  • Be a part of research breakthroughs in the field and play a crucial role in developing, improving, and exploring the capabilities of Large Language Models (LLMs), reasoning and agentic AI
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Principal Ai Engineer - Enterprise Ai Solutions

Our Mission: At Palo Alto Networks®, we’re united by a shared mission—to protect...
Location
Location
United States , Santa Clara
Salary
Salary:
185200.00 - 299475.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in a related field or equivalent military experience required
  • 12+ years of related experience, or a Master's degree with 8 years of experience, or a PhD with 5 years of experience
  • Proven expertise in designing and building complex, enterprise-grade AI/ML platforms and applications
  • Direct hands-on experience with Generative AI technologies, including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and agentic AI systems
  • Strong programming skills in languages such as Python, Java, or Go and proficiency in modern AI/ML frameworks (e.g., TensorFlow, PyTorch)
  • Extensive hands-on experience with distributed systems architecture, streaming data platforms, and cloud AI/ML platforms (e.g., GCP Vertex AI, AWS SageMaker)
Job Responsibility
Job Responsibility
  • Lead the applied AI solution design and architecture, breaking down ambiguous business problems into concrete, actionable AI solution designs
  • Drive the hands-on development and implementation of key AI components, supporting both traditional and Generative AI model development and deployment
  • Contribute significantly to the detailed design of large-scale, distributed AI/ML systems, ensuring performance, reliability, and security
  • Proactively collaborate with executive leadership, data science, engineering, and product stakeholders to translate business use-cases into scalable AI solutions
  • Provide technical leadership and mentorship to other AI/ML engineers, fostering a culture of engineering excellence and hands-on experimentation
  • Lead the implementation and continuous improvement of MLOps pipelines, including automated model training, versioning, deployment, and monitoring
  • Champion and enforce design standards, patterns, and best practices for scalable and secure development of AI applications across various teams
  • Actively research and evaluate cutting-edge AI/ML techniques, algorithms, and models to identify opportunities for platform enhancement and new solution development
What we offer
What we offer
  • Restricted stock units
  • Bonus
  • Fulltime
Read More
Arrow Right

Principal AI Engineer

We are seeking a highly accomplished Principal AI Engineer to define and drive t...
Location
Location
Ireland , Dublin 18
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Demonstrated experience designing and building AI/ML systems in production at scale, ideally across multiple problem domains
  • Expert-level proficiency in Python and deep experience with modern AI frameworks such as PyTorch and TensorFlow
  • Strong experience with cloud-native architectures and AI infrastructure on platforms such as AWS, Azure, or GCP
  • Deep understanding of machine learning, deep learning, NLP, generative AI, and transformer-based architectures (e.g., BERT, GPT-style models, ViTs)
  • Proven expertise in MLOps, including model versioning, deployment strategies, monitoring, evaluation, and lifecycle management
  • Strong systems-thinking mindset, with experience designing resilient, scalable, and cost-efficient AI services
  • Experience working with large-scale data architectures, streaming and batch processing, and model inference optimization
  • Excellent communication skills with the ability to explain complex technical concepts to both technical and non-technical stakeholders
  • Track record of technical mentorship and influence without relying on formal line management
  • Comfortable operating in high-ambiguity environments and making sound technical judgments with incomplete information
Job Responsibility
Job Responsibility
  • Define and drive the technical direction of our AI platforms and solutions
  • Architect, build, and scale production-grade AI systems that deliver durable business impact
  • Lead through deep hands-on expertise, influence technical strategy across teams, and raise the engineering bar for AI development across the organization
  • Design, implement, and operate advanced AI systems that support critical business and client needs in a scalable, secure, and reliable manner
  • Partner closely with product, engineering, and data leaders to translate business intent into robust AI architectures and platforms
  • Fulltime
Read More
Arrow Right

Principal AI Engineer

Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience: Extensive experience in designing and building AI/ML solutions, with a significant focus on generative AI and Large Language Models (LLMs)
  • Gen AI Expertise: Deep understanding of modern AI architectures and techniques, including Retrieval-Augmented Generation (RAG), fine-tuning, function calling, and AI agentic workflows
  • Programming Proficiency: Expert-level skills in Python and extensive experience with core AI/ML libraries such as PyTorch, TensorFlow
  • System Design: Proven ability to architect and develop large-scale, distributed, multi-tier applications. Strong knowledge of microservices, API design, and system integration
  • MLOps: Solid understanding of MLOps principles and experience with tools for model versioning, deployment, monitoring, and lifecycle management
  • Leadership: Demonstrated experience serving as a technical lead, architect, or principal engineer, with a track record of mentoring team members and driving projects to completion
Job Responsibility
Job Responsibility
  • Architectural Leadership: Design and architect end-to-end generative AI solutions, from proof-of-concept to production, ensuring scalability, performance, and reliability
  • Technical Strategy: Develop and maintain a comprehensive strategic roadmap for generative AI adoption, evaluating new models, techniques, and platforms to keep our capabilities at the forefront of the industry
  • Solution Development: Lead the hands-on development of complex AI systems, including Retrieval-Augmented Generation (RAG) pipelines, autonomous AI agents, fine-tuning workflows, and custom model integrations
  • Best Practices & Standards: Establish and govern best practices for the full AI development lifecycle, including prompt engineering, model evaluation, MLOps, and data management
  • Cross-Functional Partnership: Collaborate closely with multiple management teams and business units to identify high-impact use cases and ensure the successful integration of AI solutions to meet business goals
  • Mentorship & Guidance: Serve as a senior advisor and coach to other engineers and analysts, fostering a culture of innovation and technical excellence. Allocate work and provide technical direction to the team
  • Risk & Compliance: Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding its clients and assets. Drive compliance with all applicable laws, rules, and regulations, particularly those related to AI ethics, data privacy, and model bias
  • Innovation and Research: Stay abreast of the latest advancements in generative AI research, and translate state-of-the-art developments into practical, innovative solutions
  • Fulltime
Read More
Arrow Right

Lead Generative AI Engineer Manager

We are seeking a highly skilled Lead GenAI Engineer Manager to join the Citi Inn...
Location
Location
Canada , Mississauga
Salary
Salary:
145100.00 - 217700.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years' experience in the software industry, with proven success in a senior position such as Principal Engineer or Architect
  • 3+ years' experience serving as a people manager
  • Highly experienced in delivering complex technical solutions to production, preferably within the Python and AI/ML ecosystem
  • Proficiency in programming languages such as Python
  • Passion for and proven hands-on experience integrating with AI/ML technologies
  • Experience with cloud architectures and public cloud offerings
  • A strong and diverse technical background, with the ability to quickly learn new technologies and influence highly skilled engineering teams
  • Excellent communication, leadership, and organizational abilities
  • Excellent analytical and problem-solving skills with the ability to think strategically
  • Experience in the financial industry is a major advantage
Job Responsibility
Job Responsibility
  • Lead the end-to-end development of highly complex AI solutions, infrastructure, and architecture
  • Lead and guide a team of engineers and data scientists, reviewing designs and code to uphold the highest levels of engineering standards
  • Translate ambiguous product or business problems into clear technical direction, defining success metrics for engineering and data science teams
  • Design robust model architectures, retrieval strategies, prompting/orchestration layers, and evaluation frameworks that meet product, reliability, and scalability requirements
  • Engage with data-science, technical, and business stakeholders to define and architect solutions for key use-cases across our lines of business
  • Actively contribute to software development, both as a hands-on coder and as a reviewer
  • Build and maintain core Python-based Generative AI components, including RAG pipelines, model wrappers, orchestration logic, and data loaders using FastAPI, ADK, and internal libraries
  • Ensure robust error handling, observability, and test coverage across all codebases
  • Manage executive stakeholder relationships in technology, acting as a partner and trusted advisor
  • Manage multiple concurrent initiatives and projects of varying sizes and complexity
  • Fulltime
Read More
Arrow Right

Principal Generative AI Scientist

We are hiring a Data Scientist Specialist! Role: Data Scientist Specialist (Prin...
Location
Location
United States , McLean
Salary
Salary:
80.00 - 95.73 USD / Hour
apexsystems.com Logo
Apex Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD in AI, Data Science, or a closely related field (required)
  • 10+ years of AI/ML experience, including 3+ years in applied Generative AI or LLM-based solutions
  • Strong experience with AWS cloud-native AI development, including SageMaker, Bedrock, and MLflow on EKS
  • Deep hands-on expertise with GenAI system design, RAG, agents, prompt engineering, and vector databases
  • Advanced Python skills with extensive use of Jupyter notebooks
  • Experience with Transformers, LangChain, or similar GenAI frameworks
  • Strong understanding of GenAI architectural patterns and best practices
  • GitHub repository link required demonstrating hands-on technical work
Job Responsibility
Job Responsibility
  • Architect and implement AI agents, agentic workflows, and full-scale GenAI applications
  • Develop, fine-tune, and evaluate LLMs, including Claude, Azure OpenAI models, and open-source alternatives
  • Design and deploy Retrieval-Augmented Generation (RAG) and Graph RAG solutions using vector databases and knowledge bases
  • Implement Model Context Protocol (MCP) and Agent-to-Agent (A2A) communication patterns
  • Build and maintain Jupyter-based workflows using SageMaker, MLflow, Kubeflow, and Kubernetes (EKS)
  • Collaborate with UI, microservices, product, and data engineering teams to deliver end-to-end GenAI experiences
  • Integrate GenAI services via API-driven enterprise integration patterns
  • Establish evaluation frameworks, safety guardrails, bias mitigation, and validation processes for production deployment
  • Design and own data ingestion pipelines (extracting, chunking, enriching, anonymizing, and embedding data)
  • Orchestrate multimodal ETL/ELT pipelines and scalable ingestion workflows
What we offer
What we offer
  • Medical
  • dental
  • vision
  • life
  • disability
  • other insurance plans
  • ESPP (employee stock purchase program)
  • 401K program
  • HSA (Health Savings Account on the HDHP plan)
  • SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions
  • Fulltime
Read More
Arrow Right

Principal AI Engineer

Lead the evolution of T-Mobile’s Agentic Next Best Action (ANBA) capabilities—po...
Location
Location
United States , Overland Park; Frisco; Bellevue
Salary
Salary:
150700.00 - 271900.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep expertise in LLM fine-tuning and prompt engineering (e.g., OpenAI APIs, Hugging Face, Anthropic Claude, Google Gemini)
  • Strong experience with AI orchestration tools (e.g., LangChain, LlamaIndex, vector databases for retrieval augmentation)
  • Hands-on knowledge of function calling and API-based reasoning models (e.g., using structured outputs to drive automated workflows)
  • Proficiency in Python and AI development frameworks for building scalable AI applications
  • Understanding of multi-agent architectures and best practices in agentic AI design
  • Experience with real-world AI evaluation techniques, including golden sets, synthetic data generation, and interactive testing
  • Ability to collaborate across teams, working with engineers, product managers, and conversational designers to refine AI-driven solutions
  • Bachelor's degree in Computer Science, Artificial Intelligence, or equivalent
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • Architects agentic AI systems that accomplish sophisticated tasks by invoking AI models as well as internal and third-party tools using APIs, ensuring flawless data flow in production environments
  • Optimizes performance of agentic AI systems through prompt engineering, fine-tuning and reinforcement learning using T-Mobile’s customer interaction data
  • Develops and maintains supporting software components and scripts to enable AI model deployment, testing, evaluation and monitoring
  • Implement retrieval-augmented generation (RAG) techniques to ensure AI responses are contextually accurate and grounded in real-time data
  • Stay at the forefront of LLM advancements, incorporating the latest techniques in prompt design, few-shot learning, Tool integration protocols like MCP and AI orchestration frameworks like Agent SDK
  • Collaborates with backend engineers, business experts and conversation designers ensuring AI-driven enhancements are optimally integrated into production environments
  • Defining success metrics that aligns with business requirements and continuously evaluate and improve model quality based on those metrics
  • Participates in other duties or projects as assigned by business management as needed
What we offer
What we offer
  • Annual stock grant
  • Employee stock purchase plan
  • 401(k)
  • Access to free, year-round money coaches
  • Medical, dental and vision insurance
  • Flexible spending account
  • Paid time off and up to 12 paid holidays
  • Paid parental and family leave
  • Family building benefits
  • Back-up care
  • Fulltime
Read More
Arrow Right

Principal Engineer - AI Platform Development (Azure PostgreSQL)

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
Spain , Barcelona
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND extensive technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Lead the design and development of AI Store capabilities in Azure PostgreSQL, including vector search, semantic indexing, and AI-optimized database features to power the next generation of intelligent applications
  • Architect intuitive, scalable APIs, SDKs, and extensibility layers that bring advanced database and AI capabilities into the hands of developers
  • Create seamless developer experiences by integrating PostgreSQL services with modern development tools, frameworks, and cloud platforms accelerating application development on Azure PostgreSQL
  • Partner closely with database engine engineers, product managers, and developer advocates to translate developer needs into deep system and platform innovations
  • Design and deliver high-quality interfaces, SDKs, samples, and documentation that make building AI-powered applications on PostgreSQL accessible, powerful, and joyful
  • Engage with open-source communities, technology partners, and developer ecosystems to amplify impact, gather feedback, and inform platform evolution
  • Champion a developer-first mindset while advancing technical excellence, scalability, and innovation across the stack from database internals to developer workflows
  • Fulltime
Read More
Arrow Right