CrawlJobs Logo
Boston Consulting Group Logo Boston Consulting Group · IT - Software Development

AI Architect

Germany, Cologne · Job Posted March 25, 2026
Apply Position
Job Link Share

Job Description

The AI Architect at BCG Platinion is responsible for designing and implementing advanced AI-driven architectures for enterprise clients. The role involves developing AI-based software factories, delivery pipelines, and intelligent systems, as well as establishing secure engineering environments and governance mechanisms.

Job Responsibility

  • Design AI-driven target architectures and conceptualize AI-based software factories
  • Develop AI-powered delivery pipelines that translate development processes, engineering standards, and architectural guidelines into machine-executable workflows
  • Establish trusted AI engineering environments by designing governance mechanisms with multi-layered validation, clear identity boundaries, and end-to-end traceability
  • Implement evaluation and security mechanisms such as automated testing and evaluation pipelines, architecture compliance checks, and red-teaming approaches for AI-generated systems
  • Translate enterprise knowledge into machine-readable structures—such as architecture decisions, domain models, APIs, and business rules—to enable autonomous development
  • Turn business intent into scalable architectures, embed AI sustainably into existing system landscapes and operating models, and translate vision into measurable business impact

Requirements

  • Degree in Computer Science, Information Systems, AI Engineering, or a related field
  • Strong understanding of legacy systems, enterprise solutions, and current market trends (e.g., agentic AI, LLM orchestration, AI-native architectures)
  • Hands-on experience with AI systems, such as LLM-based applications, AI agents, or machine learning platforms
  • Familiarity with modern software delivery approaches, including DevSecOps, CI/CD pipelines, automated testing, and platform engineering
  • Familiarity with concepts like agent assembly lines, execution harnesses, or context engineering
  • Ability to translate complex business requirements into technical architectures and communicate effectively with both technical and non-technical stakeholders
  • Ability to thrive in interdisciplinary teams and global environments
  • Flexibility and willingness to travel as needed
  • Fluency in both German and English

What we offer

  • Constant new development incentives in an open and rewarding work environment
  • Individual training offers and a culture of open feedback
  • Modern structures enabling you to stay focused
  • Easy travel booking
  • Excellent back-office support
  • Comprehensive Knowledge Center
  • Regular office Fridays and legendary events
  • Strong and close team network
Boston Consulting Group - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

AI Architect

8 matching positions

Ai Architect

We are looking for an experienced AI Architect to shape and deliver enterprise A...
Location
Location
United States , Coppell
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of experience in architecture, AI solution design, or enterprise technology leadership roles
  • Demonstrated knowledge of enterprise architecture principles, API development, and microservices design
  • Hands-on experience with leading AI platforms and tools such as OpenAI, Gemini, GitHub Copilot, and LangChain
  • Practical understanding of retrieval-augmented generation, prompt design, and modern knowledge-based AI solution patterns
  • Ability to design secure, scalable, and production-ready AI systems that integrate with business applications and data platforms
  • Experience collaborating with technical and business stakeholders to translate operational needs into effective technology solutions
  • Strong communication and leadership skills with the ability to influence direction across cross-functional teams
Job Responsibility
Job Responsibility
  • Develop enterprise-wide AI architecture standards, reference models, and implementation guidelines to support consistent solution delivery across business functions
  • Design and deploy scalable platforms for generative AI, agent-based systems, machine learning, and analytics that can operate effectively in a global environment
  • Establish governance practices covering model oversight, responsible AI usage, security controls, compliance expectations, and lifecycle management
  • Partner with senior stakeholders to identify high-impact opportunities where AI can improve operational performance, decision-making, and business outcomes
  • Lead the architecture and rollout of AI-enabled assistants, knowledge tools, and automated workflows integrated with core enterprise applications and internal data sources
  • Create robust API, microservices, and orchestration patterns that enable reliable integration of AI services with business platforms and custom solutions
  • Build and refine retrieval-augmented generation solutions, vector-based search capabilities, prompt frameworks, and enterprise knowledge access models
  • Work with data engineering and platform teams to implement scalable AI pipelines, MLOps and LLMOps practices, monitoring, and cloud-based deployment patterns across major cloud environments
  • Evaluate emerging vendors, tools, and proof-of-concept solutions while guiding technical teams through architecture decisions, implementation challenges, and best practices
  • Fulltime
Read More
Arrow Right

Ai Architect

We are currently seeking a AI Architect to join our team in Chennai, Tamil Nādu ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 13+ years overall IT experience with 5+ years as an AI/ML architect
  • Strong foundation in data science, ML model lifecycle, and MLOps
  • Proven expertise in GenAI / LLM / Agentic architecture design
  • Good understanding of data engineering pipelines
  • Hands-on architecture experience with at least one of the major Hyperscalers such as Azure, GCP, AWS
  • Proven track record in RFPs, proposals, and estimation for AI programs
  • Excellent stakeholder management, communication, and leadership abilities
Job Responsibility
Job Responsibility
  • Architect and deliver GenAI, LLM, and agentic AI solutions
  • Excellent understanding of Agentic Frameworks, MLOps, LLMOps
  • Design enterprise-level scalable AI-ready architectures
  • Lead proposals, estimations, and RFP/RFI responses
  • Partner with clients as a trusted AI advisor for transformation roadmaps
  • Exposure to data engineering pipelines
  • Build reference architectures and reusable GenAI frameworks
Read More
Arrow Right

AI Architect

Location
Location
India , Pune
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 13+ years IT experience
  • 5+ years in AI/ML/GenAI architecture
  • Strong data science, MLOps, and solutioning background
  • Deep expertise with Azure (priority), GCP, AWS
  • Proven client-facing skills: RFPs, proposals, and stakeholder management
  • Certifications in Azure AI / GCP ML / AWS ML (preferred)
  • Experience: 13+ years overall IT experience with 5+ years as an AI/ML architect
  • Strong foundation in data science, ML model lifecycle, and MLOps
  • Proven expertise in GenAI / LLM / Agentic architecture design
  • Good understanding of data engineering pipelines
Job Responsibility
Job Responsibility
  • Architect and deliver GenAI, LLM, and agentic AI solutions
  • Excellent understanding of Agentic Frameworks, MLOps, LLMOps
  • Design enterprise-level scalable AI-ready architectures
  • Lead proposals, estimations, and RFP/RFI responses
  • Partner with clients as a trusted AI advisor for transformation roadmaps
  • Exposure to data engineering pipelines
  • Build reference architectures and reusable GenAI frameworks
Read More
Arrow Right

Ai Architect

We are currently seeking a AI Architect to join our team in Pune, Mahārāshtra (I...
Location
Location
India , Pune
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 13+ years IT experience
  • 5+ years in AI/ML/GenAI architecture
  • Strong data science, MLOps, and solutioning background
  • Deep expertise with Azure (priority), GCP, AWS
  • Proven client-facing skills: RFPs, proposals, and stakeholder management
  • Certifications in Azure AI / GCP ML / AWS ML (preferred)
  • Experience: 13+ years overall IT experience with 5+ years as an AI/ML architect
  • Strong foundation in data science, ML model lifecycle, and MLOps
  • Proven expertise in GenAI / LLM / Agentic architecture design
  • Good understanding of data engineering pipelines
Job Responsibility
Job Responsibility
  • Architect and deliver GenAI, LLM, and agentic AI solutions
  • Excellent understanding of Agentic Frameworks, MLOps, LLMOps
  • Design enterprise-level scalable AI-ready architectures
  • Lead proposals, estimations, and RFP/RFI responses
  • Partner with clients as a trusted AI advisor for transformation roadmaps
  • Exposure to data engineering pipelines
  • Build reference architectures and reusable GenAI frameworks
Read More
Arrow Right

Ai Architect

We are currently seeking a AI Architect to join our team in Pune, Mahārāshtra (I...
Location
Location
India , Pune
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 13+ years IT experience
  • 5+ years in AI/ML/GenAI architecture
  • Strong data science, MLOps, and solutioning background
  • Deep expertise with Azure (priority), GCP, AWS
  • Proven client-facing skills: RFPs, proposals, and stakeholder management
  • Certifications in Azure AI / GCP ML / AWS ML (preferred)
  • Good understanding of data engineering pipelines
  • Excellent stakeholder management, communication, and leadership abilities
Job Responsibility
Job Responsibility
  • Architect and deliver GenAI, LLM, and agentic AI solutions
  • Excellent understanding of Agentic Frameworks, MLOps, LLMOps
  • Design enterprise-level scalable AI-ready architectures
  • Lead proposals, estimations, and RFP/RFI responses
  • Partner with clients as a trusted AI advisor for transformation roadmaps
  • Exposure to data engineering pipelines
  • Build reference architectures and reusable GenAI frameworks
  • Fulltime
Read More
Arrow Right

Ai Architect

Our client is seeking an AI Architect to lead the design and implementation of e...
Location
Location
United States , Atlanta
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in software engineering, data architecture, or AI-related roles
  • Deep understanding of AI/ML, LLMs, and enterprise data platforms
  • Experience designing cloud-native architectures on AWS, Azure, or GCP
  • Strong background in system integration, APIs, and scalable distributed systems
  • Experience leading enterprise technology initiatives
  • Excellent communication and stakeholder management skills
Job Responsibility
Job Responsibility
  • Define enterprise AI architecture, frameworks, and governance standards
  • Lead the design of scalable AI, machine learning, and generative AI platforms
  • Evaluate AI technologies, tools, and vendors
  • Partner with business and technology leaders to identify strategic AI opportunities
  • Establish security, compliance, and responsible AI practices
  • Mentor engineering teams and provide technical leadership
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Ai Architect

We are currently seeking a AI Architect to join our team in Pune, Mahārāshtra (I...
Location
Location
India , Pune
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 13+ years overall IT experience with 5+ years as an AI/ML architect
  • Strong foundation in data science, ML model lifecycle, and MLOps
  • Proven expertise in GenAI / LLM / Agentic architecture design
  • Good understanding of data engineering pipelines
  • Hands-on architecture experience with at least one of the major Hyperscalers such as Azure, GCP, AWS
  • Experience of working on Databricks, Snowflake, Palantir etc. is added advantage
  • Proven track record in RFPs, proposals, and estimation for AI programs
  • Excellent stakeholder management, communication, and leadership abilities
Job Responsibility
Job Responsibility
  • Architect and deliver GenAI, LLM, and agentic AI solutions
  • Excellent understanding of Agentic Frameworks, MLOps, LLMOps
  • Design enterprise-level scalable AI-ready architectures
  • Lead proposals, estimations, and RFP/RFI responses
  • Partner with clients as a trusted AI advisor for transformation roadmaps
  • Exposure to data engineering pipelines
  • Build reference architectures and reusable GenAI frameworks
  • Fulltime
Read More
Arrow Right

Ai Architect

We are looking for an experienced AI Architect to shape and deliver enterprise A...
Location
Location
United States , Coppell
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of experience in architecture, AI solution design, or enterprise technology leadership roles
  • Demonstrated knowledge of enterprise architecture principles, API development, and microservices design
  • Hands-on experience with leading AI platforms and tools such as OpenAI, Gemini, GitHub Copilot, and LangChain
  • Practical understanding of retrieval-augmented generation, prompt design, and modern knowledge-based AI solution patterns
  • Ability to design secure, scalable, and production-ready AI systems that integrate with business applications and data platforms
  • Experience collaborating with technical and business stakeholders to translate operational needs into effective technology solutions
  • Strong communication and leadership skills with the ability to influence direction across cross-functional teams
Job Responsibility
Job Responsibility
  • Develop enterprise-wide AI architecture standards, reference models, and implementation guidelines to support consistent solution delivery across business functions
  • Design and deploy scalable platforms for generative AI, agent-based systems, machine learning, and analytics that can operate effectively in a global environment
  • Establish governance practices covering model oversight, responsible AI usage, security controls, compliance expectations, and lifecycle management
  • Partner with senior stakeholders to identify high-impact opportunities where AI can improve operational performance, decision-making, and business outcomes
  • Lead the architecture and rollout of AI-enabled assistants, knowledge tools, and automated workflows integrated with core enterprise applications and internal data sources
  • Create robust API, microservices, and orchestration patterns that enable reliable integration of AI services with business platforms and custom solutions
  • Build and refine retrieval-augmented generation solutions, vector-based search capabilities, prompt frameworks, and enterprise knowledge access models
  • Work with data engineering and platform teams to implement scalable AI pipelines, MLOps and LLMOps practices, monitoring, and cloud-based deployment patterns across major cloud environments
  • Evaluate emerging vendors, tools, and proof-of-concept solutions while guiding technical teams through architecture decisions, implementation challenges, and best practices
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right