AI Solution Architect Job at Andersen

Job Description

Andersen is hiring an AI Solution Architect in Germany to design and integrate scalable AI systems, supporting a major digital-transformation program and enabling modern, reliable AI-driven services. The project is part of a large European digital transformation initiative aimed at integrating advanced AI into mission-critical systems. The team focuses on building scalable AI solutions, modernizing legacy architectures, and ensuring reliable deployment to support next-generation public and private sector services.

Job Responsibility

Defining the overall architecture and technical strategy for AI/GenAI systems, ensuring scalability, robustness and alignment with organizational standards
Selecting appropriate models, frameworks, serving stacks and infrastructure components for AI workloads
Designing end-to-end RAG, vector search and agent-based AI solutions, including data flows, orchestration logic and system boundaries
Overseeing model lifecycle processes: training, fine-tuning, evaluation, deployment, monitoring and continuous improvement
Providing architectural guidance to development teams and ensuring consistent implementation across projects
Preparing architectural documentation, diagrams, guidelines and decision records
Collaborating with security, data, infrastructure and product teams to ensure compliance, reliability and performance
Evaluating new AI technologies, tools and frameworks and assessing their relevance for the organization's ecosystem
Reviewing complex incidents, performance issues and design flaws, providing direction for remediation and optimization
Supporting procurement and vendor evaluation for AI platforms, hosting, data systems or model providers

Requirements

Experience in software engineering for 10+ years with at least 3-4 years in AI/ML solution design
Strong expertise in designing LLM/GenAI architectures, including model selection, serving, orchestration and scaling
Practical experience with Python and modern AI frameworks (PyTorch, TensorFlow, JAX)
Deep understanding of transformer models, embeddings, vector search and RAG architectures
Experience designing agent-based systems and AI orchestration frameworks (LangGraph, LangChain, AutoGen or equivalents)
Hands-on experience with MLOps practices, model lifecycle management, versioning and monitoring
Knowledge of vector databases (FAISS, Milvus, Pinecone, Chroma) and search optimization techniques
Experience designing high-availability AI inference services using vLLM, Triton, TensorRT or similar serving technologies
Solid understanding of cloud environments for AI workloads (AWS/GCP/Azure), GPU/accelerator usage and cost optimization
Ability to translate business requirements into AI solution architectures, integration patterns and technical specifications
Experience defining security, compliance and data governance standards for AI systems
Strong communication skills for working with stakeholders, engineering teams and management
Level of English – from Upper-Intermediate and above
Level of German – from Intermediate+ and above

What we offer

Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others
The opportunity to change the project and/or develop expertise in an interesting business domain
Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant
Guarantee of professional, financial, and career growth
The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities
Access to the corporate training portal
Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies)
Certification compensation (AWS, PMP, etc)
Referral program
English courses
Private health insurance and compensation for sports activities

Andersen - All Job Offers

Select Country

AI Solution Architect

Job Description

Job Responsibility

Requirements

What we offer

Looking for more opportunities?