Solution Architect - LangGraph & Agentic AI

We are looking for an experienced Solution Architect with hands-on experience designing and deploying LangGraph-based AI solutions to lead the architecture of enterprise agentic AI platforms and applications.

You will work with business and technology stakeholders to identify high-value AI opportunities and translate them into secure, scalable, and production-ready architectures.

The role combines AI architecture, enterprise integration, cloud engineering, agentic AI, security, governance, and stakeholder leadership.

You will be expected to understand LangGraph at a practical level and be able to challenge architectural decisions, guide engineering teams, and ensure that AI solutions can operate reliably at enterprise scale.

Requirements

AI Solution Architecture

Lead the architecture and design of enterprise AI agent and agentic workflow solutions.

Design LangGraph-based architectures for single-agent and multi-agent applications.

Translate business requirements, processes, SLAs, security requirements, and technical constraints into solution architectures.

Evaluate architectural alternatives and document key technical decisions and trade-offs.

Define reusable architecture patterns for agentic AI solutions.

Enterprise Agent Architecture

Design architectures incorporating:

LLMs

LangGraph

RAG

Enterprise data

APIs and business systems

Workflow engines

Human approval processes

Observability

Security and governance

Define appropriate boundaries between AI reasoning and deterministic business logic.

Design state management, persistence, recovery, and long-running agent workflows.

Determine when to use single-agent, multi-agent, or conventional application architectures.

Cloud and Platform Architecture

Design scalable AI application architectures on AWS, Azure, or GCP.

Define compute, networking, storage, API, security, and platform requirements.

Design architectures suitable for enterprise-scale production workloads.

Evaluate cloud services and AI platform capabilities based on performance, security, scalability, and cost.

Work with platform engineering and DevOps teams to establish deployment standards.

Integration Architecture

Design integration between AI agents and enterprise applications, APIs, databases, and SaaS platforms.

Define secure mechanisms for agent tool access and business-system interactions.

Design authentication, authorisation, secrets management, and access-control approaches.

Ensure AI-driven actions are traceable, auditable, and appropriately governed.

AI Security and Governance

Establish security and governance principles for enterprise AI agents.

Address risks including:

Prompt injection

Data leakage

Unauthorised tool usage

Excessive agent permissions

Inaccurate or unsafe actions

Sensitive-data exposure

Define appropriate human-in-the-loop controls.

Ensure solutions comply with organisational security, privacy, regulatory, and responsible-AI requirements.

AI Evaluation and Observability

Define architecture for AI application monitoring and observability.

Establish approaches for evaluating agent accuracy, reliability, latency, cost, and task completion.

Define appropriate logging, tracing, metrics, and alerting.

Establish operational processes for monitoring and continuously improving production agents.

Stakeholder and Technical Leadership

Work directly with senior business and technology stakeholders to define AI strategies and roadmaps.

Lead architecture workshops and technical design sessions.

Communicate complex AI concepts and architectural trade-offs to technical and non-technical audiences.

Provide technical direction to AI engineers, developers, data teams, and platform engineers.

Review solution designs and ensure alignment with enterprise architecture standards.

Mentor engineering teams and promote reusable AI architecture patterns.

Required Experience

Significant experience in solution architecture, software architecture, AI architecture, or a related role.

Hands-on experience designing and deploying LangGraph-based AI applications or agentic workflows.

Strong understanding of LLM application architectures.

Experience with enterprise AI/ML solutions in production.

Strong understanding of RAG, tool calling, agent orchestration, and human-in-the-loop patterns.

Strong experience with at least one major cloud platform: AWS, Azure, or GCP.

Strong understanding of enterprise integration patterns and APIs.

Experience with security, governance, observability, and operational requirements for production systems.

Strong technical understanding of Python and modern software engineering practices.

Desirable Experience

LangChain / LangSmith

Multi-agent architectures

Enterprise RAG platforms

Vector databases

Kubernetes

Event-driven architectures

Microservices

Infrastructure as Code

CI/CD

MLOps / LLMOps

AI security

Responsible AI

Large-scale enterprise transformation

Experience working directly with senior client stakeholders

Find Jobs in Germany on Arbeitnow