AI agent architecture audit

Our AI employee qualified as an “AI Architecture Auditor” reviews request paths, models, providers, RAG, tools, resilience, cost and observability. You receive a Google Doc with findings, evidence and a ranked fix plan. The specialist is available online in your panel with the Max plan or Max Specialists add-on ($35/month).

$100price
2–5 daysturnaround
C4 diagramsin the report
Order an auditWhat is included
Order

Order an audit

We reply within a business day

What we review

  • Request and data path. Input, routing, model and provider, prompt and its version, knowledge-base retrieval, tools and MCP, memory, storage, output, side effects, background jobs, fallbacks.
  • Whether an agent is needed at all. Often a simple deterministic flow with one model call solves the task: cheaper, faster and more predictable.
  • Answer quality. Is there an evaluation set, how is regression measured after prompt changes, how do pre-moderation and hand-over to a human work.
  • RAG. Chunking, embeddings, per-tenant filtering, data freshness, what happens when retrieval finds nothing.
  • Reliability. Timeouts, retries, provider cascade when limits run out, queues, what the customer sees on failure.
  • Cost. Tokens by request type, caching, model choice per task, expensive agent loops.
  • Observability and change management. Traces, metrics, owners, how a new prompt ships and how it is rolled back.
  • Security at the architecture level. Trust boundaries, tenant isolation, tool permissions per OWASP for LLM applications. Deep attack testing is a separate service, the security audit.

How it goes

  • Fact gathering. Code, configuration, traces, dashboards, incidents, tests. We record what is observed, what is only supported by code and what is an assumption.
  • Measurements. Response time, error and refusal rates, cost per conversation, quality on your examples. No invented numbers: when data is missing we say which instrument is needed to get it.
  • Diagrams. C4 context and container diagrams, components when needed, with confirmed and assumed connections marked.
  • Recommendations. For each: current state, evidence, desired state, expected effect, trade-offs, effort and an experiment that verifies the improvement. Ranked by user impact, risk and effort.

What you get

  • A report with short conclusions for the executive and a detailed part for the team.
  • Architecture diagrams in editable form.
  • A staged change plan with acceptance criteria you can hand to your team or to us.

2–5 days depending on the size of the system. Fixed price: $100.