BrainBank

Enterprise AI Architecture: Beyond the Model

7/13/2026, 5:52:54 PM

#mcp#best-practices#architecture#enterprise-ai#dod-audit#agent-framework

An enterprise AI architecture must separate the frontier model from its agent harness, semantic data plane, and mission controls to ensure deterministic calculations and auditable evidence instead of relying solely on probabilistic models.

Enterprise AI Architecture: Beyond the Model

Claude Code, Ask Sage, Palantir AIP, IBM watsonx, Databricks AI, and Custom Development

Comparative architecture and implementation strategy for text-intensive, data-intensive, big-data, and DoD financial audit workloads

🟨 Deployment note: Model availability, authorization, classification, contract terms, and approved use must be validated for each environment.



Executive Summary

The central conclusion is simple: Claude is a model family; Claude Code is an agent harness; Ask Sage, Palantir, IBM, and Databricks are enterprise platforms. Their value should not be measured only by whether they offer a Claude model. The important question is which Claude Code mechanisms they adopt directly, which remain available through the real Claude Code client or Claude Agent SDK, and which are replaced by stronger enterprise-native controls.

🟦 At-a-glance recommendation
Use Ask Sage for secure text and document assistance and as a controlled route to Claude Code. Use Palantir AIP when the mission depends on an operational Ontology, governed actions, evidence relationships, and workflow. Use Databricks when the center of gravity is Spark, SQL, large-scale data engineering, machine learning, lineage, and evaluation. Use IBM where hybrid infrastructure, legacy modernization, enterprise integration, and deterministic decision services dominate. Build a custom harness only for the mission-specific layer, and keep the underlying model replaceable.

OptionPrimary identityStrongest usePrimary caution
Claude CodeRepository-centric agent harnessCoding, software engineering, custom agent patternsNot an enterprise data catalog, financial semantic layer, or audit evidence system
Ask SageSecure multi-model access and rapid RAG adoptionText-heavy analysis, drafting, policy/document research, controlled Claude Code connectivityNot the authoritative transaction, reconciliation, or lineage platform
Palantir AIPOperational semantics and governed actionOntology, permissions, cases, workflow, evidence-to-transaction relationshipsRequires disciplined Ontology and data governance; proprietary platform dependence
IBM watsonx / BobHybrid enterprise orchestration and modernizationMainframe/legacy code, business rules, integrations, regulated enterprise workflowBroader and more complex stack; Claude-native artifacts are not the organizing standard
Databricks AILarge-scale data and AI operationsSpark/SQL, pipelines, ML, semantic analytics, lineage, tracing and evaluationLess naturally oriented to object-centric case/action workflows than Palantir
Custom solutionMission-specific control and portabilityUnique workflows, model routing, specialized tools, evaluations and user experienceHighest engineering, security, operations and lifecycle burden

For DoD audit, the best outcome is a layered architecture rather than a single product: a trusted financial data and evidence plane; deterministic reconciliation and control logic; governed MCP or API tools; a constrained, replaceable model layer; human review; and an immutable record of every query, source, calculation, tool call, approval, and change.


1. The Core Comparison: Model, Harness, Platform, and Mission Control

Many enterprise AI comparisons collapse four different layers into one. This produces misleading conclusions such as "Platform X uses Claude, therefore it has Claude Code," or "Platform Y does not have CLAUDE.md, therefore it lacks persistent enterprise context." The layers solve different problems and should be evaluated separately.

Rendering diagram…

Figure 1. Four-layer enterprise AI architecture.

LayerExamplesPurposeKey implication
Frontier modelClaude and other LLMsReasoning, language, coding, classification and tool selectionAccuracy remains probabilistic; the model should not become the system of record
Agent harnessClaude Code, Agent SDK, AIP Logic, Orchestrate, Databricks Agent Framework, Deep AgentContext assembly, planning loop, tools, state, permissions, retries, budgets and evaluationHarness quality determines whether a capable model becomes a reliable system
Data and semantic planeOntology, Unity Catalog, SQL/Spark, watsonx.data, RAG datasetsAuthoritative data, metadata, business meaning, retrieval, lineage and computationPoor data cannot be repaired by a stronger model
Mission control and evidenceIAM, markings, actions, workflow, approvals, logs, case/evidence repositoryAuthorization, segregation of duties, reproducibility and accountabilityEssential for audit, financial management and consequential actions

🟥 Architecture rule
Do not put authoritative business logic, financial calculations, evidence provenance, access control, or approval authority inside a system prompt. Keep them in governed services that the agent can call but cannot redefine.


2. Claude Code as the Reference Agent Harness

Claude Code is an agentic coding system that reads a repository, edits files, runs commands, connects to external tools, and integrates with development environments. Its importance to enterprise architecture is not limited to coding. It provides a clear reference design for context, reusable procedures, deterministic controls, tool connectivity, specialized agents, and extension packaging. [1]

PrimitiveFunctionEnterprise valueLimitation
CLAUDE.md and rulesPersistent project, user, or organization instructions loaded into session contextArchitecture conventions, build/test commands, security rules and review checklistsContext, not guaranteed enforcement; use hooks or platform policy for hard controls
Auto memoryAgent-written notes that persist useful discoveries across sessionsBuild commands, debugging insights and recurring preferencesMust be auditable and bounded; not an authoritative knowledge base
SkillsReusable SKILL.md packages with instructions, scripts and supporting resourcesRepeatable workflows such as code review, reconciliation analysis, document review or deploymentStrong pattern for modular capability, but procedures still require testing and governance
MCPOpen protocol connecting agents to tools, data and external servicesDatabases, APIs, tickets, documents, enterprise applications and custom functionsMCP standardizes connection; it does not guarantee authorization, data quality or safe tool design
HooksDeterministic lifecycle controls before or after agent actionsBlock dangerous commands, require tests, log activity or validate changesCritical for enforcing rules that must not depend on model judgment
Custom agents and agent teamsSpecialized workers with isolated context and controlled toolsParallel analysis, code review, testing, research and domain specialistsRaises orchestration, cost, state-management and evaluation complexity
PluginsDistribution package for skills, agents, hooks, MCP, LSP and settingsReusable organizational extension bundlesA software-engineering extension model, not an enterprise data governance model
Permissions and sandboxingControls over tools, files, commands and execution environmentLimit agent blast radius and require approvalLocal coding permissions differ from enterprise data permissions and segregation of duties
LSP and IDE integrationLanguage-server diagnostics and editor contextTyped code intelligence, errors, symbols and navigationHighly valuable for software development; lower priority for financial audit analytics
Claude Agent SDKProgrammable access to Claude Code tools and agent capabilitiesCustom applications and agent workflows with controlled orchestration and permissionsBest route for adopting Claude Code patterns outside a coding interface

Claude Code does not natively replace a distributed query engine, financial semantic model, enterprise knowledge graph, record-level lineage system, case-management platform, or audit evidence repository. Those capabilities must come from the surrounding enterprise platform or custom architecture.


3. How Commercial Platforms Adopt or Replace Claude Code Capabilities

There are four materially different forms of Claude adoption. An accurate comparison must identify which form applies to each platform and use case.

Adoption modeDefinitionArchitectural implicationExamples
1. Model accessThe platform exposes Claude as one of its available modelsThe enterprise uses Claude reasoning but retains the platform's proprietary harnessIBM select-product integration; Databricks model endpoints; Palantir model services; Ask Sage routing
2. Claude Code client compatibilityThe real Claude Code CLI or IDE connects to the platform endpoint or MCP serverCLAUDE.md, Skills, hooks, plugins, subagents and LSP remain Claude Code client capabilitiesAsk Sage explicitly supports Claude Code; Palantir documents Claude Code IDE usage and MCP connection
3. Claude Agent SDK hostingA custom agent uses Anthropic's programmable harness inside the enterprise platformDeeper adoption of Claude planning, tools and orchestration while using enterprise data and controlsPalantir provides explicit Claude Agent SDK templates; other platforms can support custom Python frameworks with varying levels of native integration
4. Proprietary functional replacementThe platform supplies its own context, agents, policy, data semantics, workflow and evaluationClaude Code artifacts are not portable, but enterprise controls may be stronger for operational workPalantir Ontology/AIP, IBM Orchestrate/Bob, Databricks Unity Catalog/MLflow, Ask Sage datasets/personas/Deep Agent

🟪 Important distinction
When Claude Code is connected through Ask Sage or to Palantir MCP, it is incorrect to say that CLAUDE.md, Skills, hooks, plugins, subagents, permissions, or LSP are absent. They remain available in the Claude Code client. The better question is whether the enterprise platform natively understands, governs, distributes, and audits those artifacts.


4. Ask Sage

4.1 Extent of Claude adoption

Ask Sage has the most direct verified compatibility with the actual Claude Code user experience. Its Anthropic-compatible endpoint is documented as working with the Claude Code CLI and VS Code extension. This lets the Claude Code client continue to provide its own project instructions, skills, hooks, plugins, subagents, permissions and IDE integration while Ask Sage supplies the controlled endpoint, authentication, model routing and government-oriented deployment environment. [4]

Ask Sage also provides its own datasets, personas, prompt library, plugins, web search, Deep Agent and MCP capabilities. Deep Agent performs iterative research across the web and private RAG datasets. These are useful platform-native capabilities, but they are not necessarily format-compatible with Anthropic Skills, Claude plugins or CLAUDE.md. [5]

CategoryAssessment
Directly adoptedAnthropic-style API format; Claude Code client compatibility; MCP; access to Claude models through approved backends
Client-providedCLAUDE.md, auto memory, Skills, hooks, plugins, subagents, permission modes and LSP when the actual Claude Code client is used
Platform-native analogsDatasets and RAG, personas, prompt library, platform plugins, Deep Agent, Agent Builder and administrative controls
Not the primary strengthDistributed SQL/Spark, enterprise financial semantic modeling, object/action Ontology, record-level transaction lineage and large-scale reconciliation

4.2 Strong suite

  • Secure access to multiple commercial models through a common interface.

  • Rapid text-heavy and document-heavy deployments without building a complete model gateway and RAG application from scratch.

  • Controlled Claude Code use for development teams where Ask Sage is an approved endpoint.

  • Government-oriented deployment options and user-friendly configuration for non-developer analysts.

  • Fast prototyping of policy research, report analysis, drafting, summarization and knowledge assistance.

4.3 Appropriate role in a DoD architecture

Ask Sage is best positioned as a secure interaction and model-access layer. It can support document research, NFR and CAP drafting, policy synthesis, auditor-request response, developer assistance and rapid mission prototypes. It should not be the authoritative source for balances, transactions, reconciliation results, data lineage or audit evidence. Those must come from a governed financial data and evidence platform.


5. Palantir AIP

5.1 Extent of Claude adoption

Palantir demonstrates the deepest verified integration with Anthropic's programmable agent layer among the reviewed commercial platforms. Palantir documents Claude Code as an IDE integration, provides Palantir MCP and Ontology MCP, and offers explicit agent templates for the Claude Agent SDK with simplified configuration for Ontology MCP, Palantir MCP and the Ontology SDK. [6][7]

This does not make Palantir a reimplementation of Claude Code. Palantir's strategic differentiation is the enterprise platform surrounding the agent: Ontology, object and action security, user permission propagation, operational applications, workflow, cases, branching, lineage and observability.

CapabilityRoleWhy it matters
Palantir MCPDevelopment-oriented MCP for data integration, Ontology configuration and application development within FoundryConnect Claude Code and other AI IDEs/agents to platform-building capabilities
Ontology MCPExposes object types, action types and query functions as governed MCP toolsLets external agents read objects, execute predefined actions and query data under application restrictions
Claude Agent SDK templatesNative starting templates integrated with Ontology MCP, Palantir MCP and OSDKAllows Anthropic harness patterns to run close to Palantir data and operational controls
AI FDEPalantir-native AI development environment whose operations respect the user's existing permissionsProvides proprietary enterprise context, capabilities, governance and platform-building workflow
AIP observability and execution historyMetrics, traces, logs and workflow historySupports operational monitoring and investigation beyond a local agent transcript

5.2 What Palantir replaces rather than adopts

  • CLAUDE.md is replaced at the platform level by governed application context, Ontology definitions, repository context, system instructions and platform policies. The Claude Code file still exists when the external client is used.

  • Claude Skills are complemented or replaced by functions, action types, AIP Logic blocks, agent templates, OSDK capabilities and platform applications.

  • Claude hooks are complemented by action validation, application restrictions, workflow approvals, branching and platform automation.

  • Claude local permissions are complemented by enterprise identity, markings, object/property security and the user's existing Foundry permissions.

  • Claude plugins are complemented by Palantir packages, applications, templates, SDKs and MCP services.

5.3 Strong suite

  • Operational semantic modeling: representing financial, business and audit objects and their relationships.

  • Controlled actions: allowing agents to initiate only predefined business actions and workflows.

  • Cross-system data integration, case management, remediation tracking and evidence relationships.

  • Permission-aware enterprise applications and human-in-the-loop operations.

  • Turning analysis into an operational decision, task, case or approved action.

5.4 Appropriate role in a DoD architecture

Palantir/Advana is a strong candidate for the operational audit and evidence layer: connecting financial statement line items to accounts, transactions, feeder systems, supporting documents, controls, NFRs, corrective actions, owners and auditor requests. Its value is greatest when the organization needs to navigate relationships and execute controlled remediation, not merely run large SQL queries.


6. IBM watsonx and IBM Bob

6.1 Extent of Claude adoption

IBM and Anthropic announced a strategic partnership to integrate Claude into selected IBM development tools and enterprise products while retaining IBM security, governance and cost controls. IBM also committed enterprise guidance, reference architectures and open-source assets to the MCP community. [10]

IBM's architecture remains IBM-native. Watsonx Orchestrate acts as an enterprise agent control plane; watsonx.data can expose document libraries through a framework-agnostic remote MCP server; and IBM Bob provides proprietary repository intelligence, software modernization workflows, integration-agent generation and enterprise governance. [11][12][13]

CategoryAssessment
Directly adoptedClaude integration in selected products; MCP across Orchestrate and watsonx.data; enterprise agent lifecycle guidance
Not directly adoptedNo verified native use of CLAUDE.md, Anthropic Skills, Claude plugin packaging, Claude hooks or Claude LSP architecture as IBM's organizing standard
Platform-native replacementsWatsonx Orchestrate, Agent Development Kit, agent catalog/toolkits, watsonx.data, governance, IBM Bob and decision services
Distinctive advantageHybrid/on-prem enterprise operations, Red Hat ecosystem, mainframe and legacy modernization, business rules and integration with long-lived systems

6.2 Strong suite

  • Java, COBOL, RPG, IBM i and mainframe modernization with deep enterprise context.

  • Hybrid cloud and on-premises integration where data and applications cannot be centralized easily.

  • Deterministic decision services and business rules for processes that should not be improvised by an LLM.

  • Enterprise orchestration of agents from multiple vendors under a common control plane.

  • Integration with existing middleware, applications and regulated operational environments.

6.3 Appropriate role in a DoD architecture

IBM is most compelling where audit remediation or financial transformation depends on understanding and modernizing legacy code, interfaces and business rules. Claude may help analyze code or explain policy, but IBM's core value is maintaining enterprise process integrity across hybrid and mainframe environments.


7. Databricks AI

7.1 Extent of Claude adoption

Databricks supports external foundation models, custom Python agents, MCP tools and external-agent registration, but its native architecture is model- and framework-agnostic rather than Claude Code-native. Databricks documents support for agents written with any Python authoring library and integrates them with MLflow tracing. It does not currently document CLAUDE.md, Anthropic Skills, Claude hooks, Claude plugins or LSP as native platform constructs. [8]

The appropriate comparison is therefore not whether Databricks copies Claude Code. Databricks provides the data, query, governance, deployment, lineage and evaluation foundation that an agent needs to work reliably at enterprise scale.

CapabilityRoleWhy it matters
Agent FrameworkAuthor, deploy and evaluate custom Python agents; connect them to structured data, unstructured data, code and external APIsFramework-agnostic agent deployment close to enterprise data
Unity CatalogGovern tables, files, functions, models, services and other data/AI assetsCentral identity, privileges, metadata and audit foundation
Unity AI GatewayGovern runtime interaction among models, agents, MCP servers and tools; route traffic, apply guardrails and monitor usageEnterprise control plane for AI services and tool access
MLflowTracing, evaluation, model/agent lifecycle and monitoringSystem-level quality and observability rather than conversational demos
Spark and SQLDistributed transformation, matching, aggregation and feature engineeringCorrect computational foundation for millions or billions of records
LineageAutomatic lineage for supported queries, down to the column levelImpact analysis and traceability across data products and reports
Genie / semantic analyticsNatural-language access to governed analytical data and business semanticsAnalyst interaction with SQL-based data rather than raw-record prompting

7.2 Strong suite

  • Terabyte- and petabyte-scale ingestion, transformation, joins, aggregation and machine learning.

  • Population-level reconciliation, anomaly detection, fraud and improper-payment analytics.

  • Lakehouse governance, data access control, automatic lineage and reusable analytical data products.

  • ML and agent tracing, evaluation, monitoring and cost/performance optimization.

  • Open data and SQL/Spark orientation that can support multiple downstream applications and models.

7.3 Appropriate role in a DoD architecture

Databricks is a strong computational and analytical foundation for normalizing ERP and feeder data, constructing transaction populations, performing large joins, reconciling balances, training anomaly models and producing curated exception tables. Palantir or another operational platform may then turn those analytical results into cases, evidence relationships and approved actions.


8. Detailed Capability and Adoption Matrix

Direct = explicitly supported as a native or documented integration. Client = supplied by the actual Claude Code client. Analog = proprietary platform capability serving a similar function. Not confirmed = no current official evidence of exact support.

8.1 Claude-native primitives and direct integrations

CapabilityClaude CodeAsk SagePalantir AIPIBM watsonx / BobDatabricks AI
Claude model accessNativeDirect model routingDirect model servicesSelect IBM productsExternal model endpoints/model serving
Actual Claude CodeNativeDirect compatible endpointDocumented IDE/client integrationNot confirmed as endpointExternal use possible; native hosting not confirmed
Claude Agent SDKNativeAPI compatibility possible; native template not confirmedDirect templates documentedNot confirmedCustom Python framework possible; first-class template not confirmed
MCPNativeDirect platform MCP plus Claude Code MCPPalantir MCP and Ontology MCPOrchestrate and watsonx.data MCPMCP services governed through Unity Catalog / AI Gateway
CLAUDE.mdNativeClient: yes; native Ask Sage format: noClient: yes; native AIP format: noNo exact formatNo exact format
Auto memoryNativeClient-provided; platform session/data features differClient/SDK-provided; platform histories differProprietary state/contextFramework-dependent; MLflow traces are not memory
SkillsNative SKILL.mdClient: yes; personas/prompts/plugins are analogsClient/SDK: yes; functions/templates/Logic are analogsAgent/tool catalogs and workflows are analogsAgent code, instructions and workflows are analogs
HooksNativeClient: yes; native equivalent less granularClient: yes; actions, restrictions and approvals are analogsPolicy and orchestration analogsService policies, jobs and validation gates are analogs
PluginsNative extension packagingClient: yes; Ask Sage plugins differClient: yes; platform packages/templates differBob/toolkits/catalog differNo Claude plugin system; Marketplace serves different purposes

8.2 Enterprise data, control, and operational capabilities

CapabilityClaude CodeAsk SagePalantir AIPIBM watsonx / BobDatabricks AI
Subagents / teamsNativeClient: yes; Deep Agent is a different abstractionAgent SDK and platform agent compositionOrchestrate multi-agent compositionFramework-dependent supervisor/multi-agent patterns
LSP / IDE intelligenceNativeClient: yes through Claude CodeClient: yes; AI FDE/Code Workspaces are proprietaryBob provides proprietary code intelligenceExternal IDE and notebook tooling; no Claude LSP system
Knowledge / RAGFiles, MCP, memory, webDatasets, files, web, Deep AgentOntology, datasets, documents, functionsKnowledge bases and document librariesTables, volumes, vector/knowledge services, Unity Catalog
Semantic queryTool-dependentPrimarily RAG and APIsOntology queries, functions, SQL and actionswatsonx.data, integrations and decision servicesSpark, SQL, semantic metrics and Genie
Execution environmentLocal/cloud coding sandboxClaude Code client sandbox plus Ask Sage endpoint controlsPlatform-controlled execution and scoped toolsCloud/hybrid controlled runtime and IAMClusters, serverless compute, Apps and model serving
Enterprise permissionsClaude Code permissionsGovernment endpoint/admin controls; depends on integrated systemStrong identity, markings, object/property security and restrictionsIAM, secrets, governance and enterprise integrationUnity Catalog privileges, service policies and connections
Observability / evaluationSessions, logs and hooksAccount metrics and platform controls; app-specific evaluation requiredAIP metrics, traces, logs and execution historyEnterprise monitoring/governance; product-specific evaluationMLflow tracing/evaluation, system tables and gateway monitoring
Operational actionsShell/tools; coding-orientedPlugins/MCP/agents; not a financial action modelPredefined Ontology actions and workflowsOrchestrated enterprise actions and decision servicesCustom tools, functions, jobs and workflows
Primary differentiationDeveloper harnessSecure access and rapid text/RAG adoptionOperational Ontology and governed workflowHybrid integration and modernizationBig-data computation and AI operations

9. Knowledge, Query, and Semantic Architecture

The word "knowledge" describes fundamentally different mechanisms across these products. A model context file, a vector index, a SQL semantic layer and an operational Ontology are not substitutes for one another.

Knowledge typeMechanismPurposeStrong platformsDesign implication
Project contextCLAUDE.md, rules and memoryPersistent instructions and repository knowledgeClaude CodeFlexible and close to work; limited enforcement and enterprise lineage
Document knowledgeRAG over policies, reports, contracts and supporting documentsRetrieve source passages for grounded answersAsk Sage, IBM watsonx.data, Databricks knowledge/vector services, Palantir documentsDepends on corpus quality, metadata, retrieval and citation validation
Analytical semanticsSQL views, metric definitions, dimensional models and governed functionsStandardize measures and calculations across large structured datasetsDatabricks, custom lakehouse, Palantir SQL/functionsBest for reproducible balances, trends, variance and aggregation
Operational semanticsObjects, relationships, actions, owners and workflow stateConnect data to business meaning and controlled actionPalantir Ontology; custom knowledge graph/workflowHigh value for cases and remediation; requires sustained domain governance
Deterministic decision logicRules, validations and decision servicesEnforce policy or calculation consistentlyIBM decision services, SQL/Python/Spark rules, platform actionsLess flexible than an LLM, but essential for consequential calculations and controls

🟩 For financial management
A canonical financial semantic layer should define funds, appropriations, fiscal years, TAS, USSGL, SFIS attributes, balances, obligations, expenditures, disbursements and financial statement line items. These definitions belong in governed data models and deterministic functions, not only in prompts or vector documents.

9.1 Why a query engine matters more than a larger model for data-heavy work

An LLM should not calculate a material balance by reading thousands of transaction rows in its context window. SQL or Spark should perform the aggregation; a rules engine should test compliance; a statistical or ML model should score anomalies; and the LLM should select approved tools, explain results, identify missing evidence and guide follow-up. This separation improves scale, reproducibility, cost and auditor confidence.


10. Harness Engineering and Enterprise Controls

Harness engineering is the discipline of making an LLM operate as a bounded, observable and testable system. The strongest model can still fail if the harness retrieves the wrong context, chooses unsafe tools, loops indefinitely, loses state, bypasses permissions or produces conclusions that cannot be reproduced.

Harness componentFunctionEnterprise importance
Context compilerSelect instructions, schemas, documents, examples, history and tool resultsPrevents irrelevant or unauthorized context from entering the task
Planner and completion controllerDecompose tasks, choose steps and determine when to stopControls loops, cost and premature or false completion
Tool registry and contractsTyped descriptions, inputs, outputs, permissions and failure behaviorTool quality usually matters more than prompt cleverness
Permission brokerPropagate identity and authorize each read, query or actionPrevents agents from exceeding the user or mission role
Execution isolationSandbox code, commands, packages, files, network and secretsLimits blast radius from mistakes or malicious content
State and memoryPersist only required task and organizational knowledgeSupports continuity while avoiding hidden, stale or unauthorized memory
Budget controllerLimit tokens, time, compute, SQL volume, retries and external callsKeeps agentic work economically and operationally bounded
EvaluationTest retrieval, calculations, tool use, security, policy and final answersMeasures the full system rather than model fluency
Telemetry and replayCapture prompts, versions, tools, queries, data snapshots and outputsSupports investigation, quality improvement and audit reproduction
Human controlApproval, exception handling, reviewer assignment and segregation of dutiesRequired before consequential financial or operational actions

11. Workload-Based Platform Strategy

WorkloadExamplesRecommended center of gravityEngineering focus
Text-intensivePolicies, manuals, NFR responses, CAP narratives, audit reports, correspondence, contractsAsk Sage + approved Claude/model; custom RAG where necessaryRetrieval recall, authoritative sources, effective dates, citation support, prompt-injection defense and human review
Data-intensiveGL/subledger analysis, budget execution, variance, journal review, transaction matchingDatabricks or Palantir with deterministic SQL/rules; LLM as orchestratorCanonical semantics, reproducible queries, data quality, row/column security and evidence links
Big dataMillions/billions of transactions, population profiling, fraud/anomaly modelsDatabricks or equivalent distributed engine; Palantir for operational follow-throughPartitioning, incremental pipelines, lineage, feature quality, false positives, cost and latency
Operational workflowCases, evidence packages, approvals, remediation, owner/action trackingPalantir AIP/Ontology; IBM Orchestrate for enterprise integration patternsObject/action design, permission propagation, branching, approvals and status accountability
Legacy/hybridMainframe code, COBOL/RPG/Java, long-lived interfaces and business rulesIBM Bob / watsonx / OrchestrateDependency discovery, deterministic rules, test coverage, hybrid connectivity and controlled modernization
Custom mission applicationUnique cross-platform workflows or user experienceClaude Agent SDK or platform-neutral framework + MCP + enterprise servicesModel abstraction, secure tools, evaluations, telemetry, operations and lifecycle ownership

11.1 Text-heavy solution design

  • Curate authoritative collections and preserve document version, effective date, owner, security marking and supersession status.

  • Use hybrid retrieval, metadata filtering and reranking rather than relying only on vector similarity.

  • Require sentence- or claim-level citations and test whether the cited passage actually supports the answer.

  • Isolate retrieved content from system instructions and defend against prompt injection embedded in documents.

  • Measure retrieval coverage, citation support, abstention quality and human correction rate - not only response fluency.

11.2 Data-heavy solution design

  • Create governed SQL, Spark or service functions for every material calculation and reconciliation.

  • Expose narrow tools such as get_balance, trace_to_transactions, retrieve_support, run_reconciliation and create_case.

  • Return structured outputs with row counts, filters, effective dates, data versions and query identifiers.

  • Keep agent access read-only by default; require explicit approval for case updates, workflow changes or postings.

  • Use the LLM to plan, interpret and explain - never to substitute for a reproducible calculation engine.

11.3 Big-data solution design

For population-scale analysis, the correct pattern is raw data to distributed processing to curated analytical products to governed tools to AI explanation. Raw transaction populations should not be placed directly into an LLM context. The agent should invoke pre-approved distributed queries, receive summarized and traceable results, and drill into selected exceptions only when necessary.


12. DoD Financial Audit Target Architecture

GAO reported in May 2026 that DoD's revised audit approach increases emphasis on technology, including AI, focuses on material line items and evidence supporting account balances, and directs the Department to maximize AI, automation, data analytics and Advana to resolve audit issues. GAO also emphasized continuing concerns about reliable financial information, internal controls, IT weaknesses, transparency, fraud risk and sustainability. [16]

Rendering diagram…

Figure 2. AI-enabled DoD financial audit target architecture.

LayerContentsAudit purpose
1. Authoritative source and evidence planeSource IDs, transaction IDs, original values, documents, ingestion times, transformations, owners, markings and integrity metadataPreserve the evidence chain and prevent AI output from replacing the system of record
2. Financial semantic layerTAS, fund, appropriation, fiscal year, USSGL, SFIS, line item, beginning/activity/ending balance and materialityProvide one governed meaning for calculations and evidence
3. Deterministic reconciliation and control engineFeeder-to-GL, subledger-to-GL, rollforward, duplicate, unsupported journal, document match, interface and population completenessProduce repeatable tests and exception populations
4. Operational evidence and case layerTransactions, source systems, documents, controls, samples, NFRs, owners, corrective actions and auditor requestsConnect analysis to accountability and remediation
5. Governed tool layerRead-only queries, approved SQL functions, evidence retrieval, reconciliation execution and package generationConstrain the agent to approved, typed and logged operations
6. Replaceable AI layerResearch, retrieval, tool selection, explanation, exception prioritization and draftingUse model strengths without coupling the mission architecture to one vendor
7. Human review and approvalPreparer, reviewer, approver, auditor coordination and exception dispositionMaintain accountability and segregation of duties
8. Immutable execution recordIdentity, model/prompt/skill version, data snapshot, SQL, tools, sources, output, approvals and changesEnable replay, inspection and audit reliance

🟥 Non-negotiable audit principle
The AI may retrieve, classify, explain, recommend and orchestrate. The governed data platform must calculate, reconcile, authorize, record and prove.

12.1 Priority AI use cases and automation boundaries

Use casePrimary engineAppropriate AI roleControl boundary
Policy and audit guidance researchRAG + LLMRetrieve, summarize, compare and cite authoritative guidanceHuman validates interpretation and applicability
Auditor document request responseRAG + evidence system + workflowFind candidate support, assemble package and draft responseHuman confirms completeness, relevance and release authority
Balance-to-transaction tracingSQL/Spark + semantic model + OntologyTrace line item to accounts, transactions, feeder systems and supportLLM explains path; deterministic services produce trace
GL/subledger reconciliationSQL/Spark/rulesMatch populations, quantify differences and classify exception typesLLM does not calculate material totals
Journal voucher analysisRules + anomaly model + LLM explanationIdentify unusual preparers, timing, accounts, amounts, descriptions and unsupported entriesHuman investigates and determines disposition
Universe of Transactions completenessData engineering + lineage + control rulesValidate expected sources, record counts, totals, period coverage and interface completenessAI prioritizes gaps; system proves completeness
NFR and CAP supportEvidence graph + RAG + LLMSummarize condition, cause, effect, milestones, owners and supporting evidenceHuman owns root cause, commitment and closure decision
Legacy system analysisCode agent + IBM/Claude toolsExplain interfaces, rules and data transformations in legacy codeTesting and system owners validate behavior
Improper-payment / fraud triageML/statistics + rules + case managementScore population, cluster patterns and route casesHuman investigators determine findings and actions

12.2 Data-model implication for Advana FM

A broad GL Extended table can be a valuable analytical spine because it brings many accounting attributes into one queryable population. It is not, by itself, an audit-ready evidence model. It may lack the full sequence of subledger events, interface-control evidence, source-document relationships, status history, reversals and corrections, user approvals, and business-event context needed to explain why an accounting entry occurred.

The recommended design is to retain the broad analytical table for speed while adding governed links to source transactions, subledger events, supporting documents, system/interface metadata, control results and audit cases. Palantir Ontology is one way to represent those relationships; a Databricks-centered implementation can use curated relational models, lineage, metric definitions and a separate case/evidence application.

12.3 Model availability and procurement risk

As of July 13, 2026, the DoD-Anthropic procurement and litigation environment remains unsettled. Current reporting indicates that Anthropic was designated a supply-chain risk for Pentagon contracting and was not included in the May 2026 agreements with seven other AI providers. The architecture should therefore support model substitution and validate model availability for each contract, network, classification and use case. [17][18]


13. Platform Strategies for Advana FM and DoD Audit

StrategyWhen it fitsDesign patternTradeoff
Palantir-firstAdvana/Foundry is the approved operational platform and Ontology is centralBuild financial/audit Ontology, evidence cases, governed actions and agent tools; use Claude or another approved modelBest operational integration and workflow; risk of weak Ontology/data discipline and vendor dependence
Databricks-firstLakehouse and Spark/SQL are the enterprise data foundationBuild canonical audit data products, reconciliation functions, lineage and ML; expose governed tools to agents and a case applicationBest computation and openness; requires added operational case/action design
Ask Sage-firstImmediate priority is secure text, policy and document assistanceDeploy curated datasets, citations and role-specific assistants; connect Claude Code for developers; integrate authoritative query tools laterFast value and low initial engineering; insufficient alone for transaction-scale audit evidence
IBM-firstLegacy and hybrid systems dominate the transformation problemUse Bob and watsonx for code/process modernization, Orchestrate for integrations, decision services for deterministic rulesStrong legacy integration; may add complexity when modern data platforms already cover core needs
Custom-firstMission workflow is unique or portability is paramountUse Agent SDK or neutral framework, MCP, enterprise IAM, data services, evidence store, evaluation and model routingMaximum control; highest lifecycle, ATO, security and operations burden
Hybrid - recommended for enterprise auditMultiple workload types coexistDatabricks/approved compute for population analytics; Palantir/Advana for operational evidence and workflow; Ask Sage for secure text; IBM for legacy; replaceable modelsBest alignment to workload; requires clear system boundaries and governance

13.1 Recommended role allocation

ComponentRecommended role
Advana / PalantirOperational audit data, Ontology, evidence relationships, case/remediation workflow, permissions and actions
Databricks or approved distributed computeHigh-volume ingestion, normalization, large joins, reconciliation, population profiling, anomaly models and reusable data products
Ask SageSecure model gateway, document/policy research, analyst drafting, rapid prototypes and controlled Claude Code access
IBMLegacy/mainframe modernization, hybrid integrations, deterministic business rules and enterprise orchestration where required
Claude or another approved modelReplaceable reasoning, language, coding, tool selection and explanation component
Custom mission servicesFinancial semantics, validated tools, evaluation suites, evidence packaging and cross-platform orchestration

14. Building a Custom Enterprise AI Solution

A custom solution should borrow Claude Code's engineering patterns without making Claude-specific artifacts the only way the mission system operates. Mission logic and evidence should remain accessible to other approved models and agents.

Build areaRecommended patternOutcome
Model abstractionUse a routing layer and common message/tool interfaceSwitch models without rebuilding tools, evidence, permissions or workflow
Canonical contextMaintain versioned domain rules, data definitions, system quirks and operating proceduresEquivalent in purpose to CLAUDE.md, but governed and available across models
Skill-style modulesPackage reconciliation, evidence review, sampling, NFR response and control testing separatelyAvoid one giant prompt and enable focused testing/versioning
MCP / API toolsExpose typed, narrow, authenticated functionsReduce bespoke integrations and constrain agent behavior
Deterministic validation hooksRun security, data-quality, query, evidence and approval checks before completion or actionConvert critical rules from suggestions into enforced controls
Agent specializationUse separate research, data, evidence, security and review agents only where isolation adds valuePrevent context overload and over-privileged general agents
Enterprise authorizationPropagate user identity and mission role to every toolPrevent the agent from becoming a shared super-user
Evidence and replayRecord sources, queries, versions, outputs and approvalsMake every material result reproducible
Evaluation and red teamingTest gold cases, planted data errors, prompt injection, unauthorized access and incomplete evidenceEstablish reliability before operational expansion
Secure executionSandbox code, packages, network, secrets and temporary filesContain failures and malicious inputs

14.1 What not to build from scratch

  • Enterprise identity and access management when an approved service already exists.

  • A new distributed query engine or data catalog when Databricks, Palantir or another approved platform already provides it.

  • A custom vector database solely because an LLM feature requires retrieval.

  • A proprietary tool protocol where MCP or OpenAPI can meet the requirement.

  • A model-specific evidence store that becomes unusable when the model changes.

  • An autonomous financial posting agent before read-only workflows, evidence controls and human approvals are proven.


15. Implementation Roadmap and Measures of Success

PhasePrimary workExit criterion
Phase 0 - Mission and governanceSelect one material audit use case; define authoritative sources, owners, security boundary, model options and success criteriaApproved concept, data/tool inventory, risk register and evaluation plan
Phase 1 - Trusted data foundationBuild canonical transaction/balance/evidence datasets, source reconciliation, quality controls and lineageReconciled population with documented completeness and quality
Phase 2 - Deterministic toolsImplement validated SQL/Spark/rule functions and expose them through governed APIs or MCPRepeatable calculations, reconciliations and evidence retrieval
Phase 3 - Read-only copilotAdd agent for research, query planning, explanation and evidence-package assemblyGrounded responses with citations and no consequential write access
Phase 4 - Human-approved workflowAdd case creation, task routing, exception disposition and package submissionControlled actions with segregation of duties and immutable approvals
Phase 5 - Scale and optimizeExpand populations, models and workflows; add routing, monitoring, cost controls and fallback modelsMeasured enterprise performance, reliability and sustainability
Measurement domainRecommended measures
Data trustPercent of material balances reconciled; transaction population completeness; percent traceable to source and support; unresolved data-quality exceptions
Text/RAG qualityRetrieval recall; citation support rate; superseded-source error rate; abstention quality; human correction rate
Analytical accuracySQL/rule test pass rate; reconciliation precision; anomaly false-positive/false-negative rate; reproducibility across data snapshots
Operational performanceTime to answer auditor requests; evidence-package cycle time; analyst hours saved; case aging; remediation throughput
Agent controlUnauthorized tool attempts; approval bypasses; prompt-injection success rate; budget overruns; failed or looping tasks
AuditabilityPercent of material outputs with complete model, prompt, tool, query, data-snapshot, source and approval record
Cost and scaleCost per document, query, million transactions, evidence package and closed exception; compute and token utilization

16. Final Recommendations

  1. Do not select a platform based on which one advertises Claude. Select the authoritative data, semantic, workflow and control layers first.

  2. Use the real Claude Code client when repository-centric software engineering is the problem. Use the Claude Agent SDK when its harness patterns are needed inside a custom application.

  3. Treat Ask Sage as a secure model and text-assistance layer, not as the transaction or evidence system.

  4. Treat Palantir AIP as an operational semantic and workflow platform whose differentiation is Ontology, permissions, actions and evidence relationships.

  5. Treat Databricks as the analytical and computational foundation for large structured data, reconciliation, ML, lineage and evaluation.

  6. Treat IBM as the preferred specialist where legacy modernization, hybrid integration and deterministic enterprise decisioning are central.

  7. For DoD audit, begin with trusted data, material-line-item semantics, reconciliation and evidence provenance. Add AI after the deterministic foundation exists.

  8. Keep model access replaceable because technical performance, cost, authorization and procurement conditions can change faster than mission systems.

  9. Default to read-only agent tools. Introduce actions only through predefined workflows, explicit approval and segregation of duties.

  10. Evaluate the complete system - retrieval, data, tools, calculations, permissions, citations and human workflow - rather than the model alone.

🟦 Recommended Advana FM pattern
Governed financial and evidence data + distributed reconciliation and analytics + operational Ontology/case management + narrow MCP tools + replaceable approved models + read-only agent by default + human-approved actions + immutable execution record.


Appendix A. Decision Checklist

Decision areaRequired question
Mission outcomeWhat specific decision, audit assertion, evidence package or workflow must improve?
Authoritative dataWhich system and data product is authoritative for each balance, transaction, document and status?
Semantic modelWhere are accounting and business definitions implemented and versioned?
Deterministic logicWhich calculations, matches, thresholds and control tests must be reproducible?
Model roleWhat requires reasoning or language, and what should remain SQL, code, rules or workflow?
Tool designAre agent tools narrow, typed, authenticated, logged and read-only by default?
PermissionsDoes every operation execute under the user or approved service identity?
EvidenceCan each material claim be traced to source, query, data version and supporting document?
Human controlWho prepares, reviews, approves and resolves exceptions?
EvaluationWhat gold cases and adversarial tests demonstrate reliability and security?
OperationsWho owns monitoring, incidents, model changes, data drift, cost and retraining?
PortabilityCan the model be replaced without rebuilding data, tools, evidence and workflow?
AuthorizationIs the model, platform, network, data type and use case approved under the applicable ATO and contract?

Appendix B. Source Notes

Product capabilities and availability change rapidly. The following official documentation and current reporting support the principal factual statements in this report. Revalidate before acquisition or deployment.

1. Anthropic - Claude Code overview: <u>Open source</u>

2. Anthropic - How Claude remembers your project: <u>Open source</u>

3. Anthropic - Create plugins: <u>Open source</u>

4. Ask Sage - Anthropic-compatible endpoints and Claude Code integration: <u>Open source</u>

5. Ask Sage - Data, Deep Agent and MCP: <u>Open source</u>

6. Palantir - July 2026 announcements, including Claude Agent SDK templates: <u>Open source</u>

7. Palantir - June 2026 announcements, including Palantir MCP and Ontology MCP GA: <u>Open source</u>

8. Palantir - Ontology MCP overview: <u>Open source</u>

9. Palantir - AI FDE overview: <u>Open source</u>

10. IBM and Anthropic partnership: <u>Open source</u>

11. IBM Cloud - Agentic AI workflow with watsonx Orchestrate and MCP: <u>Open source</u>

12. IBM watsonx.data remote MCP server: <u>Open source</u>

13. IBM Bob AI coding agent: <u>Open source</u>

14. Databricks - Use agents on Databricks: <u>Open source</u>

15. Databricks - Unity AI Gateway and Unity Catalog lineage: <u>Open source</u>

15a. Databricks - Unity Catalog data lineage: <u>Open source</u>

16. GAO-26-109115 - DOD Financial Management: Questions Associated with New Financial Audit Approach: <u>Open source</u>

17. Reuters - Pentagon supply-chain-risk designation of Anthropic, March 5, 2026: <u>Open source</u>

18. Reuters - Pentagon agreements with seven AI providers, May 1, 2026: <u>Open source</u>

Learning map

Stage 1: Core Architectures & Agent Primitives

  • Model vs. Harness: Learn the functional separation of the LLM from the planning engine to prevent prompt-injection of business logic.
  • Model Context Protocol (MCP): Understand how open protocols decouple reasoning models from backend tools and enterprise databases.
  • State and Memory Management: Grasp how agents persist context across sessions without inflating token budgets or crossing security boundaries.

Stage 2: Enterprise Semantic & Data Planes

  • Semantic Layers (SQL/Spark/Ontology): Learn to construct deterministic semantic schemas so the LLM accesses validated statistics rather than calculating values itself.
  • Lineage & Metadata Tracking: Discover how to trace LLM-generated decisions down to the underlying column-level database modifications.
  • Permissions & IAM Propagation: Master identity delegation to prevent agents from acting as over-privileged system-level users.

Stage 3: Operational Guardrails & Evaluations

  • Harness Isolation & Sandboxing: Execute agent commands safely inside secure containers to contain programming mistakes or malicious data.
  • Automated Evaluation (Evals): Build systematic validation suites with test datasets to grade retrieval coverage, accuracy, and compliance.

Get hands-on — step by step

Step 1: Set up a Local Sandbox

Create a secure Python virtual environment to host your agent's local testing environment:

mkdir mcp-audit-sandbox
cd mcp-audit-sandbox
python3 -m venv venv
source venv/bin/activate
pip install mcp langchain-anthropic

Step 2: Write a Read-Only SQL-Mocking Tool

Create a Python file tools.py that implements a deterministic database query rather than letting the LLM calculate results directly:

def get_ledger_balance(fund_id: str) -> dict:
    # Mocking database response
    mock_db = {"FUND_A": 1500000.00, "FUND_B": 850000.50}
    balance = mock_db.get(fund_id, 0.0)
    return {"fund_id": fund_id, "balance": balance, "status": "reconciled"}

Step 3: Integrate with an MCP Server Pattern

Set up a fastmcp server pattern to securely register your ledger query tool:

from mcp.server.fastmcp import FastMCP
mcp = FastMCP("DoDAuditServer")

@mcp.tool()
def query_balance(fund_id: str) -> str:
    """Retrieves verified reconciled balance for a given fund ID."""
    res = get_ledger_balance(fund_id)
    return f"Verified balance for {res['fund_id']} is ${res['balance']:,.2f}."

Step 4: Evaluate and Audit the Run

Execute tests against the tool to verify that the LLM is restricted to calling this exact tool rather than guessing ledger balances, logging the full execution trace.

Top 3 sources

  1. 1
    Anthropic Claude Code Documentation

    The official guide to Anthropic's reference agent harness, showing how to structure CLI agents, memory, and permissions.

    https://code.claude.com/docs/en/overview

  2. 2
    Model Context Protocol (MCP) Official Site

    The official open-source protocol documentation explaining how to safely connect LLMs to data sources and tools.

    https://modelcontextprotocol.io

  3. 3
    Databricks Agent Framework

    Official reference guide to deploying, evaluating, and monitoring enterprise-grade Python agents alongside secure database catalogs.

    https://docs.databricks.com/en/generative-ai/agent-framework/index.html

Links are AI-suggested — worth a quick sanity check before diving in.