Enterprise AI Architecture: Beyond the Model
7/13/2026, 5:52:54 PM
An enterprise AI architecture must separate the frontier model from its agent harness, semantic data plane, and mission controls to ensure deterministic calculations and auditable evidence instead of relying solely on probabilistic models.
Enterprise AI Architecture: Beyond the Model
Claude Code, Ask Sage, Palantir AIP, IBM watsonx, Databricks AI, and Custom Development
Comparative architecture and implementation strategy for text-intensive, data-intensive, big-data, and DoD financial audit workloads
🟨 Deployment note: Model availability, authorization, classification, contract terms, and approved use must be validated for each environment.
Executive Summary
The central conclusion is simple: Claude is a model family; Claude Code is an agent harness; Ask Sage, Palantir, IBM, and Databricks are enterprise platforms. Their value should not be measured only by whether they offer a Claude model. The important question is which Claude Code mechanisms they adopt directly, which remain available through the real Claude Code client or Claude Agent SDK, and which are replaced by stronger enterprise-native controls.
🟦 At-a-glance recommendation
Use Ask Sage for secure text and document assistance and as a controlled route to Claude Code. Use Palantir AIP when the mission depends on an operational Ontology, governed actions, evidence relationships, and workflow. Use Databricks when the center of gravity is Spark, SQL, large-scale data engineering, machine learning, lineage, and evaluation. Use IBM where hybrid infrastructure, legacy modernization, enterprise integration, and deterministic decision services dominate. Build a custom harness only for the mission-specific layer, and keep the underlying model replaceable.
| Option | Primary identity | Strongest use | Primary caution |
|---|---|---|---|
| Claude Code | Repository-centric agent harness | Coding, software engineering, custom agent patterns | Not an enterprise data catalog, financial semantic layer, or audit evidence system |
| Ask Sage | Secure multi-model access and rapid RAG adoption | Text-heavy analysis, drafting, policy/document research, controlled Claude Code connectivity | Not the authoritative transaction, reconciliation, or lineage platform |
| Palantir AIP | Operational semantics and governed action | Ontology, permissions, cases, workflow, evidence-to-transaction relationships | Requires disciplined Ontology and data governance; proprietary platform dependence |
| IBM watsonx / Bob | Hybrid enterprise orchestration and modernization | Mainframe/legacy code, business rules, integrations, regulated enterprise workflow | Broader and more complex stack; Claude-native artifacts are not the organizing standard |
| Databricks AI | Large-scale data and AI operations | Spark/SQL, pipelines, ML, semantic analytics, lineage, tracing and evaluation | Less naturally oriented to object-centric case/action workflows than Palantir |
| Custom solution | Mission-specific control and portability | Unique workflows, model routing, specialized tools, evaluations and user experience | Highest engineering, security, operations and lifecycle burden |
For DoD audit, the best outcome is a layered architecture rather than a single product: a trusted financial data and evidence plane; deterministic reconciliation and control logic; governed MCP or API tools; a constrained, replaceable model layer; human review; and an immutable record of every query, source, calculation, tool call, approval, and change.
1. The Core Comparison: Model, Harness, Platform, and Mission Control
Many enterprise AI comparisons collapse four different layers into one. This produces misleading conclusions such as "Platform X uses Claude, therefore it has Claude Code," or "Platform Y does not have CLAUDE.md, therefore it lacks persistent enterprise context." The layers solve different problems and should be evaluated separately.
Figure 1. Four-layer enterprise AI architecture.
| Layer | Examples | Purpose | Key implication |
|---|---|---|---|
| Frontier model | Claude and other LLMs | Reasoning, language, coding, classification and tool selection | Accuracy remains probabilistic; the model should not become the system of record |
| Agent harness | Claude Code, Agent SDK, AIP Logic, Orchestrate, Databricks Agent Framework, Deep Agent | Context assembly, planning loop, tools, state, permissions, retries, budgets and evaluation | Harness quality determines whether a capable model becomes a reliable system |
| Data and semantic plane | Ontology, Unity Catalog, SQL/Spark, watsonx.data, RAG datasets | Authoritative data, metadata, business meaning, retrieval, lineage and computation | Poor data cannot be repaired by a stronger model |
| Mission control and evidence | IAM, markings, actions, workflow, approvals, logs, case/evidence repository | Authorization, segregation of duties, reproducibility and accountability | Essential for audit, financial management and consequential actions |
🟥 Architecture rule
Do not put authoritative business logic, financial calculations, evidence provenance, access control, or approval authority inside a system prompt. Keep them in governed services that the agent can call but cannot redefine.
2. Claude Code as the Reference Agent Harness
Claude Code is an agentic coding system that reads a repository, edits files, runs commands, connects to external tools, and integrates with development environments. Its importance to enterprise architecture is not limited to coding. It provides a clear reference design for context, reusable procedures, deterministic controls, tool connectivity, specialized agents, and extension packaging. [1]
| Primitive | Function | Enterprise value | Limitation |
|---|---|---|---|
| CLAUDE.md and rules | Persistent project, user, or organization instructions loaded into session context | Architecture conventions, build/test commands, security rules and review checklists | Context, not guaranteed enforcement; use hooks or platform policy for hard controls |
| Auto memory | Agent-written notes that persist useful discoveries across sessions | Build commands, debugging insights and recurring preferences | Must be auditable and bounded; not an authoritative knowledge base |
| Skills | Reusable SKILL.md packages with instructions, scripts and supporting resources | Repeatable workflows such as code review, reconciliation analysis, document review or deployment | Strong pattern for modular capability, but procedures still require testing and governance |
| MCP | Open protocol connecting agents to tools, data and external services | Databases, APIs, tickets, documents, enterprise applications and custom functions | MCP standardizes connection; it does not guarantee authorization, data quality or safe tool design |
| Hooks | Deterministic lifecycle controls before or after agent actions | Block dangerous commands, require tests, log activity or validate changes | Critical for enforcing rules that must not depend on model judgment |
| Custom agents and agent teams | Specialized workers with isolated context and controlled tools | Parallel analysis, code review, testing, research and domain specialists | Raises orchestration, cost, state-management and evaluation complexity |
| Plugins | Distribution package for skills, agents, hooks, MCP, LSP and settings | Reusable organizational extension bundles | A software-engineering extension model, not an enterprise data governance model |
| Permissions and sandboxing | Controls over tools, files, commands and execution environment | Limit agent blast radius and require approval | Local coding permissions differ from enterprise data permissions and segregation of duties |
| LSP and IDE integration | Language-server diagnostics and editor context | Typed code intelligence, errors, symbols and navigation | Highly valuable for software development; lower priority for financial audit analytics |
| Claude Agent SDK | Programmable access to Claude Code tools and agent capabilities | Custom applications and agent workflows with controlled orchestration and permissions | Best route for adopting Claude Code patterns outside a coding interface |
Claude Code does not natively replace a distributed query engine, financial semantic model, enterprise knowledge graph, record-level lineage system, case-management platform, or audit evidence repository. Those capabilities must come from the surrounding enterprise platform or custom architecture.
3. How Commercial Platforms Adopt or Replace Claude Code Capabilities
There are four materially different forms of Claude adoption. An accurate comparison must identify which form applies to each platform and use case.
| Adoption mode | Definition | Architectural implication | Examples |
|---|---|---|---|
| 1. Model access | The platform exposes Claude as one of its available models | The enterprise uses Claude reasoning but retains the platform's proprietary harness | IBM select-product integration; Databricks model endpoints; Palantir model services; Ask Sage routing |
| 2. Claude Code client compatibility | The real Claude Code CLI or IDE connects to the platform endpoint or MCP server | CLAUDE.md, Skills, hooks, plugins, subagents and LSP remain Claude Code client capabilities | Ask Sage explicitly supports Claude Code; Palantir documents Claude Code IDE usage and MCP connection |
| 3. Claude Agent SDK hosting | A custom agent uses Anthropic's programmable harness inside the enterprise platform | Deeper adoption of Claude planning, tools and orchestration while using enterprise data and controls | Palantir provides explicit Claude Agent SDK templates; other platforms can support custom Python frameworks with varying levels of native integration |
| 4. Proprietary functional replacement | The platform supplies its own context, agents, policy, data semantics, workflow and evaluation | Claude Code artifacts are not portable, but enterprise controls may be stronger for operational work | Palantir Ontology/AIP, IBM Orchestrate/Bob, Databricks Unity Catalog/MLflow, Ask Sage datasets/personas/Deep Agent |
🟪 Important distinction
When Claude Code is connected through Ask Sage or to Palantir MCP, it is incorrect to say that CLAUDE.md, Skills, hooks, plugins, subagents, permissions, or LSP are absent. They remain available in the Claude Code client. The better question is whether the enterprise platform natively understands, governs, distributes, and audits those artifacts.
4. Ask Sage
4.1 Extent of Claude adoption
Ask Sage has the most direct verified compatibility with the actual Claude Code user experience. Its Anthropic-compatible endpoint is documented as working with the Claude Code CLI and VS Code extension. This lets the Claude Code client continue to provide its own project instructions, skills, hooks, plugins, subagents, permissions and IDE integration while Ask Sage supplies the controlled endpoint, authentication, model routing and government-oriented deployment environment. [4]
Ask Sage also provides its own datasets, personas, prompt library, plugins, web search, Deep Agent and MCP capabilities. Deep Agent performs iterative research across the web and private RAG datasets. These are useful platform-native capabilities, but they are not necessarily format-compatible with Anthropic Skills, Claude plugins or CLAUDE.md. [5]
| Category | Assessment |
|---|---|
| Directly adopted | Anthropic-style API format; Claude Code client compatibility; MCP; access to Claude models through approved backends |
| Client-provided | CLAUDE.md, auto memory, Skills, hooks, plugins, subagents, permission modes and LSP when the actual Claude Code client is used |
| Platform-native analogs | Datasets and RAG, personas, prompt library, platform plugins, Deep Agent, Agent Builder and administrative controls |
| Not the primary strength | Distributed SQL/Spark, enterprise financial semantic modeling, object/action Ontology, record-level transaction lineage and large-scale reconciliation |
4.2 Strong suite
-
Secure access to multiple commercial models through a common interface.
-
Rapid text-heavy and document-heavy deployments without building a complete model gateway and RAG application from scratch.
-
Controlled Claude Code use for development teams where Ask Sage is an approved endpoint.
-
Government-oriented deployment options and user-friendly configuration for non-developer analysts.
-
Fast prototyping of policy research, report analysis, drafting, summarization and knowledge assistance.
4.3 Appropriate role in a DoD architecture
Ask Sage is best positioned as a secure interaction and model-access layer. It can support document research, NFR and CAP drafting, policy synthesis, auditor-request response, developer assistance and rapid mission prototypes. It should not be the authoritative source for balances, transactions, reconciliation results, data lineage or audit evidence. Those must come from a governed financial data and evidence platform.
5. Palantir AIP
5.1 Extent of Claude adoption
Palantir demonstrates the deepest verified integration with Anthropic's programmable agent layer among the reviewed commercial platforms. Palantir documents Claude Code as an IDE integration, provides Palantir MCP and Ontology MCP, and offers explicit agent templates for the Claude Agent SDK with simplified configuration for Ontology MCP, Palantir MCP and the Ontology SDK. [6][7]
This does not make Palantir a reimplementation of Claude Code. Palantir's strategic differentiation is the enterprise platform surrounding the agent: Ontology, object and action security, user permission propagation, operational applications, workflow, cases, branching, lineage and observability.
| Capability | Role | Why it matters |
|---|---|---|
| Palantir MCP | Development-oriented MCP for data integration, Ontology configuration and application development within Foundry | Connect Claude Code and other AI IDEs/agents to platform-building capabilities |
| Ontology MCP | Exposes object types, action types and query functions as governed MCP tools | Lets external agents read objects, execute predefined actions and query data under application restrictions |
| Claude Agent SDK templates | Native starting templates integrated with Ontology MCP, Palantir MCP and OSDK | Allows Anthropic harness patterns to run close to Palantir data and operational controls |
| AI FDE | Palantir-native AI development environment whose operations respect the user's existing permissions | Provides proprietary enterprise context, capabilities, governance and platform-building workflow |
| AIP observability and execution history | Metrics, traces, logs and workflow history | Supports operational monitoring and investigation beyond a local agent transcript |
5.2 What Palantir replaces rather than adopts
-
CLAUDE.md is replaced at the platform level by governed application context, Ontology definitions, repository context, system instructions and platform policies. The Claude Code file still exists when the external client is used.
-
Claude Skills are complemented or replaced by functions, action types, AIP Logic blocks, agent templates, OSDK capabilities and platform applications.
-
Claude hooks are complemented by action validation, application restrictions, workflow approvals, branching and platform automation.
-
Claude local permissions are complemented by enterprise identity, markings, object/property security and the user's existing Foundry permissions.
-
Claude plugins are complemented by Palantir packages, applications, templates, SDKs and MCP services.
5.3 Strong suite
-
Operational semantic modeling: representing financial, business and audit objects and their relationships.
-
Controlled actions: allowing agents to initiate only predefined business actions and workflows.
-
Cross-system data integration, case management, remediation tracking and evidence relationships.
-
Permission-aware enterprise applications and human-in-the-loop operations.
-
Turning analysis into an operational decision, task, case or approved action.
5.4 Appropriate role in a DoD architecture
Palantir/Advana is a strong candidate for the operational audit and evidence layer: connecting financial statement line items to accounts, transactions, feeder systems, supporting documents, controls, NFRs, corrective actions, owners and auditor requests. Its value is greatest when the organization needs to navigate relationships and execute controlled remediation, not merely run large SQL queries.
6. IBM watsonx and IBM Bob
6.1 Extent of Claude adoption
IBM and Anthropic announced a strategic partnership to integrate Claude into selected IBM development tools and enterprise products while retaining IBM security, governance and cost controls. IBM also committed enterprise guidance, reference architectures and open-source assets to the MCP community. [10]
IBM's architecture remains IBM-native. Watsonx Orchestrate acts as an enterprise agent control plane; watsonx.data can expose document libraries through a framework-agnostic remote MCP server; and IBM Bob provides proprietary repository intelligence, software modernization workflows, integration-agent generation and enterprise governance. [11][12][13]
| Category | Assessment |
|---|---|
| Directly adopted | Claude integration in selected products; MCP across Orchestrate and watsonx.data; enterprise agent lifecycle guidance |
| Not directly adopted | No verified native use of CLAUDE.md, Anthropic Skills, Claude plugin packaging, Claude hooks or Claude LSP architecture as IBM's organizing standard |
| Platform-native replacements | Watsonx Orchestrate, Agent Development Kit, agent catalog/toolkits, watsonx.data, governance, IBM Bob and decision services |
| Distinctive advantage | Hybrid/on-prem enterprise operations, Red Hat ecosystem, mainframe and legacy modernization, business rules and integration with long-lived systems |
6.2 Strong suite
-
Java, COBOL, RPG, IBM i and mainframe modernization with deep enterprise context.
-
Hybrid cloud and on-premises integration where data and applications cannot be centralized easily.
-
Deterministic decision services and business rules for processes that should not be improvised by an LLM.
-
Enterprise orchestration of agents from multiple vendors under a common control plane.
-
Integration with existing middleware, applications and regulated operational environments.
6.3 Appropriate role in a DoD architecture
IBM is most compelling where audit remediation or financial transformation depends on understanding and modernizing legacy code, interfaces and business rules. Claude may help analyze code or explain policy, but IBM's core value is maintaining enterprise process integrity across hybrid and mainframe environments.
7. Databricks AI
7.1 Extent of Claude adoption
Databricks supports external foundation models, custom Python agents, MCP tools and external-agent registration, but its native architecture is model- and framework-agnostic rather than Claude Code-native. Databricks documents support for agents written with any Python authoring library and integrates them with MLflow tracing. It does not currently document CLAUDE.md, Anthropic Skills, Claude hooks, Claude plugins or LSP as native platform constructs. [8]
The appropriate comparison is therefore not whether Databricks copies Claude Code. Databricks provides the data, query, governance, deployment, lineage and evaluation foundation that an agent needs to work reliably at enterprise scale.
| Capability | Role | Why it matters |
|---|---|---|
| Agent Framework | Author, deploy and evaluate custom Python agents; connect them to structured data, unstructured data, code and external APIs | Framework-agnostic agent deployment close to enterprise data |
| Unity Catalog | Govern tables, files, functions, models, services and other data/AI assets | Central identity, privileges, metadata and audit foundation |
| Unity AI Gateway | Govern runtime interaction among models, agents, MCP servers and tools; route traffic, apply guardrails and monitor usage | Enterprise control plane for AI services and tool access |
| MLflow | Tracing, evaluation, model/agent lifecycle and monitoring | System-level quality and observability rather than conversational demos |
| Spark and SQL | Distributed transformation, matching, aggregation and feature engineering | Correct computational foundation for millions or billions of records |
| Lineage | Automatic lineage for supported queries, down to the column level | Impact analysis and traceability across data products and reports |
| Genie / semantic analytics | Natural-language access to governed analytical data and business semantics | Analyst interaction with SQL-based data rather than raw-record prompting |
7.2 Strong suite
-
Terabyte- and petabyte-scale ingestion, transformation, joins, aggregation and machine learning.
-
Population-level reconciliation, anomaly detection, fraud and improper-payment analytics.
-
Lakehouse governance, data access control, automatic lineage and reusable analytical data products.
-
ML and agent tracing, evaluation, monitoring and cost/performance optimization.
-
Open data and SQL/Spark orientation that can support multiple downstream applications and models.
7.3 Appropriate role in a DoD architecture
Databricks is a strong computational and analytical foundation for normalizing ERP and feeder data, constructing transaction populations, performing large joins, reconciling balances, training anomaly models and producing curated exception tables. Palantir or another operational platform may then turn those analytical results into cases, evidence relationships and approved actions.
8. Detailed Capability and Adoption Matrix
Direct = explicitly supported as a native or documented integration. Client = supplied by the actual Claude Code client. Analog = proprietary platform capability serving a similar function. Not confirmed = no current official evidence of exact support.
8.1 Claude-native primitives and direct integrations
| Capability | Claude Code | Ask Sage | Palantir AIP | IBM watsonx / Bob | Databricks AI |
|---|---|---|---|---|---|
| Claude model access | Native | Direct model routing | Direct model services | Select IBM products | External model endpoints/model serving |
| Actual Claude Code | Native | Direct compatible endpoint | Documented IDE/client integration | Not confirmed as endpoint | External use possible; native hosting not confirmed |
| Claude Agent SDK | Native | API compatibility possible; native template not confirmed | Direct templates documented | Not confirmed | Custom Python framework possible; first-class template not confirmed |
| MCP | Native | Direct platform MCP plus Claude Code MCP | Palantir MCP and Ontology MCP | Orchestrate and watsonx.data MCP | MCP services governed through Unity Catalog / AI Gateway |
| CLAUDE.md | Native | Client: yes; native Ask Sage format: no | Client: yes; native AIP format: no | No exact format | No exact format |
| Auto memory | Native | Client-provided; platform session/data features differ | Client/SDK-provided; platform histories differ | Proprietary state/context | Framework-dependent; MLflow traces are not memory |
| Skills | Native SKILL.md | Client: yes; personas/prompts/plugins are analogs | Client/SDK: yes; functions/templates/Logic are analogs | Agent/tool catalogs and workflows are analogs | Agent code, instructions and workflows are analogs |
| Hooks | Native | Client: yes; native equivalent less granular | Client: yes; actions, restrictions and approvals are analogs | Policy and orchestration analogs | Service policies, jobs and validation gates are analogs |
| Plugins | Native extension packaging | Client: yes; Ask Sage plugins differ | Client: yes; platform packages/templates differ | Bob/toolkits/catalog differ | No Claude plugin system; Marketplace serves different purposes |
8.2 Enterprise data, control, and operational capabilities
| Capability | Claude Code | Ask Sage | Palantir AIP | IBM watsonx / Bob | Databricks AI |
|---|---|---|---|---|---|
| Subagents / teams | Native | Client: yes; Deep Agent is a different abstraction | Agent SDK and platform agent composition | Orchestrate multi-agent composition | Framework-dependent supervisor/multi-agent patterns |
| LSP / IDE intelligence | Native | Client: yes through Claude Code | Client: yes; AI FDE/Code Workspaces are proprietary | Bob provides proprietary code intelligence | External IDE and notebook tooling; no Claude LSP system |
| Knowledge / RAG | Files, MCP, memory, web | Datasets, files, web, Deep Agent | Ontology, datasets, documents, functions | Knowledge bases and document libraries | Tables, volumes, vector/knowledge services, Unity Catalog |
| Semantic query | Tool-dependent | Primarily RAG and APIs | Ontology queries, functions, SQL and actions | watsonx.data, integrations and decision services | Spark, SQL, semantic metrics and Genie |
| Execution environment | Local/cloud coding sandbox | Claude Code client sandbox plus Ask Sage endpoint controls | Platform-controlled execution and scoped tools | Cloud/hybrid controlled runtime and IAM | Clusters, serverless compute, Apps and model serving |
| Enterprise permissions | Claude Code permissions | Government endpoint/admin controls; depends on integrated system | Strong identity, markings, object/property security and restrictions | IAM, secrets, governance and enterprise integration | Unity Catalog privileges, service policies and connections |
| Observability / evaluation | Sessions, logs and hooks | Account metrics and platform controls; app-specific evaluation required | AIP metrics, traces, logs and execution history | Enterprise monitoring/governance; product-specific evaluation | MLflow tracing/evaluation, system tables and gateway monitoring |
| Operational actions | Shell/tools; coding-oriented | Plugins/MCP/agents; not a financial action model | Predefined Ontology actions and workflows | Orchestrated enterprise actions and decision services | Custom tools, functions, jobs and workflows |
| Primary differentiation | Developer harness | Secure access and rapid text/RAG adoption | Operational Ontology and governed workflow | Hybrid integration and modernization | Big-data computation and AI operations |
9. Knowledge, Query, and Semantic Architecture
The word "knowledge" describes fundamentally different mechanisms across these products. A model context file, a vector index, a SQL semantic layer and an operational Ontology are not substitutes for one another.
| Knowledge type | Mechanism | Purpose | Strong platforms | Design implication |
|---|---|---|---|---|
| Project context | CLAUDE.md, rules and memory | Persistent instructions and repository knowledge | Claude Code | Flexible and close to work; limited enforcement and enterprise lineage |
| Document knowledge | RAG over policies, reports, contracts and supporting documents | Retrieve source passages for grounded answers | Ask Sage, IBM watsonx.data, Databricks knowledge/vector services, Palantir documents | Depends on corpus quality, metadata, retrieval and citation validation |
| Analytical semantics | SQL views, metric definitions, dimensional models and governed functions | Standardize measures and calculations across large structured datasets | Databricks, custom lakehouse, Palantir SQL/functions | Best for reproducible balances, trends, variance and aggregation |
| Operational semantics | Objects, relationships, actions, owners and workflow state | Connect data to business meaning and controlled action | Palantir Ontology; custom knowledge graph/workflow | High value for cases and remediation; requires sustained domain governance |
| Deterministic decision logic | Rules, validations and decision services | Enforce policy or calculation consistently | IBM decision services, SQL/Python/Spark rules, platform actions | Less flexible than an LLM, but essential for consequential calculations and controls |
🟩 For financial management
A canonical financial semantic layer should define funds, appropriations, fiscal years, TAS, USSGL, SFIS attributes, balances, obligations, expenditures, disbursements and financial statement line items. These definitions belong in governed data models and deterministic functions, not only in prompts or vector documents.
9.1 Why a query engine matters more than a larger model for data-heavy work
An LLM should not calculate a material balance by reading thousands of transaction rows in its context window. SQL or Spark should perform the aggregation; a rules engine should test compliance; a statistical or ML model should score anomalies; and the LLM should select approved tools, explain results, identify missing evidence and guide follow-up. This separation improves scale, reproducibility, cost and auditor confidence.
10. Harness Engineering and Enterprise Controls
Harness engineering is the discipline of making an LLM operate as a bounded, observable and testable system. The strongest model can still fail if the harness retrieves the wrong context, chooses unsafe tools, loops indefinitely, loses state, bypasses permissions or produces conclusions that cannot be reproduced.
| Harness component | Function | Enterprise importance |
|---|---|---|
| Context compiler | Select instructions, schemas, documents, examples, history and tool results | Prevents irrelevant or unauthorized context from entering the task |
| Planner and completion controller | Decompose tasks, choose steps and determine when to stop | Controls loops, cost and premature or false completion |
| Tool registry and contracts | Typed descriptions, inputs, outputs, permissions and failure behavior | Tool quality usually matters more than prompt cleverness |
| Permission broker | Propagate identity and authorize each read, query or action | Prevents agents from exceeding the user or mission role |
| Execution isolation | Sandbox code, commands, packages, files, network and secrets | Limits blast radius from mistakes or malicious content |
| State and memory | Persist only required task and organizational knowledge | Supports continuity while avoiding hidden, stale or unauthorized memory |
| Budget controller | Limit tokens, time, compute, SQL volume, retries and external calls | Keeps agentic work economically and operationally bounded |
| Evaluation | Test retrieval, calculations, tool use, security, policy and final answers | Measures the full system rather than model fluency |
| Telemetry and replay | Capture prompts, versions, tools, queries, data snapshots and outputs | Supports investigation, quality improvement and audit reproduction |
| Human control | Approval, exception handling, reviewer assignment and segregation of duties | Required before consequential financial or operational actions |
11. Workload-Based Platform Strategy
| Workload | Examples | Recommended center of gravity | Engineering focus |
|---|---|---|---|
| Text-intensive | Policies, manuals, NFR responses, CAP narratives, audit reports, correspondence, contracts | Ask Sage + approved Claude/model; custom RAG where necessary | Retrieval recall, authoritative sources, effective dates, citation support, prompt-injection defense and human review |
| Data-intensive | GL/subledger analysis, budget execution, variance, journal review, transaction matching | Databricks or Palantir with deterministic SQL/rules; LLM as orchestrator | Canonical semantics, reproducible queries, data quality, row/column security and evidence links |
| Big data | Millions/billions of transactions, population profiling, fraud/anomaly models | Databricks or equivalent distributed engine; Palantir for operational follow-through | Partitioning, incremental pipelines, lineage, feature quality, false positives, cost and latency |
| Operational workflow | Cases, evidence packages, approvals, remediation, owner/action tracking | Palantir AIP/Ontology; IBM Orchestrate for enterprise integration patterns | Object/action design, permission propagation, branching, approvals and status accountability |
| Legacy/hybrid | Mainframe code, COBOL/RPG/Java, long-lived interfaces and business rules | IBM Bob / watsonx / Orchestrate | Dependency discovery, deterministic rules, test coverage, hybrid connectivity and controlled modernization |
| Custom mission application | Unique cross-platform workflows or user experience | Claude Agent SDK or platform-neutral framework + MCP + enterprise services | Model abstraction, secure tools, evaluations, telemetry, operations and lifecycle ownership |
11.1 Text-heavy solution design
-
Curate authoritative collections and preserve document version, effective date, owner, security marking and supersession status.
-
Use hybrid retrieval, metadata filtering and reranking rather than relying only on vector similarity.
-
Require sentence- or claim-level citations and test whether the cited passage actually supports the answer.
-
Isolate retrieved content from system instructions and defend against prompt injection embedded in documents.
-
Measure retrieval coverage, citation support, abstention quality and human correction rate - not only response fluency.
11.2 Data-heavy solution design
-
Create governed SQL, Spark or service functions for every material calculation and reconciliation.
-
Expose narrow tools such as get_balance, trace_to_transactions, retrieve_support, run_reconciliation and create_case.
-
Return structured outputs with row counts, filters, effective dates, data versions and query identifiers.
-
Keep agent access read-only by default; require explicit approval for case updates, workflow changes or postings.
-
Use the LLM to plan, interpret and explain - never to substitute for a reproducible calculation engine.
11.3 Big-data solution design
For population-scale analysis, the correct pattern is raw data to distributed processing to curated analytical products to governed tools to AI explanation. Raw transaction populations should not be placed directly into an LLM context. The agent should invoke pre-approved distributed queries, receive summarized and traceable results, and drill into selected exceptions only when necessary.
12. DoD Financial Audit Target Architecture
GAO reported in May 2026 that DoD's revised audit approach increases emphasis on technology, including AI, focuses on material line items and evidence supporting account balances, and directs the Department to maximize AI, automation, data analytics and Advana to resolve audit issues. GAO also emphasized continuing concerns about reliable financial information, internal controls, IT weaknesses, transparency, fraud risk and sustainability. [16]
Figure 2. AI-enabled DoD financial audit target architecture.
| Layer | Contents | Audit purpose |
|---|---|---|
| 1. Authoritative source and evidence plane | Source IDs, transaction IDs, original values, documents, ingestion times, transformations, owners, markings and integrity metadata | Preserve the evidence chain and prevent AI output from replacing the system of record |
| 2. Financial semantic layer | TAS, fund, appropriation, fiscal year, USSGL, SFIS, line item, beginning/activity/ending balance and materiality | Provide one governed meaning for calculations and evidence |
| 3. Deterministic reconciliation and control engine | Feeder-to-GL, subledger-to-GL, rollforward, duplicate, unsupported journal, document match, interface and population completeness | Produce repeatable tests and exception populations |
| 4. Operational evidence and case layer | Transactions, source systems, documents, controls, samples, NFRs, owners, corrective actions and auditor requests | Connect analysis to accountability and remediation |
| 5. Governed tool layer | Read-only queries, approved SQL functions, evidence retrieval, reconciliation execution and package generation | Constrain the agent to approved, typed and logged operations |
| 6. Replaceable AI layer | Research, retrieval, tool selection, explanation, exception prioritization and drafting | Use model strengths without coupling the mission architecture to one vendor |
| 7. Human review and approval | Preparer, reviewer, approver, auditor coordination and exception disposition | Maintain accountability and segregation of duties |
| 8. Immutable execution record | Identity, model/prompt/skill version, data snapshot, SQL, tools, sources, output, approvals and changes | Enable replay, inspection and audit reliance |
🟥 Non-negotiable audit principle
The AI may retrieve, classify, explain, recommend and orchestrate. The governed data platform must calculate, reconcile, authorize, record and prove.
12.1 Priority AI use cases and automation boundaries
| Use case | Primary engine | Appropriate AI role | Control boundary |
|---|---|---|---|
| Policy and audit guidance research | RAG + LLM | Retrieve, summarize, compare and cite authoritative guidance | Human validates interpretation and applicability |
| Auditor document request response | RAG + evidence system + workflow | Find candidate support, assemble package and draft response | Human confirms completeness, relevance and release authority |
| Balance-to-transaction tracing | SQL/Spark + semantic model + Ontology | Trace line item to accounts, transactions, feeder systems and support | LLM explains path; deterministic services produce trace |
| GL/subledger reconciliation | SQL/Spark/rules | Match populations, quantify differences and classify exception types | LLM does not calculate material totals |
| Journal voucher analysis | Rules + anomaly model + LLM explanation | Identify unusual preparers, timing, accounts, amounts, descriptions and unsupported entries | Human investigates and determines disposition |
| Universe of Transactions completeness | Data engineering + lineage + control rules | Validate expected sources, record counts, totals, period coverage and interface completeness | AI prioritizes gaps; system proves completeness |
| NFR and CAP support | Evidence graph + RAG + LLM | Summarize condition, cause, effect, milestones, owners and supporting evidence | Human owns root cause, commitment and closure decision |
| Legacy system analysis | Code agent + IBM/Claude tools | Explain interfaces, rules and data transformations in legacy code | Testing and system owners validate behavior |
| Improper-payment / fraud triage | ML/statistics + rules + case management | Score population, cluster patterns and route cases | Human investigators determine findings and actions |
12.2 Data-model implication for Advana FM
A broad GL Extended table can be a valuable analytical spine because it brings many accounting attributes into one queryable population. It is not, by itself, an audit-ready evidence model. It may lack the full sequence of subledger events, interface-control evidence, source-document relationships, status history, reversals and corrections, user approvals, and business-event context needed to explain why an accounting entry occurred.
The recommended design is to retain the broad analytical table for speed while adding governed links to source transactions, subledger events, supporting documents, system/interface metadata, control results and audit cases. Palantir Ontology is one way to represent those relationships; a Databricks-centered implementation can use curated relational models, lineage, metric definitions and a separate case/evidence application.
12.3 Model availability and procurement risk
As of July 13, 2026, the DoD-Anthropic procurement and litigation environment remains unsettled. Current reporting indicates that Anthropic was designated a supply-chain risk for Pentagon contracting and was not included in the May 2026 agreements with seven other AI providers. The architecture should therefore support model substitution and validate model availability for each contract, network, classification and use case. [17][18]
13. Platform Strategies for Advana FM and DoD Audit
| Strategy | When it fits | Design pattern | Tradeoff |
|---|---|---|---|
| Palantir-first | Advana/Foundry is the approved operational platform and Ontology is central | Build financial/audit Ontology, evidence cases, governed actions and agent tools; use Claude or another approved model | Best operational integration and workflow; risk of weak Ontology/data discipline and vendor dependence |
| Databricks-first | Lakehouse and Spark/SQL are the enterprise data foundation | Build canonical audit data products, reconciliation functions, lineage and ML; expose governed tools to agents and a case application | Best computation and openness; requires added operational case/action design |
| Ask Sage-first | Immediate priority is secure text, policy and document assistance | Deploy curated datasets, citations and role-specific assistants; connect Claude Code for developers; integrate authoritative query tools later | Fast value and low initial engineering; insufficient alone for transaction-scale audit evidence |
| IBM-first | Legacy and hybrid systems dominate the transformation problem | Use Bob and watsonx for code/process modernization, Orchestrate for integrations, decision services for deterministic rules | Strong legacy integration; may add complexity when modern data platforms already cover core needs |
| Custom-first | Mission workflow is unique or portability is paramount | Use Agent SDK or neutral framework, MCP, enterprise IAM, data services, evidence store, evaluation and model routing | Maximum control; highest lifecycle, ATO, security and operations burden |
| Hybrid - recommended for enterprise audit | Multiple workload types coexist | Databricks/approved compute for population analytics; Palantir/Advana for operational evidence and workflow; Ask Sage for secure text; IBM for legacy; replaceable models | Best alignment to workload; requires clear system boundaries and governance |
13.1 Recommended role allocation
| Component | Recommended role |
|---|---|
| Advana / Palantir | Operational audit data, Ontology, evidence relationships, case/remediation workflow, permissions and actions |
| Databricks or approved distributed compute | High-volume ingestion, normalization, large joins, reconciliation, population profiling, anomaly models and reusable data products |
| Ask Sage | Secure model gateway, document/policy research, analyst drafting, rapid prototypes and controlled Claude Code access |
| IBM | Legacy/mainframe modernization, hybrid integrations, deterministic business rules and enterprise orchestration where required |
| Claude or another approved model | Replaceable reasoning, language, coding, tool selection and explanation component |
| Custom mission services | Financial semantics, validated tools, evaluation suites, evidence packaging and cross-platform orchestration |
14. Building a Custom Enterprise AI Solution
A custom solution should borrow Claude Code's engineering patterns without making Claude-specific artifacts the only way the mission system operates. Mission logic and evidence should remain accessible to other approved models and agents.
| Build area | Recommended pattern | Outcome |
|---|---|---|
| Model abstraction | Use a routing layer and common message/tool interface | Switch models without rebuilding tools, evidence, permissions or workflow |
| Canonical context | Maintain versioned domain rules, data definitions, system quirks and operating procedures | Equivalent in purpose to CLAUDE.md, but governed and available across models |
| Skill-style modules | Package reconciliation, evidence review, sampling, NFR response and control testing separately | Avoid one giant prompt and enable focused testing/versioning |
| MCP / API tools | Expose typed, narrow, authenticated functions | Reduce bespoke integrations and constrain agent behavior |
| Deterministic validation hooks | Run security, data-quality, query, evidence and approval checks before completion or action | Convert critical rules from suggestions into enforced controls |
| Agent specialization | Use separate research, data, evidence, security and review agents only where isolation adds value | Prevent context overload and over-privileged general agents |
| Enterprise authorization | Propagate user identity and mission role to every tool | Prevent the agent from becoming a shared super-user |
| Evidence and replay | Record sources, queries, versions, outputs and approvals | Make every material result reproducible |
| Evaluation and red teaming | Test gold cases, planted data errors, prompt injection, unauthorized access and incomplete evidence | Establish reliability before operational expansion |
| Secure execution | Sandbox code, packages, network, secrets and temporary files | Contain failures and malicious inputs |
14.1 What not to build from scratch
-
Enterprise identity and access management when an approved service already exists.
-
A new distributed query engine or data catalog when Databricks, Palantir or another approved platform already provides it.
-
A custom vector database solely because an LLM feature requires retrieval.
-
A proprietary tool protocol where MCP or OpenAPI can meet the requirement.
-
A model-specific evidence store that becomes unusable when the model changes.
-
An autonomous financial posting agent before read-only workflows, evidence controls and human approvals are proven.
15. Implementation Roadmap and Measures of Success
| Phase | Primary work | Exit criterion |
|---|---|---|
| Phase 0 - Mission and governance | Select one material audit use case; define authoritative sources, owners, security boundary, model options and success criteria | Approved concept, data/tool inventory, risk register and evaluation plan |
| Phase 1 - Trusted data foundation | Build canonical transaction/balance/evidence datasets, source reconciliation, quality controls and lineage | Reconciled population with documented completeness and quality |
| Phase 2 - Deterministic tools | Implement validated SQL/Spark/rule functions and expose them through governed APIs or MCP | Repeatable calculations, reconciliations and evidence retrieval |
| Phase 3 - Read-only copilot | Add agent for research, query planning, explanation and evidence-package assembly | Grounded responses with citations and no consequential write access |
| Phase 4 - Human-approved workflow | Add case creation, task routing, exception disposition and package submission | Controlled actions with segregation of duties and immutable approvals |
| Phase 5 - Scale and optimize | Expand populations, models and workflows; add routing, monitoring, cost controls and fallback models | Measured enterprise performance, reliability and sustainability |
| Measurement domain | Recommended measures |
|---|---|
| Data trust | Percent of material balances reconciled; transaction population completeness; percent traceable to source and support; unresolved data-quality exceptions |
| Text/RAG quality | Retrieval recall; citation support rate; superseded-source error rate; abstention quality; human correction rate |
| Analytical accuracy | SQL/rule test pass rate; reconciliation precision; anomaly false-positive/false-negative rate; reproducibility across data snapshots |
| Operational performance | Time to answer auditor requests; evidence-package cycle time; analyst hours saved; case aging; remediation throughput |
| Agent control | Unauthorized tool attempts; approval bypasses; prompt-injection success rate; budget overruns; failed or looping tasks |
| Auditability | Percent of material outputs with complete model, prompt, tool, query, data-snapshot, source and approval record |
| Cost and scale | Cost per document, query, million transactions, evidence package and closed exception; compute and token utilization |
16. Final Recommendations
-
Do not select a platform based on which one advertises Claude. Select the authoritative data, semantic, workflow and control layers first.
-
Use the real Claude Code client when repository-centric software engineering is the problem. Use the Claude Agent SDK when its harness patterns are needed inside a custom application.
-
Treat Ask Sage as a secure model and text-assistance layer, not as the transaction or evidence system.
-
Treat Palantir AIP as an operational semantic and workflow platform whose differentiation is Ontology, permissions, actions and evidence relationships.
-
Treat Databricks as the analytical and computational foundation for large structured data, reconciliation, ML, lineage and evaluation.
-
Treat IBM as the preferred specialist where legacy modernization, hybrid integration and deterministic enterprise decisioning are central.
-
For DoD audit, begin with trusted data, material-line-item semantics, reconciliation and evidence provenance. Add AI after the deterministic foundation exists.
-
Keep model access replaceable because technical performance, cost, authorization and procurement conditions can change faster than mission systems.
-
Default to read-only agent tools. Introduce actions only through predefined workflows, explicit approval and segregation of duties.
-
Evaluate the complete system - retrieval, data, tools, calculations, permissions, citations and human workflow - rather than the model alone.
🟦 Recommended Advana FM pattern
Governed financial and evidence data + distributed reconciliation and analytics + operational Ontology/case management + narrow MCP tools + replaceable approved models + read-only agent by default + human-approved actions + immutable execution record.
Appendix A. Decision Checklist
| Decision area | Required question |
|---|---|
| Mission outcome | What specific decision, audit assertion, evidence package or workflow must improve? |
| Authoritative data | Which system and data product is authoritative for each balance, transaction, document and status? |
| Semantic model | Where are accounting and business definitions implemented and versioned? |
| Deterministic logic | Which calculations, matches, thresholds and control tests must be reproducible? |
| Model role | What requires reasoning or language, and what should remain SQL, code, rules or workflow? |
| Tool design | Are agent tools narrow, typed, authenticated, logged and read-only by default? |
| Permissions | Does every operation execute under the user or approved service identity? |
| Evidence | Can each material claim be traced to source, query, data version and supporting document? |
| Human control | Who prepares, reviews, approves and resolves exceptions? |
| Evaluation | What gold cases and adversarial tests demonstrate reliability and security? |
| Operations | Who owns monitoring, incidents, model changes, data drift, cost and retraining? |
| Portability | Can the model be replaced without rebuilding data, tools, evidence and workflow? |
| Authorization | Is the model, platform, network, data type and use case approved under the applicable ATO and contract? |
Appendix B. Source Notes
Product capabilities and availability change rapidly. The following official documentation and current reporting support the principal factual statements in this report. Revalidate before acquisition or deployment.
1. Anthropic - Claude Code overview: <u>Open source</u>
2. Anthropic - How Claude remembers your project: <u>Open source</u>
3. Anthropic - Create plugins: <u>Open source</u>
4. Ask Sage - Anthropic-compatible endpoints and Claude Code integration: <u>Open source</u>
5. Ask Sage - Data, Deep Agent and MCP: <u>Open source</u>
6. Palantir - July 2026 announcements, including Claude Agent SDK templates: <u>Open source</u>
7. Palantir - June 2026 announcements, including Palantir MCP and Ontology MCP GA: <u>Open source</u>
8. Palantir - Ontology MCP overview: <u>Open source</u>
9. Palantir - AI FDE overview: <u>Open source</u>
10. IBM and Anthropic partnership: <u>Open source</u>
11. IBM Cloud - Agentic AI workflow with watsonx Orchestrate and MCP: <u>Open source</u>
12. IBM watsonx.data remote MCP server: <u>Open source</u>
13. IBM Bob AI coding agent: <u>Open source</u>
14. Databricks - Use agents on Databricks: <u>Open source</u>
15. Databricks - Unity AI Gateway and Unity Catalog lineage: <u>Open source</u>
15a. Databricks - Unity Catalog data lineage: <u>Open source</u>
16. GAO-26-109115 - DOD Financial Management: Questions Associated with New Financial Audit Approach: <u>Open source</u>
17. Reuters - Pentagon supply-chain-risk designation of Anthropic, March 5, 2026: <u>Open source</u>
18. Reuters - Pentagon agreements with seven AI providers, May 1, 2026: <u>Open source</u>
Learning map
Stage 1: Core Architectures & Agent Primitives
- Model vs. Harness: Learn the functional separation of the LLM from the planning engine to prevent prompt-injection of business logic.
- Model Context Protocol (MCP): Understand how open protocols decouple reasoning models from backend tools and enterprise databases.
- State and Memory Management: Grasp how agents persist context across sessions without inflating token budgets or crossing security boundaries.
Stage 2: Enterprise Semantic & Data Planes
- Semantic Layers (SQL/Spark/Ontology): Learn to construct deterministic semantic schemas so the LLM accesses validated statistics rather than calculating values itself.
- Lineage & Metadata Tracking: Discover how to trace LLM-generated decisions down to the underlying column-level database modifications.
- Permissions & IAM Propagation: Master identity delegation to prevent agents from acting as over-privileged system-level users.
Stage 3: Operational Guardrails & Evaluations
- Harness Isolation & Sandboxing: Execute agent commands safely inside secure containers to contain programming mistakes or malicious data.
- Automated Evaluation (Evals): Build systematic validation suites with test datasets to grade retrieval coverage, accuracy, and compliance.
Get hands-on — step by step
Step 1: Set up a Local Sandbox
Create a secure Python virtual environment to host your agent's local testing environment:
mkdir mcp-audit-sandbox
cd mcp-audit-sandbox
python3 -m venv venv
source venv/bin/activate
pip install mcp langchain-anthropic
Step 2: Write a Read-Only SQL-Mocking Tool
Create a Python file tools.py that implements a deterministic database query rather than letting the LLM calculate results directly:
def get_ledger_balance(fund_id: str) -> dict:
# Mocking database response
mock_db = {"FUND_A": 1500000.00, "FUND_B": 850000.50}
balance = mock_db.get(fund_id, 0.0)
return {"fund_id": fund_id, "balance": balance, "status": "reconciled"}
Step 3: Integrate with an MCP Server Pattern
Set up a fastmcp server pattern to securely register your ledger query tool:
from mcp.server.fastmcp import FastMCP
mcp = FastMCP("DoDAuditServer")
@mcp.tool()
def query_balance(fund_id: str) -> str:
"""Retrieves verified reconciled balance for a given fund ID."""
res = get_ledger_balance(fund_id)
return f"Verified balance for {res['fund_id']} is ${res['balance']:,.2f}."
Step 4: Evaluate and Audit the Run
Execute tests against the tool to verify that the LLM is restricted to calling this exact tool rather than guessing ledger balances, logging the full execution trace.
Top 3 sources
- 1Anthropic Claude Code Documentation
The official guide to Anthropic's reference agent harness, showing how to structure CLI agents, memory, and permissions.
https://code.claude.com/docs/en/overview
- 2Model Context Protocol (MCP) Official Site
The official open-source protocol documentation explaining how to safely connect LLMs to data sources and tools.
https://modelcontextprotocol.io
- 3Databricks Agent Framework
Official reference guide to deploying, evaluating, and monitoring enterprise-grade Python agents alongside secure database catalogs.
https://docs.databricks.com/en/generative-ai/agent-framework/index.html
Links are AI-suggested — worth a quick sanity check before diving in.