Ask Sage · Palantir AIP · IBM watsonx · Databricks — Combined & Corrected Reference
7/13/2026, 6:00:33 PM · updated 7/13/2026, 6:04:25 PM
An architectural guide comparing Ask Sage, Palantir AIP, IBM watsonx, and Databricks for integrating Claude Code, MCP, and model-agnostic agent harnesses within secure DoD financial audit environments.
Merged from two independent analyses, fact-checked against primary sources, and reconciled. Prepared July 13, 2026.
Provenance key used throughout:
[A]= carried from the original attached analysis and verified accurate ·[C]= added or corrected from this review's research ·[A→C]= present in the original but corrected here. Full change log in Section 9.
1. Executive assessment
Claude models, Claude Code / the Claude Agent SDK, and enterprise AI platforms operate at three different layers. The central error to avoid is treating them as competing, substitutable products:
- Claude models provide reasoning, language generation, coding, and tool selection.
- Claude Code and the Claude Agent SDK provide an agent harness: context assembly, tool execution, permissions, agent loops, memory, hooks, subagents, skills, plugins, and IDE interaction.
- Enterprise AI platforms provide governed data, identity, workflow execution, semantic models, lineage, deployment, evaluation, compliance, and integration with operational systems.
[A]
Using a Claude model does not mean using Claude Code's architecture. Among the platforms reviewed:
- Ask Sage has the closest direct compatibility with the actual Claude Code client — confirmed: its Anthropic-compatible endpoint runs the real Claude Code CLI, VS Code extension, and Claude Cowork unmodified, including DoD PKI cert support for Army GenAI.
[A, verified] - Palantir has gone furthest in combining the Claude Agent SDK, MCP, enterprise permissions, operational data, and actions — confirmed via Foundry's Anthropic-compatible proxy endpoints and Ontology MCP's support for headless Anthropic SDK agents.
[A, verified] - Databricks has an equally direct Claude Code relationship, not merely a model-serving one: Agent Bricks lists the Claude Code SDK as a first-class supported harness, and Omnigent — Databricks' open-source "harness of harnesses" — composes Claude Code, Codex, and custom agents under one governed runtime. This reclassifies Databricks from "not documented" to Direct.
[C — corrects the original analysis] - IBM has the strongest proprietary alternative for hybrid enterprise integration, legacy modernization, decision services, and mainframe-heavy environments, via IBM Bob and watsonx Orchestrate as a multi-vendor agentic control plane.
[A] - Claude Code itself remains the strongest of these for repository-centric coding and configurable local agent behavior.
[A]
One fact changes the practical calculus for a DoD environment specifically, and it is addressed nowhere in the original analysis — see Section 2.
2. Critical currency note: the DoD–Anthropic contract dispute
New in this version — absent from the original attached analysis, and material to any recommendation that assumes Claude is a freely approved model inside DoD contracts and classified networks.
In late February 2026, DoD designated Anthropic a "supply chain risk" — a designation typically reserved for foreign adversaries — following a dispute over whether the military could use Claude for "all lawful purposes," which Anthropic said could authorize autonomous weapons systems or domestic mass surveillance. President Trump directed federal agencies to cease using Anthropic technology. On May 1, 2026, DoD announced classified-network (IL6/IL7) AI partnerships with eight vendors — SpaceX, OpenAI, Google, NVIDIA, Reflection, Microsoft, AWS, and Oracle — pointedly excluding Anthropic. Anthropic sued; a California injunction preserves its ability to serve civilian agencies, but the Pentagon exclusion stands for DoD contracts while litigation continues. Reporting since indicates informal talks have reopened, but as of this writing the exclusion is active and contested.
Practical implication: recommendations below that route through "Claude via the approved AIP model service" or "Claude via Ask Sage" remain architecturally correct — both platforms genuinely support Claude as described — but whether Claude is a procurable, authorized model for a specific DoD contract or classified network is a live policy question independent of the technical architecture. Two consequences:
- Architect any DoD-facing build so the model provider is swappable behind your MCP/tool abstraction layer — Claude, or another accredited model, should sit behind the same harness without a rebuild.
- For unclassified CUI/FOUO work (most day-to-day DoD FM analysis), Claude via FedRAMP-High pathways may remain more available than classified-network deployments — confirm current status with your ISSM/AO before committing engineering time, since this is actively litigated and changing.
3. What Claude Code actually includes
Claude Code is more than an interface to an LLM: it is an agentic coding tool that reads a codebase, edits files, executes commands, and interacts with development tools; the Claude Agent SDK exposes the same tools, agent loop, and context-management mechanisms for custom agents. [A]
3.1 Context and knowledge
Claude Code assembles context from source files, CLAUDE.md, local auto-memory (indexed by MEMORY.md, capped at the first 200 lines / 25KB per session load), active IDE files, command output, MCP resources/tools, agent skills, and subagent results. This is flexible, session-oriented project knowledge — not the same thing as an enterprise knowledge graph, governed data catalog, or semantic SQL layer. [A, verified]
3.2 Skills, hooks, plugins, subagents, LSP
- Skills: reusable SKILL.md-centered instruction packages that load on demand — relevant DoD FM examples include audit evidence validation, USSGL/SFIS mapping checks, NFR root-cause analysis, and reconciliation procedures.
[A] - Hooks: deterministic controls at lifecycle events (block an unsafe command, run a scan post-edit, require a test before completion, log to an audit system).
- Plugins: package skills, hooks, subagents, MCP servers, and LSP servers into one distributable, versioned unit.
- Subagents / agent teams: context-isolated specialist workers with restricted tools, run in foreground or background.
- LSP: plugins can bundle language-server diagnostics so Claude sees IDE errors/warnings directly; a documented "safe mode" flag disables CLAUDE.md, plugins, skills, hooks, and MCP servers for troubleshooting.
[A, core claim verified; LSP/auto-memory inclusion in safe mode specifically unconfirmed]
These matter much less for large-scale financial transaction analysis than data lineage, semantic modeling, SQL execution, access control, and evidence provenance. [A]
3.3 The harness-engineering framework
An AI harness is the system around the model that determines whether it becomes a useful enterprise agent or merely a chatbot. A mature harness includes twelve functional components: [A]
| Harness component | Purpose |
|---|---|
| Context compiler | Selects what documents, schema, instructions, history, and metadata enter the prompt |
| Planner | Decomposes a goal into steps and chooses tools |
| Tool registry | Defines available tools, schemas, descriptions, and restrictions |
| Permission broker | Decides what the agent may read, change, execute, or approve |
| Execution environment | Runs code and commands in a controlled sandbox |
| State manager | Maintains session state, checkpoints, and resumability |
| Memory system | Stores reusable knowledge outside the immediate context window |
| Budget controller | Limits tokens, time, tool calls, compute, and retries |
| Completion controller | Determines when the task is complete or must stop |
| Evaluator | Tests correctness, grounding, security, and policy compliance |
| Telemetry layer | Records prompts, tools, queries, outputs, costs, latency, and failures |
| Human-control layer | Provides approvals, exception handling, and segregation of duties |
Claude Code and the Agent SDK supply much of this for coding-oriented agents. Palantir, IBM, and Databricks supply alternative enterprise harnesses. Ask Sage can either supply its own Deep Agent/Agent Builder environment or serve as the secure model endpoint behind the actual Claude Code harness. [A]
4. Adoption comparison matrix
Classification terms: Direct = the platform explicitly implements or supports the Claude mechanism. Client-provided = the mechanism works because the real Claude Code client is being used against the platform's endpoint. Analogous = the platform has a proprietary equivalent, not format-compatible. Not documented = no public documentation establishes compatibility. [A]
| Capability | Ask Sage | Palantir AIP | IBM watsonx/Bob | Databricks AI |
|---|---|---|---|---|
| Claude model access | Direct — model routing via Anthropic-compatible endpoint | Direct — AIP model services (Azure, AWS Bedrock, Vertex, native) | Strategic integration across IBM portfolio (Orchestrate, Bob, watsonx.ai) | Direct — Mosaic AI Model Serving hosts Claude natively |
| Actual Claude Code compatibility | Very high — documented Anthropic-compatible endpoint; real Claude Code CLI/VS Code/Cowork run unmodified | High — Foundry provides Anthropic-compatible proxy endpoints; Claude Code confirmed as external client | Not documented as a Claude Code-compatible endpoint; IBM Bob is a separate, proprietary coding agent | Direct as of June 2026 — Agent Bricks lists Claude Code SDK as a first-class harness [A→C: corrected] |
| Claude Agent SDK | API-compatible via the endpoint; no separate native SDK integration documented | Direct — Ontology MCP explicitly supports headless "Anthropic SDK" agents alongside Google ADK, Microsoft Agent Framework, OpenAI SDK | No explicit native Claude Agent SDK support found | Direct — Omnigent composes Claude Code, Codex, and custom agents under one runtime [A→C: corrected] |
| MCP | Native — built-in M365/GitHub connectors plus custom MCP servers, admin-whitelisted | Very strong — two distinct servers: Ontology MCP (governed operational data) and Palantir MCP (80+ dev tools, cannot write production data) | Strong — Orchestrate and watsonx.data expose MCP servers; IBM co-authors the open MCP standard | Strong — MCP added directly to Unity Catalog; managed servers expose UC Functions, Genie, Vector Search, DBSQL |
| CLAUDE.md | Available when running actual Claude Code through the endpoint; not a native Ask Sage format | Available through external Claude Code; not a native AIP configuration standard | No exact adoption found | No exact adoption found; Genie Ontology plays an analogous canonical-context role |
| Skills | Available through Claude Code; Ask Sage personas/templates/plugins are analogous, not format-compatible | Available through Claude Code/Agent SDK; documented pattern for building Claude skills around Ontology MCP tools | IBM Agent Catalog concepts are analogous, not Anthropic Agent Skills | "Agent-mode skills" for Genie Code share the name, not the spec; converging but proprietary |
| Hooks | Provided by the Claude Code client when used as endpoint | Provided by external Claude Code; Palantir has its own action/approval/workflow mechanisms | IBM orchestration and policy controls are analogous | Databricks service policies, jobs, and MLflow controls are analogous |
| Plugins | Claude Code plugins work in the client; Ask Sage also has ~27 proprietary plugins/agents | Claude Code plugins work externally; Palantir has packages, templates, applications, and MCP as alternatives | IBM Agent Catalog and ADK are proprietary alternatives | Framework libraries, Unity Catalog services, and MCP are alternatives; no plugin marketplace |
| Subagents | Claude Code and Cowork provide them; Deep Agent is analogous | Claude Agent SDK supports agent composition; AIP can expose agents as tools | Orchestrate supports native and external agent composition | Multi-agent supervisor patterns and Omnigent-composed harnesses are supported |
| LSP / IDE diagnostics | Full Claude Code capability when used as endpoint | Available through external Claude Code; AI FDE has its own proprietary code/data awareness | IBM Bob supplies its own repository and IDE intelligence | No exact equivalent; notebook/dev tooling is platform-native |
| Knowledge / RAG | Datasets, files, personas, plugins, MCP, with an Explainability retrieval-audit feature | Ontology, datasets, documents, functions, applications | Knowledge bases and watsonx.data document libraries | AI Search, Vector Search, Unity Catalog tables and volumes, Genie Ontology |
| Semantic / query engine | Primarily RAG and API-driven — no full enterprise semantic SQL layer identified | Very strong operational semantic layer via Ontology, query functions, actions, object relationships | Strong hybrid data and decision-service capability | Very strong analytical semantic layer via SQL, Genie, Metric Views, Spark, Unity Catalog |
| Audit / governance | Strong secure gateway and government-deployment positioning; zero-trust, label-based access control | Strong identity propagation, permissions, branching, lineage, execution history, and approvals — satisfies EU AI Act Art. 13 auditability with less configuration than peers | Strong enterprise governance, hybrid deployment, decisioning and lifecycle controls; Sovereign Core embeds policy at the runtime layer | Strong data/AI lineage, access control, traffic governance via Unity AI Gateway, MLflow tracing and evaluation |
5. Platform deep dives
5.1 Ask Sage
Extent of Claude adoption
Ask Sage's Anthropic-compatible endpoint is fully documented to run the real Claude Code CLI and VS Code extension with minimal configuration (point ANTHROPIC_BASE_URL at Ask Sage), including DoD PKI certificate support for Army GenAI environments, and the same pattern extends to Claude Cowork. Because the real client is doing the work, Ask Sage does not need to reimplement CLAUDE.md, skills, hooks, plugins, subagents, or LSP — it supplies model routing, authentication, government connectivity, and inference underneath the unmodified Anthropic client. [A, verified]
Ask Sage's own native platform separately includes datasets, persona/prompt templates, ~27 plugins and agents, Deep Agent, Agent Builder, workbooks/canvases, and API access — but these should not be treated as format-compatible with Anthropic Agent Skills, Claude plugins, or CLAUDE.md. [A]
Strongest capabilities
- Access to 150+ commercial models behind one controlled, government-accredited interface
- Fastest path to Claude Code inside a controlled DoD/IL5/IL6 environment without building a model gateway
- CUI-capable, zero-trust, label-based access control; edge/air-gapped deployment option
- Lowest-engineering path from chat to API-based applications for non-developer analysts
Limitations
Ask Sage should not be treated as the authoritative enterprise data or audit system. It is weaker than Palantir or Databricks on enterprise semantic modeling of financial objects, transaction-scale reconciliation, column-level lineage, distributed SQL/Spark computation, and evidence-chain management. For DoD audit, position it as a secure model and analyst-assistance layer — not the Universe of Transactions, reconciliation engine, or evidence repository. [A]
5.2 Palantir AIP
Extent of Claude adoption — three levels
- Level 1: Claude as an AIP model, via Azure, AWS Bedrock, Google Vertex, or native enrollment, subject to region/environment availability.
- Level 2: Claude Code as an external Foundry client — confirmed. Foundry provides LLM-provider-compatible proxy endpoints (Anthropic, OpenAI format) specifically so tools like Claude Code can run while Foundry adds rate limiting, zero data retention, and usage tracking. Under this pattern Claude Code supplies CLAUDE.md, skills, plugins, hooks, subagents, and IDE integration; Palantir supplies governed data, Ontology, models, APIs, permissions, and enterprise tools; MCP connects the two.
- Level 3: Claude Agent SDK inside Palantir-hosted agents — confirmed. Ontology MCP explicitly documents integration with headless agent frameworks including the "Anthropic SDK," alongside Google ADK, Microsoft Agent Framework, and OpenAI SDK.
Ontology MCP vs. Palantir MCP — an important, correctly documented distinction
Ontology MCP (OMCP) exposes object types, action types, and query functions as governed MCP tools for agents that need to safely read, write (via predefined actions only), and query production ontology data; access is scoped through application restrictions and standard Foundry permissions. Palantir MCP is a separate, developer-facing server (80+ tools across roughly 14 categories) for building Foundry resources — datasets, ontology, code repos, OSDK apps — and explicitly cannot write production ontology data. This separation is far more appropriate for high-consequence financial management than giving an agent unrestricted database or shell access. [A, verified]
Palantir's proprietary harness
AI FDE (Palantir's own enterprise harness) acts under the current user's identity and permissions — if the user cannot create a repository, edit an object type, or execute an action, neither can AI FDE. Palantir replaces most Claude Code constructs with its own:
| Claude Code concept | Palantir counterpart |
|---|---|
| CLAUDE.md | Application/repository/AI FDE context |
| Skill | Function, tool, AIP Logic block |
| Plugin | Platform package or MCP server |
| Hook | Action validation or workflow policy |
| Subagent | Agent-as-tool or Agent SDK subagent |
| Local trace | AIP execution history and workflow lineage |
[A]
Strongest capabilities
- Operational data integration and business-object modeling — an Ontology can represent financial statement line items, USSGL accounts, appropriations, journal vouchers, obligations, disbursements, feeder systems, supporting documents, audit samples, controls, NFRs, and corrective actions as first-class, related objects
- Fine-grained authorization/markings, human-in-the-loop actions, case management, cross-system lineage
- Structurally satisfies EU AI Act Article 13-style auditability with less custom configuration than competing platforms
Limitations
The Ontology requires careful design and sustained governance; poor semantic modeling produces a sophisticated interface over unreliable data. Proprietary constructs create vendor dependence. Large-scale raw computation is more naturally a Spark-oriented job where Databricks is already the data platform. [A]
5.3 IBM watsonx and IBM Bob
Extent of Claude adoption
IBM and Anthropic announced a strategic partnership (October 2025) to infuse Claude into IBM's software portfolio with enterprise security, governance, and cost controls. IBM is primarily adopting Claude models, not replacing its architecture with Claude Code's. Its harnesses remain watsonx Orchestrate, IBM Agent Development Kit, IBM Agent Catalog, watsonx.data, watsonx.governance, IBM Bob, and IBM's decision/automation products. Orchestrate now functions as an agentic control plane governing agents from IBM's own Granite models, Anthropic's Claude, OpenAI's GPT, Mistral, and custom builds under one consistent policy layer — IBM's real differentiator is governing agents it didn't build, at scale, across vendors. [A, extended]
IBM Bob vs. Claude Code
Bob (IBM's coding agent, replacing the earlier Watsonx Code Assistant) covers architecture, coding, testing, security, and modernization for Java, IBM i, and mainframe environments, dynamically routing tasks across Claude, Mistral, and Granite by accuracy/performance/cost — roughly 80,000 IBM employees reportedly use it internally with a cited 45% productivity gain. Public documentation does not establish Bob as using CLAUDE.md, Anthropic Agent Skills, Claude plugin packaging, hooks, LSP plugins, or Claude Code's exact subagent configuration — it is its own harness and development model. [A, extended]
Strongest capabilities
- Hybrid/on-premises architecture; Java, COBOL, RPG, and mainframe modernization
- Business rules and decision services — a deterministic entitlement or policy calculation should remain in a rules engine, with Claude explaining the policy or gathering inputs, not improvising the final number
- $11B Confluent acquisition brings Kafka/Flink real-time streaming into watsonx.data; Sovereign Core embeds policy at the infrastructure runtime level
Limitations
Less attractive when the goal is the exact Claude Code developer experience, lightweight greenfield agent development, Spark-scale data engineering, or a Palantir-style operational ontology. Its breadth (Orchestrate, watsonx.data, watsonx.ai, watsonx.governance, Bob) can itself create architectural complexity. [A]
5.4 Databricks AI
This section corrects the original analysis, which understated Databricks' Claude Code relationship based on documentation that predates the June 2026 Data + AI Summit.
Extent of Claude adoption
Databricks supports Anthropic through Mosaic AI Model Serving with centralized credential management and AI Gateway controls, and its Agent Framework supports custom agents, RAG, tool-calling, and multi-agent systems with MLflow tracing/evaluation. At the June 2026 Data + AI Summit, Databricks explicitly expanded Agent Bricks — its developer agent platform (100,000+ agents built, reportedly processing over a quadrillion tokens/year) — to support the Claude Code SDK as a first-class harness alongside LangGraph, Agno, CrewAI, and OpenAI Agent SDKs. Databricks also released Omnigent, an open-source "harness of harnesses" that explicitly composes Claude Code, Codex, and custom agents in one workflow, with contextual policies enforced at runtime through Unity AI Gateway and every session traced in MLflow. This is Direct adoption of the Claude Agent SDK/Claude Code harness — not merely hosting the underlying model. [C]
Databricks' real advantage
Unity Catalog is the governance backbone — it enforces access controls, tracks data/AI lineage down to the column level, records activity for audit, and now governs tables, files, functions, models, agents, and MCP servers together (MCP was added directly to Unity Catalog). Genie Ontology continuously learns business semantics (fiscal year definitions, org hierarchy, term definitions) so agents don't rebuild context every call, and Genie Agents convert natural-language questions into governed SQL. This is generally more reliable for financial metrics than placing business definitions only in a system prompt. [A, extended with C]
Strongest capabilities
- Terabyte/petabyte-scale processing, Spark and distributed SQL, data engineering pipelines, ML feature development
- The most direct interoperability with the actual Claude Code harness of any platform reviewed, via Agent Bricks and Omnigent
- Unity AI Gateway as a single governance/cost/guardrail layer across models, agents, MCP servers, and Skills
Limitations
Less naturally oriented toward operational object/action modeling, case-based remediation workflows, and human-approval processes tied directly to business objects — those can be built, but typically require additional applications or workflow systems on top. GovCloud/FedRAMP High coverage is expanding but currently behind Ask Sage and Palantir's classified-environment accreditation timeline. [A, extended]
6. Recommended platform by workload
| Workload | Best primary fit | Why |
|---|---|---|
| Secure text assistance and document analysis | Ask Sage with Claude or Claude Code | Secure model access, datasets, multiple models, rapid implementation, retrieval audit trail |
| Coding and repository automation | Claude Code directly — through Ask Sage, Palantir, or Databricks as the endpoint | Strongest configurable coding harness, skills, hooks, subagents, and IDE integration; now equally well hosted by all three |
| Operational enterprise workflow | Palantir AIP | Ontology, actions, permissions, approvals, operational applications |
| Large-scale structured analytics | Databricks | Spark, SQL, pipelines, semantic metrics (Genie Ontology), MLflow, lineage |
| Big-data anomaly / fraud analysis | Databricks, operationalized through Palantir | Distributed computation first; operational case/action layer second |
| Legacy and mainframe modernization | IBM Bob and watsonx | Specialized Java, IBM i, COBOL, and mainframe capabilities |
| Complex hybrid enterprise orchestration | IBM watsonx Orchestrate | Multi-vendor agent catalog, decisioning, hybrid environment governance |
| Maximum customization and portability | Custom application on the Claude Agent SDK + MCP | Direct control over harness, tools, policy, and user experience |
| DoD financial audit | Palantir/Advana or Databricks as the evidence/data plane, Ask Sage/Claude as the assistant layer | Audit requires trusted data, lineage, reconciliation, and controlled workflows — not only an LLM |
6.1 Text-heavy solutions
Examples: policy analysis, audit report review, correspondence drafting, NFR summarization, control narrative generation.
Recommended architecture: secure model gateway (Ask Sage or an enterprise model endpoint) → document ingestion and metadata extraction → hybrid keyword+vector retrieval → reranking with document-level access control → Claude Agent SDK or platform-native agent → citation and evidence display → human review → evaluation against a curated Q&A set.
Measure retrieval correctness, citation accuracy, whether superseded guidance was excluded, and whether the system appropriately declined when evidence was insufficient — not how fluent the answer sounds. Ask Sage is the strong default here; Palantir becomes more valuable once documents must tie to operational objects, transactions, controls, owners, or actions. [A]
6.2 Data-heavy solutions
Examples: budget execution, transaction reconciliation, GL analysis, abnormal journal review, obligation-to-invoice matching.
Recommended architecture: governed structured data layer → data contracts and quality rules → semantic layer defining measures and accounting concepts → deterministic SQL/code tools → an MCP interface exposing only curated queries and actions → the LLM for planning, tool selection, and explanation → reproducible result storage → human approval for consequential actions.
The LLM should never calculate critical financial totals from thousands of records in its own context window: SQL calculates the balance, Spark performs the large join, a rules engine tests compliance, a statistical model flags anomalies — the model chooses the approved tool and explains results. Choose Palantir when data must connect to business objects, cases, and actions; Databricks when the center of gravity is SQL/Spark/ML/scale; IBM when logic spans legacy/mainframe systems; Ask Sage as the analyst-facing language layer on top. [A]
6.3 Big-data solutions
For millions or billions of transactions, never send raw records to Claude. Pattern: raw source systems → distributed ingestion/standardization → data-quality and reconciliation pipelines → curated transaction/balance/exception tables → semantic measures and approved query functions → MCP tools → Claude or another LLM → explanation, prioritization, and workflow initiation.
Focus areas: partitioning, incremental processing, data skew, source-to-target reconciliation, schema evolution, lineage, deterministic business rules, cost per million transactions, and false-positive management. Databricks generally has the best native foundation for this computation; Palantir can consume the curated results and convert them into operational cases and approved actions. A common mistake is using an agent to replace the Spark/SQL layer — the agent should orchestrate the computation, not perform it in natural language. [A]
7. Recommended architecture for DoD audit
GAO's May 2026 testimony (GAO-26-109115) confirms DoD's revised audit approach shifts from decentralized response and reliance on internal controls toward centralized coordination (the new Joint Task Force-Audit), a focus on material line items, and "manual testing of large samples and using artificial intelligence tools, as needed" — explicitly increased emphasis on technology including AI, with evidence supporting material account balances taking priority over remediating underlying control deficiencies for at least the next two years. [A→C: verified against the primary GAO source and paraphrase tightened]
The target should not be "an audit chatbot." It should be an audit evidence and validation architecture with AI assistance, in seven layers: [A]
| Layer | What it does |
|---|---|
| 1. Authoritative source and evidence plane | Source-system ID, transaction ID, accounting period, source document, original/transformed values, ingestion timestamp, interface control, transformation version, data owner, classification/CUI markings, integrity hash, system-of-record reference. This layer is Palantir/Advana, Databricks, or another governed enterprise platform — never the LLM. |
| 2. Financial semantic layer | Appropriation, fund, fiscal year, TAS, USSGL, SFIS attributes, financial statement line item, beginning/ending balance, obligation, expenditure, disbursement, unsupported adjustment, materiality thresholds — implemented as deterministic transformations, Ontology objects, SQL views, or metric definitions, not prompt text. |
| 3. Reconciliation and control engine | Feeder-to-GL and subsidiary-ledger-to-GL reconciliation, trial-balance validation, beginning-to-ending roll-forward, duplicate/unsupported-journal detection, invoice-payment-disbursement matching, period-of-availability and population-completeness testing. AI may prioritize and explain exceptions; the underlying test must be reproducible. |
| 4. Governed MCP tools | Narrow, purpose-built, default-read-only tools: get_line_item_balance, trace_balance_to_transactions, retrieve_supporting_documents, run_feeder_gl_reconciliation, list_unsupported_journals, get_control_owner, create_audit_evidence_package, submit_exception_for_review. Write/workflow actions require explicit approval through predefined actions only. |
| 5. Agent harness | Palantir AIP Logic or a Palantir-hosted Claude Agent SDK agent, a custom Claude Agent SDK agent, the Databricks agent framework, Ask Sage Agent Builder, or IBM Orchestrate — implementing tool allowlists, iteration/token/compute budgets, prompt-injection defenses, mandatory citations, stop conditions, and human approval. Given Section 2, architect this layer so the underlying model is swappable. |
| 6. Immutable execution record | For every material answer: user identity, timestamp, question, prompt/policy/skill version, model and model version, retrieved sources, SQL/query text, data snapshot date, tool calls and outputs, intermediate decisions, final answer, human reviewer, approval/rejection, subsequent changes. Without this, an AI-generated audit conclusion cannot be reliably reproduced. |
| 7. Evaluation | Test suites covering known balances, known reconciliation breaks, known unsupported journals, adversarial instructions embedded in documents, access-control boundaries, stale policy documents, intentionally incomplete evidence, and required-refusal scenarios. Evaluate the full system, not just the LLM. |
7.1 Recommended role of each platform in a DoD audit environment
| Platform | Recommended role |
|---|---|
| Ask Sage | Secure access to Claude and other models; audit policy/document research; drafting and summarization; Claude Code access for developers; controlled analyst assistance and rapid prototypes. Not the authoritative balance, transaction, reconciliation, or evidence system. |
| Palantir / Advana | Audit-relevant data integration, Universe of Transactions, financial/business-event relationships, source-to-report traceability, evidence cases, NFR and remediation workflows, controlled actions, identity-based access. For an Advana FM environment, normally the leading candidate for the operational audit and evidence layer. |
| Databricks | High-volume ingestion, large joins, transaction normalization, ML models, anomaly detection, population profiling, semantic metrics, data-quality pipelines, distributed reconciliation — either as the primary data platform or a computational layer feeding Advana/Palantir, per the Department's approved architecture. |
| IBM | Use where there is substantial need for legacy financial-system modernization, mainframe integration, COBOL/Java transformation, deterministic business rules, or hybrid infrastructure. Less compelling as an additional platform when Palantir or Databricks already performs the core function. |
| Custom Claude Agent SDK solution | Use when the workflow is unique, exact control of prompts/tools is necessary, portability matters, and the organization has adequate engineering/cybersecurity capacity. Do not build your own data catalog, distributed query engine, identity platform, or lineage system unless there is a compelling reason — build the specialized harness and audit tools, and rely on established platforms for commodity infrastructure. |
7.2 What to build if developing your own solution
Adopt directly: the Claude Agent SDK for the agent loop; MCP for tool/data interfaces; Agent Skills or a similar version-controlled procedure format; a CLAUDE.md-like repository policy file; subagents for isolated specialist tasks; hooks for deterministic safety/quality controls; sandboxed execution; explicit permissions and tool approvals; complete tracing and replay; automated evaluation. [A]
Keep vendor-neutral: store critical business logic outside model-specific prompts — SQL for calculations, Python/Spark for transformations, MCP/OpenAPI for tools, versioned schemas, OpenTelemetry-compatible traces, model-independent evaluation datasets, external identity/authorization, external evidence storage. The model should be replaceable without rebuilding the system — this is now a functional requirement, not just good hygiene, given Section 2. [A→C]
Do not overinvest in LSP for audit applications — it is valuable for software development but not a priority for financial-audit users. For audit, invest instead in data lineage, query validation, evidence provenance, document-to-transaction linking, access controls, semantic definitions, reproducible calculations, and review/approval workflows. [A]
8. Final decision
- Text-heavy secure assistant → prioritize Ask Sage plus Claude Code or the Claude Agent SDK.
- Data-heavy operational solution → prioritize Palantir AIP and the Ontology.
- Big-data analytical solution → prioritize Databricks with Unity Catalog, SQL/Spark, MLflow, and Agent Bricks/Omnigent if Claude Code-style harness portability matters.
- Legacy, hybrid, or mainframe-heavy environment → prioritize IBM watsonx and IBM Bob.
- DoD audit → the layered architecture in Section 7, with the model layer built swappable per Section 2.
For DoD audit specifically, the flow is:
Authoritative financial/business data → Reconciliation, lineage, and semantic controls → Palantir/Advana evidence and operational ontology → Governed MCP tools → Claude or another approved model → Analyst explanation, exception prioritization, and controlled workflow → Human review and immutable audit record
The strongest overall DoD audit design is not a single commercial AI product. It is a controlled combination of a trusted data and evidence plane, deterministic audit logic, governed tools, a constrained agent harness, an approved LLM (with the provider treated as swappable given the current DoD–Anthropic contract dispute), and human accountability. [A→C]
Non-negotiable principle: the AI may recommend, explain, classify, retrieve, and orchestrate. The governed data platform must calculate, reconcile, authorize, record, and prove. That separation will matter far more to audit success than which model or vendor is selected.
[A]
9. Corrections and provenance log
Transparency on what changed between the original attached analysis and this combined version, and why.
| Item | Original claim | Correction / status after verification |
|---|---|---|
| Databricks – Claude Code SDK / Claude Agent SDK compatibility | "Not publicly documented as a Claude Code-compatible endpoint"; "no explicit Claude Agent SDK template found" | Corrected to Direct. Agent Bricks (June 2026 Data + AI Summit) explicitly lists the Claude Code SDK as a supported harness; Omnigent explicitly composes Claude Code as a harness. This was accurate pre-June 2026 but is now stale. |
| DoD–Anthropic contract status | Not addressed anywhere in the original analysis | Added. DoD designated Anthropic a supply-chain risk (Feb 2026) and excluded it from the May 2026 classified-network AI vendor expansion; litigation ongoing. Directly affects whether "Claude via AIP/Ask Sage" is procurable for a given DoD contract, independent of the architecture being sound. |
| Ask Sage – Claude Code endpoint compatibility | Claimed full compatibility with citation to Ask Sage's Anthropic Compatibility Guide | Verified accurate. Confirmed via Ask Sage documentation: Anthropic-compatible endpoint, DoD PKI support for Army GenAI, and Claude Cowork gateway support. |
| Palantir – Ontology MCP vs. Palantir MCP distinction | Described as two separate servers with different read/write scopes | Verified accurate against Palantir's own Foundry documentation, including the July 2, 2026 platform summary. |
| Palantir – Claude Agent SDK / Foundry model proxy | Claimed Claude Code can run against Foundry-provided models via an Anthropic-compatible proxy | Verified accurate — Foundry's "LLM-provider compatible APIs" documentation explicitly names Claude Code as a supported use case. |
| GAO-26-109115 citation | Paraphrased as DoD validating material balances with documentation, using AI where useful | Verified accurate against GAO's own summary table; wording tightened to match GAO's primary source more closely. |
| Claude Code – MEMORY.md / auto-memory | Cited as the auto-memory index file | Verified accurate. |
| Claude Code – "safe mode" flag | Described as disabling CLAUDE.md, skills, plugins, hooks, MCP, LSP, and auto-memory | Core mechanism verified (a real flag disabling CLAUDE.md/plugins/skills/hooks/MCP). LSP and auto-memory's inclusion in that specific disable list could not be independently confirmed — treat as likely but unverified. |
| Documentation URLs | Several citations use the docs.anthropic.com/en/docs/claude-code/... domain | The current canonical Claude Code docs domain is code.claude.com/docs/en/... (and docs.claude.com for the API). Older links likely still resolve but should be re-cited from the current domain going forward. |
Everything not listed in this table was checked against available primary sources during this review and found consistent with the original analysis. No other material factual errors were identified — the original document's sourcing discipline was, on the whole, unusually strong.
Learning map
Stage 1: Enterprise AI & Harness Fundamentals
- Understand Claude Code & Agent SDK: Learn how local agent loops, context compilers (CLAUDE.md), and skills function relative to raw LLM APIs.
- Master Model Context Protocol (MCP): Study how MCP decouples client-side agents from server-side tools and data schemas, ensuring secure boundaries.
Stage 2: Enterprise Platform Integration
- Analyze Gateway Configurations: Understand how to run Claude Code over Anthropic-compatible endpoints (such as Ask Sage, Databricks AI Gateway, or Palantir's proxy).
- Leverage Semantic & Ontological Layers: Learn why robust operational semantic models (like Palantir's Ontology or Databricks' Genie Ontology) must handle calculations instead of relying on model reasoning.
Stage 3: Designing for High-Security Compliance
- Implement Model-Agnostic Abstraction: Architect your system's tools and harnesses so the underlying LLM provider can be swapped during supply chain/contract disputes.
- Build Immutable Audit Trails: Structure telemetry and logging layers to track every prompt, schema, tool output, and human approval for transaction-level reproducibility.
Get hands-on — step by step
Step 1: Configure Your Secure Endpoint Environment
Set up your system to redirect Claude SDK traffic to your secure enterprise proxy or gateway (e.g., Ask Sage or Databricks AI Gateway):
export ANTHROPIC_BASE_URL="https://your-secure-gateway-endpoint/v1"
export ANTHROPIC_API_KEY="your-authorized-gateway-token"
Step 2: Establish Agent System Rules via CLAUDE.md
Create a local CLAUDE.md in your project root to enforce deterministic processing constraints on the agent loop:
# System Instructions
- For calculations, generate and execute SQL queries; do not calculate in-context.
- Always output strict source citations from retrieved databases.
Step 3: Run and Test a Mock MCP Tool Server
Install the Model Context Protocol SDK to register a safe, read-only analytical tool:
npm install @modelcontextprotocol/sdk
Create an entrypoint configuration mapping user requests to local SQL query execution, ensuring the agent cannot write directly to production tables.
Step 4: Implement Immutable Trace Logging
Configure a telemetry wrapper in Python or Node.js to record the complete input/output execution record:
import json
import uuid
def log_audit_trail(session_id, step, prompt, tools, response, approved_by):
log_entry = {
"trace_id": str(uuid.uuid4()),
"session_id": session_id,
"step": step,
"prompt": prompt,
"tools_called": tools,
"raw_response": response,
"authorized_by": approved_by
}
with open("audit_trail.json", "a") as f:
f.write(json.dumps(log_entry) + "
")
Execute a simple run to verify that all inputs, responses, and tool telemetry are captured securely.
Top 3 sources
- 1Model Context Protocol (MCP) Official Site
The open standard specification, quickstarts, and SDK guides for exposing secure data tools to LLM agents.
https://modelcontextprotocol.io
- 2Databricks Mosaic AI Agent Framework
Comprehensive documentation on deploying high-quality enterprise agents, securing routes via the AI Gateway, and evaluating quality with MLflow.
https://docs.databricks.com/en/generative-ai/agent-framework.html
- 3Palantir Foundry Documentation
Primary resource detailing operational Ontology architecture, data-source integration, fine-grained access control, and model-integration security.
https://www.palantir.com/docs/foundry/
Links are AI-suggested — worth a quick sanity check before diving in.