Enterprise Credibility Audit
Capability Readiness Center
This page audits bp Sphere capabilities the way BP technology, finance, audit, security, operations, and transformation leaders will judge them: business value, runtime explainability, governance, operability, and North Star movement.
Data boundary: scores below are computed at request time from the live FastAPI route map, BP RBAC config, source modules, and available runtime/API modules. Missing production telemetry is shown as a gap; it is not filled with invented values.
Five Enterprise Credibility Audits
| Audit | Question | Required Proof |
|---|---|---|
| Business Audit | Does it solve a real finance problem? | Problem, KPI, beneficiary, decision speed, risk reduction, cost reduction. |
| Runtime Audit | Can we explain how it works? | Signal, context, policy, evidence, agent, decision, action, learning. |
| Governance Audit | Can we prove it is controlled? | Policies, human approvals, agent permissions, security gates, audit trail. |
| Operations Audit | Can we operate it at scale? | Latency, failures, queue depth, fallback path, cost controls, ownership. |
| Transformation Audit | Does it move BP toward the North Star? | Current state, future state, role change, KPI impact, North Star alignment. |
Live Runtime Signals Used For This Audit
| Signal | Observed Value | Source | Status |
|---|---|---|---|
| Capability readiness manifest | 10 | tenant domains/finance/platform/capability_manifests.yaml | Available |
| Release gate minimum score | 80 | capability_readiness.release_gate | Available |
| FastAPI route map | 8 | Live request.app.routes | Available |
| Evidence Vault API | True | iris_sor/api/evidence_vault.py | Available |
| Decision Replay API | True | iris_sor/api/decision_replay.py | Available |
| SOR Adapter API | True | iris_sor/api/sor_adapters.py | Available |
| Mission Runtime Standard Service | True | iris_sor/services/mission_runtime_standard_service.py | Available |
| Agent Manifest Service | True | iris_sor/services/manifest_service.py | Available |
| Tenant RBAC route policy | True | config/tenants/bp/rbac/iris_rbac_menu.yaml | Available |
Capability Readiness Scorecard
Scores are not manually entered. They are derived from route registration, RBAC registration, module existence, source-level proof terms, and platform module availability. A low score means the code/runtime proof is absent or not yet wired.
| Capability | Business | Agent | Data | Evidence | Security | Cost | Operations | Transformation | Audit Note | Evidence Basis |
|---|---|---|---|---|---|---|---|---|---|---|
| Future Finance Transformation Journey | 67 | 100 | 100 | 100 | 75 | 100 | 75 | 100 | Computed from live checks. Missing: route, production telemetry: current_state_metrics,value_realization_actuals. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Continuous Close Intelligence | 67 | 100 | 100 | 100 | 75 | 100 | 75 | 100 | Computed from live checks. Missing: route, production telemetry: sap_journal_feed,blackline_reconciliation_feed,close_calendar_feed. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Enterprise Runtime Topology | 67 | 100 | 100 | 100 | 75 | 100 | 75 | 75 | Computed from live checks. Missing: route, production telemetry: runtime_health,adapter_health,model_usage. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Technology Credibility Audit | 67 | 100 | 100 | 100 | 75 | 100 | 75 | 100 | Computed from live checks. Missing: route, production telemetry: runtime_health,adapter_health,security_events. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Agent Registry & Governance | 67 | 100 | 100 | 100 | 75 | 100 | 75 | 75 | Computed from live checks. Missing: route, production telemetry: agent_execution_history,certification_state. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Evidence Fabric / Evidence Vault | 67 | 100 | 100 | 100 | 75 | 100 | 75 | 75 | Computed from live checks. Missing: route, production telemetry: evidence_pack_count,artifact_count,integrity_status. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Context Graph | 67 | 100 | 100 | 100 | 75 | 100 | 75 | 75 | Computed from live checks. Missing: route, production telemetry: graph_object_count,relationship_count,source_freshness. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Cost Governance Center | 67 | 100 | 100 | 100 | 75 | 100 | 75 | 75 | Computed from live checks. Missing: route, production telemetry: token_usage,model_cost,sap_reads. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Transformation Heatmap | 67 | 100 | 100 | 100 | 75 | 100 | 75 | 100 | Computed from live checks. Missing: route, production telemetry: baseline_metrics,target_metrics,realized_value. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Local ServiceNow Runtime (Enterprise Work) | 67 | 33 | 100 | 100 | 25 | 67 | 75 | 50 | Computed from live checks. Missing: route, RBAC, cost telemetry/content, production telemetry: sn_work_item_volume,approval_cycle_time,sla_breach_rate. | route=missing; RBAC=missing; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
North Star Audit
| Capability | North Star Dimension | Credibility Proof |
|---|---|---|
| Continuous Close | Time | Close readiness, journal readiness, reconciliation readiness, critical path, forecasted close duration. |
| Evidence Fabric | Assurance | Evidence packs, policies, transactions, documents, approvals, replay. |
| Context Graph | Data | Unified context across supplier, customer, contract, journal, asset, policy, decision, action. |
| Forecast Agent | Insight | Drivers, assumptions, scenarios, confidence, executive narrative, recommended action. |
| Policy Agent | Assurance | Authority limits, SOX, approval matrix, write-back boundary, escalation path. |
| Decision Center | Work | Judgment over processing through decision crates, supervisor approvals, and action queues. |
Agent Credibility Audit
| Dimension | What Must Be Visible | Where It Shows |
|---|---|---|
| Identity | Agent ID, version, owner, criticality, autonomy level. | Agent Registry drawer. |
| Activation | Why the agent ran and which event or signal triggered it. | Runtime trace / signal feed. |
| Inputs | Source systems, APIs, tables, documents, context objects. | Data lineage drawer. |
| Policies | Governance rules and action boundaries applied. | Policy result tab. |
| Evidence | Records, documents, calculations, approvals, and historical patterns used. | Evidence pack viewer. |
| Outputs | Recommendation, confidence, alternatives, impact, action payload. | Decision crate. |
| Escalation | Supervisor path, approval owner, override reason. | Human accountability panel. |
| Learning | Outcome captured, override captured, pattern updated. | Learning and replay panel. |
Runtime Audit Flow
Every credible capability should map to this flow. This prevents the demo from becoming a collection of widgets.
Data Lineage Audit
| Dimension | Requirement | UI Proof |
|---|---|---|
| Source | ECC, CFIN, S4, Ariba, BlackLine, Databricks, treasury, documents, market feeds. | Shown per object and per evidence record. |
| Access Method | Representative workshop adapter now; production target API, event, table, or curated Databricks product. | Adapter detail drawer. |
| Refresh | Real-time event, near-real-time sync, hourly, daily, or static policy/document version. | Freshness badge. |
| Confidence | Source quality, lineage completeness, evidence coverage, policy coverage. | Confidence and data-quality score. |
| Lineage | Source -> context -> decision -> action. | Lineage timeline. |
Security, Cost, and Operations Audit
| Audit | Question | Required UI Proof |
|---|---|---|
| Security | Who accessed it? Which agent executed? What permissions were used? What systems and sensitive data were touched? | Identity drawer, agent identity, permission scope, security gateway result. |
| Cost | How expensive is this capability to operate? | Context reads, SAP reads, verification calls, writebacks, model usage, token cost, cache hit rate. |
| Operations | What happens if a dependency fails? | Fallback path for agent failure, SAP unavailable, Databricks unavailable, model unavailable, policy denial. |
Transformation Audit
| Dimension | Question | Example Proof |
|---|---|---|
| Current State | How work is done today. | Manual investigation, process queues, periodic reporting, delayed controls. |
| Future State | How work changes. | Continuous decisions, preventive controls, evidence on demand, human supervision. |
| Agents | Who performs investigation and coordination. | Named agent family, owner, inputs, outputs, policies. |
| Human Role | What changes for people. | Processor -> decision analyst; coordinator -> decision orchestrator; controller -> risk supervisor. |
| KPI Impact | What improves. | Cycle time, close duration, DSO, touchless rate, control coverage, forecast accuracy. |
| North Star Impact | Which dimension moves. | Time, work, posture, assurance, data, insight. |
Immediate Audit List Before BP Demo
| Page / Capability | Audit Focus | Status | Gap To Close | Evidence Basis |
|---|---|---|---|---|
| Future Finance | Business problem, North Star alignment, KPI impact, transformation dashboard. | PASS | Computed from live checks. Missing: route, production telemetry: current_state_metrics,value_realization_actuals. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Continuous Close | Readiness score logic, evidence, escalations, replay. | PASS | Computed from live checks. Missing: route, production telemetry: sap_journal_feed,blackline_reconciliation_feed,close_calendar_feed. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Context Graph | Object lineage and data sources. | PARTIAL | Computed from live checks. Missing: route, production telemetry: graph_object_count,relationship_count,source_freshness. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Agent Registry | Identity, permissions, policies, owners, runtime metrics. | PARTIAL | Computed from live checks. Missing: route, production telemetry: agent_execution_history,certification_state. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Runtime Topology | Security, recovery, cost controls, adapters, replay. | PARTIAL | Computed from live checks. Missing: route, production telemetry: runtime_health,adapter_health,model_usage. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Cost Governance | SAP usage, Databricks usage, LLM usage, deterministic work split. | PARTIAL | Computed from live checks. Missing: route, production telemetry: token_usage,model_cost,sap_reads. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |
| Transformation Heatmap | Current state, future state, gap, required capabilities. | PASS | Computed from live checks. Missing: route, production telemetry: baseline_metrics,target_metrics,realized_value. | route=missing; RBAC=yes; module=yes; runtime=agent_manifest_service,cost_ui,decision_replay_api,evidence_api |