BlogEvaluation guide
How to Evaluate Secret-Zeroization on GPU Pod Decommission
Before accepting a retired GPU pod, require evidence that its old identities and decryption paths no longer work—not just that its operating system was rebuilt.
Consider a decommission rehearsal for a Supermicro HGX B300 pod: the operator reinstalls Linux, removes tenant volumes, and presents a clean login screen. Then a witness tries the previous BMC credential. It still works.
That hypothetical failure captures the evaluation problem. Reimaging changes the host’s software state; it does not necessarily remove management-plane credentials, TPM-resident objects, recovery copies, or external keys.
For founders comparing public cloud with on-prem GPU pods, the question is not “Can you wipe the server?” It is “Can you identify every surviving trust path, eliminate the retired tenant’s secrets, and prove the result?”
1. Define the secret inventory before shutdown
Require a per-pod zeroization manifest, tied to asset serials, tenant identifiers, and the actual firmware and management configuration. A Supermicro HGX B300 architecture name alone does not establish a wipe procedure.
The manifest should cover:
- Host TPM and hardware-root-of-trust material: tenant-controlled persistent objects, sealed-secret blobs, enrolled keys, and recoverable copies. Distinguish removable ownership material from immutable manufacturer roots; a TPM clear does not erase every hardware identity.
- Tenant KMS keys: key versions, wrapping keys, imported material, replicas, escrow, recovery paths, and deletion schedules. Identify keys outside the operator’s authority.
- BMC/OOB credentials: local accounts, API tokens, sessions, TLS private keys, directory bindings, remote-console credentials, and automation-held copies.
- Cluster secrets: bootstrap tokens, kubeconfigs, service-account signing keys, registry credentials, SSH keys, storage credentials, and workload secrets.
- Removable media: installation USBs, recovery devices, exported configuration bundles, and diagnostic packages containing credentials or key material.
Record each item’s owner, location, removal method, verifier, and dependencies. For shared services, remove tenant-specific secrets and access paths without destroying keys required by other tenants.
Use Pacific’s CMMC evaluation context to frame responsibility questions—not as evidence that a particular configuration satisfies an assessment requirement.
2. Separate zeroization evidence from a reimage receipt
Ask operators to distinguish deletion, revocation, zeroization, and cryptographic erase. They are not interchangeable.
A revoked credential may remain readable. A deleted file may remain recoverable. A reimage may leave management controllers and external secret stores untouched. Cryptographic erase depends on destroying every relevant decryption path, not merely disabling one KMS alias.
For encrypted data, require evidence that encryption covered the target material and that applicable keys—including recovery and wrapped copies—were irrecoverably destroyed. A scheduled KMS deletion remains pending until its recovery window closes.
For overwrite-based procedures, require platform-supported methods and verification appropriate to the storage location. Generic file overwrites do not reliably address flash wear-leveling, controller storage, or TPM objects.
Accept evidence such as operation identifiers, key-destruction status, controller audit events, post-reset inventories, and signed verification results. Never place raw secrets in the evidence pack. A wipe attestation should identify its scope, method, result, and limitations; a fresh boot measurement alone proves neither credential removal nor key destruction.
The separate media-sanitization evaluation addresses media disposition. This review asks whether secrets and identities survive anywhere.
3. Witness the procedure and test the old trust paths
Require a rehearsed runbook with an executor and an independent witness. Preserve evidence before destructive steps remove logs or access.
The witness should:
- 1. Match asset identities and secret identifiers to the approved manifest.
- 2. Observe supported zeroization operations and record timestamped results.
- 3. Verify external revocation or destruction through the responsible control plane.
- 4. Attempt authorized negative tests: old BMC login, retired cluster credentials, and access through the retired key path.
- 5. Sign a report listing completed actions, pending actions, exceptions, and disposition.
A failed login is supporting evidence, not proof of destruction: an outage or account lock can produce the same result. Pair negative tests with authoritative state and operation records.
Keep evidence retrievable after the tenant account closes. Define who holds it, who can review it, and when final sign-off occurs.
4. Treat incomplete zeroization as a disposition blocker
The most consequential failures often sit outside the host image:
- A powered-off node misses the cleanup job.
- A BMC reset preserves a credential store.
- A backup contains a still-usable private key.
- KMS deletion remains reversible.
- A support bundle carries an exported cluster credential.
- An RMA device leaves custody before verification.
Require an exception workflow. Failed assets should remain quarantined from reassignment, with custody controls, an accountable owner, and a remediation deadline. If supported zeroization cannot be verified, assess destruction of the affected component or another approved disposition.
Document residual risk explicitly, including immutable device identities and inaccessible components. “Factory reset completed” is not an adequate exception closure.
5. Make acceptance depend on evidence, not assurances
Ask for a redacted sample manifest, a witnessed rehearsal, and a completed evidence pack before accepting the process. Evaluation should establish who can authorize destruction, which actions are irreversible, and what prevents premature reassignment.
Pacific’s capacity overview provides deployment context; Pacific Intelligent Technologies, Inc. provides company context. Neither substitutes for configuration-specific zeroization evidence.
For CUI environments, ask counsel and your ISSM to review the evaluation criteria, evidence retention, and disposition rules. No reset procedure alone establishes CMMC certification or guarantees compliance.
Schedule a 30-minute evaluation discussion to pressure-test the manifest, witness procedure, and unresolved trust paths.
6. FAQ: Where does this evaluation stop?
Is this the same as offboarding?
No. Offboarding and exit evaluation covers the broader transition. Zeroization establishes what secrets no longer survive after that transition.
Does regular rotation solve decommission risk?
No. Secrets-rotation cadence concerns live-service hygiene. Retirement also requires removing old versions, recovery copies, and retired identities.
Should every hardware-root key be erased?
No. Evaluate ownership and supported lifecycle operations through the hardware-root-of-trust checklist. Immutable manufacturer roots differ from tenant-controlled secrets; document that boundary rather than promising universal erasure.
Continue on the mothership
This satellite stops at the playbook. Transactions, specs, and comparisons live on pacificmachines.com. If the next step is a human, book 30 minutes with Harper.