blackbox-negative-suite.log
BLACKBOX NEGATIVE SUITE V3 — every exit below is OBSERVED from a real CLI run oracle (static spec pin): produce_ok=0 corpus_error=4 selftest_pass=0 [PASS] P1 positive control: pinned 10-doc corpus -> produce CLI exit 0 expected_exit=0 observed_exit=0 [PASS] P2 positive control: selftest CLI -> exit 0, ALL PASS: True expected_exit=0 observed_exit=0 [PASS] N1 missing active doc 05 [cmd: python3 evidence/canonicalizer-fix7-canon-v1-ssot.py --produce <case-docs> <ssot.md>] expected_exit=4 observed_exit=4 — exit==4(oracle)=OK; stdout corpus_ok: False=OK; stdout membership_frozen_ok: False=OK; suppression marker=OK; no aggregate digest leak=OK; no output artifact created=OK [PASS] N2 extra active doc 99 [cmd: python3 evidence/canonicalizer-fix7-canon-v1-ssot.py --produce <case-docs> <ssot.md>] expected_exit=4 observed_exit=4 — exit==4(oracle)=OK; stdout corpus_ok: False=OK; stdout membership_frozen_ok: False=OK; suppression marker=OK; no aggregate digest leak=OK; no output artifact created=OK [PASS] N3 invalid active doc 03 (unbalanced fence) [cmd: python3 evidence/canonicalizer-fix7-canon-v1-ssot.py --produce <case-docs> <ssot.md>] expected_exit=4 observed_exit=4 — exit==4(oracle)=OK; stdout corpus_ok: False=OK; stdout membership_frozen_ok: False=OK; suppression marker=OK; no aggregate digest leak=OK; no output artifact created=OK [PASS] N4 absent docs directory [cmd: python3 evidence/canonicalizer-fix7-canon-v1-ssot.py --produce <case-docs> <ssot.md>] expected_exit=4 observed_exit=4 — exit==4(oracle)=OK; stdout corpus_ok: False=OK; stdout membership_frozen_ok: False=OK; suppression marker=OK; no aggregate digest leak=OK; no output artifact created=OK [N/A ] N5 duplicate active doc ON DISK — case-insensitive filesystem cannot host two casefold-equal filenames; adjacent equivalent executed instead: [PASS] N5' adjacent equivalent: duplicate-listing validator rejects casefold duplicate expected_exit=ok=False observed_exit=ok=False [PASS] N6 forbidden marker in seal-path code -> manifest_tool CLI --scan exit 1 (observed) expected_exit=1 observed_exit=1 [PASS] N7 manifest authority tamper -> manifest_tool CLI --verify exit 1 (observed) expected_exit=1 observed_exit=1 [PASS] N8 candidate digest class claimed CODEX_SEALED -> manifest_tool CLI --verify exit 1 (observed) expected_exit=1 observed_exit=1 BLACKBOX_NEGATIVE_SUITE: PASS (10/10 observed-behavior checks; every exit code above was OBSERVED from a real CLI execution, none inferred)