feat: validator, bundle builder and release checks for 0.1.0

- Add tools/validate.py: validates packages, and with --correction runs
  proposed corrections through the gate against a package without
  writing anything (spec/11 §11.4). The gate now refuses a proposal that
  fails the correction schema, rule correction.schema.
- tools/load.py validates every package before loading, and with
  --bundle --built-from builds a scienting-bundle/1 with the FTS5 search
  index and bundle_meta (spec/13 §13.5). Search rows are defined per
  unit (sentence, cell, equation outside a sentence, figure-text) with
  the parent kind as context.
- Roster keys carry a role, and a key with the role owner may revoke any
  receipt (spec/08 §8.7, spec/20); roster schema, store table and the
  fixture roster updated. The checker signs a trial revocation to prove
  the rule both ways.
- A qa: receipt raises the nodes it sampled except those in its errors
  (spec/08 §8.2); the example paper's fidelity counts become 27 F3,
  13 F2, 4 F1 and 1 F0.
- The destination chooses the keyed scheme, not the text policy:
  hmac-team between the team's machines, hkdf-pages outside the team
  (spec/05 §5.8, spec/12 §12.5).
- A TextQuoteSelector must repeat the anchor's plain quote and is absent
  for hashed or keyed anchors (spec/18 §18.3).
- Add fixtures/records/suspect.json, a scienting-suspect/1 record.
- Oracle: hashes are kept incrementally and checked after every
  correction against a full recomputation; load and write refuse unsafe
  manifest paths; Ed25519, HKDF and schema validation come from the
  cryptography and jsonschema packages; canonical JSON uses the built-in
  encoder with an exact RFC 8785 fallback.
- The tools need Python 3.14 with cryptography and jsonschema; the py310
  CI environment is dropped and the workflow runs the default only.
- Resolve every [CHECK] note in the docs, READMEs and context; add
  CONTRIBUTING.md; every tool answers --help and refuses unknown options.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
alexmandClaude committed 2026-10-14 18:58:00 -04:00
1 parent b357af84d8
commit 8c8b51cc3f
89 files changed
+1141 -513

No files matched your search

@@ -1 +1 @@
{"doc":"scienting-doc/1","files":[{"path":"assets/586f92512b294a1c325bfc16207771fb9acc7bb67bb206f25a429a055134056f.png","present":false,"sha256":"586f92512b294a1c325bfc16207771fb9acc7bb67bb206f25a429a055134056f","size":18213},{"path":"assets/a18e1eb7f434c85ee180399dc55d2ee78c5ceb915c4a004c5dd0e490399d4c75.png","sha256":"a18e1eb7f434c85ee180399dc55d2ee78c5ceb915c4a004c5dd0e490399d4c75","size":73},{"path":"corrections.jsonl","sha256":"6d72d6629c7da952c17af944a90e266f5be1d0540f2c82c207fea57244aa3bee","size":8310},{"path":"datasets/ds-hale-bond-params/anchors.jsonl","sha256":"f45d4dd993aeaa741d7d6a12eb1817e5c975ccec2a1527da13457b4fec0bf1cc","size":5986},{"path":"datasets/ds-hale-bond-params/data.csv","sha256":"dbde72e4526e469e1535b87272eb50683160b2fe7c40b7f064e6592341f754a8","size":206},{"path":"datasets/ds-hale-bond-params/datapackage.json","sha256":"d8bbf8bd7c1b0207ada817d10580e835bda3a8691ad3e14fc1910519f4341974","size":574},{"path":"derived/mathml.jsonl","sha256":"a1aa1bad2eeea181f85670ad12aff89f95b703b6d28c092e2aad4c74e3d3b597","size":348},{"path":"document.json","sha256":"3e18fac5264a12b7981230b23b28fba400e28a6e9ba5f1f9c319027d64f4300e","size":979},{"path":"ids.jsonl","sha256":"665b127abf3d7ad20631aa2281d66cea0076cd68e77fc8a5921bc310d295a489","size":852},{"path":"locations.jsonl","sha256":"2c085435b753f9f586d29790d65cc9e61470f0ae661591480f528193dcd91a04","size":7396},{"path":"nodes.jsonl","sha256":"26f94d985bf65825c33cef53a3952b4177de203f6829073e76eea19ee3d0d37c","size":45649},{"path":"pages.jsonl","sha256":"948177c6b7e5e361ac1da0ecff6b52406d3513f14d58cd27cd84f17e6f1c054e","size":438},{"path":"provenance.json","sha256":"b1af404b3a07d4b102f0a45237285315dc1ff60f243636c22aef3e1c20b46912","size":224},{"path":"receipts.jsonl","sha256":"2d4e11512d055abbd6953a803f6498ffd3a0bfdde3fad8f9e97e700f4c6d8ef4","size":13075},{"path":"references.jsonl","sha256":"09875f7f7205036b2cf4fb5a889dcecc686faf4b1dc2c4e129b7017abbc9ce3d","size":567},{"path":"roster.json","sha256":"d5c14bada3b9b61e71c91f2f9f8dbd7eeb84b3e0b4256748e655821aaba326bd","size":861},{"path":"witnesses.json","sha256":"99ae654df4fb461a424bb51edd476a89041182c7df9c98653a81b78031f92ada","size":1006}],"format":"scienting-package/1","key":"hale2026harmonic"}
{"doc":"scienting-doc/1","files":[{"path":"assets/586f92512b294a1c325bfc16207771fb9acc7bb67bb206f25a429a055134056f.png","present":false,"sha256":"586f92512b294a1c325bfc16207771fb9acc7bb67bb206f25a429a055134056f","size":18213},{"path":"assets/a18e1eb7f434c85ee180399dc55d2ee78c5ceb915c4a004c5dd0e490399d4c75.png","sha256":"a18e1eb7f434c85ee180399dc55d2ee78c5ceb915c4a004c5dd0e490399d4c75","size":73},{"path":"corrections.jsonl","sha256":"6d72d6629c7da952c17af944a90e266f5be1d0540f2c82c207fea57244aa3bee","size":8310},{"path":"datasets/ds-hale-bond-params/anchors.jsonl","sha256":"f45d4dd993aeaa741d7d6a12eb1817e5c975ccec2a1527da13457b4fec0bf1cc","size":5986},{"path":"datasets/ds-hale-bond-params/data.csv","sha256":"dbde72e4526e469e1535b87272eb50683160b2fe7c40b7f064e6592341f754a8","size":206},{"path":"datasets/ds-hale-bond-params/datapackage.json","sha256":"d8bbf8bd7c1b0207ada817d10580e835bda3a8691ad3e14fc1910519f4341974","size":574},{"path":"derived/mathml.jsonl","sha256":"a1aa1bad2eeea181f85670ad12aff89f95b703b6d28c092e2aad4c74e3d3b597","size":348},{"path":"document.json","sha256":"db825f861803d1c475e49978c95e98aa11a8085e47371348e9e88969f612e025","size":979},{"path":"ids.jsonl","sha256":"665b127abf3d7ad20631aa2281d66cea0076cd68e77fc8a5921bc310d295a489","size":852},{"path":"locations.jsonl","sha256":"2c085435b753f9f586d29790d65cc9e61470f0ae661591480f528193dcd91a04","size":7396},{"path":"nodes.jsonl","sha256":"26f94d985bf65825c33cef53a3952b4177de203f6829073e76eea19ee3d0d37c","size":45649},{"path":"pages.jsonl","sha256":"948177c6b7e5e361ac1da0ecff6b52406d3513f14d58cd27cd84f17e6f1c054e","size":438},{"path":"provenance.json","sha256":"b1af404b3a07d4b102f0a45237285315dc1ff60f243636c22aef3e1c20b46912","size":224},{"path":"receipts.jsonl","sha256":"2d4e11512d055abbd6953a803f6498ffd3a0bfdde3fad8f9e97e700f4c6d8ef4","size":13075},{"path":"references.jsonl","sha256":"09875f7f7205036b2cf4fb5a889dcecc686faf4b1dc2c4e129b7017abbc9ce3d","size":567},{"path":"roster.json","sha256":"7ee0c38fb4fdfc15d4ffa8139a239c23082dc69f8147c5920a39e8361cc7bbeb","size":924},{"path":"witnesses.json","sha256":"99ae654df4fb461a424bb51edd476a89041182c7df9c98653a81b78031f92ada","size":1006}],"format":"scienting-package/1","key":"hale2026harmonic"}