feat: validator, bundle builder and release checks for 0.1.0
- Add tools/validate.py: validates packages, and with --correction runs proposed corrections through the gate against a package without writing anything (spec/11 §11.4). The gate now refuses a proposal that fails the correction schema, rule correction.schema. - tools/load.py validates every package before loading, and with --bundle --built-from builds a scienting-bundle/1 with the FTS5 search index and bundle_meta (spec/13 §13.5). Search rows are defined per unit (sentence, cell, equation outside a sentence, figure-text) with the parent kind as context. - Roster keys carry a role, and a key with the role owner may revoke any receipt (spec/08 §8.7, spec/20); roster schema, store table and the fixture roster updated. The checker signs a trial revocation to prove the rule both ways. - A qa: receipt raises the nodes it sampled except those in its errors (spec/08 §8.2); the example paper's fidelity counts become 27 F3, 13 F2, 4 F1 and 1 F0. - The destination chooses the keyed scheme, not the text policy: hmac-team between the team's machines, hkdf-pages outside the team (spec/05 §5.8, spec/12 §12.5). - A TextQuoteSelector must repeat the anchor's plain quote and is absent for hashed or keyed anchors (spec/18 §18.3). - Add fixtures/records/suspect.json, a scienting-suspect/1 record. - Oracle: hashes are kept incrementally and checked after every correction against a full recomputation; load and write refuse unsafe manifest paths; Ed25519, HKDF and schema validation come from the cryptography and jsonschema packages; canonical JSON uses the built-in encoder with an exact RFC 8785 fallback. - The tools need Python 3.14 with cryptography and jsonschema; the py310 CI environment is dropped and the workflow runs the default only. - Resolve every [CHECK] note in the docs, READMEs and context; add CONTRIBUTING.md; every tool answers --help and refuses unknown options. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
89 files changed
+1141
-513
No files matched your search
@@ -1 +1 @@
|
||||
{"doc":"scienting-doc/1","files":[{"path":"assets/586f92512b294a1c325bfc16207771fb9acc7bb67bb206f25a429a055134056f.png","present":false,"sha256":"586f92512b294a1c325bfc16207771fb9acc7bb67bb206f25a429a055134056f","size":18213},{"path":"assets/a18e1eb7f434c85ee180399dc55d2ee78c5ceb915c4a004c5dd0e490399d4c75.png","sha256":"a18e1eb7f434c85ee180399dc55d2ee78c5ceb915c4a004c5dd0e490399d4c75","size":73},{"path":"corrections.jsonl","sha256":"6d72d6629c7da952c17af944a90e266f5be1d0540f2c82c207fea57244aa3bee","size":8310},{"path":"datasets/ds-hale-bond-params/anchors.jsonl","sha256":"f45d4dd993aeaa741d7d6a12eb1817e5c975ccec2a1527da13457b4fec0bf1cc","size":5986},{"path":"datasets/ds-hale-bond-params/data.csv","sha256":"dbde72e4526e469e1535b87272eb50683160b2fe7c40b7f064e6592341f754a8","size":206},{"path":"datasets/ds-hale-bond-params/datapackage.json","sha256":"d8bbf8bd7c1b0207ada817d10580e835bda3a8691ad3e14fc1910519f4341974","size":574},{"path":"derived/mathml.jsonl","sha256":"a1aa1bad2eeea181f85670ad12aff89f95b703b6d28c092e2aad4c74e3d3b597","size":348},{"path":"document.json","sha256":"3e18fac5264a12b7981230b23b28fba400e28a6e9ba5f1f9c319027d64f4300e","size":979},{"path":"ids.jsonl","sha256":"665b127abf3d7ad20631aa2281d66cea0076cd68e77fc8a5921bc310d295a489","size":852},{"path":"locations.jsonl","sha256":"2c085435b753f9f586d29790d65cc9e61470f0ae661591480f528193dcd91a04","size":7396},{"path":"nodes.jsonl","sha256":"26f94d985bf65825c33cef53a3952b4177de203f6829073e76eea19ee3d0d37c","size":45649},{"path":"pages.jsonl","sha256":"948177c6b7e5e361ac1da0ecff6b52406d3513f14d58cd27cd84f17e6f1c054e","size":438},{"path":"provenance.json","sha256":"b1af404b3a07d4b102f0a45237285315dc1ff60f243636c22aef3e1c20b46912","size":224},{"path":"receipts.jsonl","sha256":"2d4e11512d055abbd6953a803f6498ffd3a0bfdde3fad8f9e97e700f4c6d8ef4","size":13075},{"path":"references.jsonl","sha256":"09875f7f7205036b2cf4fb5a889dcecc686faf4b1dc2c4e129b7017abbc9ce3d","size":567},{"path":"roster.json","sha256":"d5c14bada3b9b61e71c91f2f9f8dbd7eeb84b3e0b4256748e655821aaba326bd","size":861},{"path":"witnesses.json","sha256":"99ae654df4fb461a424bb51edd476a89041182c7df9c98653a81b78031f92ada","size":1006}],"format":"scienting-package/1","key":"hale2026harmonic"}
|
||||
{"doc":"scienting-doc/1","files":[{"path":"assets/586f92512b294a1c325bfc16207771fb9acc7bb67bb206f25a429a055134056f.png","present":false,"sha256":"586f92512b294a1c325bfc16207771fb9acc7bb67bb206f25a429a055134056f","size":18213},{"path":"assets/a18e1eb7f434c85ee180399dc55d2ee78c5ceb915c4a004c5dd0e490399d4c75.png","sha256":"a18e1eb7f434c85ee180399dc55d2ee78c5ceb915c4a004c5dd0e490399d4c75","size":73},{"path":"corrections.jsonl","sha256":"6d72d6629c7da952c17af944a90e266f5be1d0540f2c82c207fea57244aa3bee","size":8310},{"path":"datasets/ds-hale-bond-params/anchors.jsonl","sha256":"f45d4dd993aeaa741d7d6a12eb1817e5c975ccec2a1527da13457b4fec0bf1cc","size":5986},{"path":"datasets/ds-hale-bond-params/data.csv","sha256":"dbde72e4526e469e1535b87272eb50683160b2fe7c40b7f064e6592341f754a8","size":206},{"path":"datasets/ds-hale-bond-params/datapackage.json","sha256":"d8bbf8bd7c1b0207ada817d10580e835bda3a8691ad3e14fc1910519f4341974","size":574},{"path":"derived/mathml.jsonl","sha256":"a1aa1bad2eeea181f85670ad12aff89f95b703b6d28c092e2aad4c74e3d3b597","size":348},{"path":"document.json","sha256":"db825f861803d1c475e49978c95e98aa11a8085e47371348e9e88969f612e025","size":979},{"path":"ids.jsonl","sha256":"665b127abf3d7ad20631aa2281d66cea0076cd68e77fc8a5921bc310d295a489","size":852},{"path":"locations.jsonl","sha256":"2c085435b753f9f586d29790d65cc9e61470f0ae661591480f528193dcd91a04","size":7396},{"path":"nodes.jsonl","sha256":"26f94d985bf65825c33cef53a3952b4177de203f6829073e76eea19ee3d0d37c","size":45649},{"path":"pages.jsonl","sha256":"948177c6b7e5e361ac1da0ecff6b52406d3513f14d58cd27cd84f17e6f1c054e","size":438},{"path":"provenance.json","sha256":"b1af404b3a07d4b102f0a45237285315dc1ff60f243636c22aef3e1c20b46912","size":224},{"path":"receipts.jsonl","sha256":"2d4e11512d055abbd6953a803f6498ffd3a0bfdde3fad8f9e97e700f4c6d8ef4","size":13075},{"path":"references.jsonl","sha256":"09875f7f7205036b2cf4fb5a889dcecc686faf4b1dc2c4e129b7017abbc9ce3d","size":567},{"path":"roster.json","sha256":"7ee0c38fb4fdfc15d4ffa8139a239c23082dc69f8147c5920a39e8361cc7bbeb","size":924},{"path":"witnesses.json","sha256":"99ae654df4fb461a424bb51edd476a89041182c7df9c98653a81b78031f92ada","size":1006}],"format":"scienting-package/1","key":"hale2026harmonic"}
|
||||
@@ -1 +1 @@
|
||||
{"counts":{"leaves":45,"nodes":75},"fidelity":{"counts":{"F0":1,"F1":4,"F2":12,"F3":28},"lowest":"F0"},"format":"scienting-doc/1","hashing":{"scheme":"plain"},"key":"hale2026harmonic","kind":"article","language":"en","license":{"text":"All rights reserved by the publisher (fictional)."},"meta":{"DOI":"10.5555/example.hale.2026","author":[{"family":"Hale","given":"R."},{"family":"Osei","given":"M."}],"container-title":"Journal of Example Chemistry","issued":{"date-parts":[[2026,3,2]]},"page":"101-109","title":"Harmonic bond parameters for small organic molecules from a two-step fit","type":"article-journal","volume":"14"},"meta_hash":"776546e619e3fc9f1832153fb0585272c0a7015a0708994245cb09b1cfd1fb87","policy":"full","relations":[],"rev":12,"root":"9c00efa3d1f8fe5c93ae26868926f6af6c193a5cf8cecd32ba650842aff71e01","store":"smithlab","version":{"date":"2026-03-02","type":"version-of-record"},"work":{"key":"hale2026harmonic","same_as":["doi:10.5555/example.hale.2026"]}}
|
||||
{"counts":{"leaves":45,"nodes":75},"fidelity":{"counts":{"F0":1,"F1":4,"F2":13,"F3":27},"lowest":"F0"},"format":"scienting-doc/1","hashing":{"scheme":"plain"},"key":"hale2026harmonic","kind":"article","language":"en","license":{"text":"All rights reserved by the publisher (fictional)."},"meta":{"DOI":"10.5555/example.hale.2026","author":[{"family":"Hale","given":"R."},{"family":"Osei","given":"M."}],"container-title":"Journal of Example Chemistry","issued":{"date-parts":[[2026,3,2]]},"page":"101-109","title":"Harmonic bond parameters for small organic molecules from a two-step fit","type":"article-journal","volume":"14"},"meta_hash":"776546e619e3fc9f1832153fb0585272c0a7015a0708994245cb09b1cfd1fb87","policy":"full","relations":[],"rev":12,"root":"9c00efa3d1f8fe5c93ae26868926f6af6c193a5cf8cecd32ba650842aff71e01","store":"smithlab","version":{"date":"2026-03-02","type":"version-of-record"},"work":{"key":"hale2026harmonic","same_as":["doi:10.5555/example.hale.2026"]}}
|
||||
@@ -1 +1 @@
|
||||
{"format":"scienting-roster/1","keys":[{"id":"ana","person":{"name":"Ana Example"},"public":"KaptcVSRRjQ1EaRm7sWY+ExKeNtrQ5Xny7G0sOQq1Rc=","purposes":["sign"],"registered_at":"2026-09-01T00:00:00Z","revoked_at":null,"scheme":"ed25519"},{"id":"ben","person":{"name":"Ben Example"},"public":"FTgWcu94E4B07ky4Sd2W6VcMzamQgx8G7v++3Y/jvfY=","purposes":["sign"],"registered_at":"2026-09-01T00:00:00Z","revoked_at":null,"scheme":"ed25519"},{"id":"ben-spot","person":{"name":"Ben Example"},"public":"Z9Kcdd6RARODR/eUTI0yTXQkue0/K6ehrInEtAfGrzI=","purposes":["spot-check"],"registered_at":"2026-09-01T00:00:00Z","revoked_at":null,"scheme":"ed25519"},{"id":"cara","person":{"name":"Cara Example"},"public":"J8HPVPYtxYbKQZLMnlvND2FeGrhHj/RN8fLQ0MeyKCc=","purposes":["sign"],"registered_at":"2026-09-01T00:00:00Z","revoked_at":null,"scheme":"ed25519"}],"store":"smithlab"}
|
||||
{"format":"scienting-roster/1","keys":[{"id":"ana","person":{"name":"Ana Example"},"public":"KaptcVSRRjQ1EaRm7sWY+ExKeNtrQ5Xny7G0sOQq1Rc=","purposes":["sign"],"registered_at":"2026-09-01T00:00:00Z","revoked_at":null,"role":"owner","scheme":"ed25519"},{"id":"ben","person":{"name":"Ben Example"},"public":"FTgWcu94E4B07ky4Sd2W6VcMzamQgx8G7v++3Y/jvfY=","purposes":["sign"],"registered_at":"2026-09-01T00:00:00Z","revoked_at":null,"role":"editor","scheme":"ed25519"},{"id":"ben-spot","person":{"name":"Ben Example"},"public":"Z9Kcdd6RARODR/eUTI0yTXQkue0/K6ehrInEtAfGrzI=","purposes":["spot-check"],"registered_at":"2026-09-01T00:00:00Z","revoked_at":null,"role":"editor","scheme":"ed25519"},{"id":"cara","person":{"name":"Cara Example"},"public":"J8HPVPYtxYbKQZLMnlvND2FeGrhHj/RN8fLQ0MeyKCc=","purposes":["sign"],"registered_at":"2026-09-01T00:00:00Z","revoked_at":null,"role":"reader","scheme":"ed25519"}],"store":"smithlab"}
|
||||
Reference in new issue
Block a user