infra/paperspec
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
76d76353d9faf1d5464bb25275dcc178c38a6ca5
paperspec/registry/formats.json
T
alexmandClaude ea0a7efa78 feat: zipped packages, target set, checklists, audit fixes and a stress test 
Features for the next six months (accessible HTML export, paperpack and
Lode on packages, the personal bundle):

- Zipped packages: the oracle writes and reads `.sct.zip` archives under
  the rules of spec/12 §12.2; validate.py and load.py accept them; a
  byte-identical zip of the tiny package joins the fixtures, and two
  broken archives (traversal, symbolic link) join fixtures/invalid.
- The target set of targeted F3 (spec/08 §8.10) is computed by the
  oracle and pinned by vectors/targets.jsonl under each digit rule; the
  rule now covers cells as well as sentences and the leaves of anchored
  containers, and defines a node's section.
- scienting-checklist/1 (provisional): a conformance check of an export,
  covered by a receipt as ["checklist", id, hash] (spec/08 §8.11), with a
  WCAG 2.1 AA fixture and its receipt.
- QA reports are signed like receipts (spec/08 §8.9).
- A `description` annotation body with role alt or long, so an
  accessible export can find a confirmed figure description; the layer
  fixture carries one, and the store's body-kind constraint allows it.
- scienting-spot-check/1, the seed payload, is registered with a schema.
- exercise, submission and grade are provisional until a course has
  used them.

Audit fixes, each with a vector or a broken package where one was
missing:

- Folder packages: symbolic links are refused on validate and load,
  manifest paths must not collide under case folding, listed files are
  matched by exact name, files are hashed in chunks under a size limit.
- Files are compared byte for byte, so CR LF, a byte order mark, NaN,
  a lone surrogate or invalid UTF-8 is refused instead of translated;
  integers beyond 2^53 are read as doubles, as canonical JSON writes them.
- Receipts: signature.key must equal by and the key must be valid when
  signed; a qa receipt's nodes must be the sample at the original's
  hashes, its scope must name qa.of, its errors must be sampled nodes;
  statuses are computed once, iteratively, so chains of spot-checks
  hundreds deep settle; Base64 and manifest shape errors become refusals
  instead of tracebacks; counts and the fidelity of roster-less packages
  are recomputed.
- The gate enforces rule 11 of spec/11 §11.4: changed nodes are
  validated against the node schema and the references between nodes
  are checked, so a set to a bad value, an insert with unknown
  properties or a delete of a referenced header cell is refused; a
  relabel to null drops the label; a reclassify drops foreign
  attributes; a split strips whitespace across runs; ids.jsonl order
  follows spec/04 §4.4 in every state; a move after itself is refused.
- Anchors: the relabel rule requires that nothing else changed below the
  node; an alias chain ending in a deletion no longer crashes resolve.
- Notation: a script after an empty group applies to the previous atom
  ({}^{14}C); letters are defined by Unicode block in spec/05 §5.4 and
  the oracle; \left) is complex.
- Page fingerprints delete whitespace before folding, so "10 -20" and
  "10-20" fold alike (spec/07 §7.1).
- Grades are summed with exact decimals; the reviewer error bound is
  computed with integer arithmetic.
- receipts and revocations are keyed by (doc_key, id) in SQL, since one
  revocation may be carried by several packages.

Checking:

- tools/stress.py: seeded randomized property tests over canonical JSON,
  normalization, notation, random correction walks, anchor resolution,
  Merkle roots, spot-check samples, error bounds, fingerprints, mutated
  archives and packages, rights and spot-check chains; CI runs it.
- check.py verifies every count and version the prose states against
  the repository, the zipped fixture and crafted archives, the checklist
  coverage, and nine more broken packages.
- CONTRIBUTING.md gains a release checklist.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-10-14 20:07:22 -04:00

239 lines
8.1 KiB
JSON
Raw Blame History

{
"registry": "formats",
"version": "0.1.0",
"formats": [
{
"format": "scienting-package/1",
"media_type": "application/vnd.scienting.doc+zip",
"schema": "manifest.schema.json",
"status": "candidate",
"chapter": "spec/12-package.md",
"description": "A package: MANIFEST.json and its files, a folder or a zip."
},
{
"format": "scienting-doc/1",
"media_type": "application/vnd.scienting.doc+json",
"schema": "document.schema.json",
"status": "candidate",
"chapter": "spec/02-model.md",
"description": "A document: document.json, with nodes.jsonl and the package's other files."
},
{
"format": "scienting-page/1",
"media_type": null,
"schema": "page.schema.json",
"status": "candidate",
"chapter": "spec/07-geometry.md",
"description": "The page fingerprint function, and a page record."
},
{
"format": "scienting-anchor/1",
"media_type": "application/vnd.scienting.anchor+json",
"schema": "anchor.schema.json",
"status": "candidate",
"chapter": "spec/06-anchors.md",
"description": "A pinned address with enough context to survive change."
},
{
"format": "scienting-correction/1",
"media_type": "application/vnd.scienting.correction+json",
"schema": "correction.schema.json",
"status": "candidate",
"chapter": "spec/11-corrections.md",
"description": "An operation on an established document."
},
{
"format": "scienting-receipt/1",
"media_type": "application/vnd.scienting.receipt+json",
"schema": "receipt.schema.json",
"status": "candidate",
"chapter": "spec/08-fidelity.md",
"description": "A signature over a Merkle root of reviewed values."
},
{
"format": "scienting-revocation/1",
"media_type": "application/vnd.scienting.revocation+json",
"schema": "revocation.schema.json",
"status": "candidate",
"chapter": "spec/08-fidelity.md",
"description": "A signed withdrawal of receipts."
},
{
"format": "scienting-roster/1",
"media_type": "application/vnd.scienting.roster+json",
"schema": "roster.schema.json",
"status": "candidate",
"chapter": "spec/08-fidelity.md",
"description": "The keys that may sign, and for what."
},
{
"format": "scienting-qa-report/1",
"media_type": "application/vnd.scienting.qa-report+json",
"schema": "qa-report.schema.json",
"status": "candidate",
"chapter": "spec/08-fidelity.md",
"description": "Reviewer error bounds for a delivery, signed."
},
{
"format": "scienting-spot-check/1",
"media_type": null,
"schema": "spot-check.schema.json",
"status": "candidate",
"chapter": "spec/08-fidelity.md",
"description": "The payload a spot-check key signs to seed a sample; never a file of its own."
},
{
"format": "scienting-rights/1",
"media_type": "application/vnd.scienting.rights+json",
"schema": "rights.schema.json",
"status": "candidate",
"chapter": "spec/14-rights.md",
"description": "A witness's license, basis and uses."
},
{
"format": "scienting-policy/1",
"media_type": "application/vnd.scienting.policy+json",
"schema": "policy.schema.json",
"status": "candidate",
"chapter": "spec/14-rights.md",
"description": "A signed team decision that resolves unknown uses."
},
{
"format": "scienting-stages/1",
"media_type": "application/vnd.scienting.stages+json",
"schema": "stages.schema.json",
"status": "candidate",
"chapter": "spec/14-rights.md",
"description": "The uses each stage needs."
},
{
"format": "scienting-backend/1",
"media_type": "application/vnd.scienting.backend+json",
"schema": "backend.schema.json",
"status": "candidate",
"chapter": "spec/14-rights.md",
"description": "A tool's code and weight licenses and their conditions."
},
{
"format": "scienting-profile/1",
"media_type": "application/vnd.scienting.profile+json",
"schema": "profile.schema.json",
"status": "candidate",
"chapter": "spec/14-rights.md",
"description": "What backend conditions ask about a team."
},
{
"format": "scienting-stamps/1",
"media_type": "application/vnd.scienting.stamps+json",
"schema": "stamps.schema.json",
"status": "candidate",
"chapter": "spec/07-geometry.md",
"description": "Download-stamp line rules."
},
{
"format": "scienting-suspect/1",
"media_type": null,
"schema": "suspect.schema.json",
"status": "candidate",
"chapter": "spec/05-hashes.md",
"description": "A doubtful reading for review."
},
{
"format": "scienting-layer/1",
"media_type": "application/ld+json; profile=\"http://www.w3.org/ns/anno.jsonld\"",
"schema": "layer.schema.json",
"status": "candidate",
"chapter": "spec/18-layers.md",
"description": "A layer of W3C Web Annotations."
},
{
"format": "scienting-exercise/1",
"media_type": null,
"schema": "exercise.schema.json",
"status": "provisional",
"chapter": "spec/19-exercises.md",
"description": "The body of an exercise annotation."
},
{
"format": "scienting-submission/1",
"media_type": "application/vnd.scienting.submission+json",
"schema": "submission.schema.json",
"status": "provisional",
"chapter": "spec/19-exercises.md",
"description": "A student's answer under a pseudonym."
},
{
"format": "scienting-grade/1",
"media_type": "application/vnd.scienting.grade+json",
"schema": "grade.schema.json",
"status": "provisional",
"chapter": "spec/19-exercises.md",
"description": "The grader's result."
},
{
"format": "scienting-project/1",
"media_type": "application/vnd.scienting.project+json",
"schema": "project.schema.json",
"status": "provisional",
"chapter": "spec/20-projects.md",
"description": "A project."
},
{
"format": "scienting-bundle/1",
"media_type": "application/vnd.sqlite3",
"schema": "sql/bundle-sqlite.sql",
"status": "provisional",
"chapter": "spec/13-database.md",
"description": "The SQLite bundle readers and servers query."
},
{
"format": "scienting-dataset/1",
"media_type": "application/vnd.scienting.dataset+json",
"schema": "dataset.schema.json",
"status": "provisional",
"chapter": "spec/15-datasets.md",
"description": "A Frictionless Data Package with units, uncertainty and origin."
},
{
"format": "scienting-digitization/1",
"media_type": "application/vnd.scienting.digitization+json",
"schema": "digitization.schema.json",
"status": "provisional",
"chapter": "spec/16-digitization.md",
"description": "How values were read off a figure panel."
},
{
"format": "scienting-view/1",
"media_type": "application/vnd.vegalite+json",
"schema": "view.schema.json",
"status": "provisional",
"chapter": "spec/17-views.md",
"description": "A Vega-Lite view that pins its data."
},
{
"format": "scienting-snapshot/1",
"media_type": "application/vnd.scienting.snapshot+json",
"schema": "snapshot.schema.json",
"status": "provisional",
"chapter": "spec/21-drafts.md",
"description": "What a draft cites, pinned."
},
{
"format": "scienting-draft-ids/1",
"media_type": null,
"schema": "draft-ids.schema.json",
"status": "provisional",
"chapter": "spec/21-drafts.md",
"description": "A Typst project's sentence-ID sidecar."
},
{
"format": "scienting-checklist/1",
"media_type": "application/vnd.scienting.checklist+json",
"schema": "checklist.schema.json",
"status": "provisional",
"chapter": "spec/08-fidelity.md",
"description": "A check of an export against a named standard, covered by a receipt."
}
]
}
Reference in new issue View Git Blame Copy Permalink