Add provenance columns to all processor outputs #13

New Issue

2026-04-12T16:43:56-04:00

aalexmmaldonado commented

2026-04-12 16:43:56 -04:00

(Migrated from github.com)

Every AnnotationEntry already carries SourceName, URL, and Reference fields, but the pKa processor doesn't extract them. Future downstream work all depends on knowing where each data point came from.

Scope

Add three columns to the pKa output schema: source_name (String, from entry["SourceName"]), source_url (String, nullable, from entry["URL"]), and reference (String, nullable, from the first element of entry["Reference"] if present).

Update FlatPKaRecord, update the tests, and document this as the standard for all future processors.

Definition of done

Three new columns in the output. Tests updated. Standard documented.

Every `AnnotationEntry` already carries `SourceName`, `URL`, and `Reference` fields, but the pKa processor doesn't extract them. Future downstream work all depends on knowing where each data point came from. ### Scope Add three columns to the pKa output schema: `source_name` (String, from `entry["SourceName"]`), `source_url` (String, nullable, from `entry["URL"]`), and `reference` (String, nullable, from the first element of `entry["Reference"]` if present). Update `FlatPKaRecord`, update the tests, and document this as the standard for all future processors. ### Definition of done Three new columns in the output. Tests updated. Standard documented.

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: data/pcdigitizer#13