Crowdsourcing Review Consensus Agreement Percent Calculator
Measure crowdsourced transcription consensus as the percentage of reviewer contributions that agree with the accepted reading.
Description
Calculate reviewer agreement percentage and dissenting contribution count from safe integer contribution totals.
Measure crowdsourced transcription consensus as the percentage of reviewer contributions that agree with the accepted reading.
When to use Crowdsourcing Review Consensus Agreement Percent Calculator
- Calculate reviewer agreement percentage and dissenting contribution count from safe integer contribution totals.
- Apply the same explicit rule consistently during ingest, quality control, reporting, or preservation planning.
- Expose records that need human review without silently rewriting the source data.
How the calculation works
The denominator counts contributions, not unique people, so repeated votes can change the result unless deduplicated first.
agreement % = agreeing/total · 100; dissenting = total−agreeing Interpreting the result
The denominator counts contributions, not unique people, so repeated votes can change the result unless deduplicated first.
Assumptions and limitations
- Agreement with an accepted value measures consensus, not correctness, independence, inter-rater reliability, or confidence intervals.
- Preserve the original value and record the rule version when using this result in an archival workflow.