Crowdsourcing Review Consensus Agreement Percent Calculator
Measure crowdsourced transcription consensus as the percentage of reviewer contributions that agree with the accepted reading.
Description
Calculate reviewer agreement percentage and dissenting contribution count from safe integer contribution totals.
Measure crowdsourced transcription consensus as the percentage of reviewer contributions that agree with the accepted reading.
When to use Crowdsourcing Review Consensus Agreement Percent Calculator
- Calculate reviewer agreement percentage and dissenting contribution count from safe integer contribution totals.
- Apply the same explicit rule consistently during ingest, quality control, reporting, or preservation planning.
- Expose records that need human review without silently rewriting the source data.
How the calculation works
The denominator counts contributions, not unique people, so repeated votes can change the result unless deduplicated first.1
agreement % = agreeing/total · 100; dissenting = total−agreeing Interpreting the result
The denominator counts contributions, not unique people, so repeated votes can change the result unless deduplicated first.
Limitations and assumptions
- Agreement with an accepted value measures consensus, not correctness, independence, inter-rater reliability, or confidence intervals.
- Preserve the original value and record the rule version when using this result in an archival workflow.
References
-
Digital preservation — Wikipedia contributors
Similar or alternative tools
- Transcription Progress Character Count Percent Calculator
Report transcription progress as the percentage of transcribed characters relative to the total expected character count.
- OCR Confidence Score Below Threshold Word Counter
Count OCR word confidence scores that fall below a review threshold and report the affected fraction of the transcribed words.
- Country Code ISO 3166 Alpha-2 Validator
Validate whether a normalized two-letter value is a currently assigned ISO 3166-1 alpha-2 country code. Reserved and user-assigned letter pairs are not accepted.