Skip to content

Main content

Public Corpus Exclusion Share Tool

Measure explicitly counted disjoint exclusions from the original public corpus while retaining supplied categories.

Loading tool…

Description

Summarize supplied corpus exclusions by category.

Quotations and corpora depend on span boundaries, omissions, annotation context and exclusion policies. A clipped window or support count describes supplied records while the adequacy, independence and meaning of their context still require editorial interpretation.

Summarize supplied corpus exclusions by category.

When to use this tool

Use Public Corpus Exclusion Share when checking a supplied quotation, context or corpus-support convention.

How to use the tool and how it works

  1. Enter originalUnits, excludedCounts, exclusionCategories. Keep parallel arrays aligned. Use the units and conventions below.
  2. Run the tool. Correct any format, range, or cross-field input error before interpreting the output.
  3. Read excludedTotal, share, defined, retainedCategories. Inspect defined before interpreting the associated values.

Summarize supplied corpus exclusions by category. Require aligned nonnegative counts and unique category labels, with total excluded <= originalUnits; share = total/original, or zero with defined false at an empty original corpus.1

Input fieldMeaning and unitsAccepted input
originalUnitsOriginal UnitsRequired. Safe integer; minimum 0.
excludedCountsExcluded CountsRequired. Array of safe integer; minimum 0; maximum items 256.
exclusionCategoriesExclusion CategoriesRequired. Array of text; maximum UTF-16 length 8192; maximum items 256.
Output fieldInterpretationReturned shape
excludedTotalExcluded TotalRequired. Safe integer.
shareDimensionless numerator/denominator ratio under the explicit basis above.Required. Finite number.
definedWhether the stated denominator or information basis permits interpretation of the associated value; inspect before using a placeholder.Required. Boolean.
retainedCategoriesRetained CategoriesRequired. Array of text; maximum UTF-16 length 8192; maximum items 256.
json
{
  "input": {
    "originalUnits": 100,
    "excludedCounts": [
      10,
      15
    ],
    "exclusionCategories": [
      "duplicate",
      "out-of-scope"
    ]
  },
  "output": {
    "excludedTotal": 25,
    "share": 0.25,
    "defined": true,
    "retainedCategories": [
      "duplicate",
      "out-of-scope"
    ]
  }
}

Limitations and assumptions

  • Exclusion counts are assumed disjoint; preserving category labels does not justify the exclusion policy or establish corpus representativeness.
  • Inputs must satisfy both the field types and the cross-field conditions above. Invalid input causes an error; a successful false flag or documented placeholder is a different result.
  • Numeric calculations use binary floating point unless exact decimal-integer arithmetic is explicitly stated. No hidden measurement tolerance or decimal rounding is added; nonfinite or out-of-contract results are rejected. Numeric signed-zero results are exported as zero.

Alternative or Complementary methods

Read the complete sources and audit the annotation/exclusion policy before treating a numerical coverage measure as interpretive support.

References

  1. Calculation and input contract: critical-theory/public-corpus-exclusion-share — tool.io

Similar or alternative tools