Skip to content

Main content

Classification: Abstention Correct Denominator Tool

Compute accuracy under an explicit include/exclude-abstention denominator, with attempted counts excluding abstentions and undefined status retained.

Loading tool…

Description

Return accuracy under an explicit abstention denominator.

Classifier metrics count particular outcomes on a declared population and positive-label convention. Precision, recall and accepted-only measures use different denominators. A reporting value at an empty denominator is a policy choice, while one cell, derivative or contribution does not constitute a complete performance evaluation.

Return accuracy under an explicit abstention denominator.

When to use this tool

Use Classification: Abstention Correct Denominator when checking the stated confusion-count, metric contribution or abstention-denominator convention.

How to use the tool and how it works

  1. Enter correct, attempted, abstained, denominatorPolicy. Use the units and conventions below.
  2. Run the tool. Correct any format, range, or cross-field input error before interpreting the output.
  3. Read result. Expand result to inspect the returned fields.

Return accuracy under an explicit abstention denominator. Require bounded whole correct <= attempted and abstained >= 0; denominator adds abstentions only for include-abstentions, defined tests positive denominator, accuracy divides or returns zero.1

Classifier metrics use different outcome supports and denominator conventions. A zero-denominator reporting policy does not supply missing observed outcomes.2

Input fieldMeaning and unitsAccepted input
correctCorrectRequired. Safe integer. Calculation count range: 0-1000000 inclusive.
attemptedAttemptedRequired. Safe integer. Calculation count range: 0-1000000 inclusive.
abstainedAbstainedRequired. Safe integer. Calculation count range: 0-1000000 inclusive.
denominatorPolicyDenominator PolicyRequired. Text; one of "include-abstentions", "exclude-abstentions". Implementation limit: 8192 Unicode code points and 16384 UTF-16 code units.
Output fieldInterpretationReturned shape
resultReturned calculated value or nested object under the stated output convention.Required. Object.
result.denominatorDenominatorCalculated result member: number.
result.definedReporting flag under the explicit denominator or information policy above; inspect any zero placeholder or policy-defined value.Calculated result member: boolean.
result.accuracyAccuracyCalculated result member: number.
json
{
  "input": {
    "correct": 6,
    "attempted": 8,
    "abstained": 2,
    "denominatorPolicy": "include-abstentions"
  },
  "output": {
    "result": {
      "denominator": 10,
      "defined": true,
      "accuracy": 0.6
    }
  }
}

Limitations and assumptions

  • The policy changes the reported metric; excluded abstentions and zero-denominator placeholders must not be mistaken for observed accuracy.
  • Outputs are nested inside result. Inputs must satisfy both the field types and the cross-field conditions above. Invalid input causes an error; a successful false flag or documented placeholder is a different result.
  • Numeric calculations use binary floating point unless exact decimal-integer arithmetic is explicitly stated. No hidden measurement tolerance or decimal rounding is added; nonfinite or out-of-contract results are rejected. Numeric signed-zero results are exported as zero.

Alternative or Complementary methods

Evaluate the complete confusion table, relevant class supports and abstention coverage together; use suitable uncertainty and validation methods for conclusions about predictive performance.

References

  1. Calculation and input contract: classification/abstention-correct-denominator — tool.io

  2. Model evaluation: classification metrics — scikit-learn developers

Similar or alternative tools