Skip to content

Main content

Label Pair Disagreement Selector

Select exact actual/predicted label disagreement observations with original indexes, preserving repeated labels; no classification threshold or error severity model.

Loading tool…

Description

Select exact actual/predicted label disagreement observations with original indexes, preserving repeated labels; no classification threshold or error severity model.

A confusion table uses actual labels as rows and predicted labels as columns. Cells can contain occurrence counts or supplied nonnegative weights; the axis label order must stay with the matrix. Row, column and joint normalization have different denominators, and a zero denominator needs an explicit undefined result.

Select exact actual/predicted label disagreement observations with original indexes, preserving repeated labels; no classification threshold or error severity model.

When to use this tool

Use this tool to select exact actual/predicted label disagreement observations with original indexes, preserving repeated labels; no classification threshold or error severity model.

How to use the tool and how it works

  1. Enter actual, predicted using the input definitions below.
  2. Run the operation. Resolve malformed-input errors before interpreting the result.
  3. Read result.disagreements. Interpret signs, units, ordering and null values using the rules below.

Require aligned actual/predicted lists and return each position with different exact label strings as {index,actual,predicted}.1

Input fieldMeaning and unitsAccepted input
actualActual label strings, aligned with predicted and optional weights.Dense list of at most 128 strings, each at most 8,192 UTF-16 code units.
predictedPredicted label strings, aligned with actual.Dense list of at most 128 strings, each at most 8,192 UTF-16 code units.
Output fieldInterpretation
resultObject containing the fields below.
result.disagreementsOriginal-index exact actual/predicted mismatch records.
json
{
  "input": {
    "actual": [
      "a",
      "b"
    ],
    "predicted": [
      "a",
      "a"
    ]
  },
  "output": {
    "result": {
      "disagreements": [
        {
          "index": 1,
          "actual": "b",
          "predicted": "a"
        }
      ]
    }
  }
}

Limitations and assumptions

  • No label universe, class severity or prediction threshold is inferred.
  • Label strings are compared exactly. Confusion values may be nonnegative fractional weights; a count interpretation requires count data. Probability-like score rows use [0,1] entries with sum tolerance 10⁻⁸, without establishing calibration.
  • Every declared top-level input is required and unknown fields are rejected. Ordinary strings are limited to 8,192 UTF-16 code units and lists to 128 entries, with tighter operation-specific bounds where stated. JSON text has bounded nesting and node counts.
  • Numeric outputs must be finite and within the absolute safe-integer magnitude; exact larger integers use decimal text. Source positions are zero-based UTF-16 offsets and span ends are exclusive unless a different convention is explicitly stated.

Alternative or Complementary methods

Check label coverage and axis order before comparing tables. Use a separate evaluation design for uncertainty, calibration, operating thresholds and the consequences of real-world decisions.

References

  1. Tool behavior and example: Label Pair Disagreement Selector — tool.io

Similar or alternative tools

  • Label Pair Confusion Table

    Build an occurrence-count multiclass confusion table over explicit actual/predicted label observations with a caller-ordered complete label universe; unknown labels reject, no identity coercion.

  • Label Pair Coverage Audit

    Audit unknown label occurrences separately in aligned actual and predicted observations against an explicit label universe; do not drop or coerce unknown evidence.