Speech Sample Coder Agreement One Token Tool

Description

Compare supplied coder tokens after pairwise missing-token exclusion.

Speech and language research can use periods, samples, utterances, phoneme tokens, transcript labels, and timed observations. Counts and durations give different denominators, while missing or unscorable records need an explicit policy. Arithmetic on these annotations does not itself establish a validated clinical measure.

Compare supplied coder tokens after pairwise missing-token exclusion.

When to use this tool

Use Speech Sample Coder Agreement One Token when you need the stated acoustic, annotation, timing, or record-support calculation for supplied research data.

How to use the tool and how it works

Enter first, second, missingToken. Keep parallel arrays aligned. Use the units and conventions below.
Run the tool. Correct any format, range, or cross-field input error before interpreting the output.
Read eligible, agreements, disagreements, agreement. Use the output convention below.

Compare aligned coder tokens only where neither equals missingToken. Require at least one eligible pair, then return agreement count, original zero-based disagreement positions, and agreement fraction.^[1]

Input field	Meaning and units	Accepted input
first	First	Required. Array of text; maximum UTF-16 length 8192; maximum items 256.
second	Second	Required. Array of text; maximum UTF-16 length 8192; maximum items 256.
missingToken	Missing Token	Required. Text; maximum UTF-16 length 8192.

Output field	Interpretation	Returned shape
eligible	Eligible	Required. Safe integer.
agreements	Agreements	Required. Safe integer.
disagreements	Zero-based indices in the original paired arrays.	Required. Array of safe integer; maximum items 256.
agreement	Agreement	Required. Finite number.

json

{
  "input": {
    "first": [
      "A",
      "B",
      "NA",
      "C"
    ],
    "second": [
      "A",
      "C",
      "A",
      "C"
    ],
    "missingToken": "NA"
  },
  "output": {
    "eligible": 3,
    "agreements": 2,
    "disagreements": [
      1
    ],
    "agreement": 0.6666666666666666
  }
}

Limitations and assumptions

Matching is exact and no chance correction is applied. This does not verify transcription, detect coder dependence, or establish clinical reliability or an agreement-study design.
The field tables state structural bounds; the mechanics also specify cross-field constraints. Malformed inputs and unsupported domains cause errors. A successful false flag, empty branch value, or zero placeholder has the meaning stated above and is distinct from an input error.
Numeric calculations use binary floating point unless exact decimal-integer arithmetic is explicitly stated. No hidden measurement tolerance or decimal rounding is added; nonfinite or out-of-contract results are rejected. Signed zero is exported as zero.

Alternative or Complementary methods

Use validated acoustic extraction and annotation procedures for the intended research task. A clinical interpretation needs an appropriate assessment method beyond this supplied-data calculation.

References

Calculation and input contract: speech-therapy/speech-sample-coder-agreement-one-token — tool.io

Similar or alternative tools

Speech Sample Pause Denominator
Compare supplied counts against elapsed or pause-excluded speech sample time.
Speech Sample Syllables Time Rate Term
Subtract silenceSeconds and excludedSeconds from durationSeconds for positive speakingSeconds.