Skip to content

Main content

Standard Setting One Judge Item Term Tool

Calculate one supplied judge/item contribution without inferring a passing threshold or standard-setting policy.

Loading tool…

Description

contribution = successProbability*itemPoints*judgeWeight.

Judgment-based standard setting can aggregate expected points over items and judges. A local success-probability contribution depends on the supplied weights and definition of the target performance level.

contribution = successProbability*itemPoints*judgeWeight.

When to use this tool

Use Standard Setting One Judge Item Term when checking one explicit judge-item contribution.

How to use the tool and how it works

  1. Enter successProbability, itemPoints, judgeWeight. Use the units and conventions below.
  2. Run the tool. Correct any format, range, or cross-field input error before interpreting the output.
  3. Read contribution. Use the output convention below.

Require successProbability in [0,1] and nonnegative itemPoints and judgeWeight. contribution = successProbability*itemPoints*judgeWeight.1

Input fieldMeaning and unitsAccepted input
successProbabilitySuccess ProbabilityRequired. Finite number; minimum 0; maximum 1.
itemPointsItem PointsRequired. Finite number; minimum 0.
judgeWeightJudge WeightRequired. Finite number; minimum 0.
Output fieldInterpretationReturned shape
contributionThis operation’s local contribution, to be combined only under the same larger-model convention.Required. Finite number.
json
{
  "input": {
    "successProbability": 0.6,
    "itemPoints": 5,
    "judgeWeight": 0.25
  },
  "output": {
    "contribution": 0.75
  }
}

Limitations and assumptions

  • This is one judge-item contribution. Probabilities and weights are supplied; a complete standard requires appropriate judges, weight normalization, aggregation and policy review.
  • Inputs must satisfy both the field types and the cross-field conditions above. Invalid input causes an error; a successful false flag or documented placeholder is a different result.
  • Numeric calculations use binary floating point unless exact decimal-integer arithmetic is explicitly stated. No hidden measurement tolerance or decimal rounding is added; nonfinite or out-of-contract results are rejected. Numeric signed-zero results are exported as zero.

Alternative or Complementary methods

Use a complete validated standard-setting procedure and approved policy for an actual cut score.

References

  1. Calculation and input contract: education/standard-setting-one-judge-item-term — tool.io

Similar or alternative tools