Desirable Difficulty Calibration

Calibrate practice difficulty from observed recall and caller target band.

Description

Difficulty calibration compares observed recall with a caller-defined target band.

Difficulty calibration compares observed recall with a caller-defined target band. The resulting label indicates which direction this simple rule would move practice difficulty.1

Calibrate practice difficulty from observed recall and caller target band.

When to use Desirable Difficulty Calibration

Use this tool to calibrate practice difficulty from observed recall and caller target band.

Prepare the lesson timeline, roster, observations or assessment labels requested. Use consistent units and exact identifiers, then choose comparison criteria appropriate to the activity.

How to use Desirable Difficulty Calibration and understand its results

  1. Prepare the lesson timeline, roster, observations or assessment labels requested. Use consistent units and exact identifiers, then choose comparison criteria appropriate to the activity.
  2. Enter recallPercent, lowerTargetPercent, upperTargetPercent using the field table and calculation rules, then run the tool.
  3. Read deviationPoints, adjustment. The explanation below defines the units, signs, ordering and any flags or placeholder values.
  4. If the tool reports an input issue, correct the values and run it again. Apply the stated assumptions when interpreting a successfully returned result.
Input fieldMeaningValue type; see rules belowRequirement
recallPercentRecall percentnumberRequired
lowerTargetPercentLower target percentnumberRequired
upperTargetPercentUpper target percentnumberRequired

Enter recall and ordered lower/upper percentages in 0–100. Return adjustment and nonnegative distance in percentage points to the nearest violated boundary, or zero inside.

below band→reduce-difficulty; above→increase-difficulty; inclusive inside→maintain

Units, indexing, boundary conditions and exceptional cases are defined in the calculation rules above.

Output fieldMeaningValue type
deviationPointsDeviation pointsnumber
adjustmentAdjustmentstring
json
{
  "input": {
    "recallPercent": 65,
    "lowerTargetPercent": 60,
    "upperTargetPercent": 80
  },
  "output": {
    "deviationPoints": 0,
    "adjustment": "maintain"
  }
}

Limitations and assumptions

The tool does not establish a desirable target, infer learning gains or account for retrieval conditions and learner needs.

Numeric inputs must be finite. Follow the calculation-specific rules for overflow, underflow and exceptional cases. Missing required fields, extra fields, wrong value types and violations of the calculation rules are input errors.

Alternative or Complementary methods

Use Retrieval Practice Gate: Schedule the next retrieval test from observed recall and a mastery gate. For a complementary task, use Peer Instruction Vote Shift: Compare peer-instruction concept votes before and after discussion.

References

  1. Desirable Difficulty Calibration — tool.io

Similar or alternative tools

Don't forget to set a bookmark for tool.io!
Privacy | Imprint | Cookies