Skip to content

Main content

Random Assessment Item Sampler Generator

Sample distinct existing question records without replacement within each requested objective count, shuffle the combined paper, and delegate coverage auditing against a caller-selected minimum. Entire supplied prompts and answers are retained unchanged; extra bank objectives are ignored, shortages fail explicitly, and no assessment-validity or difficulty claim is made.

Loading tool…

Description

Sample distinct existing question records without replacement within each requested objective count, shuffle the combined paper, and delegate coverage auditing against a caller-selected minimum. Entire supplied prompts and answers are retained unchanged; extra bank objectives are ignored, shortages fail explicitly, and no assessment-validity or difficulty claim is made.

A workflow or scheduling fixture makes ordering, dependencies, capacity, and timing explicit. Returning both the constructed records and their checks helps consumers distinguish a valid arrangement from a simulated failure case.

Sample distinct existing question records without replacement within each requested objective count, shuffle the combined paper, and delegate coverage auditing against a caller-selected minimum. Entire supplied prompts and answers are retained unchanged; extra bank objectives are ignored, shortages fail explicitly, and no assessment-validity or difficulty claim is made.

When to use this tool

Use this generator to create reproducible assessment item sampler cases from the supplied model or bank. Inspect the returned evidence before using cases in a test or exercise.

How to use the tool and how it works

  1. Supply bank, objectives, minimumItemsPerObjective in the field shapes below. Set seed when you need an explicit replay.
  2. Run the tool and correct any input error. For generated controls, distinguish a successful fixture containing an invalid case from failure to generate the fixture.
  3. Read items, coverage. Use the conventions below. Keep answer-bearing fields separate when presenting an exercise.

Sample each objective's exact requested number of distinct items, combine the objective pools, shuffle presentation order, and delegate minimum coverage checking. Return selected item records and objective-aligned coverage evidence.1

Delegated operations used for this result: assessment blueprint coverage. Their calculation or parsing conventions apply to the corresponding result fields.2

Input fieldMeaning and unitsAccepted input
bankBankRequired. Array of Object; no unknown keys.; minimum items 1; maximum items 256.
bank[].idLiteral identifier used independently of display labels.Required. Text; minimum UTF-16 length 1; maximum UTF-16 length 128.
bank[].objectiveIdObjective IdRequired. Text; minimum UTF-16 length 1; maximum UTF-16 length 128.
bank[].promptPromptRequired. Text; minimum UTF-16 length 1; maximum UTF-16 length 2048.
bank[].answerAnswerRequired. Text; maximum UTF-16 length 4096.
objectivesObjectivesRequired. Array of Object; no unknown keys.; minimum items 1; maximum items 32.
objectives[].idLiteral identifier used independently of display labels.Required. Text; minimum UTF-16 length 1; maximum UTF-16 length 128.
objectives[].countCountRequired. Safe integer; minimum 0; maximum 32.
minimumItemsPerObjectiveMinimum Items Per ObjectiveRequired. Safe integer; minimum 1; maximum 32.
seedOptional numeric seed; takes precedence over context randomness. Without either, use the fixed tool.io default seed.Optional. Safe integer.
Output fieldInterpretationReturned shape
itemsItemsRequired. Array of Object; no unknown keys.; minimum items 1; maximum items 128.
items[].idLiteral identifier used independently of display labels.Required. Text; minimum UTF-16 length 1; maximum UTF-16 length 128.
items[].objectiveIdObjective IdRequired. Text; minimum UTF-16 length 1; maximum UTF-16 length 128.
items[].promptPromptRequired. Text; minimum UTF-16 length 1; maximum UTF-16 length 2048.
items[].answerAnswerRequired. Text; maximum UTF-16 length 4096.
coverageCoverageRequired. Object; no unknown keys.
coverage.objectiveIdsObjective IdsRequired. Array of Text; minimum UTF-16 length 1; maximum UTF-16 length 128.; maximum items 32.
coverage.itemCountsItem CountsRequired. Array of Safe integer; minimum 0; maximum 32.; minimum items 1; maximum items 32.
coverage.uncoveredObjectiveIdsUncovered Objective IdsRequired. Array of Text; minimum UTF-16 length 1; maximum UTF-16 length 128.; maximum items 32.
coverage.coveragePercentCoverage PercentRequired. Finite number; minimum 0; maximum 100.
randomnessReplay source and normalized 32-bit seed, or null seed for an advancing context source.Required. Object; no unknown keys.
randomness.seedOptional safe-integer replay seed; normalization and precedence are explained below.Required. Safe integer. or Null.
randomness.sourceSourceRequired. Text; one of "context", "seed".

An explicit safe-integer seed takes precedence over injected context randomness and is normalized to an unsigned 32-bit integer. With no seed and no context source, replay uses the fixed tool.io default seed. A context source must return finite values from zero inclusive to one exclusive; its advancing state must be retained separately. randomness records the source and normalized seed, or null for context. These generators are not cryptographic random sources.

json
{
  "input": {
    "bank": [
      {
        "id": "a",
        "objectiveId": "O1",
        "prompt": "1 + 1",
        "answer": "2"
      },
      {
        "id": "b",
        "objectiveId": "O1",
        "prompt": "2 + 2",
        "answer": "4"
      },
      {
        "id": "c",
        "objectiveId": "O1",
        "prompt": "3 + 3",
        "answer": "6"
      },
      {
        "id": "d",
        "objectiveId": "O2",
        "prompt": "4 - 1",
        "answer": "3"
      },
      {
        "id": "e",
        "objectiveId": "O2",
        "prompt": "5 - 2",
        "answer": "3"
      }
    ],
    "objectives": [
      {
        "id": "O1",
        "count": 2
      },
      {
        "id": "O2",
        "count": 1
      },
      {
        "id": "O3",
        "count": 0
      }
    ],
    "minimumItemsPerObjective": 1,
    "seed": 42
  },
  "output": {
    "items": [
      {
        "id": "a",
        "objectiveId": "O1",
        "prompt": "1 + 1",
        "answer": "2"
      },
      {
        "id": "b",
        "objectiveId": "O1",
        "prompt": "2 + 2",
        "answer": "4"
      },
      {
        "id": "e",
        "objectiveId": "O2",
        "prompt": "5 - 2",
        "answer": "3"
      }
    ],
    "coverage": {
      "objectiveIds": [
        "O1",
        "O2",
        "O3"
      ],
      "itemCounts": [
        2,
        1,
        0
      ],
      "uncoveredObjectiveIds": [
        "O3"
      ],
      "coveragePercent": 66.66666666666666
    },
    "randomness": {
      "seed": 42,
      "source": "seed"
    }
  }
}

Limitations and assumptions

  • Enough items per objective are required. Requested quotas need not meet minimumItemsPerObjective, so inspect coverage rather than assuming success means adequate coverage. Item correctness, difficulty, and assessment validity are not evaluated.
  • A replay requires the same complete input and implementation. The stated sampling convention applies within its eligible space. A finite draw does not exhaust all possible outputs; repeats remain possible unless a distinct-selection rule is explicit.
  • The field tables state structural bounds; cross-field constraints and bounded search or output budgets also apply. Unknown keys are rejected where the object contract disallows them. Input errors are distinct from null fields and deliberate invalid controls in a successful output.

Alternative or Complementary methods

For a supplied example, inspect the returned construction or delegated check directly. To evaluate a consumer, also test cases chosen for its own boundaries; a generated finite corpus does not establish exhaustive coverage.

References

  1. Tool behavior and example: Random Assessment Item Sampler Generator — tool.io

  2. Calculation or validation: pedagogy/assessment-blueprint-coverage — tool.io

Similar or alternative tools

  • Calendar Overlap and Common Gap Finder

    Compare bounded supplied busy calendars over an explicit half-open epoch-millisecond window, deduplicating same-calendar overlap and delegating interval cells to report common gaps, overlaps and per-calendar occupied duration.

  • Random Booking Occupancy Dataset Generator

    Construct synthetic half-open day reservations within resource capacity, with daily occupancy, overlap evidence, and optional labeled over-capacity controls.