Description
Return attention-row allowed-mask density.
Attention masks mark which query-to-key relationships are visible. Implementations can use opposite Boolean polarities, so true need not always mean allowed. A mask share depends on the chosen row or head and its denominator; an empty selection has no defined share rather than proving that attention is absent.
Return attention-row allowed-mask density.
When to use this tool
Use Attention Row Mask Density when checking the stated attention coordinate, visibility, angle or head-layout convention.
How to use the tool and how it works
- Enter allowed. Use the units and conventions below.
- Run the tool. Correct any format, range, or cross-field input error before interpreting the output.
- Read allowedCount, density, defined. Inspect defined before interpreting the associated values.
Return attention-row allowed-mask density. allowedCount counts true entries, density = count/length or zero with defined false for empty input.1
| Input field | Meaning and units | Accepted input |
|---|---|---|
| allowed | Allowed | Required. Array of boolean; maximum items 256. |
| Output field | Interpretation | Returned shape |
|---|---|---|
| allowedCount | Allowed Count | Required. Safe integer. |
| density | allowedCount/allowed.length, or zero placeholder when defined=false. | Required. Finite number. |
| defined | Whether the associated denominator or reporting quantity is defined; inspect before interpreting zero placeholders. | Required. Boolean. |
{
"input": {
"allowed": [
true,
false,
true,
false
]
},
"output": {
"allowedCount": 2,
"density": 0.5,
"defined": true
}
}Limitations and assumptions
- This counts supplied flags without constructing a mask, applying attention or validating an actual sequence.
- Inputs must satisfy both the field types and the cross-field conditions above. Invalid input causes an error; a successful false flag or documented placeholder is a different result.
Alternative or Complementary methods
Inspect the complete model configuration and implementation for positional schedules, masking, softmax and actual inference behavior.
References
Similar or alternative tools
- Attention Mask Visible Key Count
Count visible and hidden keys under explicit mask polarity.
- Attention Head Masked Share
Return masked share for a selected attention head.