Description
Return bigrams=max(0,tokens+leftPadding+rightPadding-1), treating each true padding flag as one added token.
A similarity term depends on the comparison universe, missing-value policy, treatment of repeated features, and normalization. A score can also have a caller-selected value when its mathematical denominator vanishes. Those conventions matter before interpreting a threshold or comparing methods.
Return bigrams=max(0,tokens+leftPadding+rightPadding-1), treating each true padding flag as one added token.
When to use this tool
Use Token Bigram Boundary Padding Budget when you need this particular comparison term, normalization, domain condition, or empty-result policy in a larger matching workflow.
How to use the tool and how it works
- Enter tokens, leftPadding, rightPadding. Use the units and conventions below.
- Run the tool. Correct any format, range, or cross-field input error before interpreting the output.
- Read bigrams. Use the output convention below.
Return bigrams=max(0,tokens+leftPadding+rightPadding-1), treating each true padding flag as one added token. Require nonnegative integer tokens.1
| Input field | Meaning and units | Accepted input |
|---|---|---|
| tokens | Nonnegative original token count; padding adds up to two. | Required. Safe integer; minimum 0. |
| leftPadding | Left Padding | Required. Boolean. |
| rightPadding | Right Padding | Required. Boolean. |
| Output field | Interpretation | Returned shape |
|---|---|---|
| bigrams | Bigrams | Required. Safe integer. |
{
"input": {
"tokens": 4,
"leftPadding": true,
"rightPadding": true
},
"output": {
"bigrams": 5
}
}Limitations and assumptions
- An empty sequence with both pads has one pad-to-pad bigram under this convention. No token sequence, padding label, or similarity score is actually constructed.
- The field tables state structural bounds; the mechanics also specify cross-field constraints. Malformed inputs and unsupported domains cause errors. A successful false flag, empty branch value, or zero placeholder has the meaning stated above and is distinct from an input error.
- Numeric calculations use binary floating point unless exact decimal-integer arithmetic is explicitly stated. No hidden measurement tolerance or decimal rounding is added; nonfinite or out-of-contract results are rejected. Signed zero is exported as zero.
Alternative or Complementary methods
Compare methods only after aligning feature definitions, missingness, empty policies, multiplicities, and normalizers. Use a complete comparison when the tool returns only one contribution or count check.
References
Similar or alternative tools
- Containment Score Direction Reversal Gap
Calculate firstContainment=intersection/firstSize and secondContainment=intersection/secondSize, then gap=firstContainment-secondContainment.
- Cosine Antiparallel Negative Score Label
Return negative for score<0 and antiparallel when abs(score+1)<=tolerance.