Skip to content

Main content

BIOES Single Token Transition Label

Check one local BIOES transition under an explicit strict span-closing convention, excluding sentence boundary validation.

Loading tool…

Description

Check one supplied local BIOES tag transition.

Language-processing records distinguish tokens, code points, UTF-16 positions and UTF-8 byte offsets. Tag grammars and local transition checks do not validate a full annotation sequence. Log-loss units determine perplexity conversion, while identifier suffixes may be textual labels rather than ordinary decimal numbers.

Check one supplied local BIOES tag transition.

When to use this tool

Use BIOES Single Token Transition Label when you already have previousTag, currentTag and need to check one supplied local BIOES tag transition.

How to use the tool and how it works

  1. Enter previousTag, currentTag. Use the units and conventions below.
  2. Run the tool. Correct any format, range, or cross-field input error before interpreting the output.
  3. Read validLocalTransition. Inspect validLocalTransition before interpreting the associated values.

Parse exact O or B/I/E/S plus a nonempty same-line type. A prior B or I requires current I/E of identical type; prior O/E/S permits current O/B/S.1

Input fieldMeaning and unitsAccepted input
previousTagPrevious TagRequired. Text; maximum UTF-16 length 8192.
currentTagCurrent TagRequired. Text; maximum UTF-16 length 8192.
Output fieldInterpretationReturned shape
validLocalTransitionLocal BIOES transition only; sequence start, sequence end and global consistency are not checked.Required. Boolean.
json
{
  "input": {
    "previousTag": "B-PER",
    "currentTag": "E-PER"
  },
  "output": {
    "validLocalTransition": true
  }
}

Limitations and assumptions

  • This checks one transition only, without validating sentence start/end, preceding transitions, type vocabulary or actual entity spans.
  • Inputs must satisfy both the field types and the cross-field conditions above. Invalid input causes an error; a successful false flag or documented placeholder is a different result.

Alternative or Complementary methods

Validate the complete corpus format, tokenizer, annotation sequence and scoring convention. Use a full parser or model evaluation when needed, preserving the exact offset unit, vocabulary and log base rather than inferring them from a local transformation.

References

  1. Calculation and input contract: computational-linguistics/bioes-single-token-transition-label — tool.io

Similar or alternative tools