Description
Map only the Unicode fullwidth ASCII forms FF01..FF5E to ASCII, preserving all other characters.
Text positions can be measured in UTF-16 code units, Unicode code points, grapheme clusters, or modeled display columns. These coordinates are not interchangeable. Invisible markers and delimiter policies can also affect interpretation even when a string looks unchanged, so the chosen representation needs to stay explicit.
Map only the Unicode fullwidth ASCII forms FF01..FF5E to ASCII, preserving all other characters.
When to use this tool
Use Unicode Fullwidth Ascii Offset Token when you need the stated marker, coordinate, delimiter, or normalization operation under an explicit text representation.
How to use the tool and how it works
- Enter text. Use the units and conventions below.
- Run the tool. Correct any format, range, or cross-field input error before interpreting the output.
- Read converted, changed. Use the output convention below.
Convert U+FF01–FF5E to their ASCII counterparts by subtracting 65248 and count changed code points, preserving all other text.1
| Input field | Meaning and units | Accepted input |
|---|---|---|
| text | Text | Required. Text; maximum UTF-16 length 8192. |
| Output field | Interpretation | Returned shape |
|---|---|---|
| converted | Converted | Required. Text; maximum UTF-16 length 8192. |
| changed | Changed | Required. Safe integer. |
{
"input": {
"text": "ＡＢ１２！"
},
"output": {
"converted": "AB12!",
"changed": 5
}
}Limitations and assumptions
- This excludes ideographic space and is not full NFKC normalization, transliteration, case folding, or a display-width calculation.
- The field tables state structural bounds; the mechanics also specify cross-field constraints. Malformed inputs and unsupported domains cause errors. A successful false flag, empty branch value, or zero placeholder has the meaning stated above and is distinct from an input error.
Alternative or Complementary methods
Choose the coordinate system required by the consumer. Use a full parser, renderer, or segmentation method when a local marker or delimiter rule cannot determine the complete text behavior.
References
Similar or alternative tools
- Terminal Tab Expansion Origin Offset
Calculate advance=width-((column-origin)%width) and nextColumn=column+advance.
- Text: Bidi Control Visible Name Label
Name one of the twelve Unicode Bidi_Control code points for visible inspection, without applying the bidirectional layout algorithm.