Skip to content

Main content

Public Orthography Diacritic Preserver Tool

Preserve public orthographic text exactly and count existing Unicode combining-mark code points without normalizing or stripping diacritics.

Loading tool…

Description

Return text unchanged and count code points whose Unicode category is a mark.

Unicode text can be counted as code points, UTF-16 units, encoded bytes, or grapheme clusters. A literal character transformation follows a specific mapping and may preserve distinctions that a broader normalization would remove.

Return text unchanged and count code points whose Unicode category is a mark.

When to use this tool

Use Public Orthography Diacritic Preserver when you need one explicitly bounded Unicode mapping, count, or encoding component.

How to use the tool and how it works

  1. Enter text. Use the units and conventions below.
  2. Run the tool. Correct any format, range, or cross-field input error before interpreting the output.
  3. Read preservedText, combiningMarkCount. Use the output convention below.

Return text unchanged and count code points whose Unicode category is a mark.1

Input fieldMeaning and unitsAccepted input
textSupplied text; only the transformations stated above are applied.Required. Text; maximum UTF-16 length 8192.
Output fieldInterpretationReturned shape
preservedTextPreserved TextRequired. Text; maximum UTF-16 length 8192.
combiningMarkCountCombining Mark CountRequired. Safe integer.
json
{
  "input": {
    "text": "á"
  },
  "output": {
    "preservedText": "á",
    "combiningMarkCount": 1
  }
}

Limitations and assumptions

  • No normalization is performed, so precomposed letters need not contribute marks; count does not establish orthographic correctness or permission to alter community language data.
  • Inputs must satisfy both the field types and the cross-field conditions above. Invalid input causes an error; a successful false flag or documented placeholder is a different result.

Alternative or Complementary methods

Choose normalization and comparison rules for the intended language and preserve the original text when creating a search variant.

References

  1. Calculation and input contract: indigenous-studies/public-orthography-diacritic-preserver — tool.io

Similar or alternative tools