Filename Unicode Normalization Collision Table
Audit filenames colliding after an explicit Unicode normalization form; no assumption about the target filesystem normalization policy.
Description
Audit filenames colliding after an explicit Unicode normalization form; no assumption about the target filesystem normalization policy.
Unicode normalization can make different filename spellings compare equal. The chosen normalization form defines that collision policy.
When to use this tool
Audit filenames colliding after an explicit Unicode normalization form; no assumption about the target filesystem normalization policy.
- Prepare the supplied names, form fields for this operation.
- Compare the complete example with the representation used by your own input before carrying the result into another step.
How to use the tool and how it works
- Enter names, form. Use the exact text syntax, units and index conventions explained below.
- Run the tool. If input validation fails, correct the supplied fields before interpreting any result.
- Read result.collisions. Interpret false, null and empty lists using the distinctions below; they can be valid outputs.
Validate each as a single non-dot POSIX filename, normalize with exact NFC, NFD, NFKC or NFKD and group repeated normalized strings with source indexes.1
| Input field | Meaning and representation | Accepted input |
|---|---|---|
| names | names. | At most 128 strings, each at most 128 UTF-16 code units |
| form | form. | Text; at most 8,192 UTF-16 code units, subject to the grammar above |
| Output field | Interpretation |
|---|---|
| result | Object containing the named outputs below. |
| result.collisions | The collisions list in the ordering and representation described above. |
{
"input": {
"names": [
"\u00e9",
"e\u0301"
],
"form": "NFC"
},
"output": {
"result": {
"collisions": [
{
"normalized": "\u00e9",
"indexes": [
0,
1
]
}
]
}
}
} Limitations and assumptions
- No case folding or filesystem-specific equivalence is included. The operation reports collisions without renaming files or promising portability.
- Every declared top-level field is required and unexpected fields are rejected. Numeric inputs must be finite; ordinary text fields are bounded to 8,192 UTF-16 code units, with tighter operation-specific limits where stated.
- String lists have at most 128 entries of at most 128 code units; matrices have at most 128 rows and columns. Larger numeric lists and parsed JSON have separate bounded budgets. Nonfinite results and excessively large serialized outputs are rejected.
- Indexes are zero-based and spans have an exclusive end unless explicitly stated otherwise. A valid false, null or empty-list result is distinct from malformed input.
Alternative or Complementary methods
Use a filesystem-aware implementation with appropriate platform semantics for actual file operations. Literal slash components, Unicode comparison and filename plans do not resolve symlinks or atomically reserve a destination.
References
Similar or alternative tools
- Filename Casefold Collision Table
Audit the bounded ASCII case-insensitive filename branch; rejects non-ASCII rather than pretend lowercasing implements full Unicode case folding.
- Filename Collision Plan
Plan exact-case filename collisions using numbered suffixes before the final extension, reserving all requested names; no files are touched.