Skip to content

Main content

Missingness Indicator One Cell Token Tool

Calculate missingness indicator one cell token from explicit caller-supplied inputs.

Loading tool…

Description

Recognize a missing-value token under supplied text normalization.

Feature transformations depend on training-derived parameters, category vocabularies and explicit missing-value conventions. A local formula or token rule does not ensure that fitting, application and validation avoid data leakage.

Recognize a missing-value token under supplied text normalization.

When to use this tool

Use Missingness Indicator One Cell Token when checking one supplied feature-transform or encoding component.

How to use the tool and how it works

  1. Enter value, missingTokens, trim, caseSensitive. Use the units and conventions below.
  2. Run the tool. Correct any format, range, or cross-field input error before interpreting the output.
  3. Read missing. Inspect missing before interpreting the associated values.

Recognize a missing-value token under supplied text normalization. Optionally trim both value and missingTokens and lowercase when caseSensitive is false, then test any equality.1

Input fieldMeaning and unitsAccepted input
valueValueRequired. Text; maximum UTF-16 length 8192.
missingTokensMissing TokensRequired. Array of text; maximum UTF-16 length 8192; maximum items 256.
trimTrimRequired. Boolean.
caseSensitiveCase SensitiveRequired. Boolean.
Output fieldInterpretationReturned shape
missingMissingRequired. Boolean.
json
{
  "input": {
    "value": " NA ",
    "missingTokens": [
      "NA",
      ""
    ],
    "trim": true,
    "caseSensitive": false
  },
  "output": {
    "missing": true
  }
}

Limitations and assumptions

  • This is literal token policy, not detection of native null, numeric NaN or semantic missingness.
  • Inputs must satisfy both the field types and the cross-field conditions above. Invalid input causes an error; a successful false flag or documented placeholder is a different result.

Alternative or Complementary methods

Use a correctly fitted preprocessing pipeline and suitable validation design for complete data transformation and model assessment.

References

  1. Calculation and input contract: data-science/missingness-indicator-one-cell-token — tool.io

Similar or alternative tools