Row Hash Digest Dedupe Key

Fingerprint one decoded row using legacy MD5 over UTF-8 JSON array text, preserving cell boundaries; confirm row equality before deduplication because MD5 is not collision resistant.

Description

A row fingerprint can be a compact lookup key, but collisions must not be treated as proof of equality.

A row fingerprint can be a compact lookup key, but collisions must not be treated as proof of equality. JSON array serialization preserves cell boundaries before hashing.1

Fingerprint one decoded row using legacy MD5 over UTF-8 JSON array text, preserving cell boundaries; confirm row equality before deduplication because MD5 is not collision resistant.

When to use Row Hash Digest Dedupe Key

Use this for the following task: Fingerprint one decoded row using legacy MD5 over UTF-8 JSON array text, preserving cell boundaries; confirm row equality before deduplication because MD5 is not collision resistant.

Prepare the CSV text, decoded cells or byte values requested below. Choose delimiter and header flags explicitly when those fields are present.

How to use Row Hash Digest Dedupe Key and understand its results

  1. Prepare the CSV text, decoded cells or byte values requested below. Choose delimiter and header flags explicitly when those fields are present.
  2. Enter cells using the field table, then run the tool.
  3. Read digest. Interpret flags, units, ordering and placeholder values using the rules below.
  4. Review any reported issue or failed check, correct the supplied values when appropriate, and verify the result in its intended context.
Input fieldMeaningValue type and boundsRequirement
cellsCellslist of string; minimum entries 0; maximum entries 10000; each entry: string; maximum text length 10000Required

Supply one decoded row as cell strings. Serialize the full array and pass that text to the existing MD5 implementation.2

digest = MD5(UTF-8(JSON.stringify(cells)))

This summarizes the declared operation. Units, indexing, inclusivity and exceptional cases are explained in the surrounding text.

Output fieldMeaningValue type
digestDigeststring
json
{
  "input": {
    "cells": [
      "Ada",
      "36"
    ]
  },
  "output": {
    "digest": "a872fb1e68f10972395943b0605da494"
  }
}

Limitations and assumptions

MD5 is not collision resistant and is unsuitable for security guarantees. Confirm exact row equality before deduplicating with the digest.

Supply the decoded cell strings or raw values declared by the input fields; this tool does not load a spreadsheet file. Malformed requests produce input errors. A successfully evaluated request can still contain false flags, empty result lists or a result outside the supplied threshold; those outcomes have the meanings stated above.

Alternative or Complementary methods

Choose Unique Rows Dedupe First Occurrence for this operation: Remove exact duplicate decoded CSV records after an optional header, retaining first occurrences and their original order; cell boundaries remain significant. For a complementary task, use Duplicate Rows Extractor for this operation: Extract every CSV data record whose exact decoded row occurs more than once, retaining all members of duplicate groups in original order and preserving an optional header.

Further background: Format and language reference: Row Hash Digest Dedupe Key.

References

  1. Format and language reference: Row Hash Digest Dedupe Key — RFC Editor

  2. Row Hash Digest Dedupe Key — tool.io

Similar or alternative tools

  • Unique Rows Dedupe First Occurrence

    Remove exact duplicate decoded CSV records after an optional header, retaining first occurrences and their original order; cell boundaries remain significant.

  • Duplicate Rows Extractor

    Extract every CSV data record whose exact decoded row occurs more than once, retaining all members of duplicate groups in original order and preserving an optional header.

Don't forget to set a bookmark for tool.io!
Privacy | Imprint | Cookies