Description
Compute the merged Shannon term minus the two separate terms, defining zero-mass terms as zero.
Entropy summarizes uncertainty under a specified probability model and logarithm convention. Support indicators, one-symbol terms, and exponentiated entropies are components with different meanings.
Compute the merged Shannon term minus the two separate terms, defining zero-mass terms as zero.
When to use this tool
Use Information: Symbol Probability Merge Entropy Delta when you need one explicitly scoped entropy or support calculation.
How to use the tool and how it works
- Enter firstMass, secondMass, base. Use the units and conventions below.
- Run the tool. Correct any format, range, or cross-field input error before interpreting the output.
- Read result. Expand result to inspect the returned fields.
Require nonnegative masses summing to at most one and base > 1. Compute the merged Shannon term minus the two separate terms, defining zero-mass terms as zero.1
| Input field | Meaning and units | Accepted input |
|---|---|---|
| firstMass | First Mass | Required. Finite number. |
| secondMass | Second Mass | Required. Finite number. |
| base | Numeric base or source quantity interpreted under the specific calculation above. | Required. Finite number. |
| Output field | Interpretation | Returned shape |
|---|---|---|
| result | Result | Required. Object. |
| result.entropyDelta | Entropy Delta | Calculated result member: number. |
{
"input": {
"firstMass": 0.25,
"secondMass": 0.25,
"base": 2
},
"output": {
"result": {
"entropyDelta": -0.5
}
}
}Limitations and assumptions
- The delta is merged entropy minus original entropy and can be negative; other symbols and the complete distribution are not supplied.
- Outputs are nested inside result. Inputs must satisfy both the field types and the cross-field conditions above. Invalid input causes an error; a successful false flag or documented placeholder is a different result.
- Numeric calculations use binary floating point unless exact decimal-integer arithmetic is explicitly stated. No hidden measurement tolerance or decimal rounding is added; nonfinite or out-of-contract results are rejected. Numeric signed-zero results are exported as zero.
Alternative or Complementary methods
Validate and align complete probability distributions before aggregating terms or interpreting an uncertainty estimate.
References
Similar or alternative tools
- Information: Entropy Concavity Single Mixture Gap
Compute both Shannon entropies, entropy of their weighted mixture, and mixture entropy minus weighted component entropies.
- Information: Entropy Effective Alphabet Size
Return exp(entropy × ln(base)) for effectiveAlphabetSize.