Back to Publications

Boltzmann-Shannon Interaction Entropy: A Normalized Measure for Continuous Variables with an Application as a Subsample Quality Metric

Chaos, 33(12) 2023 Editor's Pick Open Access

Authors: C. Tyler Diggans and A. R. AlMomani

Introduces Boltzmann-Shannon Interaction Entropy (BSIE), a normalized entropy measure for continuous random variables that captures the interaction between geometric and probabilistic structure. Unlike classical entropy measures, BSIE is bounded and interpretable. A key application is as a subsample quality metric, a principled way to assess whether a data subset preserves the statistical structure of the full dataset.

Related Expertise

Explainable & Interpretable ML / AI (Pillar 2)