Please use this identifier to cite or link to this item:
Appears in Collections:Faculty of Social Sciences Journal Articles
Peer Review Status: Refereed
Title: Advancing Shannon Entropy for Measuring Diversity in Systems
Author(s): Rajaram, Rajeev
Castellani, Brian
Wilson, Anna
Issue Date: 2017
Citation: Rajaram R, Castellani B & Wilson A (2017) Advancing Shannon Entropy for Measuring Diversity in Systems, Complexity, 2017, Art. No.: 8715605.
Abstract: From economic inequality and species diversity to power laws and the analysis of multiple trends and trajectories, diversity within systems is a major issue for science. Part of the challenge is measuring it. Shannon entropy H has been used to rethink diversity within probability distributions, based on the notion of information. However, there are two major limitations to Shannon’s approach. First, it cannot be used to compare diversity distributions that have different levels of scale. Second, it cannot be used to compare parts of diversity distributions to the whole. To address these limitations, we introduce a renormalization of probability distributions based on the notion of case-based entropy Cc as a function of the cumulative probability c. Given a probability density , measures the diversity of the distribution up to a cumulative probability of p(x), Cc, by computing the length or support of an equivalent uniform distribution that has the same Shannon information as the conditional distribution of pc(x) up to cumulative probability c. We illustrate the utility of our approach by renormalizing and comparing three well-known energy distributions in physics, namely, the Maxwell-Boltzmann, Bose-Einstein, and Fermi-Dirac distributions for energy of subatomic particles. The comparison shows that Ccis a vast improvement over H as it provides a scale-free comparison of these diversity distributions and also allows for a comparison between parts of these diversity distributions.
DOI Link:
Rights: Copyright © 2017 R. Rajaram et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Files in This Item:
File Description SizeFormat 
8715605.pdf3 MBAdobe PDFView/Open

This item is protected by original copyright

Items in the Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

If you believe that any material held in STORRE infringes copyright, please contact providing details and we will remove the Work from public display in STORRE and investigate your claim.