An axiomatization of partition entropy

Abstract-- The aim of this paper is to present an axiomatization of a generalization of Shannon's entropy starting from partitions of finite sets. The proposed axiomatization yields as special cases the Havrda-Charvat entropy, and thus, provides axiomatizations for the Shannon entropy, the Gini index, and for other types of entropy used in classification and data mining. Keywords-- Shannon entropy, Gini index, Havrda-Charvat entropy, non-Shannon entropy.

• Type: Journal
• Year: 2002
• Where: TIT
• Authors: Dan A. Simovici, Szymon Jaroszewicz
• Keywords: Entropy, Havrda-Charvat Entropy, Shannon Entropy, TIT 2002