Entropy is invariant to reshuffling
202306161816
Status:
Tags: entropy complexity
entropy is invariant to reshuffling the order of elements in a sequence, whereas Entropy rate is not.
e.g. if you have a signal A 010101 and signal B 011100, entropy does not see a difference between these.
thus, the latter is a more appropriate measure of dynamic complexity (Mediano2023)
entropy takes into account the relative frequency of values
entropy rate quantifies the predictability of a signal