Understanding the Formulation of Information Entropy
NOTE: The terms “language” and “word” are used metaphorically in this document. A “language” often has many “words”, and the frequency of each “word” varies. If a “language” $X$ has a total of $n$ “wo