Entropy Model in Application to Natural Languages
Loading...
Date
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Université d'Ottawa / University of Ottawa
Abstract
In this thesis, we study the mathematics behind the information theory. The focus is on Shannon's notion of the asymptotic entropy (entropy rate) and its applications to natural languages. We discuss various approaches to estimation of the entropy rate and their ramifications.
Description
Keywords
asymptotic entropy, entropy rate, information theory, natural languages