# Introduction to Large Deviation Theory

# Introduction to Large Deviation Theory

This chapter provides an introduction to large deviation theory. It begins with an overview of the motivatio n for the problem under study, focusing on probability distributions and how to construct an empirical distribution. It then considers the notion of a lower semi-continuous function and that of a lower semi-continuous relaxation before discussing the large deviation property for i.i.d. samples. In particular, it describes Sanov's theorem for a finite alphabet and proceeds by analyzing large deviation property for Markov chains, taking into account stationary distributions, entropy and relative entropy rates, the rate function for doubleton frequencies, and the rate function for singleton frequencies.

*Keywords:*
large deviation theory, probability distribution, lower semi-continuous function, lower semi-continuous relaxation, large deviation property, Sanov's theorem, Markov chain, stationary distribution, relative entropy rate, rate function

University Press Scholarship Online requires a subscription or purchase to access the full text of books within the service. Public users can however freely search the site and view the abstracts and keywords for each book and chapter.

Please, subscribe or login to access full text content.

If you think you should have access to this title, please contact your librarian.

To troubleshoot, please check our FAQs, and if you can't find the answer there, please contact us .