TY - CHAP
T1 - Large deviations
AU - Li, Hongbin
N1 - Publisher Copyright:
© 2011 by Taylor & Francis Group, LLC.
PY - 2017/1/1
Y1 - 2017/1/1
N2 - The theory of large deviations is concerned about the probabilities of rare events. Consider, for example, tossing a fair die n times. There are 6 possible outcomes per toss and a total of 6 n possible outcomes. What is the probability of the average of the throws being close to 1 + 2 + 3 + 4 + 5 + 6 2 = 3.5 ? This is a small deviation event for large n, since by the law of large numbers, the probability is close to 1 and, in average, each face of the die appears about n/6 times. What is the probability of the average of the throws being about 4, or the probability of getting each of faces 1 to 5 with about 1 percent of the throws and face 6 with about 95 percent of the throws? Both are rare or large deviation events with vanishing probabilities as n increases. Although the probabilities of such rare events can be computed precisely, given knowledge of the probability distribution, such exact calculations are usually complex and render little insights into the problem. It is often of interest to examine how fast the probability of a rare event decreases with increasing n. Large deviation techniques offer simple and insightful ways to compute the decaying rate of rare event probabilities, and have found numerous applications in communication and computer networks, sensing systems, computational biology, statistical mechanics, and risk analysis.
AB - The theory of large deviations is concerned about the probabilities of rare events. Consider, for example, tossing a fair die n times. There are 6 possible outcomes per toss and a total of 6 n possible outcomes. What is the probability of the average of the throws being close to 1 + 2 + 3 + 4 + 5 + 6 2 = 3.5 ? This is a small deviation event for large n, since by the law of large numbers, the probability is close to 1 and, in average, each face of the die appears about n/6 times. What is the probability of the average of the throws being about 4, or the probability of getting each of faces 1 to 5 with about 1 percent of the throws and face 6 with about 95 percent of the throws? Both are rare or large deviation events with vanishing probabilities as n increases. Although the probabilities of such rare events can be computed precisely, given knowledge of the probability distribution, such exact calculations are usually complex and render little insights into the problem. It is often of interest to examine how fast the probability of a rare event decreases with increasing n. Large deviation techniques offer simple and insightful ways to compute the decaying rate of rare event probabilities, and have found numerous applications in communication and computer networks, sensing systems, computational biology, statistical mechanics, and risk analysis.
UR - http://www.scopus.com/inward/record.url?scp=85051608276&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85051608276&partnerID=8YFLogxK
U2 - 10.1201/9781351105668
DO - 10.1201/9781351105668
M3 - Chapter
AN - SCOPUS:85051608276
SN - 9781138072169
SP - 295
EP - 315
BT - Mathematical Foundations for Signal Processing, Communications, and Networking
ER -