Babes-Bolyai University of Cluj-Napoca
Faculty of Mathematics and Computer Science
Study Cycle: Graduate
SUBJECT
| MMP0006 | Information Theory |
| Teaching Staff in Charge |
Assoc.Prof. SOOS Anna, Ph.D., asoos math.ubbcluj.ro |
| Aims |
|
Introduction in information theory. We will give the concepts of information transmission and processing. |
| Content |
|
Basics on measure theory. Probabilistic models.
Random variable. Distribution function. Density function. Numerical characteristics of random variables. Expectation, variance, standard deviation. Correlation. Conditional probability. Tsebisev inequality. Stochastic convergence. The weack laws of large numbers. Central limit theorems. Stochastic processes. Markov chains, ergodicity. The notion of information. Shannon information. Entropy and its properties. Informations resources. Ergodicity and nonergodicity. Discrete and continuous resources. Coding theory. Applications |
| References |
|
1. Gray R.M., Entropy and Information Theory, Springer, 1999
2. Blaga, P., Calculul probabilităţilor şi statistică matematică. Vol. II. Curs şi culegere de probleme, UBB, Cluj-Napoca, 1994. 3. Blaga, P., Statistica... prin Matlab, Presa Universitară Clujeană, Cluj-Napoca, 2002. 4. Murgan A. T., ”Principiile teoriei Informatiei in ingineria informatiei si a comunicatiilor”, Editura Academiei Romane, Bucuresti, 1998 5. Soós A., Bevezetés a valószínűségszámításba, Presa Universitara Clujeana, 2001. |
| Assessment |
|
The final note will be given by:
laboratory work 20% seminary work 20% exam 60% |
| Links: | Syllabus for all subjects Romanian version for this subject Rtf format for this subject |