Babes-Bolyai University of Cluj-Napoca
Faculty of Mathematics and Computer Science
Study Cycle: Graduate
SUBJECT

Code	Subject	
MMP0006	Information Theory	

Section	Sem.	Hours: C+S+L	Category	Type	
Information engineering	5	2+2+0	speciality	compulsory	

Teaching Staff in Charge	Assoc.Prof. TRÎMBITAS Radu Tiberiu, Ph.D., tradu@math.ubbcluj.ro
Assoc.Prof. CSATO Lehel, Ph.D., csatol@cs.ubbcluj.ro	
Aims	Introduction in information theory. We will give the concepts of information transmission and processing.	
Content	Basics on measure theory. Probabilistic models.
Random variable. Distribution function. Density function. Numerical characteristics of random variables. Expectation, variance, standard deviation. Correlation. 
Conditional probability.
Tsebisev inequality. Stochastic convergence. The weack laws of large numbers.
Central limit theorems.
Stochastic processes. Markov chains, ergodicity.
The notion of information. Shannon information.
Entropy and its properties.
Informations resources.   Ergodicity and nonergodicity.
Discrete and continuous resources.
Coding theory.
Applications
	
Bibliography	1.	Gray R.M., Entropy and Information Theory, Springer, 1999
2.	Blaga, P., Calculul probabilităţilor şi statistică matematică. Vol. II. Curs şi culegere de probleme, UBB, Cluj-Napoca, 1994.
3.	Blaga, P., Statistica... prin Matlab, Presa Universitară Clujeană, Cluj-Napoca, 2002.
4.	Murgan A. T., &#8221;Principiile teoriei Informatiei in ingineria informatiei si a comunicatiilor&#8221;, Editura Academiei Romane, Bucuresti, 1998
5.	Soós A., Bevezetés a valószínűségszámításba, Presa Universitara Clujeana, 2001. 
	
Assessment	The final note will be given by:
laboratory work 20%
seminary work 20%
exam 60%