Babes-Bolyai University of Cluj-Napoca
Faculty of Mathematics and Computer Science
Study Cycle: Graduate

SUBJECT

Code
Subject
MMP0006 Information Theory
Section
Semester
Hours: C+S+L
Category
Type
Information engineering
5
2+2+0
speciality
compulsory
Teaching Staff in Charge
Assoc.Prof. SOOS Anna, Ph.D.,  asoosmath.ubbcluj.ro
Aims
Introduction in information theory. We will give the concepts of information transmission and processing.
Content
Basics on measure theory. Probabilistic models.
Random variable. Distribution function. Density function. Numerical characteristics of random variables. Expectation, variance, standard deviation. Correlation.
Conditional probability.
Tsebisev inequality. Stochastic convergence. The weack laws of large numbers.
Central limit theorems.
Stochastic processes. Markov chains, ergodicity.
The notion of information. Shannon information.
Entropy and its properties.
Informations resources. Ergodicity and nonergodicity.
Discrete and continuous resources.
Coding theory.
Applications
References
1. Gray R.M., Entropy and Information Theory, Springer, 1999
2. Blaga, P., Calculul probabilităţilor şi statistică matematică. Vol. II. Curs şi culegere de probleme, UBB, Cluj-Napoca, 1994.
3. Blaga, P., Statistica... prin Matlab, Presa Universitară Clujeană, Cluj-Napoca, 2002.
4. Murgan A. T., ”Principiile teoriei Informatiei in ingineria informatiei si a comunicatiilor”, Editura Academiei Romane, Bucuresti, 1998
5. Soós A., Bevezetés a valószínűségszámításba, Presa Universitara Clujeana, 2001.
Assessment
The final note will be given by:
laboratory work 20%
seminary work 20%
exam 60%
Links: Syllabus for all subjects
Romanian version for this subject
Rtf format for this subject