Faculty of Mathematics and Computer Science

Information theory |

Code |
Semes-ter |
Hours: C+S+L |
Credits |
Type |
Section |

Teaching Staff in Charge |

Prof. MIHOC Ion, Ph.D., imihoc@math.ubbcluj.ro |

Aims |

To pressent to the students the principal notions of the information theory and some important applications of their. |

Content |

1. Information- the secondary concept and the probability - the primary concept. Hartley's formula. Shannon's entropy. The Shannon-Hincin and the Fadeev characterizations of the Shannon entropy. The information characterizations for some probability distributions.
2. Information - the primary concept and the probability - the secondary concept. Axiomatic of J.Kampe de Feriet-Bruno Forte. Information of the type M. 3. Renyi entropies. The information of order $\alpha$ for a ordinary distributions and for the incomplete distributions. 4. Information theory and statistics. Kullback-Leibler information. Properties of information: additivity, convexity. Fisher's information. Information and sufficiency. |

References |

1. Ash, R., Information Theory, John Wiley and Sons, New York. London . Sydney, 1965
2. Guiasu, S., Theodorescu, R., Teoria matematica a informatiei, Ed. Academiei RSR, Bucuresti, 1966. 3. Kullback, S., Information Theory and Statistics, John Wiley and Sons, London, 1959 4. Renyi, A., Probability Theory, Akademiai Kiado, Budapest, 1970. |

Assessment |

Exam. |