Introduction to the basics of the information theory and an overview of algorithms used in information processing.

The knowledge of basic postulates of the information theory.

- Introduction to information theory; - Source coding (statistical coding), block code for data compression, optimal prefix code (Huffman code), Arithmetic coding, Universal codes, Lempel-Ziv algorithms; - Protective coding (Model of the communication channel, Trans information, Equivocation, Irrelevance, Channel capacity and the methods of calculation, Optimal decoding. MAP criterion, The properties of binary symmetric channel, Convolutional codes and algorithms for their decoding)

Lectures and Practice.