10L142Q Fundamentals of Information Theory

(2 Credits, 32 Hours; Course Category: Specialized Basic Course; Specialty: Communication Engineering; Prerequisite: Probability and Mathematical Statistics, Random Process, Signals and Systems, Principle of Communication System)
This course is the specialized elective course for the bachelor degree of the major of the information and communication engineering. By learning this course, it can make the students to master the basic conception, the basic theory and the basic analytic methods of the Shannon information theory, and to integrate the analytic methods of the random process with the theory of the fundamentals of information theory, and to analyze more deeply how the information is transmitted efficiently and reliably in the communication system.
On the basis of introducing the mathematical model of information sources and the uncertainty for information, information source entropy and its properties and the conception and application of the average mutual information are placed emphasis on explanation in this course. Based on explaining the main parameters and the classification of channel, the deducibility and the detailed application of the Shannon channel capacity formula are placed emphasis on explanation. According to explaining the distortion degree of the information source and the information rate distortion function R(D), the distortion-less information source coding is placed emphasis on explanation. Finally, in order to enlarge the scope of knowledge for the students, and enhance the catholicity of application for the information theory in communication systems.