Course manual 2019/2020
Objectives
- The student is able to mathematically model information sources and information channels using probability theory
- The student is able to compute basic properties such as entropy, conditional entropy, mutual information
- The student is able to define typical sets and estimate their size and probability
- The student is able to prove and apply Shannon’s source coding theorem
- The student is able to prove and apply Shannon’s noisy channel coding theorem
- The student is able to design and analyze concrete symbol codes and stream codes for realistic sources
- The student is able to design and analyze concrete error-correcting codes for realistic channels
- The student is able to apply message passing algorithms to decoding problems
- The student is able to apply information theory techniques to solve simple inference problems
Teaching methods
- Lecture
- Self-study
- Exercise class
Learning activities
Activity | Hours |
Hoorcollege | 28 |
Tentamen | 3 |
Werkcollege | 28 |
Self study | 109 |
Total | 168 | (6 EC x 28 uur) |
Attendance
Programme's requirements concerning attendance (OER-B):
-
Each student is expected to actively participate in the course for which he/she is registered.
-
If a student can not be present due to personal circumstances with a compulsory part of the programme, he / she must report this as quickly as possible in writing to the relevant lecturer and study advisor.
-
It is not allowed to miss obligatory parts of the programme's component if there is no case of circumstances beyond one's control.
-
In case of participating qualitatively or quantitatively insufficiently, the examiner can expel a student from further participation in the programme's component or a part of that component. Conditions for sufficient participation are stated in advance in the course manual and on Canvas.
-
In the first and second year, a student should be present in at least 80% of the seminars and tutor groups. Moreover, participation to midterm tests and obligatory homework is required. If the student does not comply with these obligations, the student is expelled from the resit of this course. In case of personal circumstances, as described in OER-A Article 6.4, an other arrangement will be proposed in consultation with the study advisor.
Assessment
The final grade will be determined by the maximum of the following two options:
- 60% final exam grade + 40% homework grade,
- 100% final exam grade.
In addition, your final exam grade alone has to be a passing grade. The same rule applies for the re-sit exam.
There will be one homework problem set per week (in total 6), posted on the course homepage by Friday. You must submit your completed homework before the exercise class on Friday the week after – either directly in the exercise class or by email to Freek Witteveen. The solutions will be discussed in the Friday exercise class (among other things).
If you have extenuating circumstances (such as sickness or family emergency) you must confirm with the lecturer before the deadline.
Assignments
There will be one homework problem set per week (6 homeworks in total). It will contribute to 30% of the final grade, but only if it contributes positively. Otherwise, only the exam grade will count.
Fraud and plagiarism
The 'Regulations governing fraud and plagiarism for UvA students' applies to this course. This will be monitored carefully. Upon suspicion of fraud or plagiarism the Examinations Board of the programme will be informed. For the 'Regulations governing fraud and plagiarism for UvA students' see: www.student.uva.nl
Course structure
The schedule for this course is published on DataNose.
Processed course evaluations
Below you will find the adjustments in the course design in response to the course evaluations.
Coordinator