Statistics for Forensic Science

5 EC

Semester 1, period 1

5274SFFS5Y

Owner Master Forensic Science
Coordinator prof. dr. R. Nunez Queija
Part of Master Forensic Science, year 1

Course manual 2021/2022

Course content

An important goal of the course is to provide students with the required knowledge of statistical and probabilistic reasoning to distinguish correct from erroneous argumentation when applied to Forensic Science. Intuitive reasoning is frequently the source of serious misconceptions that all too often have lead to wrong juridical sentences. In the course, the students will see how to recognize and avoid such mistakes through formalistic analysis.

A second goal is to provide students with a basic toolbox for statistical estimation and hypothesis testing. The course is not meant as an advanced statistics course, but we will spend considerable effort on understanding and applying statistical tests such as the standard normal test, the student-t test and – ultimately - the chi-square test.

Study materials

Literature

  • Aitken and Taroni. Statistics and the Evaluation of Evidence for Forensic Scientists. John Wiley And Sons Ltd., Second edition, 2004. (this is the text book for this course)

     

    Schneps and C. Colmez. Math on Trial. Ingram Publishers Services US, 2013. (we will use this book to learn examples of  erroneous probabilistic and statistical reasoning in the court room)

Syllabus

  • There slides used in class will be available on canvas.

Practical training material

  • Exercises will be available on canvas.

Other

  • For students that have difficulty with the subject, there are may additional sources available. The following are at the correct level for this course. Note that these references will NOT be used in the course and they will not be part of the examinations either. They are meant as additional material for students that struggle with the level of the course:

     

    Introduction to Statistics - Online Edition. David M. Lane (ed.). With contributions by David Scott, Mikki Hebl, Rudy Guerra, Dan Osherson, and Heidi Zimmer


    Essential Mathematics and Statistics for Forensic Science. Craig Adam. Wiley, 2010.



Objectives

  • 1. use basic concepts relevant for statistical and probabilistic analysis and hypothesis testing
  • 2. apply basic statistical and probabilistic methods and techniques to stylized forensic case formulations (probability, discrete and continuous distributions, hypothesis testing)
  • 3. evaluate the risks (i.e. possibilities of drawing wrong conclusions) and detect erroneous use of probabilistic and statistical methods and techniques when applied to e.g. data sets, excerpts of criminal trials and scientific articles
  • 4. deliver a critical analysis of the use of statistical tools in the forensic context in a clear, coherent and understandable way

Teaching methods

  • Lecture
  • Presentation/symposium
  • Self-study
  • Working independently on e.g. a project or thesis
  • Discussion on canvas forum
  • Perusall (tool to jointly study the text book)

Prior to the first lecture the course starts with an individual preparation/refresher about statistical concepts (mean, median, mode, variance, covariance, correlation, regression) and probabilistic fundamentals (probability space, axioms of probability, basic combinatorics, conditional probability).

In weeks 37-41 the theory classes with accompanying exercise classes will provide students with the required theoretical knowledge. There are also weekly question hours where more theoretical issues and more elaborate problems (like old exam problems) can be discussed.

In week 39 there will be a midterm test about the material covered in self-study and during the first two weeks.

In the second part of the course, the emphasis will be on the use of statistical estimation and hypothesis testing, using the same format of theory, exercise and question hour classes.

In parallel, the students will work in small teams on an assignment to critically analyze a number of criminal trials (each group is assigned a Chapter from the book Math on trial). The cases serve as an illustration of the impact erroneous reasoning may have on the course of justice. The focus in the assignments is to identify the correctness in using statistical and probabilistic analysis and techniques in the forensic practice. The different cases will give the student insight into a wide range of applications as well as a broad spectrum of erroneous reasoning in forensic applications, e.g., alleged murder, DNA analysis, database trawling and handwriting comparisons.

In week 42, the groups will present their work in a full-day meeting. The exam is in week 43.

Learning activities

Activity

Hours

Excursie

8

Hoorcollege

10

Presentatie

16

Tentamen

3

Vragenuur

12

Werkcollege

18

Self study

73

Total

140

(5 EC x 28 uur)

Attendance

This programme does not have requirements concerning attendance (OER part B).

Additional requirements for this course:

On-line attendance (and participation) is mandatory for

- the midterm test in week 39

- the Math on Trial presentations in week 42

If a student can not be present at some of these for major reasons, if possible this must be reported to the lecturer at least one week ahead, or otherwise the lecturer needs to be contacted as soon as possible after the missed event. For the Math on Trial presentations a special arrangement (partial attendance/additional assignment) may be possible in special cases. For the midterm it will be possible to have a separate test jointly with the resit.

Assessment

Item and weight Details

Final grade

15%

Midterm test

3 (17%)

Exercise 1

1 (6%)

Exercise 2a

1 (6%)

Exercise 2b

1 (6%)

Exercise 2c

1 (6%)

Exercise 2d

1 (6%)

Exercise 3a

1 (6%)

Exercise 3b

1 (6%)

Exercise 3c

1 (6%)

Exercise 3d

1 (6%)

Exercise 3e

1 (6%)

Exercise 4a

1 (6%)

Exercise 4b

1 (6%)

Exercise 4c

1 (6%)

Exercise 4d

1 (6%)

Exercise 4e

1 (6%)

Exercise 4f

50%

Final Exam

2 (6%)

Exercise 1a

2 (6%)

Exercise 1b

2 (6%)

Exercise 1c

2 (6%)

Exercise 1d

2 (6%)

Exercise 1e

2 (6%)

Exercise 2a

2 (6%)

Exercise 2b

2 (6%)

Exercise 2c

2 (6%)

Exercise 2d

2 (6%)

Exercise 2e

2 (6%)

Exercise 2f

2 (6%)

Exercise 2g

2 (6%)

Exercise 3a

2 (6%)

Exercise 3b

2 (6%)

Exercise 3c

2 (6%)

Exercise 3d

2 (6%)

Exercise 3e

2 (6%)

Exercise 3f

35%

Math on Trial Final grade

The components will be weighted as follows:

  1. Midterm test (15%)
  2. Math on Trial assignment : presentations and discussions (individual grade, 35%)
  3. Final exam (50%)

All components will be graded on a scale from 1 to 10, with a maximum of one decimal after the point. These grades are used to calculate the final grade. In order to pass the course,  each of the three components (midterm test, Math on Trial, and final exam) must be sufficient, i.e. at least a five and a half. When a student has not fulfilled this requirement, the examiner will register the mark ‘did not fulfil all requirements’ (NAV) whether or not the averaged grade is sufficient.

Resit

There is one single resit to make up for possible insufficient grades for the midterm test and the final exam. As is usual in the program MFS, at the resit you can choose to do a resit for the final exam only, in case you already passed the midterm test (grade at least 5.5). Those who take the resit for the midterm and the final exam, must answer additional questions.

Change in format 

Note: the formats of the midterm test, the final exam and the resit are as those of previous tests/exams since the academic year 2018-2019. Exams of earlier years are very suitable as exercise material, but differ in their formats (e.g., there was no midterm test prior to 2018 and there was no text book for use at the exams).

Attendance

Attendance is mandatory, unless there are strong reasons to miss a class. To get permission to miss a class you need to request it well in time (at least one week ahead). On September 29, we will have the midterm test in class. No exception can be made for that.

 

The final grade will be announced at the latest 15 working days after the final course activity. Between this date and 35 working days after the final course activity, a post-exam discussion or inspection moment will be planned. This will be announced on Canvas and/or via email

 

Exit qualifications

Learning outcomes

Components (see above)

1

2

3

4

5

6

7

8

9

10

1

1, 3

 

x

 

 

x

 

 

 

 

 

2

2, 3

 

 

 

x

x

 

 

 

 

 

3

2, 3

 

 

 

 

 

 

x

x

 

 

4

2

 

 

 

x

 

x

 

 

x

 

Table of specification: the relation between the learning outcomes of the course (see 1.3), the assessment components of the course (see 2.4) and the  Exit Qualifications (EQ) of the Master’s Forensic Science (described in the Introduction in the Course Catalogue)

Students that were enrolled in the course in previous years

Students that took part in the Math on Trial assignment in the previous year need not participate in that part this year; the grade of last year is still valid.

All other grades from last year are not valid.

Inspection of assessed work

Via announcements on canvas.

Students need to contact the lecturers to make an appointment.

Assignments

The Math on Trial assignment is a group assignment. The individual grade fro this assignment can differ at most one point from the group grade based on the student's performance in Perusall, the canvas forum, and the discussions during the Math on Trial presentations.

1         Midterm test

The material of the first two theory classes and accompanying exercise classes will specifically be examined in the (individual) written midterm test in week 39.

2          Group assignment: Math on Trial

To illustrate the danger in wrongly using statistical and probabilistic reasoning, all students will study a chapter of the book Math on Trial (in groups) and prepare a joint presentation about (i) the contents of this chapter, as well as (ii) their analysis of it. Two (or three) students from the group will present their results in class. The audience is formed by students from other groups who should engage in a critical debate through questions to the presenting group.

The slide book and the presentation will be graded (one grade for the group). The individual grade of each student can deviate up to one grade point from the group’s grade, depending on their individual participation in discussions about their own presentation and that of other groups. The student’s individual grade for the assignment must not be lower than 5.5 in order to pass the course and will contribute to the final grade (see Section 2.4 for details).

3         The final examination

The material of the four theory classes and accompanying exercise classes will specifically be examined in the (individual) final written exam. The result of the exam must not be lower than 5.5 in order to pass the course (see Section 2.4 for details).

Fraud and plagiarism

The 'Regulations governing fraud and plagiarism for UvA students' applies to this course. This will be monitored carefully. Upon suspicion of fraud or plagiarism the Examinations Board of the programme will be informed. For the 'Regulations governing fraud and plagiarism for UvA students' see: www.student.uva.nl

Course structure

See course components.

Timetable

The schedule for this course is published on DataNose.

Additional information

The student must have the textbook available for use during the midterm test, the final exam and the resit. These tests/exams are open book and the student may need to consult specific sections or tables in the book.

Last year's course evaluation

In order to provide students some insight how we use the feedback of student evaluations to enhance the quality of education, we decided to include the table below in all course guides.

Statistics for Forensic Science (5EC) N 42  
Strengths
  • The teacher’s willingness to give in-depth explanations.
  • Writing pad.
  • Students liked the Math on Trial presentations.
Notes for improvement
  • Level of the exercises and the final exam.
  • The question hours. Students could send in questions the evening beforehand. Therefore other students didn’t have enough time to have a look at these questions.
  • Students have the feeling that they don’t meet the criteria of the learning outcomes of the Math on Trial assignment.
Response lecturer:
  • This course has to deal with very basic to already quite advanced entry levels among the students. The aim is the understanding of the concepts behind statistics, e.g. why do you choose a certain model to analyse a certain situation? To keep students with a lower entry level on board you have to start basic and you need the exercises of the Wednesday tutorial. This results in a course with a steep learning curve, especially for those with a lower entry level.
  • The argument that the level of the end-of-term exam was unexpected is curious. Practice exam questions were offered on Canvas. The possibility was there for students to ask questions during the Q&A sessions. It is up to the students to be proactive, also do the practice exam questions (not just the Wednesday tutorial exercises), hand in questions and come prepared. Not all students took this opportunity.
  • The set-up of the Wednesday tutorial and the Friday Q&A will be reviewed. Students will be asked to prepare the Wednesday tutorial exercises beforehand. That way part of the questions that would normally be discussed during the Q&A can be discussed on Wednesday already. From the beginning of the course the use of the discussion board will be stimulated so that students can also help each other with their questions. The Q&A sessions will be rephrased to advanced problem sessions or exam level sessions, but students still have to do the practice exam questions and hand in their questions beforehand.
  • The goal of the Math on Trial assignment is to analyse and assess arguments (in this case statistical arguments) of forensic examples just as it is asked in the evaluation and described in the learning outcomes (LOs) connected to the assignment. The connection between the learning outcomes and the Math on Trial assignment is explained in the course manual. Perhaps this is a semantic issue? Judgement level is maybe seen as judging right or wrong, and not as such perceived when students are doing a critical assessment?

Contact information

Coordinator

  • prof. dr. R. Nunez Queija

Staff

  • N.A.C. Levering