How Are You Testing?

Giving a quiz, test, or exam is a time-honored tradition within education. The purpose is to check how much information has been retained in the student’s mind. To truly test, the student is asked to recall information without using other sources (aka: open book test).

Given the explosion of information available in the world today, recent (actually well over 20 years!) trends have been to using open book/ open notes test and the question among educators has been Does this truly test a student’s knowledge of the subject?

In educational measurements grad classes I have taken, I learned that an open book/ open notes test is valid only if the test is timed. In other words, giving students an open book test that is untimed is not valid, as it does not test a student’s knowledge of the subject matter. It only tests how well a student can flip pages and how well they can read.

Given the stress students experience when they are told they will be tested, and given the stress that you as an instructor will experience when students push back—--my question to is this: Why are you testing? What is your purpose behind giving a test?

Here are my suggestions for how to think about testing: (this applies to F2F classes only; online classes have somewhat different considerations)

Reason for giving a test:
If it is to make sure students have read the material, then use objective test questions (T/F; multiple choice) and test using closed book. Allow enough time within the class period for everyone to complete the test without feeling hurried. The advantage to this method is that after the instructor has collected the completed tests from the student, the instructor can then review the test questions with the class while the test is still "fresh" in their minds. Encourage students to take notes when you do this.

If you decide to test students to see if they have read the material using an open book method, and if the test consists of objective test questions, then the test should be timed to approximately one minute per question. It's OK add another 5 minutes to the time limit so as to allow students to write their name on the test and "settle in". So for a 20 question test allow 25 minutes to complete the test.

You can also check for retention of knowledge using open ended test questions. In that case allow a longer time frame. This kind of test would not require a specific time for each question. As the instructor monitoring the test, you would have to gauge how the students are doing by seeing how long they are taking to complete the test. If, after 45 minutes, two-thirds of the class is still busily writing then obviously you can see they need more time. But, if after 45 minutes 2 students are slowly writing and staring into space, then you have to call time and collect the remaining tests, finished or not. Always provide students with a 5 minute warning before ending the test. This helps them know the end is coming. Open ended test questions refer to those that ask students to write out answers such as "List 4 qualities of..." or "Explain how...".

If you are checking for how well a student understands the subject matter and can write about it in his/her own words then use essay questions with either the open book or closed book option. For these kinds of tests allow an entire class period (based on a 1-2.5 hour class) —this often would be a final exam; the test questions would be complex; and a rubric would be needed to grade the exam.

Note that if you do choose this as your final exam, you will need to provide students an opportunity to practice this type of test taking during the course. Perhaps give them several short chances during the course to answer one essay question is a “quiz”. Also note that as the instructor, these tests are time consuming to grade.

Giving students an open book test in class, with either objective test questions or short answer questions and not timing the test is not testing!

The problem with testing is that many instructors know they have to give a test but don't understand why they are testing or what they are testing.

Students don’t like tests. They will just about always push back on you, the instructor, and try to negotiate ways to get out of it. However, if you fully understand why you want to test then you will be in a better position to stand your ground and make a fair decision about testing options.

More specific information about whether to use a publisher's test or on writing good test questions will be forthcoming.