More About Testing

Online and F2F Class Assessments:

Assessment for learning: If the purpose of an assessment is to find out what students already know so that you can plan what to include in your lecture and develop appropriate learning activities, then create a pre-test to assess existing knowledge. This kind of assessment will let you know what your students already know, and how much they know. This is also sometimes called a needs assessment, or gap assessment. Begin by defining what students need to know at the end of the learning experience. After you have done the initial assessment, review the end goal and look at the gap, or difference, in students’ existing knowledge and the end goal. Then create learning objectives to help reach the end goal. You must then create learning activities that close the gap.

Assessment of learning: If the purpose of giving quizzes, tests, and exams is to test the knowledge the student has retained, then you need to create assessments that do so. If you give quizzes, tests, and exams that are open ended and allow students to take as much time as they want, then you are not really testing. Best practice suggests putting a time limit on any assessment.

Open Book or Closed Book? This is a tough question to answer. Educators cannot agree on which one is better. Some instructors have said that when they tell students the exam is open book, students tend not to study. On the other hand, Open Book exams can be valid if they are timed tests. If you don’t have a time limit on the test, then all you’re really doing is seeing how fat students can flip pages.

By their very nature, tests in Distance Learning courses allow students to use their books in answering questions. Therefore, it is important to limit the time the test is available (students can usually take the test within a 48 hour window that the test is available), and put a time limit on the test itself.

How much time?
For multiple choice questions, the general rule is one minute per question. In online courses, it is a good idea to give 5-10 extra minutes because students also have to click through several times in order to get to the next question.

For essay exams think about how much you want the student to write. At the undergraduate level a paragraph is usually sufficient. Allowing 20 minutes to write a coherent paragraph is generous.

If you want students to write several pages, then it might just be better to require an essay assignment rather than a test.

Strategies for Helping Students Be Successful on Tests and Quizzes:
Create a practice test. Let students know that the “real” test will be very similar to the practice exam.

Create a study guide that lets students know what will be covered on the quiz or test.

How Are You Testing?

Giving a quiz, test, or exam is a time-honored tradition within education. The purpose is to check how much information has been retained in the student’s mind. To truly test, the student is asked to recall information without using other sources (aka: open book test).

Given the explosion of information available in the world today, recent (actually well over 20 years!) trends have been to using open book/ open notes test and the question among educators has been Does this truly test a student’s knowledge of the subject?

In educational measurements grad classes I have taken, I learned that an open book/ open notes test is valid only if the test is timed. In other words, giving students an open book test that is untimed is not valid, as it does not test a student’s knowledge of the subject matter. It only tests how well a student can flip pages and how well they can read.

Given the stress students experience when they are told they will be tested, and given the stress that you as an instructor will experience when students push back—--my question to is this: Why are you testing? What is your purpose behind giving a test?

Here are my suggestions for how to think about testing: (this applies to F2F classes only; online classes have somewhat different considerations)

Reason for giving a test:
If it is to make sure students have read the material, then use objective test questions (T/F; multiple choice) and test using closed book. Allow enough time within the class period for everyone to complete the test without feeling hurried. The advantage to this method is that after the instructor has collected the completed tests from the student, the instructor can then review the test questions with the class while the test is still "fresh" in their minds. Encourage students to take notes when you do this.

If you decide to test students to see if they have read the material using an open book method, and if the test consists of objective test questions, then the test should be timed to approximately one minute per question. It's OK add another 5 minutes to the time limit so as to allow students to write their name on the test and "settle in". So for a 20 question test allow 25 minutes to complete the test.

You can also check for retention of knowledge using open ended test questions. In that case allow a longer time frame. This kind of test would not require a specific time for each question. As the instructor monitoring the test, you would have to gauge how the students are doing by seeing how long they are taking to complete the test. If, after 45 minutes, two-thirds of the class is still busily writing then obviously you can see they need more time. But, if after 45 minutes 2 students are slowly writing and staring into space, then you have to call time and collect the remaining tests, finished or not. Always provide students with a 5 minute warning before ending the test. This helps them know the end is coming. Open ended test questions refer to those that ask students to write out answers such as "List 4 qualities of..." or "Explain how...".

If you are checking for how well a student understands the subject matter and can write about it in his/her own words then use essay questions with either the open book or closed book option. For these kinds of tests allow an entire class period (based on a 1-2.5 hour class) —this often would be a final exam; the test questions would be complex; and a rubric would be needed to grade the exam.

Note that if you do choose this as your final exam, you will need to provide students an opportunity to practice this type of test taking during the course. Perhaps give them several short chances during the course to answer one essay question is a “quiz”. Also note that as the instructor, these tests are time consuming to grade.

Giving students an open book test in class, with either objective test questions or short answer questions and not timing the test is not testing!

The problem with testing is that many instructors know they have to give a test but don't understand why they are testing or what they are testing.

Students don’t like tests. They will just about always push back on you, the instructor, and try to negotiate ways to get out of it. However, if you fully understand why you want to test then you will be in a better position to stand your ground and make a fair decision about testing options.

More specific information about whether to use a publisher's test or on writing good test questions will be forthcoming.