One of my pet hates is the boring shiny store bought compliance e-learning, you know the kind – A page with a picture and 2 chunks of text and a next button, every few pages a handful of multiple choice questions that a monkey could answer to “check the learning”
Because of things like this I am not a big fan of the computer marked test (sometimes disparagingly called a “multiple guess test”) because it is something that is so easy to do badly.
I was going to cover computer tests later in the series but someone emailed me some fantastic research (Susanne Voelkel. Combining the formative with the summative: the development of a two-stage online test to encourage engagement and provide personal feedback in large classes. (2013) Research in Learning Technology 21: 19153) on the effect of tests so I am going to cover it now.
Feedback – The 2 key things about VLE/computer tests is that they A) mark themselves and B) Give instant feedback. The thing is that while A) will save you time you really really need to spend a lot of time on B) because when students have just got something wrong (or right) they are receptive to immediate feedback and you need to make sure that it is good and it deals with the mistake that they made – sadly yes this does mean you need to provide individual feedback for each wrong answer.
Motivation – as you can see from the research above, motivating students to take the test is key
- If you give them good tests with decent feedback students grades will improve, but not all students will take the tests (and thus we assume miss out on the benefits)
- If you make the test compulsory (ie counts towards the final mark) all students will take the test but you cant make the results available instantly, students don’t seem to get the same benefit from feedback if it is delayed.
- If you set a pre-test with feedback and students need to get a certain score before they can take the test that counts towards the final mark, then grades will improve and all students will take the tests. (most VLE’s will allow you to set this up – ask your friendly Learning Technologist how to do it)
Sadly again number 3 will take the most effort on the part of academics – but if you are going to do it, then you should do it properly.
Don’t over test your students – If there are lots of questions then students will not pay as much attention to individual question feedback, similarly if there is a big test every week students will lose interest.Either have a couple of big tests and use something else to know how your students are doing on the rest of the course OR have weekly tests of 3 or 4 questions and a couple of big tests on top.
If I was doing it I would have 1 or 2 big tests and the weekly questions I would ask in class using the flipped classroom method of Eric Mazur (watch this you tube for an idea of the kind of effect it can have in class)
Finally dont add questions that require a human to mark them in your VLE/Computer tests, because A) this will mean you spend time marking them and B) the feedback will not be instant and so will not be as effective.