A Peer Review Market

The last month has been really busy and I realise I haven’t written a Blog post as I have had no free time in the evenings.  So I am going to share one thing I did end up creating over a couple of nights.

It was originally a work idea that got more complicated and I ended up working on it in my own time because it was fun and I wouldn’t have the time to do it in work.

So the original idea was to get students to put in drafts of their work for peer review and for other students to agree to review them and provide feedback.  One of my colleagues Dr Phil Langton came up with the idea of a “Peer Review Market”, the reason for this was he has previously done peer marking with his students and although they have generally got a lot out of it a number of them have been very unhappy with the marks counting towards their grade if the marker wasn’t always as good as they could be (any of you who have done peer marking on a MOOC will know that marking quality can vary a lot and some markers can give marks you might consider unfair…).

However with no incentive to look at peers work some people wouldn’t bother and so some wouldn’t get the benefit of having comments and feedback on their work.  The solution was a “Peer Review Market” where each student could post work for review, other students could volunteer to review it and the whole thing would run on a points system where you got marks for any reviewing you did and it cost you points to get your work reviewed.

Tomates anciennes.jpg

Tomates anciennes” by User:PopolonOwn work. Licensed under CC BY-SA 3.0 via Wikimedia Commons.

It seemed fairly straightforward, so I made a couple of google forms that fed a google sheet and told Phil who dropped into my office to discuss.  As it stood it worked but it would be easy to “game” the system, there was no option to be anonymous and hey wouldn’t it be good if it could email students when people had marked their work.

So I ended up spending a couple of evenings tinkering and even did some coding (to set it to send various emails).

Here is a working version of the Peer Market I have put it on a Google Site to organise it but for our proper run it will be surfaced on our VLE (using iframes).  If you want to try it use the following 2 accounts

  • Username = student1 and anonymous_id = demo1
  • Username = student2 and anonymous_id = demo2

Obviously you wont get any emails – but assume that it would send a person an email each time one of the following happened that they needed to know about

  • when someone offers to review
  • when a review is completed
  • when someone gives points to the reviewer for their time
  • when someone declines a reviewer

In my next blog post I will provide details on what is happening and a link to the spreadsheet and instructions on taking a copy to use yourself.  As well as talking about why and how we use points

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s