{"id":751,"date":"2020-04-23T15:10:40","date_gmt":"2020-04-23T15:10:40","guid":{"rendered":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/?p=751"},"modified":"2020-04-24T08:37:25","modified_gmt":"2020-04-24T08:37:25","slug":"the-dos-and-donts-of-peermark","status":"publish","type":"post","link":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/the-dos-and-donts-of-peermark\/","title":{"rendered":"The Do\u2019s and Don’ts of PeerMark"},"content":{"rendered":"

Feedback is a vital component of the assessment process. Providing meaningful feedback to students is central to developing both learner competence and confidence and is, in the words of Hattie & Timperley (2007), \u201cthe most powerful single moderator that enhances achievement\u201d. However, figures from the National Student Survey (2019) show that many students across UK universities are largely unsatisfied with the feedback they receive on their work. Teaching staff are therefore often tasked with finding new and innovative methods of increasing both the quality and quantity of student feedback as a way to enhance the learning experience.<\/span>\u00a0<\/span><\/p>\n

PeerMark<\/span>\u2122<\/span><\/a>\u00a0is a tool available through Turnitin that allows students to anonymously review and provide comments on papers submitted by their\u00a0<\/span>coursemates<\/span>. It is argued by Rust (2002) that peer-based marking makes assessment more \u2018learner-<\/span>centered<\/span>\u2019, as students\u00a0<\/span>are able to<\/span>\u00a0directly engage with the feedback process itself. This i<\/span>n<\/span>\u00a0turn can stimulate critical thinking and provide students with new insights into their own performance that they would not gain from simply reviewing their own work.<\/span>\u00a0<\/span><\/p>\n

Last year, we attempted to implement\u00a0<\/span>PeerMark<\/span>\u2122 into a timed essay assessment on the KCL Forensic Science MSc. For this assessment, a cohort consisting of around 30 students was asked to prepare a strategy document outlining how they would process a\u00a0<\/span>particular crime<\/span>\u00a0scene, given a set of circumstances and photographs. At the end of the three-hour allotted assessment period, each essay submitted to Turnitin was randomly distributed through the\u00a0<\/span>PeerMark<\/span>\u2122 system to another student for marking. Students were given one final hour to review the work, provide feedback comments (in whichever format they preferred) and assign the essay a grade out of one hundred.\u00a0<\/span>\u00a0<\/span><\/p>\n

\"Maths<\/p>\n

In general, our students responded positively to the increased amount of feedback they received on their work, as well as the ability to gain an immediate measure of how they performed within one hour of submission (as opposed to days or weeks afterwards). However, we also found that integrating the\u00a0<\/span>PeerMark<\/span>\u2122 system was not without its challenges. This post therefore covers some of the key do\u2019s and don\u2019ts of using\u00a0<\/span>PeerMark<\/span>\u2122 based on lessons learned:<\/span>\u00a0<\/span><\/p>\n

Do: Set expectations in advance<\/span><\/b>\u00a0<\/span><\/h3>\n

One widely known challenge in implementing peer-based marking systems in higher education is getting students motivated enough to take part. Many students believe that teaching staff should be solely responsible for marking and feedback provision and that any type of self or peer-based assessment is additional unnecessary \u2018work\u2019 for them to complete within an already overloaded schedule. It is therefore crucial that students are informed as far in advance as possible (preferably at the beginning of the semester or within the module handbook) as to when peer-marking activities will occur and given an explanation of how taking part in these activities is likely to increase their own performance.\u00a0<\/span>\u00a0<\/span><\/p>\n

\"Students<\/p>\n

Do: Teach students about what \u2018good\u2019 feedback really means<\/span><\/b>\u00a0<\/span><\/h3>\n

In order for<\/span>\u00a0peer-marking to have any benefit, students should be able to provide feedback to their\u00a0<\/span>coursemates<\/span>\u00a0that is constructive and addresses ways in which the author can improve for their next assignment. Without providing initial instruction to students on how to provide effective feedback, you run the risk of students making comments that are unhelpful, or in some cases hurtful (which will largely achieve the opposite of increasing learner confidence). It is therefore a good idea to share some principles of good feedback (see:\u00a0<\/span>HEA Feedback toolkit<\/span>) with students before any peer-marking activity takes place.<\/span>\u00a0<\/span><\/p>\n

Don\u2019t: Implement PeerMark<\/span><\/b>\u2122<\/span>\u00a0without doing a test run<\/span><\/b>\u00a0<\/span><\/h3>\n

Whilst on the surface\u00a0<\/span>PeerMark<\/span>\u2122 seems like\u00a0<\/span>a fairly intuitive<\/span>\u00a0system to use, we found that many students experience difficulties in accessing other students<\/span>\u2019<\/span>\u00a0work or comments that have been left on their own submissions by\u00a0<\/span>coursemates<\/span>. This seems to be especially true when students use their own laptops, which\u00a0<\/span>utilise<\/span>\u00a0a variety of different operating systems and web browsers. We therefore advise that prior to any peer-marking activity, a test assignment is set up in which several staff members try access and comment on a mock submission. It may also be beneficial to schedule a dedicated portion of time for students to undertake the peer-marking within a student computing room (SCR). This will help to create a standard technological environment and allow staff to respond to any technical issues in person.\u00a0<\/span>\u00a0<\/span><\/p>\n

Don\u2019t: Expect PeerMark to save you time<\/span><\/b>\u00a0<\/span><\/h3>\n

One of the reasons that teaching staff attempt to use\u00a0<\/span>PeerMark<\/span>\u2122 in assignments is the belief that it will alleviate their marking burden in some way by having students provide\u00a0<\/span>the majority of<\/span>\u00a0feedback. However, in most cases, additional time is needed for troubleshooting of technological issues and reviewing comments left by students on each other\u2019s work (often negating any time-saving benefits). Before implementing peer-marking, staff should think carefully about what they want to achieve from such a system. If their goal is to increase module evaluation scores by enhancing the quality and quantity of student feedback, then\u00a0<\/span>PeerMark<\/span>\u2122 may be a very useful tool. However, if their purpose is to reduce time spent on marking assignments, then other strategies, such as \u2018live marking\u2019, may be more beneficial.<\/span>\u00a0<\/span><\/p>\n

References<\/h3>\n
    \n
  • Hattie, J. and Timperley, H., 2007. The power of feedback. Review of educational research, 77(1), pp.81-112.)<\/li>\n
  • Rust, C., 2002. The impact of assessment on student learning: how can the research literature practically help to inform the development of departmental assessment strategies and learner-centred assessment practices?. Active learning in higher education, 3(2), pp.145-158.)<\/li>\n<\/ul>\n

     <\/p>\n

    \n

    Written by James Gooch \"\"<\/h3>\n

    James Gooch is a Postdoctoral Research Associate in the School of Population Health and Environmental Science. He is also a module lead on the KCL Forensic Science MSc programme and teaches on the \u2018Forensic Genetics and Toxicology\u2019 module of the Biomedical Sciences BSc, the King\u2019s Forensics MOOC and the Bolashak Bespoke Programme in Forensic Sciences.<\/p>\n

    \n

     <\/p>\n","protected":false},"excerpt":{"rendered":"

    Feedback is a vital component of the assessment process. Providing meaningful feedback to students is central to developing both learner competence and confidence and is, in the words of Hattie & Timperley (2007), \u201cthe most powerful single moderator that enhances achievement\u201d. However, figures from the National Student Survey (2019) show that many students across UK […]<\/p>\n","protected":false},"author":676,"featured_media":763,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[15],"tags":[28,79,76,78],"class_list":["post-751","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technologies","tag-assessment","tag-peer-marking","tag-tel","tag-turnitin","with-featured-image"],"_links":{"self":[{"href":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/wp-json\/wp\/v2\/posts\/751","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/wp-json\/wp\/v2\/users\/676"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/wp-json\/wp\/v2\/comments?post=751"}],"version-history":[{"count":11,"href":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/wp-json\/wp\/v2\/posts\/751\/revisions"}],"predecessor-version":[{"id":767,"href":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/wp-json\/wp\/v2\/posts\/751\/revisions\/767"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/wp-json\/wp\/v2\/media\/763"}],"wp:attachment":[{"href":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/wp-json\/wp\/v2\/media?parent=751"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/wp-json\/wp\/v2\/categories?post=751"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/digitaleducation\/wp-json\/wp\/v2\/tags?post=751"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}