{"id":242,"date":"2018-08-06T15:27:15","date_gmt":"2018-08-06T15:27:15","guid":{"rendered":"https:\/\/blogs.kcl.ac.uk\/aflkings\/?page_id=242"},"modified":"2020-04-21T10:12:08","modified_gmt":"2020-04-21T10:12:08","slug":"peer-evaluation","status":"publish","type":"page","link":"https:\/\/blogs.kcl.ac.uk\/aflkings\/rich-in-informal-feedback\/peer-evaluation\/","title":{"rendered":"Peer Evaluation"},"content":{"rendered":"<h2><strong>What is it? <\/strong><\/h2>\n<p>In peer evaluation (also called <em>peer review<\/em><strong> or <em>peer feedback<\/em><\/strong> or <strong>peer instruction<\/strong><em>) give feedback on <strong>each other\u2019s work<\/strong>, <strong>another group\u2019s work,<\/strong> or, if working in a group, <strong>other group-members\u2019 contribution to a project<\/strong>. This allows students to build confidence in understanding and applying criteria, or even negotiating their own prior to the evaluation activity. These activities are <strong>formative<\/strong> and grades are not given in order to reduce the focus on grading and scores.<\/em><\/p>\n<p>Peer evaluation activities can take place at any time, with almost any piece of work, including exams. The process can be digital or in class. There are a variety of digital technologies to facilitate this, including wikis, blogs, discussion forums, Moodle workshop, Peermark on Turnitin, Peerwise, Pebblepad, etc.\u00a0\u00a0<a href=\"https:\/\/www.kcl.ac.uk\/study\/learningteaching\/ctel\/index.aspx\"><strong>CTEL<\/strong><\/a> can help to suggest suitable tools or help you to set them up.<\/p>\n<h2><strong>Why would I use it? <\/strong><\/h2>\n<ul>\n<li>Students can learn more from noticing each other\u2019s strengths and weaknesses than either being told by the teacher, which can feed forward into<strong> judging their own work<\/strong>. Feedback provided by peers may also be more accessible and understandable than that provided by teachers (<a href=\"http:\/\/journals.sagepub.com\/doi\/abs\/10.2304\/plat.2003.3.2.102\" target=\"_blank\" rel=\"noopener noreferrer\">Falchikov 2004<\/a>). Eric Mazur, eminent researcher on peer instruction describes it below:<\/li>\n<\/ul>\n<p><iframe loading=\"lazy\" title=\"Eric Mazur - Peer Instruction\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/FUY049rIjdM?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<ul>\n<li>It increases the sense of <strong>community building and establishing social networks,<\/strong> especially for first year students and allows a communication line to peers for those who cannot attend campus. It therefore suits <strong>blended learning and Kings\u2019 fully online courses.<\/strong><\/li>\n<li>It emphasises the idea that academic work is delivered to a <strong>real audience,<\/strong> simulating the process of research environments and the workplace (<a href=\"https:\/\/www.tandfonline.com\/doi\/abs\/10.1080\/13562510600680582\" target=\"_blank\" rel=\"noopener noreferrer\">Liu and Carless, 2006<\/a>). Framing it as \u2018peer review\u2019 for postgraduates could help increase engagement in the process.<\/li>\n<li>It can <strong>save teacher time<\/strong> in giving feedback in formative situations. This can facilitate a shift towards more formative assessment without increasing teacher workload.<\/li>\n<\/ul>\n<h3>Known Issues &#8230;<\/h3>\n<ul>\n<li>It is important that students don\u2019t see peer marking as primarily a means of reducing teacher workload and that the above benefits are emphasised to them.<\/li>\n<li>Practice with understanding and applying criteria and ways of giving constructive feedback is vital, otherwise students&#8217; feedback on their peers&#8217; work is less likely to be useful.<\/li>\n<li>It is important that feedback is reciprocal and a constructive feedback culture is facilitated. Students can easily become disillusioned if they spend time on feedback and receive poor or minimal feedback in return.<\/li>\n<\/ul>\n<h2><strong>How has it been used?<\/strong><\/h2>\n<p>There are myriad examples of research, interventions and case studies on using peer evaluation in all disciplines.<\/p>\n<p><strong>Examples:<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/vimeo.com\/55833031\" target=\"_blank\" rel=\"noopener noreferrer\">Raoul Mulder from the University of Melbourne<\/a> talks about engaging students in the process.<\/li>\n<li><a href=\"https:\/\/blogs.kcl.ac.uk\/aflkings\/2018\/08\/22\/peer-review-instructions-for-students\/\">KCL case study: A War Studies module in SSPP<\/a> combines both peer formative feedback on an essay draft AND Moodle discussion forums.<\/li>\n<li><span style=\"color: #0000ff\"><a style=\"color: #0000ff\" href=\"https:\/\/www.academia.edu\/197032\/Peer_Assessment_in_Popular_Music\">Mark Pullman<\/a><\/span> presents a case study on how peer evaluation has been used in<strong> Music.\u00a0<\/strong><\/li>\n<li>Imperial College London: This is an example of how an instructor explains how he will use peer instruction in his module:<\/li>\n<\/ul>\n<p><iframe loading=\"lazy\" title=\"1.2 | MSE104 - What is Peer Instruction?\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/e9IT7BTBJgY?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p><strong>Here are some common peer evaluation activities:<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/blogs.kcl.ac.uk\/aflkings\/rich-in-informal-feedback\/two-stage-exams\/how-can-i-use-two-stage-exams\/\" target=\"_blank\" rel=\"noopener noreferrer\">Two-stage Assignments<\/a>: Providing feedback on draft assignments<\/li>\n<li><strong>Moodle Workshop<\/strong> is a good way to facilitate peer feedback activities. It allows for anonymity or random allocation of pairs.<\/li>\n<li><a href=\"https:\/\/blogs.kcl.ac.uk\/aflkings\/opportunities-for-low-stakes-practice\/collaborative-writing\/\">Collaborative Writing<\/a>\u00a0&#8211; see this resource for how to use wikis and blogs<\/li>\n<li><strong>Interview panel (viva style):<\/strong> Select 3-4 students\u00a0to grade and give feedback on one person\u2019s presentation and these \u2018panels&#8217; are rotated. Everyone gets an opportunity to give and receive feedback.<\/li>\n<li><strong>Poster presentations:<\/strong> Students walk around and ask questions to each other about their posters. This allows for small audiences, is authentic, and can be a nice scaffold for more anxious students.<\/li>\n<li><strong> OSCE style practice or <\/strong>summative presentations and\u00a0can be practised in small break-out groups in seminars <a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pubmed\/12228103\" target=\"_blank\" rel=\"noopener noreferrer\">(Brazeau et al, 2002).\u00a0<\/a><\/li>\n<li><strong>Record presentations for feedback:<\/strong> If students are happy to do so, presentations (and clinical skills practice)\u00a0can be recorded, put online and students can watch and grade them in their own time<a href=\"https:\/\/blogs.kcl.ac.uk\/aflkings\/students-directing-their-own-learning\/using-video-for-self-assessment\/\">\u00a0(<strong>See Using video for self assessment<\/strong>)<\/a>. This reduces pressure to make decisions and judgments are more likely to be objective. <strong>Students who are crippled by performing in front of an audience might prefer this method of assessment.<\/strong> Consider the quality of sound and video recordings however.<\/li>\n<li><strong>Group work: Evaluating peers\u2019 contributions to group work in order to counter social loafing<\/strong><\/li>\n<\/ul>\n<p style=\"padding-left: 30px\">In group work, students and teacher often complain about students dominating group work, while some feel they do not need to put in as much effort.\u00a0 Awarding individual marks for contribution can help this, but somewhat defeats the object of true collaborative group work and this does not usually happen in authentic work and research situations.<\/p>\n<p style=\"padding-left: 30px\">A solution is to provide students an<strong> anonymous<\/strong> <strong>online page to evaluate the contribution of their peers\u2019 contribution.<\/strong> This allows students the opportunity, especially in large classes where teacher supervision of group work is more difficult, to express concerns with peers, issues arising in\u00a0 allocating roles, or even their own problems such as extra curricula responsibilities which are preventing them form contributing. The teacher can then decide how to intervene. The students\u2019 evaluation of their peers can be used as part of the group (or individual) grade.<\/p>\n<ul>\n<li><strong>Peer evaluation on presentations:\u00a0<\/strong><\/li>\n<\/ul>\n<p>KCL&#8217;s Hannah Dickson, Joel Harvey and Nigel Blackwood recently published a study conducted in IoPPN on peer feedback in oral presentations.\u00a0 Students from one cohort took part in a peer review of their presentations on a piece of clinical work they had undertaken. The control group did not take part in the peer review exercise. Results showed that students who did take part in the peer review post-presentation achieved higher mean grades in their next summative presentation than the cohort who did not. Read their article here:<\/p>\n<div class=\"pub-meta\"><a href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/02602938.2018.1528341\" target=\"_blank\" rel=\"noopener noreferrer\"><strong><span class=\"authors\">Hannah Dickson, Joel Harvey &amp; Nigel Blackwood<\/span>\u00a0<span class=\"date\">(2018)<\/span>\u00a0<span class=\"art_title\">Feedback, feedforward: evaluating the effectiveness of an oral peer review exercise amongst postgraduate students,<\/span>\u00a0<span class=\"serial_title\">Assessment &amp; Evaluation in Higher Education.\u00a0<\/span><\/strong><\/a><\/div>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/www.heacademy.ac.uk\/system\/files\/resources\/feedback_toolkit_whole1.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">Anne Crook of Oxford Learning Institute (see page 63 of the HEA feedback toolkit resource)<\/a> suggests a way to utilise peer feedback in presentations:<\/p>\n<ol>\n<li style=\"text-align: left\">Each student in the class is given a marking criteria sheet (as used by the lecturers) and are talked through each of the criteria at the start of the session<\/li>\n<li style=\"text-align: left\">Each student is given two \u2018post-it\u2019 notes of different colours.<\/li>\n<li style=\"text-align: left\">Using the marking criteria, each student writes down one good feature of the presentation on one of the coloured notelets and one \u2018weakness\u2019 onto the other notelet; the \u2018weakness\u2019 comment has to be qualified by a suggestion of how that aspect of the presentation could be improved (note: the names of the student providing the feedback are not put onto the notelets)<\/li>\n<li style=\"text-align: left\">At the end of each presentation, the audience is given two minutes to complete their feedback; the lecturer collects the notelets, keeping the coloured notelets separate. A quick skim through the notes is made by the lecturer to ensure all feedback is \u2018appropriate\u2019. The notelets are then given to the student who has just given the presentation.<\/li>\n<\/ol>\n<ul>\n<li><strong>KEATS Discussion forums:<\/strong><\/li>\n<\/ul>\n<p style=\"padding-left: 30px\">Discussion forums can be used in variety of ways. The most common peer activity is when <strong>students ask questions and advice from each other about an assignment.<\/strong> A more formalised method of using forums is for students to <strong>upload a short section of their work to a forum to create a thread and students comment on that work<\/strong>. This works best when a small number of students are allocated to a group to comment on each other\u2019s work. It is easy to set up groups in KEATS forums, <a href=\"https:\/\/keats.kcl.ac.uk\/course\/view.php?id=51445&amp;section=13\">(see CTEL&#8217;s help page)<\/a> and students can manually enrol themselves or teachers can pre-allocate groups.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/blogs.kcl.ac.uk\/aflkings\/rich-in-informal-feedback\/peer-evaluation\/how-can-i-use-peer-evaluation\/\">How can I use peer evaluation?\u00a0<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<div class=\"mh-excerpt\"><p>What is it? In peer evaluation (also called peer review or peer feedback or peer instruction) give feedback on each other\u2019s work, another group\u2019s work, <a class=\"mh-excerpt-more\" href=\"https:\/\/blogs.kcl.ac.uk\/aflkings\/rich-in-informal-feedback\/peer-evaluation\/\" title=\"Peer Evaluation\">[&#8230;]<\/a><\/p>\n<\/div>","protected":false},"author":386,"featured_media":0,"parent":50,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-242","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/blogs.kcl.ac.uk\/aflkings\/wp-json\/wp\/v2\/pages\/242","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.kcl.ac.uk\/aflkings\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/blogs.kcl.ac.uk\/aflkings\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/aflkings\/wp-json\/wp\/v2\/users\/386"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/aflkings\/wp-json\/wp\/v2\/comments?post=242"}],"version-history":[{"count":22,"href":"https:\/\/blogs.kcl.ac.uk\/aflkings\/wp-json\/wp\/v2\/pages\/242\/revisions"}],"predecessor-version":[{"id":1283,"href":"https:\/\/blogs.kcl.ac.uk\/aflkings\/wp-json\/wp\/v2\/pages\/242\/revisions\/1283"}],"up":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/aflkings\/wp-json\/wp\/v2\/pages\/50"}],"wp:attachment":[{"href":"https:\/\/blogs.kcl.ac.uk\/aflkings\/wp-json\/wp\/v2\/media?parent=242"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}