Evaluation and Reflection

KEATS Similarity Checker Project

Overview of project

Between July 2022 and February 2023, the SSPP TEL team conducted a pilot project to improve the student experience when submitting assignments by creating a special area for students to check the plagiarism/similarity score of their assignments. The goal of the pilot was to make it easier for students with Mitigating Circumstances and the Programme Office staff to manage the process of submitting assignments to KEATS.

Any student who is not subject to Mitigating Circumstances can submit a draft and/or reupload their submission as many times as they wish up to the assessment’s original due date. Many students use this opportunity to submit a draft to check their similarity score before they make their final submission. At the moment, due to technical limitations within KEATS/ Turnitin, students who are granted an extension to an assessment via the Mitigating Circumstances process cannot submit a draft to check their similarity score; they are only allowed to submit once, and after the due date for the assignment passes they no longer have the option to upload their final version.

This is particularly problematic for students who have submitted a draft (sometimes long before the original due date) and then realise they need to apply for Mitigating Circumstances: as they are not able to delete the draft themselves, this draft will be considered their final submission and their MC claim may be rejected on the basis that they have already made a submission. In some departments, PS Staff sometimes agrees to submit and/or delete a draft for a student, but this is time consuming, not consistently applied, and it relies too much on PS Staff being available and inclined to help outside of their normal duties; it is also not sustainable when taking into account the very high number of MC claims we process at the moment.

First Steps

The departments of Geography and Global Health and Social Medicine in the Faculty of SSPP took part in the initial pilot project for their re-sit and dissertation students, and the Similarity Checker (SM) area was created and placed on their Handbook pages on KEATS. Accompanying it was a video and PDF to explain to students how to use the SM, as well as a warning text to reinforce the idea that this did not count as a submission and would not be checked by staff.

Feedback from this small cohort of students led to some revisions and changes to the SM, the most notable of which was around the language used. We had used the words “test area”, meaning to check or trial something, but students for whom English was not their native language found this confusing and equated “test” to mean exam. This was revised and the wording was changed from “test submission area” and “test area” to “Similarity Checker” and “practice area” respectively.

Once we were happy with the revisions, the SM was then rolled out to the rest of the School of Global Affairs, War Studies, and Education, Communication and Society. All Similarity Checker areas have the same layout, same wording and same instructions for parity across all the Schools. Communications for staff and students were also created by Soshana and these were used by Departments to make students and academic staff aware of the existence of the SM.

Layout

The Similarity Checker is made up of several parts. This includes an introductory text explaining what it would be used for, how to use it and a disclaimer that nothing submitted here would ever be moved nor assessed. An explainer video and PDF instructions were added to ensure accessibility and inclusive design were adhered to, so that all students would be able to clearly understand the functionality.

Screenshot of the home screen of the similarity checker.
Screenshot of the geography similarity checker.

The submission areas were divided by level and surname. There is no functional necessity for this, but it aims to prevent Turnitin from getting overloaded by all students in the one department trying to access it at the same time. If students submit in the wrong area there are no effects on their score or submission.

Screenshot of the different Turnitin Submissions.
Screenshot of the different Turnitin Submissions.

Student Feedback

A survey was created by Soshana and shared with all participating Schools, with almost 100 responses. Feedback was generally positive, with students highlighting how the SM improved their experience and confirming that it constitutes an equalising factor for students with extensions. Overall, 90% of respondents have used the SM, 93% found it useful, and 16% used it in the context of an assessment extension (mitigating circumstances).There was also some negative feedback from students who did not find it particularly beneficial, mainly due to the long turnaround time for their score after their third submission, as well as the fact that their score changed repeatedly when uploading a new draft of the same work, depending on how close the assessment due date was. These concerns will be addressed, and elements of response will be provided in future communications.

Overview of survey respondents.
Overview of survey respondents.
Respondents usage by level of study.
Respondents usage by level of study.
Respondents use of the Similarity Checker.
Respondents use of the Similarity Checker.

Conclusion and next steps

The pilot project was a successful start to improving the experience of students and staff using KEATS and Turnitin during their submission period. This was initially to improve the experience of those with Mitigating Circumstances, but we can see that many students without extensions are also using it to check their work.

Next steps will include rolling this out further to other Schools or Departments so that all students in SSPP can access it. Some Departments have their own versions, which we would like to replace with this more modern iteration of the Similarity Checker.

As next steps, the TEL team would like to address some of the points that the students raised as part of the feedback process, and create a communications plan to ensure this is being communicated to students at all relevant points of the academic year.

An all-Faculty stance should also be drawn up if/when a student submits their paper to the Similarity Checker instead of their module page and how this should be dealt with.


Written by Leanne Kelly Leanne Kelly

Leanne is the Digital Education Manager for the Faculty of Social Science and Public Policy (SSPP) at King’s College London. She is responsible for a wide range for digital education processes within the Faculty including instructional design, accessibility, training, innovation and developing new online programmes.

She has a background in publishing and eLearning, and is passionate about using technology to improve the learning experience and make it more accessible to all. She is interested in developing new ways of working, scaling projects and reusing content in new ways, and making online learning an enjoyable process for all.

Written by Soshana Fearn

Soshana Fearn

Soshana is the Senior Postgraduate Programme Officer for the Department of Geography (SSPP) at King’s College London. She delivers the day-to-day administration of taught postgraduate programmes (Masters), offers comprehensive and authoritative advice and support for all staff and students in respect of programme regulations and curriculum choices, services the relevant boards and committees, and oversees the processing of Mitigating Circumstances requests.

She has a background in project coordination and is dedicated to improve the experience of both students and staff through the development and implementation of streamlined innovative solutions, including projects related to institutional processes, policymaking and technology-enhanced learning resources.


 

Technologies

Ever wondered how your students see your KEATS course? Create temporary users to find out…

King’s has recently released a new KEATS feature that allows staff who manage a module area to create a set of temporary user accounts. These accounts only last a few days, but can be used to log into KEATS and explore module spaces exactly as a student would.

Benefits of Temporary Users

By creating temporary users you can:

  • Test a student’s journey through your learning material
  • Investigate and understand how assessment tools work from a student perspective
  • Make sure that content displays how and when you expect it to

Guidance on Creating Temporary Users

Information on how to create temporary users is available in the KEATS Staff Documentation under Creating Temporary Users.

Screenshot of Temporary Users Creation options
Create Temporary Users in your KEATS Course

The “Temporary user creation” functionality is available for the Course Administration menu of your KEATS course and you can create up to 3 accounts at any one time, that will last a maximum of 14 days.

When you create the users they are automatically enrolled in the course created them in and the “Student” role. Once you have created a temporary user you can log in using the account details via keats.kcl.ac.uk/?redirect=0.

Tips:

  • Once a Temporary user is created you can enrol the users into any KEATS area you wish.
  • If your module space is still hidden give the temporary account the role “Student Tester” so they are able to access the material.
  • If you don’t see the Temporary user creation link in you Course Administration Menu then contact your local Digital Education team as they may need to enable the functionality for your part of KEATS.

 

Moodle 4, News and Events, Technologies

KEATS Upgrade: What to expect as a student

On 18 July 2023 KEATS (Moodle) will be upgraded, with KEATS being unavailable for all staff and students from 6am and for most of upgrade day.

As part of this upgrade KEATS is getting a makeover and as such will look different for students logging back in after 18 July. The resources and teaching materials available via KEATS will remain the same, but the look of your courses will be different as improvements to the user interface and navigation are introduced.

New look KEATS will include:

Improved Dashboard & Separate My Course Page

When you login to KEATS your Dashboard will allow easy access to courses you have recently accessed and provide you with a timeline highlighting activities which have tasks and deadlines upcoming. A separate ‘My Courses’ page is also available allowing you search, access and highlight important courses for you.

KEATS (Moodle Dashboard)
New look KEATS Dashboard highlighting recently accessed courses and a timeline of upcoming activities

Navigable Table of Contents within Courses

When accessing a KEATS course, an Index Drawer is provided on the left of screen to allow you easy access to different sections and resources within the course. This index is collapsible/expandable to allow individuals to focus better on the main content as needed.

Collapsible Blocks & Resources

Similar to the table of contents, a series of blocks and resources are available on the right of screen via a collapsible/expandable Block Drawer. These blocks provide you with access to key resources and information, but can be minimised to declutter the screen as needed.

Screenshot of new-look KEATS course, displaying content in a grid format
A KEATS course showing the collapsible/expandable Index Drawer on the left and the Block Drawer on the right.

Improved Design for Mobile Devices

Our new version of KEATS is responsive to mobile and tablet devices allowing your courses to be better displayed and navigated.

New look KEATS for desktop and mobile
New look KEATS is responsively designed for screens of different sizes

Please note, faculties and departments use KEATS in different ways and may have different templates and approaches for you to be aware of. If you are in the middle of teaching during this upgrade and are experiencing unexpected changes, please do contact your Programme Team in the first instance.

Moodle 4, News and Events, Technologies

Check-out what your KEATS course will look like in Moodle 4

KEATS is being upgraded on the 18 July 2023 and will be getting a make over (see our blog post New look KEATS coming in July 2023). As well as incorporating new, modern branding guidelines the interface aims to make doing the things you want to achieve in KEATS easier.  

To help you prepare for the upgrade, a read-only test environment is available to staff which has the new theme applied. You can jump straight from KEATS to the test environment from a course to see what the content looks like using the new theme. You can also log into the site directly at https://keatsuat4x.kcl.ac.uk/ (staff only).  

Linking to the test site is being enabled locally within faculties and departments, but one thing to look out for is a new block on your course page that allows you to make the jump directly to the equivalent course in the test site. This block (and the test site) is available to staff only.

Screenshot of block enabling access to upgraded Moodle for staff

You will see changes in the look-and-feel of KEATS over time as the branding is still being developed. Look out for the new primary menus that help you get to Participant lists, Grades and other Reports (your course settings will also be here, but aren’t visible in the test environment) and keep an eye out for our blog posts giving further details on the upcoming changes.  

Screenshot of new-look KEATS course, displaying content in a grid format
Disclaimer: This may look different in your faculty

Please note: course content in the test site is a snapshot from March 2023. Any course developments after this time won’t be available in the test site. You can also access your Dashboard and the new My Courses page to browse the site as usual.