Evaluation and Reflection, News and Events, Pedagogy, Technologies

Exploring the Digital Frontier: Revolutionizing Feedback Delivery with Excel and VBA Macros Part 2

Part 2: My experience and reflections

Part 1 of this blog can be found here: https://blogs.kcl.ac.uk/digitaleducation/exploring-the-digital-frontier-revolutionizing-feedback-delivery-with-excel-and-vba-macros-part-1/

Icons of the Microsoft 365 shown

I embarked on this journey to a few years ago when I led a large course with more than 700 students and a team of 15 markers. It was a challenging for an early career lecturer to manage the administrative tasks and collaborate with the whole team: standardization, moderation, and uploading/creating feedback documents. The demanding nature of the courses allows for no mistakes or human errors. Working through the clunky and often user-unfriendly interface of Moodle/Turnitin is another difficult obstacle: one would require the Internet to do the marking and as some other colleagues would agree that we often work better off the Internet. Traditional methods were often time-consuming and inconsistent, resulting in delayed feedback that left students wanting more. The technology-driven solution aimed to address these challenges head-on. When I joined KCL in September 2022, I faced the same problems and have been made aware of different initiatives at KBS to improve the feedback and assessment process at KBS. I gathered my own systems over the years and implemented the process during the Jan 2023 marking season. Over the Spring Term 2023, I refined the process with feedback from colleagues who shared the excitements and interest. In June 2023, I presented at the festival to share the practices and implementation strategies for an innovative automation system.

The process involved harnessing the power of Microsoft Excel and VBA Macros within Microsoft Word. These technologies allowed us to streamline and automate feedback delivery. Imagine, no more laborious hours spent typing feedback comments and no human errors involved in exporting and uploading the feedback documents to Keats/Turnitin! Instead, we could focus on providing students with valuable insights to help them excel.

Screenshot of Digital Skills Hub

**Challenges Faced:**

Of course, no transformative journey is without its challenges. Some educators were initially resistant to change, finding the prospect of learning VBA Macros daunting. Additionally, ensuring the new system was compatible with various devices and platforms presented a technical hurdle. As I mentioned in the guidance (see from my SharePoint), the set-up and troubleshooting at the beginning can be quite a challenge, particularly for colleagues using the MacOS system (it’s less so for Windows users). Compatibility issues were addressed through rigorous testing and continuous monitoring of system performance. Clear communication with your marking team is also needed to make sure everyone is on the same page with the new system.

But I promise it’s worth the effort and the subsequential usages will be a much smoother sail. And from a marker’s perspective, it is much less work than working through the traditional channels.

The journey from traditional feedback systems to an automated approach using Excel and VBA Macros has been nothing short of transformative. It’s a testament to the power of technology in education, where innovative solutions can overcome challenges and improve the overall learning experience.

As we continue this path of exploration and adaptation, the future of feedback delivery looks brighter than ever to improved student satisfaction and educational outcomes. I hope that a wider adoption of the process could help deliver a more insightful and time effective feedback to our students, thereby addressing the burning issues identified from the student surveys, as well as helping deliver impacts to the quality of feedback giving and student experience, as identified in King’s Vision 2029 and the TEF framework.

Screenshot of TEF award

It takes time and communications with colleagues to identify compatibility issues and resolve them. So far, the method has been used by six Economics courses at KBS, two from the University of Glasgow; and colleagues from Marketing and Adult Nursing, have expressed their interests in using it in their courses.
It is definitely not perfect, and I am very much looking forward to feedback, comments, and of course successful implementations of colleagues.

The blog discusses a transformative journey in education, initiated during The Festival of Technology 2022 at KCL. It explores the adoption of Excel and VBA Macros within Microsoft Word to revolutionize feedback delivery. The main reasons for this change were to enhance feedback quality and efficiency, addressing challenges like resistance to change and compatibility issues. Through workshops, ongoing support, and rigorous testing, the adoption of technology resulted in a more efficient, user-friendly, and collaborative feedback system, empowering educators and improving the overall learning experience.

I would like to thank KBS colleagues, Jack Fosten, Dragos Radu, and Chahna Gonsalves for their encouragement, important suggestions and feedback as well as allowing me to pilot the process in their modules. I also thank various colleagues across other faculties for providing feedback and suggestions as well as identifying compatibility issues (with solutions).

For additional resources, including the workshop slides and a detailed guide with relevant codes and FAQs, please refer to the SharePoint folder linked here.

I am a Lecturer in Economics at the Department of Economics, King’s Business School, King’s College London. I am also an academic supervisor at the Institute of Finance and Technology, University College of London, and a chief examiner for the University of London International Programme (Econometrics). Before joining King’s, I lectured and conducted research at the London School of Economics as an LSE Fellow in Economics, and at the University of Warwick as a postdoctoral fellow (in Economics). I completed my PhD in Economics at the University of Nottingham in 2018.

I have lectured courses in econometrics and macroeconomics at King’s, LSE, and Warwick, and led seminars (tutorials) in various courses at Nottingham. From March 2023, I am the GTA Lead at King’s Business School.

Evaluation and Reflection, News and Events, Pedagogy, Technologies

Exploring the Digital Frontier: Revolutionizing Feedback Delivery with Excel and VBA Macros Part 1

Part 1: The practical guide

In today’s rapidly evolving digital age, the need for efficient and effective systems in education is more pronounced than ever. Traditional platforms like Moodle and Turnitin have served us well, but as educators, we must acknowledge their limitations in providing timely, user-friendly, and collaborative feedback on assignments, exams, and dissertations.

This tutorial aims to be your guiding light towards a better, more streamlined approach to feedback delivery. Drawing upon my workshop presented during The Festival of Technology 2022 at KCL, where I shared practical insights and implementation strategies for this automation system, we’ll delve into the fascinating world of Excel and VBA Macros within Microsoft Word. This comprehensive resource builds upon the principles discussed in that workshop.

By embarking on this journey, you’ll equip yourself with the skills and knowledge to revolutionize your approach to feedback giving. Here’s what you stand to gain:

1. **Efficiency:** Say goodbye to the laborious and time-consuming task of manually providing feedback using KEATs (Moodle/Turnitin). With Excel and VBA Macros, you’ll learn how to automate the process, saving valuable time that can be redirected towards more meaningful feedback and interactions with your students.

 

Screenshot illustrating what the purpose of the document
Picture 1: Our Aims and Objectives

2. **User-friendliness:** Discover how to create a user-friendly feedback documents for both yourself, the marking team, and your students. Your feedback system will become intuitive and accessible, ensuring that learners can easily understand and act upon your comments with a nicely formatted feedback document.

A screenshot showing the step by step summary for collecting marking and feedback
Picture 2: A summary of steps

3. **Collaboration:** Break free from the constraints of limited collaboration within traditional systems. The method will allow a marking team to efficiently collaborate and moderate, making feedback delivery a seamless and cooperative effort.

Screenshot of marking folder contents
Picture 3: What the marking folder looks like? It is sharable with the marking team

4. **Comprehensive Feedback:** Dive into the world of detailed and constructive feedback. You’ll gain the expertise to provide tailored insights that empower students to excel in their academic pursuits.

Screenshot of excel file showing comments
Picture 4: What a short comment looks like? Totally customizable.

This tutorial isn’t just about learning a new tool; it’s about transforming your approach to education. By mastering Excel and VBA Macros for feedback delivery, you’ll become a more effective educator, making a lasting impact on your students. The system will:
– Enhance your teaching methods, creating a more engaging and supportive learning environment.
– Free up your time that was spent on administrative tasks or dealing with Turnitin/Keats for more meaningful activities such as preparing feedback comments and communication with your team and students.
– For repeated courses/assessments, you can prepare a bank of modal comments for lateral uses, as well as a record of common mistakes and suggestions for improvements to communicate with students.

Screenshot of excel sheet
Picture 5: What the end product of a long feedback document looks like? Totally customizable.

Education is a dynamic field, and keeping pace with technological advancements is essential. The automation possibilities offered by Excel and VBA Macros are not just practical but also intriguing. Discovering how to harness these tools to optimize your feedback process can be genuinely exciting.

Screenshot displaying cautions with using excel
Picture 6: A few cautions?

For additional resources, including the workshop slides and a detailed guide with relevant codes and FAQs, please refer to the SharePoint folder linked here. This tutorial serves as a bridge between the insights shared during the workshop and the practical implementation of an automated feedback system. It’s an opportunity to further explore and master these valuable techniques, all while enhancing the overall learning experience for students. Join us as we embark on this transformative journey together.

Part 2 of this blog can be found here: https://blogs.kcl.ac.uk/digitaleducation/exploring-the-digital-frontier-revolutionizing-feedback-delivery-with-excel-and-vba-macros-part-2/

Moodle 4, News and Events, Technologies, Uncategorized

New CPD Sessions

The Centre for Technology Enhanced Learning (CTEL) has a wide range of new development sessions available to all staff. These sessions range from how to record, edit and upload videos; creating interactive learning resources using Kaltura, our video and media service; as well as various workshops on using KEATS, our Virtual Learning Environment.

These sessions will be run by Microsoft Teams Meetings. Click the Skills Forge links below to find timings and book on available sessions. Please contact ctel@kcl.ac.uk for more information.

 

Introductory Session

KEATS

Content Creation and Video Editing

Delivering synchronous online teaching

Assessment

Internationalisation

News and Events, Pedagogy, Technologies

Centre for Technology Enhanced Learning (CTEL) CPD Training Sessions

The Centre for Technology Enhanced Learning (CTEL) has a wide range of new development sessions available to all staff. These sessions range from how to record, edit and upload videos; creating interactive learning resources using Kaltura, our video and media service; as well as various workshops on using KEATS, our Virtual Learning Environment.

These sessions will be run by Microsoft Teams Meetings. Click the Skills Forge links below to find timings and book on available sessions. Please contact ctel@kcl.ac.uk for more information.

Introductory Session

KEATS

Content Creation and Video Editing

Delivering synchronous online teaching

Assessment

Internationalisation

Moodle 4, Pedagogy, Technologies

Introducing the New KEATS Education Templates

The KEATS Education Templates (KET) are a set of standardised templates that have been designed to improve the digital learning experience for students at King’s College London. The templates adhere to UXD (user experience design) good practice, and are designed to be performant, scalable, and in line with accessibility standards.

The KET were developed in consultation with King’s students and academic and professional services staff. They were, and continue to be, steered and shaped by the needs of their users.

Three formats for the template are available for use.

Collapsed Topics

King's KEATS Education Template 23/24: Collapsed Topics (for importing) showing the categories of; course, settings, Participants, Grades, Reports and More. The Course highlights different tabs such as; Timetable, Module Overview, Assessment and Week 1/Topic

Grid

Screenshot showing the Module Home page featuring a Timetable, Module Overview, Assessment and Week 1/Topic tabs.

Topics

Screenshot of King's KEATS Education Template 23/24: Topics (for importing) showing the categories of; course, settings, Participants, Grades, Reports and More. The Course highlights different tabs such as; Timetable, Module Overview, Assessment and Week 1/Topic

Why use the KEATS Education Templates?

The benefits of using the KEATS Education Templates, include: 

User Experience: The templates are designed to be easy to use and navigate, making it easier for students to find the information they need. 

Scalability: The templates are designed to be scalable, so they can be used for courses of all sizes. 

Consistency: The templates help to create a consistent look and feel across all KEATS course pages, which can help to improve the overall user experience. 

How to use the KEATS Education Templates

You will find guidance on implementing the templates on the KEATS Education Template (KET) Guidance page.

The guidance includes step-by-step instructions for adding the template to your KEATS page and a checklist of tasks required to edit the page after applying the template.

The first page of the guidance (Overview) includes links to the importable templates, as well as example courses with the templates applied.

Written by Fariha Choi 

Fariha Choi is a Learning Technologist at the Centre for Technology Enhanced Learning and has been with CTEL since June 2021. She has a particular interest in educational multimedia and has worked as a Learning Technologist, eLearning Developer and Learning and Development Manager for the past 11 years. 

Evaluation and Reflection, Technologies, Uncategorized

Using Microsoft Power Platform to Support Staff Development

This blog post is a follow-up to the post Using Automation to Facilitate Flipped Learning. 

Due to the success of using Microsoft Power Automate to support flipped learning for an advanced KEATS training session, the Power Automate process was rolled out to all training sessions offered by Centre for Technology Enhanced Learning (CTEL) and other elements of the Microsoft Power Platform have been introduced. This blog post will outline the processes, successes, and challenges. 

Rollout of Power Automate Process 

Once the decision was made by the CTEL CPD Chair to roll out the Power Automate process to all CTEL training sessions, we needed to decide how this would work practically. The established process, or flow, used for the KEATS: Personalising the Learning Experience training session was built specifically for that session and was the only one that included pre-session work. We navigated around this by creating individual flows for each of the sessions run by CTEL and removing and adding steps as appropriate. The Assistant Learning Technologist for the team and I worked closely with the session leads, customising and creating the flows and encouraging personalisation of their flows to better reflect their sessions, such as adding attachments and editing email text.

Another risk was that the flows would reference the same Microsoft Excel spreadsheet hosted on a SharePoint site, and with multiple people accessing and changing the data, flows could be affected and send out emails at the wrong time. We navigated around this by creating individual spreadsheets and pointing the flows to the relevant spreadsheets for each session, which allowed for further customisation from session leads if desired. 

Flows are usually triggered 2 working days before the session is scheduled, but this can vary if the pre-session work required will take more time to complete. The core template automatically completes 5 core steps when triggered: 

  1. Creates a Microsoft Teams Meeting and invites all attendees to the meeting. 
  2. Sends an email containing further information about the session if needed. This is on a 5-minute delay to allow for any manual intervention should any mistakes be made in step 1. 
  3. Sends an email to participants as soon as the scheduled session is finished containing links to further resources and a request for feedback to be left via the Microsoft Form. 
  4. Sends an email 2 working days to participants after the session has been completed, asking for feedback if it hasn’t been left. 
  5. Sends an email 10 working days after the session to participants to ask if they have attempted any content that was covered in the session and if they have any success stories to share or need any further support. 

The above template is core and session leads can add further steps as relevant to their own flows. Working days are calculated within formulas in the Excel spreadsheet and are utilised to increase the response rate, rather than send emails out over a weekend or bank holiday which can be ignored. 

Displaying Feedback in Power BI 

The Power Automate process outlined above is fairly simple in terms of its structure and aims; it sends out emails at predetermined times based on the date and time of the relevant session, which is calculated in the Microsoft Excel spreadsheet. Each email sent to attendees once the session has been completed contains a link to CTELs feedback form. Once feedback is submitted, it is collected, anonymised, and stored. I designed a Power BI report to display the quantitative and qualitative data submitted to display the impact of the sessions and assist each session lead with making any changes using free text submissions.

An Overview of CTEL Feedback organised by session titles, calendar month and by faculty. The graph on the top-left presents which workshops in order of being given the highest feedback. The graph on the top-right presents volume of feedback given by different faculties. The graph on the bottom left presents the average and highs of how much feedback was given per calendar month. The bottom right graphs show when the drilldown date of workshops and the graph below shows overall feedback of 373 out of 746.
Figure 1: The Power BI report for feedback submitted for CTEL training sessions. Data is organised by session title, calendar month, and by faculty. 373 pieces of feedback were left for 2021/22.

After organising this data and gaining experience in Power BI, I was able to link this data to attendance data extracted from SkillsForge, to gain insights into our historical CPD attendance and how this relates to our feedback submissions. An advantage to this was to see if the flows had an impact on gathering feedback for our sessions.

Figure 2 presents the attendance of CTEL training sessions. Organised by calendar month, attendance type by sessions, and by faculty. The graphs on the top left present the overview of attendance of 2021/2022 Academic Year. With 1243 total sign ups out of 2486 and 166 number of sessions. The bottom left graph shows signups by workshop over time by index per month. The top-left graph shows signups by faculties ranging 0-200+. The bottom left graph shows attendance types by sessions of each workshop.
Figure 2: The Power BI report for attendance at CTEL training sessions. Data is organised by calendar month, attendance type by sessions, and by faculty.

Key findings revealed that attendance for 2020/21 was significantly high with 2209 members of King’s staff signing up for a session offered by CTEL, with feedback submissions at 324, so around 14.7% of attendees left feedback. Attendance dropped for the year 2021/22 with 1247 members of King’s staff signing up for a session. This is to be expected as we saw an increase in face-to-face teaching taking place and there were fewer modules delivering fully online teaching, but feedback submissions increased slightly with 373 submissions, around 30% of attendees submitting feedback. This is a positive revelation as although attendance figures fell by almost three quarters, the total amount of feedback submitted increased, and the percentage rate doubled. However, we need to be aware of several caveats with this data.

Figure 3 shows a stacked graph of bookings against feedback submissions for the academic years 2020/21 and 2021/22. With 3456 Bookings, 697 feedback submissions and 20.17% percentage.
Figure 3: Data displayed in a stacked bar graph of bookings against feedback submissions for the academic years 2020/21 and 2021/22.
  • As previously mentioned, the teaching in the academic year 2020/21 was delivered fully online. 2021/22 saw a gradual increase in face-to-face teaching from January onwards, so this data isn’t 100% comparable due to a significant change in circumstances.
  • CTEL ran a total of 29 ‘Breakout Rooms in Microsoft Teams Meetings’ training sessions in 2020/21 with 861 sign-ups, which massively increases attendance data for that academic year. 719 sign-ups occurred in September alone. Breakout rooms were a highly desirable feature of Microsoft Teams Meetings, but the functionality was not robust enough to be rolled out en masse, which may have impacted feedback submissions.
  • As digital capabilities in King’s staff increased throughout the months of the pandemic and demands on staff members’ time have reduced, this may have resulted in more time to engage with and submit feedback.

During the academic year 2020/21, CTEL joined other departments across King’s to offer a full suite of training opportunities in delivering teaching online. During that time, a generic feedback form was sent to attendees which were mainly concerned with joining instructions to Teams Meeting links, so we cannot see detailed responses to questions usually asked on the CTEL feedback form. Based on the 373 feedback responses submitted in 2021/22:

  • ~94% agreed or strongly agreed that they would recommend a CTEL training session to a colleague
  • ~95% agreed or strongly agreed that the session they attended will have a positive impact on their teaching.
  • ~95% agreed or strongly agreed that taking the session was worth their time.
Figure 4 shows feedback of workshops for 2021/22. The top left graph presents subject matter understanding before attending the course. With the factors measuring from novice, basic, proficient and advanced. The top right graph presents subject matter understanding after attending the course. With the factors measuring from novice, basic, proficient and advanced. The bottom graph presents agreement results from selecting different statements. Ranging from strongly disagree, disagree, neutral, agree and strongly agree.
Figure 4: Data displayed for 2021/22 quantitative questions.

The above is very positive as it demonstrates the impact that CTELs training sessions are having across the King’s community. The feedback form has not been changed for the academic year 2022/23 and so data can be easily compared in the future.

Based on an overview of the data, the Microsoft Power Automate process appears to be working well as the feedback response rate has remained steady as attendance figures have dropped, and Power BI has been a very useful tool to display and filter feedback data. Session leads have fed back that the Power BI report is beneficial and allows greater insight into the feedback for their sessions, and the CTEL CPD Chair has passed on positive feedback regarding the overall attendance data visualisations. I am currently working on an additional Power BI report that will utilise row level security to allow Technology Enhanced Learning Managers across the university to see attendance figures for their own faculties and tailor demand or promote courses that CTEL offer at strategic points in the year.

I am pleased that the automated process works and has helped free up time for CTEL staff and helped increase our feedback response rate, but I am dissatisfied that the session leads need to access two pieces of software (Microsoft Excel and Microsoft Power Automate) to get this to work. I am currently investigating whether I can achieve the same results with a Power App (another Microsoft Power Platform application) to improve usability and increase satisfaction.

Useful Links:


Written by Dave Busson-Crowe

Dave Busson-Crowe is a Learning Technologist at the Centre for Technology Enhanced Learning and has been involved with Learning Technology in some capacity for approximately 6 years.

He has a keen interest in the use of artificial intelligence in education.