{"id":1013,"date":"2021-01-06T16:42:51","date_gmt":"2021-01-06T16:42:51","guid":{"rendered":"http:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/?p=1013"},"modified":"2021-03-08T11:26:31","modified_gmt":"2021-03-08T11:26:31","slug":"test-learn-adapt-what-might-formula-one-be-able-to-teach-higher-education","status":"publish","type":"post","link":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/2021\/01\/06\/test-learn-adapt-what-might-formula-one-be-able-to-teach-higher-education\/","title":{"rendered":"Test, Learn, Adapt- What Might Formula One be able to teach Higher Education?"},"content":{"rendered":"<p><em>Higher Education has a lot it can learn from other sectors. After a difficult year for everyone, Vanessa Todman explores what Formula One may be able to teach widening participation evaluation professionals, and what expertise we may be able to share in return.<\/em><\/p>\n<p>In 2012, the government published it&#8217;s &#8216;Test Learn Adapt&#8217; paper<a href=\"#_edn1\" name=\"_ednref1\">[i]<\/a>, setting out the argument for embedding randomised controlled trials into public policy. Its argument was a simple one: This way of working is achieving results\u00a0in areas such as medicine and international development, so other areas should learn from this success. That Higher Education should be <a href=\"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/2019\/02\/08\/i-would-like-higher-education-to-learn-from-other-sectors\/\">learning from other sectors is a big part of our team ethos<\/a>. A key element of innovation, and the What Works movement, is seeing what is working elsewhere and testing whether it can work for us too.<\/p>\n<p>While I&#8217;ve watched in awe as my front-line colleagues have delivered an incredibly difficult first term under Covid-19 restrictions, I&#8217;ve also been watching a surprisingly successful Formula One season (given the events of 2020) and I couldn&#8217;t help but draw comparisons to the logistical challenges across both experiences. I&#8217;ve also been considering what the world of motorsport has to teach us in widening higher education participation. If anyone tests, learns and adapts- it&#8217;s Formula One.<\/p>\n<h3><strong>We need real-time, detailed data to understand what&#8217;s going on<\/strong><\/h3>\n<p>A Formula One driver is not alone on the track. They rely on the voice in their ear telling them how their competitors are doing, how the weather is looking, where they\u2019re fast or slow, and when they need to come in to make a change. In such a difficult year as 2020, managers and teams at King\u2019s have needed the same. They have not been able to do what they did before because there was no year like 2020- and the conditions are still constantly changing amidst uncertainties.<\/p>\n<p>This year we launched the <strong>&#8216;Checking- in\u2019 Survey<\/strong>, four short pulse surveys we&#8217;re sending out to students at key points of the academic year to collect real-time information for faculties and senior management in a targeted and collaborative way that minimises the burden on the student. These surveys aim to provide insight into how students are experiencing the year that can be acted on quickly, disseminated to a wide variety of internal stakeholders easily, and allow progress to be tracked. Once the surveys are over we&#8217;ll continue to explore the data and what students have told us for useful information for future years &#8211; for example if our findings can tell us anything about how students from different backgrounds (including underrepresented groups and those targeted in Widening Participation activity) experienced the 2020-21 academic year in comparison to other students.<\/p>\n<h3><strong>Look to the season, as well as the race<\/strong><\/h3>\n<p>Some projects don\u2019t go as planned, that\u2019s okay, it\u2019s just a misstep towards our wider goal. After all, each student isn\u2019t just a participant in a single project, they\u2019re with us for at least three terms, if not three years or more, and their overall experience, and the experience of the students who will come after them, is important too.<\/p>\n<p>One way we\u2019ve been thinking longer term is how we measure students\u2019 <a href=\"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/2018\/05\/30\/sense-of-belonging-and-social-capital-our-hot-topics-for-2018-19\/\">sense of belonging<\/a>. Each year we ask all enrolling students our <strong>&#8216;Settling into King&#8217;s&#8217;. <\/strong>These questions aim to measure their reported &#8216;sense of belonging&#8217; to the institution, and again each year that they re-enrol. We share the results of this data with multiple teams to allow them to use consistent measures to evaluate their projects in a joined-up way. You can see an example of how we\u2019ve used this data in the past in our blog <a href=\"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/2020\/03\/25\/stuck-in-the-middle-asian-students-sense-of-belonging\/\">on the sense of belonging of Asian students<\/a><a href=\"#_edn2\" name=\"_ednref2\">[ii]<\/a>. We have been collecting it patiently for three years and now we can see the journey of a cohort from start to finish, and evaluate new programmes with the same data. We&#8217;re excited about this analysis and aim to share whatever we find more widely later in the year.<\/p>\n<h3><strong>What doesn&#8217;t work is just as important as what works<\/strong><\/h3>\n<p>As with racing, there&#8217;s only so much statistics can do to predict your outcomes and realities. You\u2019re always dealing with probabilities, not certainties, partly because human emotions, perceptions and behaviours play their part too. Probabilities are still useful, especially on a large scale, even a 30 per cent success rate can be a lot of students, and will be better than no success at all, but it does mean we have to accept that no intervention will work for everyone and some things will just go wrong. However, the great sage of Formula One, Niki Lauda, teaches us that we learn just as much, if not more, from our failures than our successes<a href=\"#_edn3\" name=\"_ednref3\">[iii]<\/a>. If something doesn&#8217;t work it&#8217;s rarely down to an individual, but something that the team can reflect on, draw lessons from, and improve upon for next time.<\/p>\n<p>Just as sometimes the car just spins off the track, evaluations don\u2019t always go to plan, sometimes your data doesn\u2019t tell you what you needed to know, or (simply) students don\u2019t open the email. Randomised controlled trials in particular can go wrong in an astonishing number of ways. We then change our processes, or try something different<a href=\"#_edn4\" name=\"_ednref4\">[iv]<\/a>, next time.<\/p>\n<h3><strong>That said, we\u2019re not in a race, or shouldn\u2019t be<\/strong><\/h3>\n<p>As much as we can learn from Formula One, we\u2019re not in the world of competitive motorsport. When we discover something important, we need to share that information. As professionals striving to address inequalities and make things better for students we have a common goal. It&#8217;s no good one university holding all the answers; that\u2019s no use to the groups of students we\u2019re trying to help. That means sharing learning, maybe not the sensitive internal stuff, but certainly &#8216;this is how you can do this well&#8217;. We&#8217;ve found more universities have reached out to us during 2020 than ever before and we absolutely welcome it. We are always happy to be a sounding board for an idea, share our experiences or work on joint projects. That\u2019s why we published<a href=\"https:\/\/www.kcl.ac.uk\/study\/widening-participation\/what-works\/final2whatworks-firsttwoyears.-july-2020-v2.pdf\">\u00a0 our Two Year report<\/a>.<\/p>\n<h3><strong>Maybe there&#8217;s something we can teach Formula One about diversity and inclusion<\/strong><\/h3>\n<p>We can&#8217;t talk about Formula One without mentioning the diversity issues it&#8217;s experiencing. Lewis Hamilton has spoken at length about the lack of working-class<a href=\"#_edn5\" name=\"_ednref5\">[v]<\/a> and ethnic minority <a href=\"#_edn6\" name=\"_ednref6\">[vi]<\/a>representation in the sport<a href=\"#_edn6\" name=\"_ednref6\"><\/a>, as well as other issues. The historic problems they&#8217;re grappling with will be recognisable to Widening Participation practitioners, especially in the more historically elite universities. It&#8217;s great to see Mercedes announce their partnership with <a href=\"https:\/\/stemettes.org\/\">Stemettes<\/a> at the close of 2020<a href=\"#_edn7\" name=\"_ednref7\">[vii]<\/a>, as well as initiatives such as <a href=\"https:\/\/www.f1inschools.co.uk\/\">F1 in schools<\/a>. As we work to encourage the next generation of engineers and scientists from underrepresented backgrounds to enter Higher Education with our own <a href=\"https:\/\/www.kcl.ac.uk\/study\/widening-participation\/our-activities\/k-plus\">K+ programme <\/a>\u00a0we&#8217;ll keep a watchful eye on the progress on and off the track with keen interest.<\/p>\n<p>*views expressed in this blog are the views of the author<\/p>\n<p>_______________________________________________________________________<\/p>\n<h2><em><a href=\"https:\/\/www.kcl.ac.uk\/study\/widening-participation\/what-works\/our-reports\">Read our reports<\/a><\/em><\/h2>\n<h2><em style=\"font-size: 16px\"><a href=\"https:\/\/confirmsubscription.com\/h\/j\/B4359A69338427CC\">Click here<\/a>\u00a0to join our mailing list.<\/em><\/h2>\n<p><em>Follow us on Twitter:\u00a0<a href=\"https:\/\/twitter.com\/kclwhatworks\" target=\"_blank\" rel=\"noopener noreferrer\">@KCLWhatWorks<\/a><\/em><\/p>\n<p>_______________________________________________________________________<\/p>\n<p><a href=\"#_ednref1\" name=\"_edn1\">[i]<\/a> Haynes, L. Service, O. Goldacre, B. Togerson, D. (2012) Test, Learn, Adapt: Developing Public Policy with Randomised Controlled Trials &#8211;\u00a0 Available at:\u00a0 <a href=\"https:\/\/www.gov.uk\/government\/publications\/test-learn-adapt-developing-public-policy-with-randomised-controlled-trials\">https:\/\/www.gov.uk\/government\/publications\/test-learn-adapt-developing-public-policy-with-randomised-controlled-trials<\/a>)<\/p>\n<p><a href=\"#_ednref2\" name=\"_edn2\">[ii]<\/a> Completely coincidentally, written by an ex-engineer.<\/p>\n<p><a href=\"#_ednref3\" name=\"_edn3\">[iii]<\/a> Paraphrased from Niki Lauda (see \u2018Lauda, N. (1986) To Hell and Back: Ebury Digital)<\/p>\n<p><a href=\"#_ednref4\" name=\"_edn4\">[iv]<\/a> And by \u2018try something different\u2019, I do not mean keep running the analysis until you get statistical significance.<\/p>\n<p><a href=\"#_ednref5\" name=\"_edn5\">[v]<\/a>\u00a0Lewis, N (2018) \u2018Lewis Hamilton\u2019s fear for the future of young working class drivers\u2019 : BBC Available at: https:\/\/www.bbc.co.uk\/sport\/formula1\/44682870<\/p>\n<p><a href=\"#_ednref6\" name=\"_edn6\">[vi]<\/a> BBC (2018) \u2018Lewis Hamilton; Formula 1 \u2018barely has any diversity\u2019 says British world champion. Available at: https:\/\/www.bbc.co.uk\/sport\/formula1\/43501543<\/p>\n<p><a href=\"#_ednref7\" name=\"_edn7\">[vii]<\/a> Mercedes (2020) \u2018Mercedes Launches \u2018Accelerate 25\u2019 Diversity &amp; Inclusion campaign\u2019 Press Release. Available at: https:\/\/www.mercedesamgf1.com\/en\/news\/2020\/12\/mercedes-launches-accelerate-25-diversity-inclusion-programme\/<\/p>\n","protected":false},"excerpt":{"rendered":"<div class=\"mh-excerpt\"><p>Higher Education has a lot it can learn from other sectors. After a difficult year for everyone, Vanessa Todman explores what Formula One may be <a class=\"mh-excerpt-more\" href=\"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/2021\/01\/06\/test-learn-adapt-what-might-formula-one-be-able-to-teach-higher-education\/\" title=\"Test, Learn, Adapt- What Might Formula One be able to teach Higher Education?\">&#8212; [Read&nbsp;More] <\/a><\/p>\n<\/div>","protected":false},"author":75,"featured_media":1014,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9,10,3],"tags":[],"class_list":["post-1013","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-behavioural-insights","category-evaluation","category-project-delivery"],"_links":{"self":[{"href":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/wp-json\/wp\/v2\/posts\/1013","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/wp-json\/wp\/v2\/users\/75"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/wp-json\/wp\/v2\/comments?post=1013"}],"version-history":[{"count":6,"href":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/wp-json\/wp\/v2\/posts\/1013\/revisions"}],"predecessor-version":[{"id":1051,"href":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/wp-json\/wp\/v2\/posts\/1013\/revisions\/1051"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/wp-json\/wp\/v2\/media\/1014"}],"wp:attachment":[{"href":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/wp-json\/wp\/v2\/media?parent=1013"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/wp-json\/wp\/v2\/categories?post=1013"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/behaviouralinsights\/wp-json\/wp\/v2\/tags?post=1013"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}