{"id":962,"date":"2019-12-19T16:32:06","date_gmt":"2019-12-19T16:32:06","guid":{"rendered":"https:\/\/blogs.kcl.ac.uk\/activelearning\/?p=962"},"modified":"2025-05-28T14:23:35","modified_gmt":"2025-05-28T14:23:35","slug":"developing-your-questions-for-evaluating-teaching","status":"publish","type":"post","link":"https:\/\/blogs.kcl.ac.uk\/activelearning\/2019\/12\/19\/developing-your-questions-for-evaluating-teaching\/","title":{"rendered":"Developing your questions for evaluating teaching"},"content":{"rendered":"<p><em>This is an evaluation guide.<\/em><\/p>\n<p>Pat Hutchings&#8217; (2000) taxonomy of educational inquiry questions can be helpful in specifying the main purpose of your evaluation.<\/p>\n<ul>\n<li>\u201c<strong>What works<\/strong>\u201d questions are evaluative; they set out to prove effectiveness. One example is as a comparison between existing teaching modes in order to decide how to allocate resources. Another is how to most effectively teach a difficult concept to a large cohort. &#8216;What works&#8217; questions might be formulated as, &#8220;Did students&#8217; use of assessment feedback change after [&#8230;]?&#8221; or &#8220;Was increasing the module structure associated with reduced attainment gaps?&#8221;<\/li>\n<li>\u201c<strong>What is<\/strong>\u201d questions focus on understanding the features or constituent parts of a given approach or intervention, but do not set out to prove effectiveness. Examples include observing the dynamics of classroom discussion about a difficult topic, understanding interdisciplinarity from a student point of view, understanding how students move from grasping others\u2019 theories to developing their own. &#8216;What is&#8217; questions might be formulated as &#8220;What use do my students make of assessment feedback?&#8221; or &#8220;What are my students&#8217; study behaviours?&#8221;.<\/li>\n<li>\u201c<strong>Possibilities<\/strong>\u201d questions build on knowledge from \u201cWhat is\u201d questions, to concentrate on particular dimensions which support students towards their goals. One example is how students might come to view difficulties in their learning as opportunities rather than morale-destroying deficits. Another is how falling student engagement might be rekindled.<\/li>\n<li>\u201c<strong>Theory building<\/strong>\u201d questions build on \u201cPossibilities\u201d questions to formulate a new model conceptual framework about a given aspect of practice. Examples of frameworks emerging from this kind of work include Schommer\u2019s epistemological dimensions of learning, Laurillard\u2019s conversational learning framework, Kirkpatrick\u2019s levels of evaluation, and Miller\u2019s pyramid of clinical competence.<\/li>\n<\/ul>\n<p><iframe loading=\"lazy\" title=\"Taxonomy of Questions from the Intro to Opening Lines\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/JCxPttq_e_Y?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p>Cohen et al (2017, p336) recommend distilling general purposes into a specific central aim. &#8220;To explore students&#8217; views about assessment feedback&#8221; (a &#8216;What is&#8217; question) would be nebulous, whereas &#8220;To describe the factors motivating students to use assessment feedback in their future work&#8221; would be more specific.<\/p>\n<p>Once you have that specific, central aim, the guides on <a href=\"https:\/\/blogs.kcl.ac.uk\/activelearning\/2019\/12\/18\/questionnaires-for-evaluating-teaching\/\">questionnaires<\/a> and <a href=\"https:\/\/blogs.kcl.ac.uk\/activelearning\/2019\/12\/20\/interviews-for-evaluating-teaching\/\">interviews<\/a> make suggestions for developing questions to ask students directly.<\/p>\n<h3>References<\/h3>\n<ul>\n<li>Cohen, L., Manion, L., &amp; Morrison, K. (2017). <em>Research methods in education. 8th edition<\/em> (8th Ed). London\u202f; New York: Routledge.<\/li>\n<li>Hutchings, P., &amp; Carnegie Foundation for the Advancement of Teaching (Eds.). (2000). <em>Opening lines: Approaches to the scholarship of teaching and learning<\/em>. Retrieved from <a href=\"https:\/\/eric.ed.gov\/?id=ED449157\">https:\/\/eric.ed.gov\/?id=ED449157<\/a><\/li>\n<\/ul>\n<p><em>Image source: <span id=\"attribution\" class=\"photo_usage-attribution\"><a href=\"https:\/\/www.flickr.com\/photos\/21450297@N06\/17240920366\" target=\"_blank\" rel=\"noopener noreferrer\">&#8220;Question mark&#8221;<\/a> by <a href=\"https:\/\/www.flickr.com\/photos\/21450297@N06\" target=\"_blank\" rel=\"noopener noreferrer\">chrisinplymouth<\/a> is licensed under <a class=\"photo_license\" href=\"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/2.0\/?ref=ccsearch&amp;atype=rich\" target=\"_blank\" rel=\"noopener noreferrer\"> CC BY-NC-SA 2.0 <\/a><\/span> <\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<div class=\"mh-excerpt\"><p>This is an evaluation guide. Pat Hutchings&#8217; (2000) taxonomy of educational inquiry questions can be helpful in specifying the main purpose of your evaluation. \u201cWhat works\u201d questions are evaluative; they set out to prove effectiveness. <a class=\"mh-excerpt-more\" href=\"https:\/\/blogs.kcl.ac.uk\/activelearning\/2019\/12\/19\/developing-your-questions-for-evaluating-teaching\/\" title=\"Developing your questions for evaluating teaching\">[&#8230;]<\/a><\/p>\n<\/div>","protected":false},"author":1342,"featured_media":963,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[59],"tags":[],"class_list":["post-962","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-evaluation"],"_links":{"self":[{"href":"https:\/\/blogs.kcl.ac.uk\/activelearning\/wp-json\/wp\/v2\/posts\/962","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.kcl.ac.uk\/activelearning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.kcl.ac.uk\/activelearning\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/activelearning\/wp-json\/wp\/v2\/users\/1342"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/activelearning\/wp-json\/wp\/v2\/comments?post=962"}],"version-history":[{"count":13,"href":"https:\/\/blogs.kcl.ac.uk\/activelearning\/wp-json\/wp\/v2\/posts\/962\/revisions"}],"predecessor-version":[{"id":1341,"href":"https:\/\/blogs.kcl.ac.uk\/activelearning\/wp-json\/wp\/v2\/posts\/962\/revisions\/1341"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/activelearning\/wp-json\/wp\/v2\/media\/963"}],"wp:attachment":[{"href":"https:\/\/blogs.kcl.ac.uk\/activelearning\/wp-json\/wp\/v2\/media?parent=962"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/activelearning\/wp-json\/wp\/v2\/categories?post=962"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/activelearning\/wp-json\/wp\/v2\/tags?post=962"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}