{"id":3797,"date":"2017-11-06T22:37:57","date_gmt":"2017-11-06T22:37:57","guid":{"rendered":"http:\/\/www.blopig.com\/blog\/?p=3797"},"modified":"2017-11-06T22:37:57","modified_gmt":"2017-11-06T22:37:57","slug":"paper-review-inside-the-black-box","status":"publish","type":"post","link":"https:\/\/www.blopig.com\/blog\/2017\/11\/paper-review-inside-the-black-box\/","title":{"rendered":"Paper review: &#8220;Inside the black box&#8221;"},"content":{"rendered":"<p><span style=\"font-weight: 400\">There are nearly 17,000 Oxford students on taught courses. They turn up reliably every October. We send them to an army of lecturers and tutors, drawn from every rank of the research hierarchy. As members of that hierarchy, we owe it to the students &#8211; all 17,000 of them &#8211; to teach them as best we can.<\/span><\/p>\n<p><span style=\"font-weight: 400\">And where can we learn the most about how to teach? There are 438,000 professional teachers in the UK. Maybe people who spend all of their working time on the subject might have good strategies to help people learn.<\/span><\/p>\n<p><b>The context of the paper<\/b><\/p>\n<p><span style=\"font-weight: 400\">Teachers obsess over assessment. Assessment is the process by which teachers figure out what students have learned. It is probably true that assessment is the only reason we have classrooms at all.<\/span><\/p>\n<p><a href=\"https:\/\/goo.gl\/W5s7KR\"><i><span style=\"font-weight: 400\">Inside the Black Box<\/span><\/i><\/a><span style=\"font-weight: 400\">\u00a0is of the vanguard of recent changes in educational thinking. Modern teaching regards good pedagogy as a practical skill. Like other types of performance, it depends on a specific set of concrete actions which can be taught and learned. Not everyone is a natural teacher &#8211; but nearly everyone can become a competent teacher.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Formative assessment is the focus of <\/span><i><span style=\"font-weight: 400\">Inside the Black Box<\/span><\/i><span style=\"font-weight: 400\">. The article argues that this process, in which teachers figure what students know and tell them how it\u2019s going wrong, is essential to good classroom practice.<\/span><\/p>\n<p><b>What is the black box?<\/b><\/p>\n<p><span style=\"font-weight: 400\">The black box is the classroom. After societal convulsions over class sizes, funding deficits, curriculum reforms, and examination structure, it\u2019s time &#8211; says the article, in 2001 &#8211; that we focus on what actually goes on inside the classroom. These social changes, it says, adjust the inputs to the black box, and society expects better things out of the black box. But what if changing the inputs makes the work inside the black box <\/span><i><span style=\"font-weight: 400\">harder?<\/span><\/i><span style=\"font-weight: 400\"> Don\u2019t we have an obligation to figure out what needs to happen to get students to learn?<\/span><\/p>\n<p><span style=\"font-weight: 400\">The article touches three questions:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Is there evidence that improving formative assessment raises standards?<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Is there evidence that there is room for improvement?<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Is there evidence about how to improve formative assessment? <\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">The answers are <\/span><i><span style=\"font-weight: 400\">yes<\/span><\/i><span style=\"font-weight: 400\">,<\/span><i><span style=\"font-weight: 400\"> yes<\/span><\/i><span style=\"font-weight: 400\">,<\/span> <span style=\"font-weight: 400\">and<\/span><i><span style=\"font-weight: 400\"> yes. <\/span><\/i><span style=\"font-weight: 400\">In meta-analyses of educational experiments, formative assessment consistently raises standards. These experiments match the experience of teachers, who know that the least effective lessons are those which do not respond to students\u2019 needs. Standard observations &#8211; such as those from Ofsted &#8211; ask teachers to answer <\/span><i><span style=\"font-weight: 400\">what are they learning<\/span><\/i><span style=\"font-weight: 400\">, and then <\/span><i><span style=\"font-weight: 400\">how do you know<\/span><\/i><span style=\"font-weight: 400\">, and then <\/span><i><span style=\"font-weight: 400\">what are you doing about it?<\/span><\/i><\/p>\n<p><span style=\"font-weight: 400\">The second question &#8211; is there room for improvement? &#8211; is one they address in great detail in the context of primary and secondary education. Some criticisms (the giving of grades for its own sake, unintentional encouragement of \u201crote or superficial learning\u201d, relentless competition between students) seem applicable in different parts of our university context. A greater weakness is a lack of emphasis. People engaged in university teaching frequently center the delivery of knowledge instead of learning, an idea exacerbated by our obsession with lectures and masked by the long lag between those lectures and the exams in which we assess them.<\/span><\/p>\n<p><b>Recommendations<\/b><\/p>\n<p><i><span style=\"font-weight: 400\">Inside the Black Box <\/span><\/i><span style=\"font-weight: 400\">makes specific recommendations for instructors about how to engage in formative assessment. Those recommendations &#8211; unusually, for an item in the educational literature &#8211; are specific and detailed. But rather than focus on them, it is worth examining three themes which run across the article.<\/span><\/p>\n<p><span style=\"font-weight: 400\">The overriding focus is the importance of formative assessment. If we care about what students learn, then we\u2019ve got to be checking what it is that they actually are learning. Opportunities for formative assessment should be \u201cdesigned into any piece of teaching\u201d. In extremis, this idea has interesting implications for the institution of lectures, which generally lack them entirely.<\/span><\/p>\n<p><span style=\"font-weight: 400\">A subsidiary idea is the importance of setting clear objectives for learning. Too many students view learning as a series of exercises rather than a step in the formation of a coherent body of knowledge. The overarching direction should be made clear. And on a more detailed level, we need to be explicit about what outcomes we want our students to obtain so that they know whether they are making satisfactory progress. Formative assessment must make reference to expectations, and formative self- or peer assessment becomes impossible if those expectations are not well-understood.<\/span><\/p>\n<p><span style=\"font-weight: 400\">And this discussion ties into a final point: when students truly apply themselves to the task of learning, their self-perception and self-esteem becomes bound up in it. Ineffective expectation-setting and insufficient clarity about the means for improvement result in students feeling demotivated, which causes them to revise their goals downward. They put in less effort and achieve outcomes that are worse. These effects are costly and can be avoided by effective formative assessment.<\/span><\/p>\n<p><i><span style=\"font-weight: 400\">Inside the Black Box<\/span><\/i><span style=\"font-weight: 400\"> is a diversion from our diet of scientific articles, but I think it is worth our attention. Pedagogy is difficult to get right. In the university context, good practice is the subject of little attention and rarely assessed. Thinking about good asssessment means that our students benefit.<\/span><\/p>\n<p><span style=\"font-weight: 400\">But all communication activities are a form of teaching. Really good teachers communicate really well. When good communication happens, everyone benefits, inside and outside the black box.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>There are nearly 17,000 Oxford students on taught courses. They turn up reliably every October. We send them to an army of lecturers and tutors, drawn from every rank of the research hierarchy. As members of that hierarchy, we owe it to the students &#8211; all 17,000 of them &#8211; to teach them as best [&hellip;]<\/p>\n","protected":false},"author":46,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","wikipediapreview_detectlinks":true,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"ngg_post_thumbnail":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"ppma_author":[496],"class_list":["post-3797","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"authors":[{"term_id":496,"user_id":46,"is_guest":0,"slug":"mark","display_name":"Mark","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/4993b5241cf007fa9b439f82360e05c268e9d358a0153d0a78f40df9ace86f42?s=96&d=mm&r=g","0":null,"1":"","2":"","3":"","4":"","5":"","6":"","7":"","8":""}],"_links":{"self":[{"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/posts\/3797","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/users\/46"}],"replies":[{"embeddable":true,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/comments?post=3797"}],"version-history":[{"count":1,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/posts\/3797\/revisions"}],"predecessor-version":[{"id":3798,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/posts\/3797\/revisions\/3798"}],"wp:attachment":[{"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/media?parent=3797"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/categories?post=3797"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/tags?post=3797"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.blopig.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=3797"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}