In which I fall over in Lisbon, and reflect again on the knowledge/skills debate

Sometimes there are things which happen which make you really think about things. One of those happened to me at the weekend. I was in Lisbon to address the Associação portuguesa de educação musical conference there. What happened was that I fell over in the street. It was morning, I was stone cold sober, and I tripped over an uneven pavement. I think that this is in part because, as a varifocal wearer, the ground is constantly out of focus for me, so I have to sort of guess what’s going on down there! Now, apart from the fact that this hurt a lot, and damaged my lip as I hit the ground, reflection occurred afterwards, as Schön would have said, ‘reflection-on-action’. If the ground is constantly out of focus, why not do something about it? Maybe not wear varifocals when walking? So I’m trying that!

But apart from playing for sympathy, this also got me thinking, suppose for a lot of people the ‘ground’ is always out of focus? In music education the notion of a ground – as in, (tenuously, admittedly) the psychology notion of figure-ground – is hard to define. But there has been a lot of talk again of late about the place of knowledge and skills. I have recently listened to a radio programme in which one commentator observes that some teachers don’t think “knowledge” is important, and so said misguided teachers only teach skills. Now, we’ve been here before! This argument is hard to apply in music education. As in so many other things we are out in the lead of other subject areas. The ‘ground’ here, which is so out of focus to the commentator I listened to, is that for music education knowledge and skills go hand in hand. And philosophers will tell you that knowledge includes knowing “how to” anyway, so skills themselves are a form of knowledge after all.

As I said, I was in Lisbon, and so, thick lip, but cleaned up somewhat, I addressed the Portuguese music educators concerning curriculum and assessment. Interestingly, at the point of me talking about knowledge and skills, they smiled and nodded sagely. One of them then said “yes, we had politicians here who thought that, but us educators told them they were being silly, and that of course kids needed both!” “Good”, I said. But this made me think. Why is the ground so unclear in England that we allow people to say things about knowledge and skills that we music educators know to be “silly”? After all, how can you develop skills in, say, guitar playing, and not know the names of chords and their relations? What is it that has created the situation that has allowed “silly” ideas like this to flourish?

One of the reasons, I think, is that for some of the people saying these things, music is so far from their own ground that they never give it a thought. A related reason is the stratified and rarefied view that these people have such that their own subjects don’t have anything like musical skills, and for them, in their subject areas, skills are somewhat nebulous. After all, the skill to read a map is nothing like the skill required to achieve a crescendo on a xylophone. Skills in music require mental and physical interaction, this is not the case in some areas of the curriculum, and it is those areas which have provided the people who have come to prominence peddling this nonsense. But why didn’t we, en masse, like the Portuguese educators did, dismiss this daftness?

Well, I think the answer is political. It suits the zeitgeist for some to say “this is broken”, and a small group of naysayers become empowered beyond that which their limited vision (like mine!) should really allow. And it is not just in knowledge/skills that we see this lack of vision. In England at the moment we are hearing of music disappearing from school curricula. This is so schools can concentrate on subjects which neoliberalism values. And that ain’t the arts! But again, there is a whole host of otherwise sensible people whose varifocals won’t let them see the ground they have been churning up. But that sad saga is for another day!

Which brings me back to falling over! This requires mental and physical interaction in order to not fall over, and so just as I will be more careful with the ground in future, we can but hope that some of those misguided commentators can also look for a ground which includes music education, rather than tacitly assume all subjects are like theirs. And if they don’t “get” music, I’m sure our PE colleagues can oblige with a few examples!

 

 

Instead of a blog…

Instead of a blog, here’s me talking about the way I feel that music education is under threat at the moment. I’m talking with Ciaran O’Donnell of Birmingham Music Hub, and S4E music in B’ham.

I really am worried about what’s going on.

Video at: http://bit.ly/2qENoUA

 

Bullseye! Target setting and target missing.

Or, a blog in which I get to say “Errr?” rather a lot!

Target setting is currently back at number one as the biggest cause of concern that I am hearing about from music teachers. Now, I am going to say upfront that I am not against target setting per se, but what I hear about from many music teachers is that what are being discussed are not targets, but something else entirely.

Let me explain. I’m not very good at darts, so imagine being told that I had one dart, and I had to hit to hit the bullseye, and that I would be in trouble if I didn’t, and, what’s more, the person telling me, let’s call that person “My-Teacher”, then if I don’t hit the bullseye My-Teacher will also be in trouble.

I throw the dart. I don’t hit the bullseye. I don’t even hit the dartboard! My-Teacher reassures me, and tells me that my target was based on my ability to drive a car, so not to worry. But secretly crying inside, My-Teacher now knows that they will be called to account with the spreadsheet-wrangler, who will “seek…desire…demand” (as G&S say in the Gondoliers!) an explanation. It’ll be My-Teacher’s fault I didn’t hit the bullseye, not mine. (Err…?)

End of metaphor, you’ll be pleased to hear!

So what’s going on in music lessons? Well, we know that the new GCSE for music is now up and running, and that it will be graded differently from before. I’ve blogged about some of these changes previously. But what I am hearing about now is that schools are somehow incorporating target grades for GCSE music as part of the reporting arrangements for KS3. Now, KS3 is not GCSE. KS3 is a different thing, OK, it comes before GCSE, but we know that 93% of kids nationally won’t go on to take it. Does this mean that those 93% should be awarded a U grade, as they will be, actually, ungraded through non-entry? No, that’d be daft! But not much dafter that what music teachers are being asked to do at present, which is, in essence:

• Invent new GCSE criteria (sub-divided, in some cases) with only grades 2, 5 and 8 to go on.
• Use these invented criteria to then invent a GCSE grade for KS3 kids
• Invent ways in which kids can progress from one invented grade to the next, preferably in an invented straight line
• Ignore that the invented grade for a unit on Songwriting, which has very little to do with the unit on the Viennese Waltz which follows it, must nonetheless show invented progression
• Invent ways of ‘tracking’ the invented grades
• Prove to the school data-wrangler that all these inventions are statistically valid
• Be prepared to have the music inventions compared with Maths, English, etc
• Put the invented grade system into practice, even though KS3 music is on a rota, with long periods where the kids don’t do music, but must still show progress (ie more invention required!)

Put like that it sounds silly doesn’t it? Well, yes, but, reductio ad absurdum, is what many music teachers seem to be being asked to do. When Robin Hammerton was Head Honcho for Ofsted music he wrote in a blog here:

As National Curriculum levels disappear, I’d ask you respectfully not to replace with another set of numbers

Err…? So, what is actually happening is what he warned against!

And then we have these observations from the OCR exam board here:

There’s a really simple reason why there are no grade boundaries for the new assessments: nobody will know until students have sat the first exams in each subject. This is because of the way that grade boundaries will be set on the new qualifications, which will ensure that approximately the same percentage of students will get a grade 7 and above as currently get a grade A and above, and similarly for grade 4 and grade C, and grade 1 and grade G. 

And this:

Ofqual has produced some grade descriptors for the new GCSEs, to be used as a guide for teachers. However, it is worth remembering that the first awards will be driven by statistics, so nobody knows for sure exactly what performance at each grade will look like until the first assessments have been sat! 

 Err…!

What the OCR seem to be saying is that predictions can’t be made. Well, fair enough, statistically speaking. Try that argument with your school data-wrangler, though, and see what they say? (!)

In the meantime, invention is taking place all over the place as schools require more and more accountability of their teachers!

All of this reminds me of Campbell’s law, which I have written about many times before:

 The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor

But back to the targets. I said the dartboard target was derived from my ability to drive a car, which clearly has nothing to do with throwing a dart. Yet in music education we are provided with statistical targets based on Maths and English results from the Primary School. Again, I say, Errr….?

So, do these conversations make sense:

“You can do long division, clearly you should be able to play the guitar!”

Err?

 “You know what a fronted adverbial is, clearly you can sing in tune”

Err?

So, we have a system of accountability based on so many levels of invention that the whole thing is in danger of collapse.

No wonder so many teachers are off down the pub to play darts!

Is curriculum music safe?

At the recent Music Mark conference, I had a slot to talk about current issues in music education. This blog entry is based on that presentation.

For me, one of the big issues that’s facing us is the reduction of curriculum time in secondary schools. This is across the board, from KS3, via KS4, to A level. I am also hearing of schools where music teaching is being removed from the curriculum, for example this.

At MM I presented some facts I had extracted by trawling through DfE statistical data. At the same time Alison Daubney and Duncan Mackrill at Sussex University are conducting a detailed piece of research into respondent views of music teaching in their school. I must emphasise mine is solely secondary data analysis using DfE extant datasets. All the statistics I cite in this piece come from these, and so there is no nuance from the DfE, therefore I am only able to provide my interpretation of the numbers I have here

These make for quite salutary reading. Let us take first the numbers of music teachers employed in secondary schools over the past three years. These have been reducing steadily at the rate of about 200/year:

	Music Teachers	loss
2013	7,300
2014	7,100	200
2015	6,900	200

In chart format this reduction can clearly be seen:

With a reducing workforce there is clearly going to be a reduction in the teaching time available too. This is clearly shown in the next chart, which shows the total number of classroom music hours taught in secondary schools:

This again shows a reduction over time, with the dataset for this being:

Total music curriculum hours taught

	Music hours taught	loss
2013	90,900
2014	88,600	2,300
2015	85,500	3,100

The speed of reduction is interesting here. From 2013 to 2014 we lost 2,300 hours of teaching, from 2014 to 2015 we lost 3,100. It is too early to tell if this accelerando is a trend, so I’ll be watching the details this time next year, when the 2016 stats are published.

A similar exponential loss can be seen in the time loss at KS 4 and 5:

The linear reduction shown in that chart is a simple excel function, so please don’t place too much statistical weight on it, but it does show that time is reducing. Again, there is an increasing rate of loss of hours here. First of all KS4:

	KS4	loss
2013	19700
2014	19200	500
2015	18300	900

Now KS5:

	KS5	loss
2013	14000
2014	13500	500
2015	12400	1100

Even at KS3, which may be thought of as being ‘safe’ because of its status as a National Curriculum subject, music is losing the number of hours being taught:

Again, the dataset:

	KS3	loss
2013	57,200
2014	56,000	1,200
2015	54,900	1,100

The KS3 loss is somewhat galling in the light of Nick Gibb’s statement here that:

Through our curriculum review, music remained a statutory subject in the national curriculum, so every child in maintained schools must study it from age 5 to 14.

It seems the case that every child is not studying it up to the age of 14!

So, these are the bald stats, why is this happening? Well, as I say, all I can do is put my personal interpretation on these bald numbers. The data itself cannot tell us why this reduction is taking place, so what follows is solely my view. I think that it is a combination of factors.

1. the EBacc. Despite what we are told, I think the EBacc is biting into take up at KS4, with a knock-on effect at A-level
2. School accountability measures. Music is increasingly seen “not to matter” in accountability terms. (I get a lot of unsolicited mail to this effect, it’s not just me being awkward!) and, when push comes to shove, SLTs are putting their efforts into subjects that “matter”.
3. The telescoping of KS3 into 2 years instead of three. I am hearing of these time and time again.
4. Staffing issues. Teachers who leave cannot be replaced, there are just not enough “warm bodies” to put in front of the classes, so SLT has no choice but to do something else for contingency purposes.

Final comment

I think that there is a “perfect storm” brewing, and music hubs will feel the chill winds soon. With fewer music teachers in schools the hub-school liaison will suffer, numbers playing instruments will drop, schools will be more and more reluctant to let kids miss lessons for peri teachers, and the base level of the house of cards will start to totter. We need to be very vigilant indeed.

Sorry not to have better news for this season of Cheer!

 

 

Twitter conversation: KS3 Assessment

This may be of interest to UK KS3 music teachers, it’s a storified twitter conversation about assessment practices in KS3 music.

It’s available here //storify.com/DrFautley/getting-started/embed?border=false//storify.com/DrFautley/getting-started.js?border=false[View the story “Assessment requirement at KS3” on Storify]

Tracking thoughts inspired by railway tracks on a train journey

I’m always concerned by how much duplication of effort there has been in music education from teachers up and down the land over the years. What is worrying me at the moment is that there seems to be a move from schools to require their music teachers to produce GCSE criteria statements for use with their pupils in key stage 3. This worry is based on a number of conversations I have had with music teachers in the past few months. I know that a few anecdotes does not count as evidence, but I have enough of these, and done enough preliminary research into the issue, to be worried.

This blog entry is me thinking out loud, as it were. It may need revising with a bit more detailed research, but here’s what I think, on this train journey, (!) right now, as I pass through the glorious Yorkshire countryside on my way back to the Midlands.

Now, I have worried about tracking in the past (see many previous blogs), what makes things different this time is the sheer amount of unsolicited mail I am getting about this issue. It seems that this is a burden that is being placed on many teachers, and I want to try and describe a number of issues with this:

1. There is little source material to base GCSE-derived criterion statements on, we only have statements for grades 2, 5, and 8, here
2. The final GCSE will be norm referenced, not criterion referenced
3. Progress towards GCSE music is problematic, as only c.7% of pupils nationally will take it…
4. …therefore GCSE is an end for 93% of kids, what’s their progress?
5. The NC is not the GCSE syllabus
6. Composing, performing and listening are assessed differently from one GCSE to another, and, again, are not the same as in the NC
7. Assessment tracking at KS3 is poorly defined, poorly conceptualised, and poorly operationalised in many schools
8. Assessment at KS3 sometimes mistakes progression for attainment

Now, as I said, many of these issues have been picked up in previous blogs, and also in the September 2016 editorial I wrote for teachtalkmusic (available here). So, in this present blog, I just want to pick up on the last two of these issues. (The others may help hard-pressed music teachers think about their school’s practice, though, and I intend to return them at some point in the future)

The notion of uses and purposes of assessment has been with us for some years now, what I am concerned with here is the ways in which schools are using tracking data. Again, this is not a new issue, but what is taking place now, is that I am seeing tracking as having taken over from attainment as the key thing upon which schools are becoming fixated. But tracking of what? We seem to be in a situation where there is an assumption that what is needed is close monitoring of KS3 pupils to ensure they stay “on track” for getting the results they should when they get to year 11. Now, this is all very fine and laudable, but it clearly gives us an issue in music, in the fact that 93% of kids won’t ever get there! So what are we doing this for? If we are to show that our tracking is so good that the 7% remain on target, then, I venture to suggest, we are doing a huge amount (93%) of work for little purpose.

So, why do I think that tracking in KS3 is poorly defined, poorly conceptualised, and poorly operationalised in many schools? Well, I wish to suggest that tracking ought to serve some useful purpose, and, at present, frequently for many music teachers, it doesn’t! One of the reasons for this is that tracking ought to be attainment based, and that assessment of attainment ought to be undertaken in music educational terms, and, again it isn’t. Regular readers will know I have long advocated the use of radar charts, and these do allow for musical progression to be tracked properly. I’ll return to that theme again in a later blog, for this blog I feel. It’s time I got to the point…

Tracking has become a modern substitute for the bad old days of unilinear attainment. We now have a different version of a straight line graph, in the form of a more complex suite of flight paths, and these now run all the way through from Y7 to GCSE. Schools are now primarily concerned, I wish to posit, with their own position in the league tables, and are using tracking as a stick with which to beat music teachers into conforming to whatever software package they’ve purchased that predicts attainment. Trouble is, this is often predicated on Maths and English, and has nothing whatsoever to do with music, musical ability (whatever that is!) or actual attainment.

So, My questions for schools are these:

1. Does your school tracking system actually help teachers with planning for teaching and learning?
2. Bearing in mind that in many cases your school maths teachers see their kids as often in a week as the music teachers do in a half term, does the tracking system require a proportionate response from all staff equally?
3. Does your school tracking system serve any useful purpose for the pupils?
4. Does your school tracking system take time away from music teaching and learning, in other words, paradoxically, would attainment be higher in music without it?

These, I feel are useful questions for dialogue with SLT. Music hubs are charged with having “challenging conversations” with school SLTs, maybe these may come in helpful?

It is important to say that I am not anti-tracking, what I am is concerned by is pointless unhelpful systemic requirements which only add to the busy music teachers workload.

OK, time to look out of the window again. Oh look, a sheep – don’t see many of those in Birmingham. I wonder if it’s on a track…

 

 

I’m asked for a quote…

…by the organisation “Music Mark”, so, on the spur of the moment, I say this:

Another blog, elsewhere!

I’ve been thinking about the purposes of KS3 music education, and the results of this are to be found on the teachtalk music website, over at this address.

Thanks to David Ashworth for this!

 

Poster at ISME

I’ve been a bit on the busy side recently, which is, in many ways, an understatement! Anyway, last week I was up in Glasgow for the International Society of Music Education (ISME) conference. Whilst there I gave four spoken presentations, and a poster. Now, if you haven’t been to an international conference, a poster might seem a bit KS3, but let me assure you it’s hard work, as you get a thorough 1-to-1 grilling from the people attending!

I produced a poster on KS3 assessment in music education, and to make it comprehensible to an international audience, gave it a title which wasn’t quite true, but is close enough to get the gist. Here is an image of the poster as presented:

(I hope the visuals work?)

It is a bit tongue-in-cheek, and a bit over-the-top too, both of which were clear from my spoken dialogue! I thought I’d put it here on my blog site just so it doesn’t now simply vanish into the obscurity of my office wall never to be seen again, but also in case anyone wishes to hark back to some of the NC madness we used to have!

I do hope that with new assessment regimes some of the daftness of times past disappear, but I at the same time I have a fear that we are in danger of replacing them with new madnesses!

 

GCSE Music – Statistics and Grade Boundaries

N.B. This is a post that may get deleted or have amendments later, if it proves that I am being daft, and haven’t read all the relevant small print! Which, as it’s about the new GCSE grading, means there is a lot of small print to read. It’s arisen from a conversation I had with Dr Alison Daubney on twitter, so thanks AllyDaubney for setting this troubling train of thought off! 

On the 15^th July 2016, the DfE published revised Grade descriptors for GCSEs graded 9 to 1. (Find them at ‪bit.ly/29EKR0W)  Well, they didn’t, actually, for music. They published them for Grades 8, 5, and 2. (Remember that these grades 9-1 work the same way as music practical exam grades, ie start at 1.) Here they are:

Grade 8

To achieve Grade 8 candidates will be able to:

• perform challenging music with a high degree of fluency and sensitivity
• compose using a wide range of musical elements with sophistication, creating effective musical ideas and sustaining interest through their development
• demonstrate, through aural identification, accurate knowledge of a wide range of musical elements, contexts and language
• evaluate music to make convincing judgements using musical terminology accurately and effectively

Grade 5

To achieve Grade 5 candidates will be able to:

• perform music with some technical challenges broadly fluently with some sensitivity
• compose using a range of musical elements with coherence, creating musical ideas and developing interest with some success
• demonstrate, through aural identification, mostly accurate knowledge of a range of musical elements, contexts and language
• evaluate music to make clear judgements using musical terminology appropriately

Grade 2

To achieve Grade 2 candidates will be able to:

• perform simple pieces with limited fluency and sensitivity
• compose using a range of musical elements, creating musical ideas with some appeal and limited development
• demonstrate, through aural identification, some knowledge of musical elements, contexts and language
• evaluate music to produce simple reflections with inconsistent use of musical terminology

 

Now, this is what many teachers have been asking me for in emails and in discussion forums for quite a while. But, hold on, I think there’s a problem. Well, lots of problems actually! The first issue is that there seems to be some confusion between criterion-referencing – which is what these grade statements are (well, sort of, but stay with me), and norm-referencing, which is where, in essence, a curve of normal frequency distribution (NFD) is used to allocate the grades within set percentages. If your assessment literacy is a bit ropey on this, detailed explanations are found elsewhere on the net. Here’s a graph of NFD from the NFER (available here)

(Source: http://www.nfer.ac.uk/research/centre-for-assessment/standardised-scores-and-percentile-ranks.cfm)

This means, in this example, that only 2% of entrants can ever get the top grade. If there is an amazingly bright group one year, and an astonishingly dim one the next year, these % figures will remain constant (again, that’s a huge over-simplification, sorry). If, therefore, you have an exam system which is norm-referenced, like the new GCSE will be, then you cannot superimpose criterion-referencing statements on it at the same time; in a similar fashion my petrol car cannot run on diesel. The DfE themselves state here that:

“The descriptors are not designed to be used for awarding purposes, unlike the ‘grade descriptions’ that apply to current GCSEs graded A* to G.”

So, again, what are they for? The DfE again:

“We have developed grade descriptors for the reformed GCSEs graded 9 to 1. These aim to assist teachers by providing an indication of the likely level of performance at grades 2, 5 and 8.

The purpose of these grade descriptors is to give an idea of average performance at the mid-points of grades 2, 5 and 8.”

However, I suspect they will be used in KS3, for assessment, monitoring, and tracking purposes. But I’ll return to that theme later.

What will this look like in practice? We don’t have the breakdown for music, but we do for some subjects, so here are drama and PE:

(Source: https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/377771/2014-09-12-board-paper-for-new-gcses-in.pdf)

Now, I’m a tad busy at the moment, but if I get an odd five minutes I’ll try and do one for music. But, TBH, it won’t be much help for anyone in an individual school! Why? Because however big your GCSE cohort is, music is such a small subject it still won’t approximate to the national figures. And if you want to feel really depressed, just remember that the kids at Eton, Chets, and Menuhin are also in there, so they will be (I guess, but I’ll probably get into trouble for saying so) up in the top x%, knocking the kids from bogstandard comp out of the way in the process. (You can’t do footnotes, I don’t think, in this blog app, so – if I’m wrong on this, please shout, and I’m not having a go at specialist music schools, just trying to show how the stats might pan out.)

I’ve written about different assessment types before here. I’m wondering how it would go down with SLT if new grading requirements involve a modified form of comparative assessment, modelled onto a graph of NFD for the pupils in each school. If we can work out the statistical modifiers, after a few years we ought to be able to map the general progress 8 stats onto this for each school, and come up with a reasonable attempt at a progress map. But what this might tell us is a tale for another blog!

Which takes me back to the point that I’m not sure what the point of the published grade descriptors is! But, if I were a hard pressed head of music whose SLT have told them to produce grade descriptors for KS3, I’d be on these like a shot!

But here’s where my next worry lies. Let’s take the Grade 2 words, and do something you never, ever should. Let’s compare it to the National Curriculum. For GCSE (ie by age 16) Grade 2 pupils have to:

• perform simple pieces with limited fluency and sensitivity

At Key Stage 2 (ie by the age of 11) children are required to be taught to:

• play and perform in solo and ensemble contexts, using their voices and playing musical instruments with increasing accuracy, fluency, control and expression

Some overlap there, methinks? And what about GCSE Grade 2:

• compose using a range of musical elements, creating musical ideas with some appeal and limited development

KS2 again:

• improvise and compose music for a range of purposes using the inter-related dimensions of music

And so on!

Which means that with some cunning wording, it could mean that we see schools producing NC levels redux, but dressed up as new GCSE-related criteria statements. Another worry now emerges: will we see invented sub-divisions of the GCSE grades being used in KS3 to “chart” (in deliberate inverted commas) progress? If so, what do these mean?

Endpoint

All of this blog is very, very speculative, and, as I said, I may be totally wrong, and if so, quite happy to have this pointed out. But this entry has been me thinking out loud, as it were, about the effects of what I have been reading and thinking about recently. As things crystallise I’ll revisit, and issue corrections and clarifications as needed.

Thanks due too to @MissDCox for her excellent blog at http://bit.ly/2a0VI7r which also got me thinking!