I was alerted this morning on Twitter to this blogpost by Brian LePort on the first of 5 reasons why students shouldn't blog. Its central thesis is that "it is almost impossible to avoid writing something that will offend someone". Consequently, bloggers run the risk of doing themselves reputational harm at best, or failing to get a job or even getting fired at worst.
LePort illustrates his thesis by the extraordinary case of Christopher Rollston, who tells how he was forced to resign from a post at Emmanuel Christian Seminary because he wrote a piece for the Huffington Post on the marginalization of women in the Bible. Rollston, who describes himself as a Christian, concluded: "Gender equality may not have been the norm two or three millennia ago, but it is essential. So, the next time someone refers to 'biblical values,' it's worth mentioning to them that the Bible often marginalized women and that's not something anyone should value." Apparently, a major funder of the seminary disapproved of such incendiary sentiments and Rollston's career there was toast.
I have to say, I find LePort's reaction to this story disappointing. Yes, people who blog should think carefully about what they say and the impact it may have. Yes, it's impossible to avoid offending someone somewhere, unless what you write is so boring and anodyne that nobody would want to read it. But I despair at the idea of a future generation so cowed with fear that nobody ever says anything original or controversial.
I'm not arguing that students and junior academics should sacrifice themselves on the altar of freedom of speech, but rather that they should have confidence in the positive as well as the negative power of the internet. If what they say is worth saying, they will get support. LePort focuses on the negative consequences of Rollston's blogging, but, as this post by Robert Cargill pointed out, he attracted huge support online and ended up in a better job, whereas Emmanuel Christian Seminary suffered massive reputational damage.
LePort makes the important point that blogs are very different to more formal academic writing and often represent a point of view at a particular point in time, which may subsequently change. To my mind, this is one of the huge benefits of blogging – if you are lucky, your blog will attract comments that expose you to a wide range of reactions and help clarify and develop your thinking. This can be both fun and useful. LePort worries, though, that this may mean your incomplete and half-baked thoughts on an issue are used against you by those in positions of authority.
As a senior academic, I hope I can offer some reassurance. In general, I see blogging as an indication that the author is a bit out of the ordinary – someone who cares enough about things to write about them, and who is willing to try and move discussion forward. If in addition they change their views on the basis of feedback, that's fine. Obviously, it's possible to reveal yourself on a blog as uninformed, irrational or bigoted, and that is definitely not good. But most of the blogs I read aren't like that.
Well, I can hear you saying, that's all very well. You are someone who actually blogs and understands social media, but most academics aren't like that. My reply is that social media is an unstoppable force and even the most traditional institutions are starting to focus on developing strategies for harnessing its power. So I'd say, yes, LePort is right in that we need to be aware that blogging is a public medium, and anything we say on a blog can be read by anyone. But it would be a shame if we allowed ourselves to become so worried about potential problems that we failed to see the advantages of blogging for fostering academic debate.That would be like staying at home with the door locked because you're scared of what may happen if you go outside.
Friday, 27 December 2013
Saturday, 30 November 2013
A letter to Boris Johnson
Dear Boris,
Last week you created
a media storm with your speech
at the Centre for Policy Studies in London. As a self-publicist, you make Katie Price look like a case of social phobia,
and maybe you are pleased with the column inches you attracted. But perhaps you are also made nervous by the many
commentators who have suggested that you have damaged your chances of greater
political glory by letting the avuncular mask slip and revealing what lies behind
it.
As a eulogy for Margaret Thatcher, your speech was most
effective, though it came across as a transparent bid to take on her mantle. But it also revealed a blind spot in your
understanding of your fellow human beings. This is evidence in the two themes that run
through the speech: (1) people are motivated solely by competition with others;
(2) those who win competitions are morally superior and more deserving than
those who lose.
Let’s look at the evidence in the speech. The first comment that gave me pause was
this: “Of the 193 present members of the
UN, we have conquered or at least invaded 171 – that is 90 per cent.” This
is presented as if it is something to be proud of. As someone who’d like to
peaceably get on with my neighbours, I find it disturbing that a man who has
ambitions to lead our country sees domination of other nations as an admirable
goal.
You then go on to argue that as Britain’s empire waned, we
suffered from a “spiritual morosity that
bordered on self-loathing”. Not my memory
of the 1960s-70s. It was all rather jolly what with flower power and the sexual
revolution (all made possible through science and the advent of the pill). According to you, part of Thatcher’s greatness
was that she revived the nation and created “a buccaneering environment where there was no shame – quite the reverse
– in getting rich.” So instead of invading other countries and stealing
their resources, we could elbow our way ahead of others in our own country, and
feel smug about it at the same time. I do remember those days, which was exactly
when my own spiritual morosity set in. Encounters with various businesses –
utilities, banks, large shops, car hire firms, airlines – which had previously
been straightforward and uneventful became obstacle courses that you had now to
negotiate with extreme caution, because they were all trying to rip you off. You
needed to be on your guard, as the default assumption was that they’d try to
stitch you up and lock you in to the wrong kind of deal, with unnecessary
insurance to boot and nasty little charges added on at the last moment. Those
of a more recent generation may find this hard to believe, but you used to be
able to interact with any large-sized company on the assumption that they were
honest and cared about their reputation. The “buccaneering
environment” that Thatcher introduced delivered us into the hands of the
pirates. Which was a good thing if you were a pirate, but not much fun for everyone
else.
The part of your speech that has attracted most comment is
when you talked about IQ. Full marks for demonstrating an understanding of the
normal distribution, but less than full marks for the logic of your argument:
“Whatever you may
think of the value of IQ tests, it is surely relevant to a conversation about
equality that as many as 16 per cent of our species have an IQ below 85, while
about 2 per cent have an IQ above 130. The harder you shake the pack, the
easier it will be for some cornflakes to get to the top.
And for one reason or
another – boardroom greed or, as I am assured, the natural and god-given talent
of boardroom inhabitants - the income gap between the top cornflakes and the
bottom cornflakes is getting wider than ever. I stress: I don’t believe that
economic equality is possible; indeed, some measure of inequality is essential
for the spirit of envy and keeping up with the Joneses that is, like greed, a
valuable spur to economic activity.”
It’s unclear how far you understand IQ – some people have
suggested you think it’s a measure of innate ability. But in a sense it doesn’t
matter whether you recognise it is
modifiable or not; the real problem is you confuse someone’s intellectual
abilities with their worth. You seem to be saying that bright people deserve to
succeed (and indeed we should give them knighthoods for their wealth generation
activity) – whereas at the same time you seem to accept that there are some individual
differences in ability. So are you saying that the less able people deserve to
be poor? The cornflake analogy you use is not entirely clear, but it seems to
amount to saying that you want to stimulate further inequalities between people
– and surely that means the poor getting poorer while the rich get richer?
What I find particularly chilling in your speech is the view
of human beings as motivated primarily by envy, greed, and the need to get to
the top, as well as the implication that if you don’t you are stupid. You seem unaware
that there are large numbers of people who are motivated by things like
interest in what they are doing (e.g. scientists), a desire to help others (e.g.
doctors, nurses, teachers or carers), or a creative urge (e.g. writers and
artists). When confronted with a banker whose annual income is fifty times as
much as average earnings, for many of us the feeling is not so much envy as
incomprehension. Why would anyone need all that money? Don’t they feel embarrassed
at having so much more than everyone else? Weren’t they taught that you care
for those less fortunate than yourself and that greed was a bad thing? Well,
clearly not, because, as you tell us, Thatcher changed the culture so that
there was “no shame – quite the reverse –
in getting rich.”
You don’t say what you think about the legions of people who
exist happily on moderate incomes, but the implication is that they are all
suckers, who’d be better off with a good dose of greed and envy. Indeed, you
imply they are parasitic on the rich, who create all this wealth by paying
massive amounts of tax. This is a good way to enrage a substantial part of the
electorate.
At least from time to time you give a nod of recognition of
the need for philanthrophy:
“But I also hope that
there is no return to that spirit of Loadsamoney heartlessness – figuratively
riffling banknotes under the noses of the homeless; and I hope that this time
the Gordon Gekkos of London are conspicuous not just for their greed – valid motivator
thought greed may be for economic progress – as for what they give and do for
the rest of the population”
But, dear Boris, if you set up a system that rewards the
greedy, you can hardly expect them to change their ways and start being
philanthropic once they’ve made it. The main reason the very rich end up
commandeering all the resources is because they are never satisfied. Like you,
they are motivated by a sense of intense competition with everyone else. They
won’t think about whether their income is sufficient to live a comfortable
life; all they care about is having more money than everyone else. And people like that are not going to make
philanthropic donations; on the contrary they will avoid paying tax using any
means that is legally available to them. And you, by clapping them on the back for
their avarice, are just encouraging them.
I agree with you that capitalism and competition are
unlikely to disappear; they are an inherent part of our economic system. I also
agree that we cannot prevent inequality; the key question for politicians is
how best to manage it. According to you we should give greed and envy a free
rein because they have such good consequences. I disagree. I do not feel proud to be British
in a country that treats its most vulnerable citizens with contempt, and values
the qualities of competition, envy and greed over those of co-operation,
compassion and moderation.
Labels:
Boris Johnson,
competition,
conservatism,
greed,
Margaret Thatcher,
politics
Tuesday, 15 October 2013
The Matthew effect and REF2014
For unto every one that hath shall be given, and he shall have abundance: but from him that hath not shall be taken away even that which he hath. Matthew 25:29
So you’ve slaved over your departmental submission for REF2014, and shortly will be handing it in. A nervous few months await before the results are announced. You’ve sweated blood over deciding whether staff publications or impact statements will be graded as 1*, 2*, 3* or 4*, but it’s not possible to predict how the committee will judge them, nor, more importantly, how these ratings will translate into funding. In the last round of evaluation, in 2008, a weighted formula was used, such that a submission earned 1 point for every 2* output, 3 points for every 3* output, and 7 points for every 4* output. Rumour has it that this year there may be no money for 2* outputs and even more for 4*. It will be more complicated than this, because funding allocations will also take into account ratings of ‘impact statements’, and the ‘environment’.
I’ve blogged previously about concerns I have with the inefficiency of the REF2014 as a method for allocating funds. Today I want to look at a different issue: the extent to which the REF increases disparities between universities over time. To examine this, I created a simulation which made a few simple assumptions. We start with a sample of 100 universities, each of which is submitting 50 staff in a Unit of Assessment. At the outset, we start with all universities equal in terms of the research quality of their staff: they are selected at random from a pool of possible staff whose research quality is normally distributed. Funding is then allocated according to the formula used in RAE2008. The key feature of the simulation is that over every assessment period there is turnover of staff (estimated at 10% in simulation shown here), and universities with higher funding levels are able to recruit replacement staff with higher scores on the research quality scale. These new staff are then the basis for computing funding allocations in the next cycle – and so on, through as many cycles as one wishes. This simulation shows that funding starts out fairly normally distributed, but as we progress through each cycle, it becomes increasingly skewed, with the top-performers moving steadily away from the rest (Figure A). In the graphs, funding is shown over time for universities grouped in deciles, i.e., bands of 10 universities after ranking by funding level.
Simulation: Mean income for universities in each of 10 deciles over 6 funding cycles |
We could do things differently. Figure B shows how tweaking the funding model could avoid opening up such a wide gulf between the richest and poorest, and retain a solid core of middle-ranking universities.
Simulation using linear weighting of * levels. Each line is average for institutions in a given decile |
Simulation where 4* outputs get favoured. Each line is average for institutions in a given decile |
However, given that finances are always limited, there will be a cost to the focus on an elite; the middle-ranking universities will get less funding, and be correspondingly less able to attract high-calibre researchers. And it could be argued that we don’t just need an elite: we need a reasonable number of institutions in which there is a strong research environment, where more senior researchers feel valued and their graduate students and postdocs are encouraged to aim high. Our best strategy for retaining international competitiveness might be by fostering those who are doing well but have potential to do even better. In any case, much research funding is awarded through competition for grants, and most of this goes to people in elite institutions, so these places will not be starved of income if we were to adopt a more balanced system of awarding central funds.
What worries me most is that I haven’t been able to find any discussion of this issue – namely, whether the goal of a funding formula should be to focus on elite institutions or distribute funds more widely. The nearest thing I’ve found so far is a paper analysing a parallel issue in grant awards (Fortin & Curry, 2013) – which comes to the conclusion that broader distribution of smaller grants is more effective than narrowly distributed large grants. Very soon, somebody somewhere is going to decide on the funding formula, and if rumours are to be believed, it will widen the gap between the haves and have-nots even further. I'm concerned that if we continue to concentrate funding only in those institutions with a high proportion of research superstars, we may be creating an imbalance in our system of funding that will be bad for UK research in the long run.
Reference
Fortin JM, & Currie DJ (2013). Big Science vs. Little Science: How Scientific Impact Scales with Funding. PloS one, 8 (6) PMID: 23840323
Labels:
funding,
HEFCE,
REF2014,
research funding,
universities
Thursday, 10 October 2013
On the need for responsible reporting of research to the media
This was one of the first tweets I saw when I woke up this morning :
In response, a parent of two girls with autism tweeted "gutted to read this. B's statement has been final for 1 yr but no therapy has been done. we're still waiting."
I was really angry. A parent who is waiting for therapy for a child has many reasons to be upset. But the study described on the BBC Website did NOT identify a 'critical window'. It was not about autism and not about intervention.
I was aware of the study because I'd been asked by the Science Media Centre to comment on an embargoed version a couple of days ago.
These requests for commentary on embargoed papers always occur very late in the day, which makes it difficult to give a thorough appraisal. But I felt I'd got the gist: the researchers had recruited 108 children aged between 1 and 6 years and done scans to look at the development of white matter in the brain. They also gave children a well-known test of cognitive development, the Mullen scales, which assesses language, visual and fine motor skills. It's not clear where the children came from, but their scores on the Mullen scales were pretty average, and as far as I can tell, none of them had any developmental disorders.
The researchers were particularly interested in lateralisation: the tendency to have more white matter on one side of the brain than the other. Left-sided lateralisation of white matter in some brain regions is well-established in adults but there's been debate as to whether this is something that develops early in life, or whether it is present from birth. In the introduction, the authors state that this lateralisation is strongly heritable, but although that's often claimed, the evidence doesn't support it (Bishop, 2013). A preponderance of white matter in the left hemisphere is of interest because in most people, the left side of the brain is strongly involved in language processing.
The authors estimated lateralisation in numerous regions of the left and right brain using a measure termed the myelin water fraction. Myelin is a fatty sheath that develops around the axons of cells in the brain, leading to improved efficiency of neural transmission. Myelination is a well-established phenomenon in brain development.
The main findings I took away from the paper were (a) myelin is asymmetrically distributed in the brains of young children, with many regions showing greater myelin density in the left than the right; (b) although the amount of myelin increases with age, the extent of lateralisation is stable from 1 to 6 years. This is an important finding.
The authors, however, put most focus on another aspect of the study: the relationship between myelin lateralisation and language level. Overall, there was no relationship with asymmetry of a temporal-occipital region that overlapped with the arcuate fasciculus, a fibre tract important for language that previously had given rather inconsistent results (see Bishop, 2013). However, looking at a total of eight brain regions and four cognitive measures, they found two regions where leftward asymmetry was related to language or visual measures, and one where rightward asymmetry was related to expressive and receptive language.
Their primary emphasis, however, was on another finding, that there were interactions between age and lateralisation, so that, for instance, left-sided lateralisation of myelin in a region encompassing caudate/thalamus and frontal cortex only became correlated with language level in older children. I found it hard to know how much confidence to place in this result: the authors stated that they corrected for multiple comparisons using false discovery rate, but if, as seems the case, they looked at both main effects and interaction terms in 32 statistical analyses, then some of these findings could be chance.
Be that as it may, it is an odd result. Remember that this was a cross-sectional study and that on no index was there an age effect on lateralisation. So it does not show that changes in language ability - which are substantial over this age range - are driven by changes in lateralisation of myelin. So what do the authors say? Well, in the paper, they conclude "The data presented here are cross sectional, longitudinal analysis will allow us to confirm these findings; however, the changing interaction between ability and myelin may be mediated by progressive functional specialization in these connected cortical regions, which itself is partly mediated by environmental influences" (p. 16175). But this is pure speculation: they have not measured functional specialisation, and, as they appear to recognise, without longitudinal data, it is premature to interpret their results as indicating change with age.
If you've followed me so far, you may be wondering when I'm going to get on to the bit about intervention for autism and critical periods. Well, there's no data in this paper on that topic. So why did the BBC publish an account of the paper likely to cause dismay and alarm in parents of children with language and communication problems? The answer is because King's College London put out a press release about this study that contained at least as much speculation as fact. We are told that the study "reveals a particular window, from 2 years to the age of 4, during which environmental influence on language development may be greatest." It doesn't do anything of the kind. They say: "the findings help explain why, in a bilingual environment, very young typically developing children are better capable of becoming fluent in both languages; and why interventions for neurodevelopmental disorders where language is impaired, such as autism, may be much more successful if implemented at a very young age. " Poppycock.
A few months ago the same press office put out a similarly misleading press release about another study, quoting the principal researcher as stating: “Now we understand that this is how we learn new words, our concern is that children will have less vocabulary as much of their interaction is via screen, text and email rather than using their external prosthetic memory. This research reinforces the need for us to maintain the oral tradition of talking to our children.” As I noted elsewhere, the study was not about children, computers or word learning.
I can see that there is a problem for researchers doing studies of structural brain development. It can be hard to excite the general public about the results unless you talk about potential implications. It is frankly irresponsible, though, to go so far beyond your data that the headline is based on the speculation rather than the findings.
I am tired of researchers trying to make their studies relevant by dragging in potential applications to autism, schizophrenia, or dyslexia, when they haven't done any research on clinical groups. They need to remember that there are real people out there whose everyday life is affected by these conditions, and that neither they nor the media can easily discriminate what a study actually found from speculations about its implications. It is the duty of researchers and press officers to be crystal clear about that distinction to avoid causing confusion and distress.
POSTSCRIPT
11/10/13: Dr O'Muircheartaigh has commented below to absolve the KCL Press Office of any responsibility for the content of their press release. I apologise for assuming that they were involved in decisions about how to publicise this research and have reworded parts of this blogpost to remove that implication.
References
Bishop, D. V. M. (2013). Cerebral asymmetry and language development: Cause, correlate, or consequence? Science, 340 (6138) DOI: 10.1126/science.1230531
O'Muircheartaigh, J., Dean, D. C., Dirks, H., Waskiewicz, N., Lehman, K., Jerskey, B. A., & Deoni, S. C. L. (2013). Interactions between white matter asymmetry and language during neurodevelopment. Journal of Neuroscience, 33(41), 16170-16177. doi: 10.1523/jneurosci.1463-13.2013
In response, a parent of two girls with autism tweeted "gutted to read this. B's statement has been final for 1 yr but no therapy has been done. we're still waiting."
I was really angry. A parent who is waiting for therapy for a child has many reasons to be upset. But the study described on the BBC Website did NOT identify a 'critical window'. It was not about autism and not about intervention.
I was aware of the study because I'd been asked by the Science Media Centre to comment on an embargoed version a couple of days ago.
These requests for commentary on embargoed papers always occur very late in the day, which makes it difficult to give a thorough appraisal. But I felt I'd got the gist: the researchers had recruited 108 children aged between 1 and 6 years and done scans to look at the development of white matter in the brain. They also gave children a well-known test of cognitive development, the Mullen scales, which assesses language, visual and fine motor skills. It's not clear where the children came from, but their scores on the Mullen scales were pretty average, and as far as I can tell, none of them had any developmental disorders.
The researchers were particularly interested in lateralisation: the tendency to have more white matter on one side of the brain than the other. Left-sided lateralisation of white matter in some brain regions is well-established in adults but there's been debate as to whether this is something that develops early in life, or whether it is present from birth. In the introduction, the authors state that this lateralisation is strongly heritable, but although that's often claimed, the evidence doesn't support it (Bishop, 2013). A preponderance of white matter in the left hemisphere is of interest because in most people, the left side of the brain is strongly involved in language processing.
The authors estimated lateralisation in numerous regions of the left and right brain using a measure termed the myelin water fraction. Myelin is a fatty sheath that develops around the axons of cells in the brain, leading to improved efficiency of neural transmission. Myelination is a well-established phenomenon in brain development.
The main findings I took away from the paper were (a) myelin is asymmetrically distributed in the brains of young children, with many regions showing greater myelin density in the left than the right; (b) although the amount of myelin increases with age, the extent of lateralisation is stable from 1 to 6 years. This is an important finding.
The authors, however, put most focus on another aspect of the study: the relationship between myelin lateralisation and language level. Overall, there was no relationship with asymmetry of a temporal-occipital region that overlapped with the arcuate fasciculus, a fibre tract important for language that previously had given rather inconsistent results (see Bishop, 2013). However, looking at a total of eight brain regions and four cognitive measures, they found two regions where leftward asymmetry was related to language or visual measures, and one where rightward asymmetry was related to expressive and receptive language.
Their primary emphasis, however, was on another finding, that there were interactions between age and lateralisation, so that, for instance, left-sided lateralisation of myelin in a region encompassing caudate/thalamus and frontal cortex only became correlated with language level in older children. I found it hard to know how much confidence to place in this result: the authors stated that they corrected for multiple comparisons using false discovery rate, but if, as seems the case, they looked at both main effects and interaction terms in 32 statistical analyses, then some of these findings could be chance.
Be that as it may, it is an odd result. Remember that this was a cross-sectional study and that on no index was there an age effect on lateralisation. So it does not show that changes in language ability - which are substantial over this age range - are driven by changes in lateralisation of myelin. So what do the authors say? Well, in the paper, they conclude "The data presented here are cross sectional, longitudinal analysis will allow us to confirm these findings; however, the changing interaction between ability and myelin may be mediated by progressive functional specialization in these connected cortical regions, which itself is partly mediated by environmental influences" (p. 16175). But this is pure speculation: they have not measured functional specialisation, and, as they appear to recognise, without longitudinal data, it is premature to interpret their results as indicating change with age.
If you've followed me so far, you may be wondering when I'm going to get on to the bit about intervention for autism and critical periods. Well, there's no data in this paper on that topic. So why did the BBC publish an account of the paper likely to cause dismay and alarm in parents of children with language and communication problems? The answer is because King's College London put out a press release about this study that contained at least as much speculation as fact. We are told that the study "reveals a particular window, from 2 years to the age of 4, during which environmental influence on language development may be greatest." It doesn't do anything of the kind. They say: "the findings help explain why, in a bilingual environment, very young typically developing children are better capable of becoming fluent in both languages; and why interventions for neurodevelopmental disorders where language is impaired, such as autism, may be much more successful if implemented at a very young age. " Poppycock.
A few months ago the same press office put out a similarly misleading press release about another study, quoting the principal researcher as stating: “Now we understand that this is how we learn new words, our concern is that children will have less vocabulary as much of their interaction is via screen, text and email rather than using their external prosthetic memory. This research reinforces the need for us to maintain the oral tradition of talking to our children.” As I noted elsewhere, the study was not about children, computers or word learning.
I can see that there is a problem for researchers doing studies of structural brain development. It can be hard to excite the general public about the results unless you talk about potential implications. It is frankly irresponsible, though, to go so far beyond your data that the headline is based on the speculation rather than the findings.
I am tired of researchers trying to make their studies relevant by dragging in potential applications to autism, schizophrenia, or dyslexia, when they haven't done any research on clinical groups. They need to remember that there are real people out there whose everyday life is affected by these conditions, and that neither they nor the media can easily discriminate what a study actually found from speculations about its implications. It is the duty of researchers and press officers to be crystal clear about that distinction to avoid causing confusion and distress.
POSTSCRIPT
11/10/13: Dr O'Muircheartaigh has commented below to absolve the KCL Press Office of any responsibility for the content of their press release. I apologise for assuming that they were involved in decisions about how to publicise this research and have reworded parts of this blogpost to remove that implication.
References
Bishop, D. V. M. (2013). Cerebral asymmetry and language development: Cause, correlate, or consequence? Science, 340 (6138) DOI: 10.1126/science.1230531
O'Muircheartaigh, J., Dean, D. C., Dirks, H., Waskiewicz, N., Lehman, K., Jerskey, B. A., & Deoni, S. C. L. (2013). Interactions between white matter asymmetry and language during neurodevelopment. Journal of Neuroscience, 33(41), 16170-16177. doi: 10.1523/jneurosci.1463-13.2013
Labels:
autism,
brains,
children,
laterality,
media,
myelination,
neuroscience,
press,
responsibility,
science communication
Wednesday, 9 October 2013
High time to revise the PhD thesis format
Before the electronic age: Henry Wellcome's dissertation from 1874 |
There are ways of dealing with this: the most useful one, taught to me by Uta Frith when we co-examined a thesis some years ago, was to make ample use of post-it notes. However, this is still pretty tedious. What I want is a loose-leaf document that I can write on. I want, when travelling on a train to be able to take a chapter or two with me.
Please, can somebody fix this?
Saturday, 5 October 2013
Good and bad news on the phonics screen
Teaching children to read is a remarkably fraught topic. Last year the UK Government introduced a
screening check to assess children’s ability to use phonics – i.e., to decode
letters into sounds. Judging from the reaction in some quarters they might as well have announced they were going to teach 6-year-olds calculus. The test, we were
told, would confuse and upset children and not tell teachers anything they did
not already know. Some people implied
that there was an agenda to teach children to read solely using meaningless
materials. This, of course, is not the case. Nonwords are used in assessment
precisely because you need to find out if the child has the skills to attack an
unfamiliar word by working out the sounds. Phonics has been ignored or rejected
for many years by those who assumed that if you taught phonics the child would
be doomed to an educational approach that involved boring drills in meaningless
materials. This is not the case: for
instance, Kevin Wheldall argues that children need to combine teaching of phonics with training in vocabulary and comprehension, and storybook reading
with real texts should be a key component of reading instruction.
There is evidence for the effectiveness of phonics training from
controlled trials, and I therefore regard it as a positive move
that the government has endorsed the use
of phonics in schools. However, they continue to meet resistance from many
teachers, for a whole range of reasons. Some just don’t like phonics. Some don’t
like testing children, especially when the outcome is a pass/fail
classification. Many fear that the government will use results of a screening
test to create league tables of schools, or to identify bad teachers. Others question the whole point of screening: This recent piece from the BBC website quotes Christine Blower, the head of the National Union of Teachers, as saying: "Children develop at different levels, the slow reader at five can
easily be the good reader by the age of 11.” To anyone familiar with the
literature on predictors of children’s reading, this shows startling levels of complacency and ignorance. We have known for years that you can predict with
good accuracy which children are likely to be poor readers at 11 years from
their reading ability at 6 (Butler et al, 1985).
When the results from last year's phonics screen came out I blogged about them, because they looked disturbingly dodgy, with a spike in the frequency distribution at the pass mark of 32. On Twitter, @SusanGodsland has pointed me to a report on the 2012 data where
this spike was discussed. This noted that the spike in the distribution was not seen in a pilot study
where the pass mark had not been known in advance. The spike was played down
in this report, and attributed to “teachers accounting for potential
misclassification in the check results, and using their teacher judgment to
determine if children are indeed working at the expected standard.” It was
further argued that the impact of the spike was small, and would lead to only
around 4% misclassification.
However, a more detailed research report on the results was rather less mealy-mouthed
about the spike and noted “the national distribution of scores suggests that
pupils on the borderline may have been marked up to meet the expected
standard.” The authors of that report did the best they could with the data and
carried out two analyses to try to correct for the spike. In the first, they
deleted points in the distribution where the linear pattern of increase in
scores was disrupted, and instead interpolated the line. They concluded that
this gave 54% rather than 58% of children passing the screen. The second approach, which they described as
more statistically robust, was to take all the factors that they had measured
that predicted scores on the phonics screen, ignoring cases with scores close to the
spike, and then use these to predict the percentage passing the screen in the
whole population. When this method was
used, only 46% of children were estimated to have passed the screen when the
spike was corrected for.
Well, this year’s results have just been published. The good news is that there is an impressive increase in percentage of children passing
from 2012 to 2013, up from 58% to 69%. This suggests that
the emphasis on phonics is encouraging teachers to teach children about how letters and sounds go together.
But any positive reaction to this news is
tinged with a sense of disappointment that once again we have a most peculiar distribution with a spike at the
pass
mark.
Proportions of children with different scores on phonics screen in 2012 and 2013. Dotted lines show interpolated values. |
I applied the same correction as had been used for the 2012 data,
i.e.
interpolating the curve over the dodgy area. This suggested that the
proportion of cases passing the screen was overestimated by about 6%
for both 2012 and 2013. (The precise figure will depend on the exact way
the interpolation is done).
Of course I recognise that any pass mark is arbitrary, and
children’s performance may fluctuate and not always represent their true
ability. The children who scored just below the pass mark may indeed not
warrant extra help with reading, and one can see how a teacher may be tempted
to nudge a score upward if that is their judgement. Nevertheless, teachers who
do this are making it difficult to rely on the screen data and to detect
whether there are any improvements year on year. And it undermines their
professional status if they cannot be trusted to administer a simple reading test objectively.
It has been announced that the pass mark for the phonics screen won’t be
disclosed in advance in 2014, which should reduce the tendency to nudge scores
up. However, if the pass mark differs from
previous years, then the tests won’t be comparable, so it seems likely that
teachers will be able to guess it will remain at 32. Perhaps one solution would
be to ask the teacher to make a rating of whether or not the
test result agrees with their judgement of the child’s ability. If they have an
opportunity to give their professional opinion, they may be less tempted to
tweak test results. I await with interest the results from 2014!
Reference
Butler, Susan R., Marsh, Herbert W., Sheppard, Marlene J., & Sheppard, John L (1985). Seven-year longitudinal study of the early prediction of reading achievement Journal of Educational Psychology, 77, 349-361 DOI: 10.1037//0022-0663.77.3.349
Labels:
children,
education,
government,
phonics,
reading,
statistics
Thursday, 26 September 2013
Raising awareness of language learning impairments
A couple of years ago I did a Google search for ‘Specific language impairment’. I was appalled by what I found. The top hit was a video by a chiropractor who explained he’d read a paper about neurological basis of language difficulties; he proceeded to mangle its contents, concluding that cranial osteopathy would help affected children.
I’ve previously described how I got together with colleagues in 2012 to try and remedy this situation, culminating in a campaign for Raising Awareness of Language Learning Impairments (RALLI). The practicalities have sometimes been challenging but I’m pleased to say that the collection of videos on our RALLI site has now attracted over 90,000 hits, providing an accessible and evidence-based source of information about developmental language impairments. As well as research-based films we have videos with practical information for parents, children and teachers.
So here, for those of you interested in this topic, is an index of what we have so far:
Background to RALLI
Research topics
- Identification of Specific Language Impairment Video Slides References
- How specific is SLI? Video Slides References
- Speech, language and communication Video Slides
- What is Pragmatic Language Impairment? Video Slides
- How common is specific language impairment? Video Slides References
- When should we be concerned about late-talkers? Video Slides References
- SLI and Autism Video Slides References
- Auditory processing disorder (APD) and language impairment Video Slides References
- The causes of Specific Language Impairment Video Slides References
- Specific language impairment and the brain Video Slides References
- An extra X or Y chromosome: a rare cause of language impairment Video Slides References
- SLI & reading: 1. Decoding (phonics) Video Slides References
- SLI and reading: 2. Understanding written language Video Slides References
- Reading intervention for children with language impairments Video References
- Friendships in teenagers with SLI Video Slides
- La Amistad y el TEL (Spanish) Video Slides
Information for teachers
- Signs of SLI
- Literacy difficulties and SLI
- Looking behind behaviour
- Teacher tips: practical strategies
- Teacher tips: adapting your language
- What is the Better Communication Research Programme?
Support for parents and children
- Finding my strengths
- A Parent's Perspective of SLI: Meet Suzanne.
- You are not alone
- It's OK to ask for help
- Getting support
- Helping your child
- Sophie's Story: SLI in adulthood
- Talking about friendships: Megan and Eleshia
- Supporting families: the role of Afasic
- Speech and language therapy: Helping Michael
- It's not your fault
- Things I wish I'd known: a parent's perspective
International
- O que é o DEL? (Portuguese)
- 什麼是特定型語言障礙? (Mandarin)
- ¿Qué es el TEL? (Spanish)
- Qu'est-ce que le TSL? (French)
- Was sind spezifische Sprachentwicklungsstörungen? (German)
- Wat is een taalstoornis? (Dutch)
- 甚麽是特殊語言障礙(廣東話版)(Cantonese)
- Che cos'é il DSL? (Italian)
- Beth yw NIP? (Welsh)
- Τι είναι η Ειδική Γλωσσική Διαταραχή ( Greek)
Reference
Bishop, D. V. M., Clark, B., Conti-Ramsden, G., Norbury, C., & Snowling, M. J. (2012). RALLI: An internet campaign for raising awareness of language learning impairments Child Language Teaching & Therapy, 28 (3), 259-262 DOI: 10.1177/0265659012459467
Subscribe to:
Posts (Atom)