Sunday, 20 March 2011

The expansion of research regulators: an evolutionary perspective

Reading about evolution has made me think about why some professions grow and thrive while others die out. I'm intrigued by the expansion in numbers of people regulating the activities of researchers. How have we got to a position where the Academy of Medical Sciences concludes: “A complex and bureaucratic regulatory environment is stifling health research in the UK”?

Consider the situation in the 1970s. If you wanted to do a piece of research you did it, no questions asked. But bad things can happen if you let people do just what they want. There are terrible examples of studies where research participants were infected, hurt or humiliated without realising what was happening or giving their consent. For examples, see Rebecca Skloot’s book, ‘The Immortal Life of Henrietta Lacks’ and Dominic Streatfeild’s ‘Brainwash: the Secret History of Mind Control’. The solution was to create a body of people, the regulators, who would scrutinise research and make sure it was ethical. Despite the regulation, every few years something bad still happened. The regulators responded by increasing their numbers and adding more regulations. In general, I’ve avoided doing studies that require me to go through an NHS ethics committee because the process is so long-winded and bureaucratic that it saps all my enthusiasm and takes up time I’d rather spend doing research. Our University ethics committee can approve studies that don’t involve patients and operates a much less complex system. Recently, though, I badly wanted to do a study involving NHS patients, and decided to grit my teeth and go through the process. It’s taken literally weeks of form-filling, and what amazed me was the sheer number of regulators I dealt with in the course of applying for approval. Then there was one set of people from the research ethics committee (REC), another set from R&D, yet more from the Comprehensive Clinical Research Network - in fact several sets of those depending on whether you were concerned with local or regional matters. There are people whose job it is to book your application in to a REC via a centralised system, and others whose job it is to do the same thing at local level when the first fail to find you a slot. These people were typically very helpful, but that isn’t the point. Why are there so many people whose sole function in life is the ethical scrutiny of researchers? Why are there so many forms to fill in that a recent article raised concerns about the environmental impact of paper use by RECs.  And how have we got to the situation described by the Academy of Medical Sciences whereby it takes an average of 621 days from receiving funding to recruiting the first patient for a trial of a cancer drug? 

From an evolutionary perspective, a research regulator is a life form with three very interesting characteristics. First, its numbers explode in response to catastrophic events regardless of how rare that event is. Second, it has few natural predators, so its expansion goes unchecked. Third, regulators multiply like bacteria: they spawn more regulations which require more regulators, so there is a rapid increase in population over time. And these three characteristics derive, I submit, from a basic human tendency to focus on emotionally-engaging events while ignoring their probability.

Catastrophe as a driving force in increasing the number of regulators
When something really terrible happens - someone is badly hurt or upset, or even worse, killed - we empathise with the victim and want to do something to prevent it happening again. All of our attention is taken up by the awfulness of the event, and we ignore the costs inherent in a solution. This kind of thinking is described by Dan Gardner in his book ‘Risk’ as due to System 1, or Gut, as opposed to the more rational System 2, or Head. Gut’s supremacy is such that if someone were to draw attention to rarity of the catastrophe or the costs of the proposed solution, they would be criticised for being heartless. It is this way of reasoning that fosters the dramatic rise in regulators.

Consider the case of Dr Harold Shipman, a general practitioner in Greater Manchester, who in 2000 was found guilty of murdering 15 of his patients. According to Wikipedia, his was one of the most prolific known serial killers in global history with 215 murders being positively ascribed to him, although the real number is likely to be higher than this. He had no obvious motive and did not appear mentally ill to his colleagues or patients. This case led to the Shipman enquiry, led by Dame Janet Smith.  It was discovered that Shipman had been sent a warning letter by the GMC but allowed to return to practice after a conviction for dishonestly obtaining pethidine in 1976.  The enquiry judged, however, that if a harsher punishment had been given, it would not have prevented Shipman from becoming a serial killer. Nevertheless, the committee called for a database to be established containing information about all doctors in the NHS, including disciplinary records, which both patients and NHS bodies could access.  They also supported a system of revalidation, whereby doctors would undergo regular checks of their competency to practise.  There is no indication that anyone ever discussed the probability of another Harold Shipman occurring. I’m sure there are many doctors who are incompetent, have massive personal problems, and there are no doubt a few who feel like murdering their patients from time to time. But I find it hard to believe that we need to set up regulations to scrutinise apparently sane doctors to prevent them from murdering their patients in cold blood.  Nevertheless, in the interests of ‘this must never happen again’ it’s recommended that a whole new posse of regulators be created to check family doctors, whose compliance will no doubt cost time that could be spent with their patients. I suspect one day there will be another doctor who does something really terrible, but I doubt these regulations would prevent this.

A much less dramatic but pertinent example was described on Jenny Rohn’s blog. I recommend you read her account of the regulations produced by her research funder that require that staff in the laboratory wear safety glasses at all times. Jenny, a woman after my own heart, took the trouble to get to the bottom of why this regulation had been introduced, and found there had been a small number of accidents, which could have been prevented if the scientist had taken commonsense precautions and worn safety glasses while performing specific hazardous procedures. A reminder to staff to do this should have been sufficient. Instead, a regulation has been introduced which costs time and money.

Regulators have no natural predators
Once regulation is established, it is remarkably difficult to remove it. This is largely a consequence of the same human tendency as discussed above: the attentional focus on catastrophe. Anyone who argues against regulation will be seen as being so cold-hearted or cavalier as to not care about the catastrophe that led to regulation being set up.

A key point here is that individual regulations often appear trivial - especially when considered in relation to the catastrophes they are designed to avert. Filling in a form, or going to an opticians is tedious, but it seems curmudgeonly to complain if someone’s life or sight can be saved. However, there are expenses in both time and money, and these can become substantial if large numbers of people are required to adhere to regulations and to administer them. We do need to consider carefully whether the measures that are put in place are effective and proportionate.

Consider another example. On 4th August 2002, 10-year-olds Holly Wells and Jessica Chapman were murdered by their school caretaker Ian Huntley in the village of Soham, Cambridgeshire. Huntley had a string of previous allegations about sexual interest in young girls when previously in the North East of England, as well as a burglary charge, but only the burglary charge was placed on the police national computer, and even this was not picked up by the routine checks that the school did, because Huntley had changed his name.  After this case, there has been massive tightening up of police checks for people who work with children. If you plan to work with children or young people, you need a Criminal Records Bureau (CRB) check.  My researcher team works in schools and we all have CRB checks. Recently, though, we’ve found some head teachers will want a new CRB check, just for their school, even if you have recently obtained one. And the regulations have been extended to individuals such as children’s authors who make occasional visits to schools.  Everyone is clearly very nervous about letting unvetted adults come into contact with children. But does it work? On 1st October 2009, Plymouth nursery worker Vanessa George admitted 13 charges of sexual abuse of children and making and distributing indecent images of children. She had completed a qualification in child care and passed a Criminal Records Bureau police check to allow her to work with younger children. 

I am aware that if I query the usefulness of the CRB check procedures it will look as if I am placing my own personal inconvenience above the welfare of vulnerable children. Regulation is tedious, and sometimes costly, but what monster would refuse to fill in a form or pay a few pounds in order to prevent a child being murdered? I can assure readers that I feel every bit as much rage and grief as anyone else every time I see that photo of Holly and Jessica that is so often reproduced in the media. If something can be done to stop children getting murdered or molested, I would be the first to endorse it. I just query whether this massive bureaucratic exercise is a cost-effective solution, as compared, say, with using resources to teach children how to identify and respond to adults who behave inappropriately.

Ultimately, the only thing that could lead to a mass extinction of regulators would be if government were to decide that the regulation was too expensive. However, in general, governments are nervous of deregulation because it will upset people who see regulation as the path to preventing another catastrophe. I disagree. It’s my belief that we can never control life so that there are no catastrophes. So from time to time bad things will happen. Every time they do, more regulators are created, but none are ever removed. Their inexorable rise seems inevitable. But as if this were not enough, there is an additional process at work.

Regulators generate more regulators
In the field of ethical scrutiny of research, a major shake-up was spawned by one rare event, the discovery that a pathologist at Alder Hey Children’s Hospital had stored body organs of deceased children without their parents’ knowledge or consent.  This lead to an explosion of regulation, and a new legal framework for the use of human tissue. But perhaps more surprisingly, it was accompanied by a broadening of the remit of research regulation to apply not just to medical research but to all research involving human participants. I suggest that a driving force here is the regulator mindset. Once you have been set up to prevent catastrophic events, you don’t just focus on the original catastrophe that started the ball rolling, you start trying to anticipate catastrophes, so you can set regulations in place to prevent them. This inevitably generates huge amounts of additional regulation. I thoroughly agree with the idea that it is better to anticipate problems than deal with their consequences, but the difficulty here is that the potential catastrophe absorbs all one’s attention and once again its probability is never considered. 

To take an example, some years ago I was part of a research group who wanted to recruit from a local maternity hospital; we simply wanted to sign up mothers who might potentially be interested in taking part in research when their children was 12 to 36 months of age. At that point, they would be contacted and invited to take part, with no obligation to do so. We did not approach mothers of babies who had any medical problems. One member of the ethics committee was concerned at our procedures. It was suggested that before writing to these parents to invite them to take part in a study, we ought to check with the family doctor whether the child had died. Well, of course, I can imagine it would be awful to receive a letter inviting you to involve your child in a study if the child had died. But what proportion of healthy babies die by 2 or 3 years of age? Is the probability of this happening high enough to justify asking family doctors of some hundred children to check their medical records before we contacted them? According to the Office of National Statistics, the mortality rate for children aged 1 to 14 years was 12 deaths per 100,000 in 2009. Deaths in children under one year of age were more common at 4.5 per 1,000 live births, but most of these were babies who would not have been recruited to our study because they were severely ill in the first week of life, and/or had very low birthweight. I am again uncomfortably aware that I will seem heartless in arguing against adopting a measure to avoid the real but rare possibility of upsetting a bereaved parent. But against this hypothetical risk we need to balance the 100 patients that won’t get seen by their family doctor in the 10 minutes it takes them to locate and check the medical records and reply to the researcher.

In case you imagine such scenarios are unique to the UK, let me give one more example, from the USA. A colleague who does brain-scanning studies of children with developmental disorders tells me she was required to conduct a pregnancy test with any girl aged 9 years or over who wished to participate in the study. This is particularly striking because it is protecting against a conjunction of two very rare possibilities: (a) that a 9-year-old girl who volunteers for a research study might be pregnant and (b) that a brain scan of the mother's head might damage a foetus.

When regulators get together with lawyers, there’s a catalytic reaction, because lawyers are even better than regulators at thinking of things that need regulating. They go beyond defending us from catastrophes and disasters to protecting against things that have the potential to upset a few people. I was interested to read in the report by the Academy of Medical Sciences that the NHS Litigation Authority had never received a claim relating to research, yet the lawyers insist we put paragraphs in our information sheets about risk, indemnity and how to make a complaint. They’ve also had a major success defending people’s rights not to have their medical records scrutinised by anyone outside the clinical care team. The problem is that if you want to do a medical research study you need to identify suitable people to take part, and that means looking at their medical records. If you insist, as current regulation requires, that no-one outside the clinical care team can look at records, you have two stark options. Either the clinical care team have to spend time not caring for patients, but trawling through records, or the research cannot get done. Richard Doll was one of the first to speak out against this kind of regulation, which makes most epidemiological studies impossible to do.  This is one point where the report by the Academy of Medical Sciences has a recommendation to allow bona fide researchers to screen medical records.

Another factor leading to multiplication of regulators is an attitude of trusting no-one. Having required researchers to give a detailed account of what their research involves, down to the last comma in an information sheet, they need squads of highly trained people to scrutinise the forms to identify possible problems. And if this is not enough, they then introduce a further stage of monitoring the research. The implication is that the researchers can’t be trusted. Unless they write regular reports to the regulators on the progress of the research, they are likely to go off the rails. Even this is not enough: the regulators also have power to visit researchers to ensure they are doing what they said they would do. This of course all creates more jobs for the regulators. Nobody ever asks whether the money might be better spent on, for instance, doing research.

How can we retrieve the situation?
Having seen the increasing drive for more and more regulation during my lifetime, I am alarmed at its unstoppable progress. I’ve focused here on those aspects that have impinged on my life as a researcher, but the trend for ever more regulation appears to infest many other areas of life. I have two suggestions for how to improve matters:

a) Before any new regulation is introduced, there should be a cold-blooded cost-benefit analysis that considers (i) the severity of the adverse event that the regulation is designed to avert; (ii) the probability of the adverse event;  (iii) the likely impact of the regulation in reducing that probability; (iv) the cost of the regulation both in terms of the salaries of people who implement it, and the time and other costs to those affected by it. I use the word cold-blooded deliberately: our normal human instincts don’t lead us to weigh up these different factors rationally. Instead, we focus solely on (i).

b) We should be more imaginative about the type of regulation that is used. For instance, research regulators increasingly play a role in training researchers in ethical conduct of research. Currently one is expected to undertake such training in addition to all the form-filling. But why not treat it more like a driving test? Once trained, researchers could be certified as competent and left to get on with it without having to fill in any forms, and without constant scrutiny and monitoring. It would save huge amounts of everyone’s time and money if we could trust people to behave professionally and treat ethical skills more like driving skills. The regulators could then focus on training researchers and offering advice to those who encountered specific ethical issues in their research. Their role would become advisory rather than policing.

I had intended to write a blogpost documenting the many stages I have gone through on the road to seeking ethics approval for my current study, but that procedure, started in December, is continuing, and I cannot tell when it will end.

17 comments:

  1. Dorothy – this is an excellent analysis of a problem that has become far more than just an irritation. I’d like to pick up on a point concerning clinical trials, not least because this is a journey on which I too am about to embark. At a meeting of scientists and clinicians at our Institute, one of the clinicians described a recent discussion with a pharma company who wanted to know whether they could set up a small trial of a licensed drug within six weeks. For licensed drugs the paperwork can be processed relatively quickly, but in the UK that probably means 6 months, and 9 months is more realistic. Needless to say, the drug company chose to conduct the clinical trial elsewhere.

    This excessive regulation associated with conducting trials in the UK has been cited as contributing to the decision of Pfizer to close its Sandwich plant. I don’t know whether it was a factor in the Novartis closure, but these days most clinical trials in the UK are small Phase I/II trials undertaken by academics such as us who generally lack the funds and capacity to consider alternatives overseas. As you mention, the Academy of Medical Sciences has been pushing for change, and a few days ago Andrew Miller MP, who chairs the Commons Science and Technology Committee, wrote to David Willetts on the subject of the Pfizer closure. Willetts is due to respond publicly this week on government strategy with regard to the UK pharma industry, and it will be interesting to see if he has anything to say on clinical trials.

    I would certainly have thought that the regulations could be simplified without endangering the lives of patients or trial volunteers, and I like your suggestion that something akin to a driving test might be used to ensure that scientists/clinicians properly understand the ethics of studies involving patients. One would hope that a more pragmatic approach, together with the threats that already exist of prosecution and a custodial sentence for investigators who fail to abide by the rules, would lead to a more sensible alignment of the level of risk with the level of regulation.

    ReplyDelete
  2. Captures all my recent frustrations with the process, thank you. It took me some time to realise how stupid I had been when I entered into the 'Integrated Research Application System' and thought it meant it was integrating things to make it easier for me. Doh, it wasn't for my benefit. And it wasn't integrated.
    A few pointers from a recent REC panel have been helpful, and the administrator did her best to help me in the paperwork madness - but you're right, these things do not make up for the sheer frustration and time it all takes. It ends up being a more ethical issue that patients don't get the results of research more speedily.
    I also was suddenly told by the local R&D that I had to have a GCP certificate, but then wasn't allowed to access GCP training because my study wasn't part of a portfolio. It was pure Kafka (and I've only got through this stage by the help of a different R&D person who's understood something about the 'spirit' of the law as opposed to abiding by the 'letter').
    It's been a while since I directly did research in the NHS myself and it gave me even more admiration for our students who plough on through all of this - it might just have put me off doing more again (but I hope not).

    ReplyDelete
  3. Charlie Wilson @crewilson23 March 2011 at 15:39

    This mirrors some common grumbles with regards to regulators for animal research as well - I suppose we're all in the same (slowly sinking) boat in that sense. I suppose there's a chance you'll find discussion of animal research on here inappropriate - feel free to remove the following if so...

    There are some interesting differences and similarities with regards to your evolutionary principles:

    1. Our increasing regulation is not, imho, driven by catastrophe, but rather a slow drip of protest and objection to the approach. We therefore don't have the majority public clamour for regulation that arose after Shipman etc, and actually the public attitude (as displayed in numerous surveys) is more like "do the work if it's necessary, avoid suffering where possible, and don't tell us about it: we like the proceeds but don't want to hear about the methods".

    2. I think you actually argued that regulators do have a form of predation - they have to continue to justify their existence to budget hawks. This, I find, has an interesting effect on the regulators. They feel that they have to continue to shift the boundaries, increasing the requirements and regulations, almost as if they need to be seen to be doing something.

    The effect is that there never seems to exist a status quo in which you are doing your experiments with best possible practice and all possible precautions - every time you refine successfully, they seek the next refinement. Refinement in animal work is a process that has to have a logical endpoint - you can't do experiments with a monkey if he's in a forest in Malaysia - but there is never a question of agreeing an endpoint at which the regulators will be happy that the best possible is being done, and so if standards are maintained, the research can continue unencumbered by further changes. My view before I left was that the regulation in the UK was getting close to the move from pushing changes that are positive for the animals (btw many refinements of the last 20 years are excellent, there is no doubt) to ones that are neutral for the animals but obstructive to the researchers. More recent changes seemed to be only driven by the need to continue to make researchers refine.

    3. I don't have an equivalent of this effect, but I do note that the presence of the UK system appears to have heavily influenced the Europe-wide changes that are going to arrive in the next few years.

    4. Solutions: In animal research we have a sort of driving licence - the Home Office issues personal licences to researchers after completion of a course and exam. I suppose it is possible that this saves us some of the burden you have described. We also have numerous (and often spurious) attempts to apply cost-benefit-like structures to the research. I'm afraid it doesn't seem to reduce the rate at which regulation increases.

    ReplyDelete
  4. Brilliant analysis! Thanks for sharing this.

    ReplyDelete
  5. Sounds like Robert Higg's "ratchet effect" from "Crisis & Leviathan".

    You might want to check out Robin Hanson's post Against IRBs.

    ReplyDelete
  6. I was very pleased to hear that the UK government has responded positively to the report by Academy of Medical Sciences, and life may improve for researchers as a consequence, see budget statement:
    http://www.acmedsci.ac.uk/index.php?pid=118&pressid=78
    TGGP: many thanks for pointing me to those sources. Lovely thing about blogging is getting put in touch with other relevant views you'd not normally come across. Yeah!

    ReplyDelete
  7. This is a wonderful summary Dorothy! I have been increasingly frustrated with people's apparent confusion between deciding what is ethical and anticipating every possible undesired outcome (no matter how low the probability).

    A gem from one ethics committee meeting I attended to discuss my research: a committee member queried whether I should be allowed to conduct the study as I could not be sure of my findings in advance...

    I would like to use this blog as a discussion opener with students and fellow researchers at UCL if you are happy with that.

    ReplyDelete
  8. Every country has its own regulations, laws and regulatory bodies or agencies governing the manufacturing, sales, marketing and distribution of products within the country.

    ReplyDelete
  9. I am interested about the book of Rebecca Skloot’s book, ‘The Immortal Life of Henrietta Lacks’ and Dominic Streatfeild’s. That there are terrible examples of studies where research participants were infected, hurt or humiliated without realising what was happening or giving their consent. I am excited to read this book..

    ReplyDelete
  10. I'm currently suffering through the excruciating process of NHS ethics approval, with additional complications that I'm performing UCL research in a GSK laboratory. This is my first time encountering this kind of bureaucracy and I've just been astonished at how long it's taken - I'm 9 months in and still haven't submitted to a REC yet. Horrendous. Thankfully I've found things to do for most of this time, but conceivably I could have been twiddling my thumbs for the last year or so - a stupendous and criminal waste of time.

    ReplyDelete
  11. Just found this excellent post which mirrors ny own brain-numbing experiences of NHS ethics and R&D. One could boil it down to a contrast between the philosophies of Hobbes and Locke.

    Hobbes: People are inherently bad and need tight regulation to prevent them doing ill

    Locke: People perform best if trusted, given resources and left to their own devices.

    Clearly Locke has won this celebrity deathmatch!

    ReplyDelete
  12. I meant Hobbes of course

    ReplyDelete
  13. This is just a quick note of thanks for all your support here to i-dealzone.com It's been a challenging year for many, however we've manage well and we could not have achieved that without our wonderful customers just like you.

    ReplyDelete
  14. I would like to use this blog as a discussion opener with students and fellow researchers at UCL if you are happy with that.
    we all know that every country has its own regulations, laws and Regulators bodies or agencies governing the manufacturing, sales, marketing and distribution of products within the country.

    ReplyDelete
  15. Love it! Thank you so much for sharing this one very helpful and peaceful info share by blogger, Love it Thanks again. - good clinical practice training

    ReplyDelete
  16. Uncertainty - So we need to conduct a randomised controlled trial: regulation vs no regulation with an end point of incidence of research harm

    ReplyDelete
    Replies
    1. Not sufficient. Need to consider other outcomes, esp those arising because research is just not done - and in some cases people leave the field altogether. Hard to quantify.

      Delete