There is no RationalWiki without you. We are a small non-profit with no staff — we are hundreds of volunteers who document pseudoscience and crankery around the world every day. We will never allow ads because we must remain independent. We cannot rely on big donors with corresponding big agendas. We are not the largest website around, but we believe we play an important role in defending truth and objectivity.
If everyone seeing this today donates $5, we will meet our goal for 2018.
| Fighting pseudoscience isn't free.|
We are 100% user-supported! Help and donate $5, $20 or whatever you can today with !
Randomized controlled trial
| The poetry of reality|
|Extraordinary claims with|
|Hot from the|
A randomized controlled trial (RCT) is a type of study that tries to evaluate a particular treatment or intervention, usually in a medical field. It is considered the most powerful and convincing form of evidence in medicine because of the number of variables that can be controlled.
A basic RCT requires that a group of people be split randomly into two groups. One group receives the treatment under scrutiny, the other receives a suitable control. The performance of the two groups is then compared to see if the new idea is worth adopting on a wider scale. This isn't a new idea, a similar non-randomized method was described in the Bible and is dated to around 600 BCE. However, it is only relatively recently that the idea has been applied to medicine.
RCTs provide a way to reduce various research biases as well as provide a comparison of outcomes in groups that differ only in the treatment received through three mechanisms: randomization, control, and blinding.
One of the main ways that bias can creep into a medical trial is by insufficient or lack of randomization. This is because doctors can, subconsciously or intentionally, influence which patient can go into which group. Researchers who are aware of the medical history of their patients may put the ones most likely to respond in the group to receive treatment, and those with a low probability of response in the control group. This will unfairly skew the results and make them less applicable to a wider scale. Even poor randomization schemes are vulnerable to bias when the next allocation can be guessed and the treatments are inadequately blinded.
Randomization's primary purpose is to assure that each arm has roughly the same mix of subjects, such that all imaginable confounders are equally balanced across the arms. In reality, a specific randomization may be imbalanced, even severely imbalanced, but, on average, it will be reasonably balanced.
While statistical methods exist to adjust for non-random allocation, non-randomized trials often show greater apparent efficacy than their randomized counterparts. This occurs for various reasons, but, among the most common is a degree of self-selection where those finding benefit in a particular group, enroll in or stay in that group. Others select themselves out. Imagine, for example, a non-randomized trial comparing parent's satisfaction of home schooling versus public schools. Could you predict the result ahead of time? Sure you can!
To just administer a group of people a treatment gives no useful data, such as with the fish oil "trials" to test if they improved the performance of school children. A simple RCT, therefore, splits its participants into two groups, "A" and "B." One is given a treatment and the other acts as a "control," that is, a group that where the outcome is known. Importantly, the control group isn't just given "nothing," as anything will usually do better than nothing. The control group is usually given a placebo, to determine if the clinical effects are real or due to the placebo effect. However, as many active drugs are likely to be better than placebos (as well as the ethics behind using placebos), the control group can also be given a medication that has a known effect. This option also provides the advantage of allowing a comparison between a current treatment and a new treatment, to see if a new treatment is worth adopting.
One of the more important aspects is blinding. This is where a patient is unaware if they are receiving a real treatment or a control treatment, thus preventing the placebo effect and early drop out from disappointed control group members. A group of patients who are told they are receiving a new treatment are likely to respond more positively to it, therefore it should be hidden from them. Similarly, the researchers themselves should be blinded. This prevents researchers from redoing or reinterpreting data to suit their interests, even when it isn't intentional or malicious. To be utterly complete, the blinding should not allow anyone to know that two people are in the same group (even if they don't know what that group is). When both patient and researcher are blinded, it is known as "double blind".
"Blinding", the term, is not without controversy, particularly in opthalmological studies, where the word "masking" is suggested as an alternative.
Proponents of alternative medicines often claim that RCTs are not good means of testing their wares. Within homeopathy, one claim is that the treatment process is extremely individualized and can't be carried out in a strict protocol. Instead, they advocate "pragmatic" trials wherein the treatment skips the typical step of proving efficacy and moves straight into effectiveness trials.
Alternately, objections to RCT may be because RCTs invariably show that alternative medicine isn't effective — indeed, if an alternative medicine is shown to be effective by RCT, it ceases to be "alternative" and merely becomes "medicine." There are numerous specific claims, from the claim that "there's more to life than evidence" to the idea that certain alternative medicines like homeopathy can't have proper placebos generated for them. Given that even very theatrical placebo operations have been carried out to test the efficacy of key-hole surgery, there are clearly very few things where a suitable placebo cannot be devised.
Use outside medical research
Noted woo-exposer Dr. Ben Goldacre has argued that politicians ought to use randomised controlled trials for testing their policies. For example, a proposal to decrease class sizes in schools to increase educational performance, could be tested by dividing a group of schools into two subgroups at random. Dr. Goldacre has expressed frustration that politicians seem to think implementing a policy without any scientifically-gathered evidence behind it — or even in defiance of all the evidence — is perfectly fine.
Ironically, RCTs already have been used in developing countries in this way, but are generally politically "unthinkable" in developed countries.
Doing politics via experiments raises serious ethical issues. However, simply subjecting an entire population to a new policy on the basis that "my buddies in the think tank paid by multinational corporations assure me it's a very good idea, and we can sell it to the electorate in such a way that it polls tolerably well" arguably also raises serious ethical issues. Especially when those same corporations stand to benefit handsomely from the policy (regulatory capture) — but hey, how likely is that, right?
- Daniel 1:8-16 Take that, CP!
- i.e. across a lot of randomizations
- Peikes, Moreno, and Orzol 2008. Propensity Score Matching A Note of Caution for Evaluators of Social Programs
- Schultz and Altman 2007 Blinding is better than masking. Imagine recruiting for a double-blind eye surgery study!
- Banerjee Controlled Trials: Homeopathy in the UK and India
- Vandenbroucke 2008. Observational Research | Randomised Trials, and Two Views of Medical Science
- Current methods of the U.S. Preventive Services Task Force: A review of the process
- How can you tell if a policy is working? Run a trial.
- Haushofer and Shapiro 2013. Policy Brief: Impacts of Unconditional Cash Transfers