In the blog post on correlations, I ended with the well-known mantra: "correlation does not imply causation". Most of empirical science has been focussing on the correlations, because determining causation is hard. However, Pearl & Mackenzie (2006) urges scientists to search for mechanisms, because it "is critical for science, as well as to everyday life, because different mechanisms call for different actions when circumstances change". For example, we know that a lack of Vitamin C causes us to get scurvy, or not. We can depict this as Vitamin C scurvy. Knowing this is very important, because without it we might think that bananas can cure scurvy (Pearl & Mackenzie (2006)) and send a trade ship on its way with bananas instead of oranges. Alternatively, we could have found that ships with strawberries don't get scurvy (strawberries contain Vitamin C) and conclude that all red fruits can cure scurvy.
So, it is important to know the exact cause of things to make good decisions. One of the easiest ways to determine cause and effect is via doing an intervention, denoted by the do-operator (Pearl (2009)). Looking back on the scurvy example, it can be rewritten as follows: let Vitamin C be denoted by (the cause) and scurvy be denoted by (the effect). Then, we test whether scurvy is caused by a lack of Vitamin C by figuring out . This do-operator means that you would do an experiment where you change and only and then measure the effect on . The "and only" part is important and can be obtained by doing a randomized controlled trial. The idea of such a trial is to take two completely random subsets of your sample. Then, for you subset you change and for the other subset you do not change . Apart from , you don't try to change anything, so in medical settings the doctors are not even allowed who gets the medication since that could affect . (See the story of Clever Hans for an example where observers affect the outcome by accident.) If done correctly, a randomized trial removes the incoming causal arrows. For example, without using randomization, it could be that the patients who get the medicin are actually cured by swimming in the sea . We can depict this in a causal graph as
(Thanks to Kumor (2018) for code examples of these graphs.) If the randomization is representative of the whole population and executed correctly, then we can say that the graph changed to
which assumes that the two subsets are not fundamentally different. Unfortunately, it is often not possible to apply a randomized trial since it could be too expensive, too time consuming or unethical. For instance, it is a bad plan to to split a group in half and force one half of the group to smoke while tracking the group for 40 years to see whether smoking causes cancer. Luckily, solutions exist to determine causation from observations alone (Bollen & Pearl (2013)). Even better, Bareinboim & Pearl (2016) summarizes how data from observational studies can be combined with randomized trials to find cause and effect; this can be useful to learn a causal effect about one population and apply it to another population. This problem is similar to meta-analyses. However, meta-analyses typically "'[average] out' differences (e.g., using inverse-variance weighting), which, in general, tends to blur, rather than exploit design distinctions among the available studies" (Bareinboim & Pearl (2016)). For a longer discussion about the lack of effectiveness of meta-analyses, see de Vrieze (2018).
In this blog post, my aim is to look at some examples of combining observational and randomized controlled trail data in an attempt to figure out how and when it can be applied.
Thanks to the do-calculus presented by (Pearl (2009)), we can rewrite our graph without thinking. (By that, I mean that the calculus allows you to easily verify equivalences like for any and .) For arbitrary disjoint sets of nodes and in a causal DAG , with and denoting the graph obtained by, respectively, deleting all arrows pointing to and emerging from nodes in , we have (Bareinboim & Pearl (2016))
Rule 1 (insertion/deletion of observations):
Rule 2 (action/observation exchange):
Rule 3 (insertion/deletion of actions):
Scientific results are meant to be used across different populations. This, according to Pearl & Bareinboim (2014), is called transportability. Specifically, it is about transfering causal effects from experimental studies to observational studies. Here, I will mostly copy the example of (Bareinboim & Pearl (2016)) and add some clarifications at the steps which I find unclear. Consider an experimental source and an observational target population. The variables are treatment , outcome , age and a set of unaccounted factors .
The unaccounted factors create differences in age between and . These unaccounted factors are unknown, but it is known that they cause the differences in age between and ; that is why is denoted with a black box in the graph. Note that this means that the graph is an overlapping of the graph of the source and target population. Now, the query can be rewritten to (Bareinboim & Pearl (2016))
This is called a transport formula, because it explains "how experimental findings in are transported over to ; the first factor is estimable from and the second one from " (Bareinboim & Pearl (2016)).
Bareinboim & Pearl. (2016). Causal inference and the data-fusion problem. https://doi.org/10.1073/pnas.1510507113.
Bollen & Pearl. (2013). Eight Myths About Causality and Structural Equation Models. https://doi.org/10.1007/978-94-007-6094-3_15.
Kumor, D. (2018). Causal Graphs in LaTeX. https://dkumor.com/posts/technical/2018/08/15/causal-tikz/.
Pearl, J. (2009). Causality. Cambridge university press. https://doi.org/10.1017/CBO9780511803161.
Pearl & Bareinboim. (2014). External Validity: From Do-Calculus to Transportability Across Populations. Statistical Science. https://doi.org/10.1214/14-STS486. Pearl, J., & Mackenzie, D. (2018). The book of why: the new science of cause and effect. Basic Books.
de Vrieze, J. (2018, September 18). Meta-analyses were supposed to end scientific debates. Often, they only cause more controversy. Science Magazine. https://www.sciencemag.org/news/2018/09/meta-analyses-were-supposed-end-scientific-debates-often-they-only-cause-more. Accessed on 2020-11-01.