Simulate the Rose Garden Event
In the recent Wall Street Journal Article Use of Coronavirus Rapid Tests May Have Fueled White House Covid-19 Cluster, Experts Say there is a description of how the rapid test has been used in the White House.
“What seems to have been fundamentally misunderstood in all this was that they were using it almost like you would implement a metal detector,” said Ashish Jha, dean of Brown University’s School of Public Health.
All tests, including those processed in a lab, can produce false negatives, he and other experts say. Some studies have shown that the Abbott Now ID test, which can produce a result in minutes, has around a 91% sensitivity—meaning 9% of tests can produce false negatives.
Question 1
Suppose a test for COVID-19 has a 0.91 probability of positively (+) identifying the disease \(D\) when it is present. Suppose the test wrongly positively (+) identifies the disease \(D^c\) with probability 0.05 when the disease is not present. From statistical data it is known that 403.6 of 100,000 people in the population have the disease, so the prevalence of COVID-19 in the population is appoximately \(P(D) = 0.004\). Source: statista Further reading, Abbott defends rapid COVID-19 test with interim trial results and Abbott: ID NOW COVID-19 results more accurate with earlier testing, Abbott Statistian
An individual is randomly chosen from this population and is given the test. Calculate the probability that
- identify the sensitivity, specificity, and prevalence.
- the test is positive, \(P(+)\).
- the individual actually suffers from the disease \(D\) if the test turns out to be positive, \(P(D|+)\).
- the individual actually does not suffer from the disease \(D^c\) if the test turns out to be positive, \(P(D^c|+)\).
- Is the result for \(P(D^c|+)\) surprising? Explain.
- Change the values in the lie detector code to verify your calculations.
Answers:
### Conditional Probability Simulation
### Bayesian Probability
# lie detector
prev <- 0.004 # prevalence = P(D)
sens <- 0.91 # sensitivity = P(+|D)
spec <- 0.95 # specificity = 1 - P(+|D^c)
reps <- 10000
true.pos.test.pos <- 0 # counter for the test to catching a truly diseased person
test.pos <- 0 # counter for when the test person is positive
for(i in 1:reps){
# simulate a person has the disease or not
D <- 0
if(runif(1) < prev){
D <- 1
}
# if diseased simulate if test positive or not
if(D == 1 ){
if(runif(1) <= sens){
test.pos <- test.pos + 1
true.pos.test.pos <- true.pos.test.pos + 1
}
}
# if not diseased simulate if test positive or not
else{
if(runif(1) <= (1-spec)) test.pos <- test.pos + 1
}
}
# simulated probability
true.pos.test.pos/test.pos
Question 2
Build two beta prior distributions for the sensitivity \(P(+|D)\) of the rapid COVID-19 test, now being reported as 0.97.
Answers:
source("DBDA2E-utilities.R")
betaABfromMeanKappa( mean=0.95, kappa=1000 )
betaABfromMeanKappa( mean=0.91, kappa=1000 )
Plot the priors.
suppressMessages(library(tidyverse))
a1 <- 970; b1 <- 30
a2 <- 910; b2 <- 90
x <- seq(0, 1, 0.001)
beta_data <- tibble(
x = x,
prior1 = dbeta(x, a1, b1),
prior2 = dbeta(x, a2, b2)
)
beta_data_longer <- beta_data %>% pivot_longer( c("prior1", "prior2"),
names_to = "prior",
values_to = "y") %>%
group_by(prior)
beta_data_longer %>% ggplot( aes(x = x, y = y, color = prior)) + geom_line()
Question 3
In a recent New York Times article Rose Garden ceremony attendees who tested positive for coronavirus the image shows approximately 300 people in attendance.
Assume the individuals in attendance for a random sample of people from the population. Assuming each individual tool a rapid COVID-19 test before entering the event.
- If the test results were available for each individual, explain how the data can be viewed at 0 or 1 data.
- What probability model could be used with \(X_i\) the 0 and 1 data from each individual?
- What probability model could be used with \(X\) the sum of the number of people who test positive?
- Assuming the rapid test from Problem 1 above was used to test the individuals, use the \(P(+)\) from part a, simulate the number of positive people who were in attendance.
- From the Washington Post article there were 9 people listed who has tested positive, but it also mentions 11 people who are photographers or reports also tested positive. Is 20 people testing positive consistent with with the simulations?
Answers:
library(ggplot2)
n <- 300
prob_pi <- 0.05
B <- 10000
x <- rbinom(B, n, prob_pi)
x_df <- tibble(simulation ,= 1:B, x = x)
x_df %>% ggplot(aes(x = x)) + geom_histogram(binwidth = 1)
mean(x)
sd(x)
median(x)
LS0tCnRpdGxlOiAiU3RhdC4gNDgxIFJvc2UgR2FyZGVuIEV2ZW50IC0gUXVpeiIKYXV0aG9yOiAiUHJvZi4gU3Vlc3MiCmRhdGU6ICJPY3RvYmVyIDksIDIwMjAiCm91dHB1dDoKICBwZGZfZG9jdW1lbnQ6IGRlZmF1bHQKICBodG1sX25vdGVib29rOiBkZWZhdWx0CiAgd29yZF9kb2N1bWVudDogZGVmYXVsdAotLS0KCiMjIyBTaW11bGF0ZSB0aGUgUm9zZSBHYXJkZW4gRXZlbnQKCkluIHRoZSByZWNlbnQgV2FsbCBTdHJlZXQgSm91cm5hbCBBcnRpY2xlIFtVc2Ugb2YgQ29yb25hdmlydXMgUmFwaWQgVGVzdHMgTWF5IEhhdmUgRnVlbGVkIFdoaXRlIEhvdXNlIENvdmlkLTE5IENsdXN0ZXIsIEV4cGVydHMgU2F5XShodHRwczovL3d3dy53c2ouY29tL2FydGljbGVzL3VzZS1vZi1jb3JvbmF2aXJ1cy1yYXBpZC10ZXN0cy1tYXktaGF2ZS1mdWVsZWQtd2hpdGUtaG91c2UtY292aWQtMTktY2x1c3Rlci1leHBlcnRzLXNheS0xMTYwMTg1NTY2NSkgdGhlcmUgaXMgYSBkZXNjcmlwdGlvbiBvZiBob3cgdGhlIHJhcGlkIHRlc3QgaGFzIGJlZW4gdXNlZCBpbiB0aGUgV2hpdGUgSG91c2UuCgo+ICJXaGF0IHNlZW1zIHRvIGhhdmUgYmVlbiBmdW5kYW1lbnRhbGx5IG1pc3VuZGVyc3Rvb2QgaW4gYWxsIHRoaXMgd2FzIHRoYXQgCj4gdGhleSB3ZXJlIHVzaW5nIGl0IGFsbW9zdCBsaWtlIHlvdSB3b3VsZCBpbXBsZW1lbnQgYSBtZXRhbCBkZXRlY3RvciwiIAo+IHNhaWQgQXNoaXNoIEpoYSwgZGVhbiBvZiBCcm93biBVbml2ZXJzaXR54oCZcyBTY2hvb2wgb2YgUHVibGljIEhlYWx0aC4KPgo+IEFsbCB0ZXN0cywgaW5jbHVkaW5nIHRob3NlIHByb2Nlc3NlZCBpbiBhIGxhYiwgY2FuIHByb2R1Y2UgZmFsc2UgCj4gbmVnYXRpdmVzLCBoZSBhbmQgb3RoZXIgZXhwZXJ0cyBzYXkuIFNvbWUgc3R1ZGllcyBoYXZlIHNob3duIHRoYXQgdGhlIAo+IEFiYm90dCBOb3cgSUQgdGVzdCwgd2hpY2ggY2FuIHByb2R1Y2UgYSByZXN1bHQgaW4gbWludXRlcywgaGFzIGFyb3VuZCBhIAo+IDkxJSBzZW5zaXRpdml0eeKAlG1lYW5pbmcgOSUgb2YgdGVzdHMgY2FuIHByb2R1Y2UgZmFsc2UgbmVnYXRpdmVzLgoKIyMjIFF1ZXN0aW9uIDEKClN1cHBvc2UgYSB0ZXN0IGZvciBDT1ZJRC0xOSBoYXMgYSAwLjkxIHByb2JhYmlsaXR5IG9mIHBvc2l0aXZlbHkgKCspIGlkZW50aWZ5aW5nIHRoZSBkaXNlYXNlICREJCB3aGVuIGl0IGlzIHByZXNlbnQuIFN1cHBvc2UgdGhlIHRlc3Qgd3JvbmdseSBwb3NpdGl2ZWx5ICgrKSBpZGVudGlmaWVzIHRoZSBkaXNlYXNlICREXmMkIHdpdGggcHJvYmFiaWxpdHkgMC4wNSB3aGVuIHRoZSBkaXNlYXNlIGlzIG5vdCBwcmVzZW50LiBGcm9tIHN0YXRpc3RpY2FsIGRhdGEgaXQgaXMga25vd24gdGhhdCA0MDMuNiBvZiAxMDAsMDAwIHBlb3BsZSBpbiB0aGUgcG9wdWxhdGlvbiBoYXZlIHRoZSBkaXNlYXNlLCBzbyB0aGUgcHJldmFsZW5jZSBvZiBDT1ZJRC0xOSBpbiB0aGUgcG9wdWxhdGlvbiBpcyBhcHBveGltYXRlbHkgJFAoRCkgPSAwLjAwNCQuIFNvdXJjZToKW3N0YXRpc3RhXShodHRwczovL3d3dy5zdGF0aXN0YS5jb20vc3RhdGlzdGljcy8xMTEyOTkzL2NvdmlkLTE5LWluY2lkZW5jZS1yYXRlLXVzLWJ5LWFnZS8pICBGdXJ0aGVyIHJlYWRpbmcsIFtBYmJvdHQgZGVmZW5kcyByYXBpZCBDT1ZJRC0xOSB0ZXN0IHdpdGggaW50ZXJpbSB0cmlhbCByZXN1bHRzXShodHRwczovL3d3dy5tYXNzZGV2aWNlLmNvbS9hYmJvdHQtZGVmZW5kcy1yYXBpZC1jb3ZpZC0xOS10ZXN0LXdpdGgtaW50ZXJpbS10cmlhbC1yZXN1bHRzLykgYW5kIFtBYmJvdHQ6IElEIE5PVyBDT1ZJRC0xOSByZXN1bHRzIG1vcmUgYWNjdXJhdGUgd2l0aCBlYXJsaWVyIHRlc3RpbmddKGh0dHBzOi8vd3d3Lm1hc3NkZXZpY2UuY29tL2FiYm90dC1pZC1ub3ctY292aWQtMTktcmVzdWx0cy1tb3JlLWFjY3VyYXRlLXdpdGgtZWFybGllci10ZXN0aW5nLyksCltBYmJvdHQgU3RhdGlzdGlhbl0oaHR0cHM6Ly9nLmNvL2tncy9FRVBTRVUpCgpBbiBpbmRpdmlkdWFsIGlzIHJhbmRvbWx5IGNob3NlbiBmcm9tIHRoaXMgcG9wdWxhdGlvbiBhbmQgaXMgZ2l2ZW4KdGhlIHRlc3QuIENhbGN1bGF0ZSB0aGUgcHJvYmFiaWxpdHkgdGhhdAoKKGEpIGlkZW50aWZ5IHRoZSBzZW5zaXRpdml0eSwgc3BlY2lmaWNpdHksIGFuZCBwcmV2YWxlbmNlLgooYikgdGhlIHRlc3QgaXMgcG9zaXRpdmUsICRQKCspJC4KKGMpIHRoZSBpbmRpdmlkdWFsIGFjdHVhbGx5IHN1ZmZlcnMgZnJvbSB0aGUgZGlzZWFzZSAkRCQgaWYgdGhlIHRlc3QgdHVybnMgb3V0IHRvIGJlIHBvc2l0aXZlLCAkUChEfCspJC4KKGQpIHRoZSBpbmRpdmlkdWFsIGFjdHVhbGx5IGRvZXMgbm90IHN1ZmZlciBmcm9tIHRoZSBkaXNlYXNlICREXmMkIGlmIHRoZSB0ZXN0IHR1cm5zIG91dCB0byBiZSBwb3NpdGl2ZSwgJFAoRF5jfCspJC4KKGUpIElzIHRoZSByZXN1bHQgZm9yICRQKEReY3wrKSQgc3VycHJpc2luZz8gRXhwbGFpbi4KKGYpIENoYW5nZSB0aGUgdmFsdWVzIGluIHRoZSBsaWUgZGV0ZWN0b3IgY29kZSB0byB2ZXJpZnkgeW91ciBjYWxjdWxhdGlvbnMuCgoqKkFuc3dlcnM6KioKCmBgYHtyfQojIyMgQ29uZGl0aW9uYWwgUHJvYmFiaWxpdHkgU2ltdWxhdGlvbgojIyMgQmF5ZXNpYW4gUHJvYmFiaWxpdHkKCiMgbGllIGRldGVjdG9yCgpwcmV2IDwtIDAuMDA0CSMgcHJldmFsZW5jZSA9IFAoRCkKc2VucyA8LSAwLjkxCSMgc2Vuc2l0aXZpdHkgPSBQKCt8RCkKc3BlYyA8LSAwLjk1CQkjIHNwZWNpZmljaXR5ID0gMSAtIFAoK3xEXmMpCgpyZXBzIDwtIDEwMDAwCgp0cnVlLnBvcy50ZXN0LnBvcyA8LSAwCSMgY291bnRlciBmb3IgdGhlIHRlc3QgdG8gY2F0Y2hpbmcgYSB0cnVseSBkaXNlYXNlZCBwZXJzb24KdGVzdC5wb3MgPC0gMAkJICAgICAgICAjIGNvdW50ZXIgZm9yIHdoZW4gdGhlIHRlc3QgcGVyc29uIGlzIHBvc2l0aXZlCgpmb3IoaSBpbiAxOnJlcHMpewoJIyBzaW11bGF0ZSBhIHBlcnNvbiBoYXMgdGhlIGRpc2Vhc2Ugb3Igbm90CglEIDwtIDAKCWlmKHJ1bmlmKDEpIDwgcHJldil7CgkJRCA8LSAxCgl9CgkjIGlmIGRpc2Vhc2VkIHNpbXVsYXRlIGlmIHRlc3QgcG9zaXRpdmUgb3Igbm90CglpZihEID09IDEgKXsKCQlpZihydW5pZigxKSA8PSBzZW5zKXsKCQkJdGVzdC5wb3MgPC0gdGVzdC5wb3MgKyAxCgkJCXRydWUucG9zLnRlc3QucG9zIDwtIHRydWUucG9zLnRlc3QucG9zICsgMQoJCX0KCX0KCSMgaWYgbm90IGRpc2Vhc2VkIHNpbXVsYXRlIGlmIHRlc3QgcG9zaXRpdmUgb3Igbm90CgllbHNlewoJCWlmKHJ1bmlmKDEpIDw9ICgxLXNwZWMpKSB0ZXN0LnBvcyA8LSB0ZXN0LnBvcyArIDEKCX0KfQoKIyBzaW11bGF0ZWQgcHJvYmFiaWxpdHkKCnRydWUucG9zLnRlc3QucG9zL3Rlc3QucG9zCmBgYAoKIyMjIFF1ZXN0aW9uIDIKCkJ1aWxkIHR3byBiZXRhIHByaW9yIGRpc3RyaWJ1dGlvbnMgZm9yIHRoZSBzZW5zaXRpdml0eSAkUCgrfEQpJCAgb2YgdGhlIHJhcGlkIENPVklELTE5IHRlc3QsIG5vdyBiZWluZyByZXBvcnRlZCBhcyAwLjk3LiAgCgoqKkFuc3dlcnM6KioKCmBgYHtyfQpzb3VyY2UoIkRCREEyRS11dGlsaXRpZXMuUiIpIApgYGAKYGBge3J9CmJldGFBQmZyb21NZWFuS2FwcGEoIG1lYW49MC45NSwga2FwcGE9MTAwMCApCmBgYAoKYGBge3J9CmJldGFBQmZyb21NZWFuS2FwcGEoIG1lYW49MC45MSwga2FwcGE9MTAwMCApCmBgYAoKClBsb3QgdGhlIHByaW9ycy4KCmBgYHtyfQpzdXBwcmVzc01lc3NhZ2VzKGxpYnJhcnkodGlkeXZlcnNlKSkKCmExIDwtIDk3MDsgYjEgPC0gMzAKYTIgPC0gOTEwOyBiMiA8LSA5MAoKeCA8LSBzZXEoMCwgMSwgMC4wMDEpCgpiZXRhX2RhdGEgPC0gdGliYmxlKCAKICB4ID0geCwgCiAgcHJpb3IxID0gZGJldGEoeCwgYTEsIGIxKSwKICBwcmlvcjIgPSBkYmV0YSh4LCBhMiwgYjIpCikKCmJldGFfZGF0YV9sb25nZXIgPC0gYmV0YV9kYXRhICU+JSBwaXZvdF9sb25nZXIoIGMoInByaW9yMSIsICJwcmlvcjIiKSwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBuYW1lc190byA9ICJwcmlvciIsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgdmFsdWVzX3RvID0gInkiKSAlPiUKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZ3JvdXBfYnkocHJpb3IpCgpiZXRhX2RhdGFfbG9uZ2VyICU+JSBnZ3Bsb3QoIGFlcyh4ID0geCwgeSA9IHksIGNvbG9yID0gcHJpb3IpKSArIGdlb21fbGluZSgpCmBgYAoKCiMjIyBRdWVzdGlvbiAzCgpJbiBhIHJlY2VudCBOZXcgWW9yayBUaW1lcyBhcnRpY2xlIFtSb3NlIEdhcmRlbiBjZXJlbW9ueSBhdHRlbmRlZXMgd2hvCnRlc3RlZCBwb3NpdGl2ZSBmb3IgY29yb25hdmlydXNdKGh0dHBzOi8vd3d3Lndhc2hpbmd0b25wb3N0LmNvbS9ncmFwaGljcy8yMDIwL3BvbGl0aWNzL2Nvcm9uYXZpcnVzLWF0dGVuZGVlcy1iYXJyZXR0LW5vbWluYXRpb24tY2VyZW1vbnkvKSB0aGUgaW1hZ2Ugc2hvd3MgYXBwcm94aW1hdGVseSAzMDAgcGVvcGxlIGluIGF0dGVuZGFuY2UuCgpBc3N1bWUgdGhlIGluZGl2aWR1YWxzIGluIGF0dGVuZGFuY2UgZm9yIGEgcmFuZG9tIHNhbXBsZSBvZiBwZW9wbGUgZnJvbSB0aGUgcG9wdWxhdGlvbi4gIEFzc3VtaW5nIGVhY2ggaW5kaXZpZHVhbCB0b29sIGEgcmFwaWQgQ09WSUQtMTkgdGVzdCBiZWZvcmUgZW50ZXJpbmcgdGhlIGV2ZW50LgoKKGEpIElmIHRoZSB0ZXN0IHJlc3VsdHMgd2VyZSBhdmFpbGFibGUgZm9yIGVhY2ggaW5kaXZpZHVhbCwgZXhwbGFpbiBob3cgdGhlIGRhdGEgY2FuIGJlIHZpZXdlZCBhdCAwIG9yIDEgZGF0YS4KKGIpIFdoYXQgcHJvYmFiaWxpdHkgbW9kZWwgY291bGQgYmUgdXNlZCB3aXRoICRYX2kkIHRoZSAwIGFuZCAxIGRhdGEgZnJvbSBlYWNoIGluZGl2aWR1YWw/CihjKSBXaGF0IHByb2JhYmlsaXR5IG1vZGVsIGNvdWxkIGJlIHVzZWQgd2l0aCAkWCQgdGhlIHN1bSBvZiB0aGUgbnVtYmVyIG9mIHBlb3BsZSB3aG8gdGVzdCBwb3NpdGl2ZT8KKGQpIEFzc3VtaW5nIHRoZSByYXBpZCB0ZXN0IGZyb20gUHJvYmxlbSAxIGFib3ZlIHdhcyB1c2VkIHRvIHRlc3QgdGhlIGluZGl2aWR1YWxzLCB1c2UgdGhlICRQKCspJCBmcm9tIHBhcnQgYSwgc2ltdWxhdGUgdGhlIG51bWJlciBvZiBwb3NpdGl2ZSBwZW9wbGUgd2hvIHdlcmUgaW4gYXR0ZW5kYW5jZS4KKGUpIEZyb20gdGhlIFdhc2hpbmd0b24gUG9zdCBhcnRpY2xlIHRoZXJlIHdlcmUgOSBwZW9wbGUgbGlzdGVkIHdobyBoYXMgdGVzdGVkIHBvc2l0aXZlLCBidXQgaXQgYWxzbyBtZW50aW9ucyAxMSBwZW9wbGUgd2hvIGFyZSBwaG90b2dyYXBoZXJzIG9yIHJlcG9ydHMgYWxzbyB0ZXN0ZWQgcG9zaXRpdmUuICBJcyAyMCBwZW9wbGUgdGVzdGluZyBwb3NpdGl2ZSBjb25zaXN0ZW50IHdpdGggd2l0aCB0aGUgc2ltdWxhdGlvbnM/CgoqKkFuc3dlcnM6KioKCmBgYHtyfQpsaWJyYXJ5KGdncGxvdDIpCgpuIDwtIDMwMApwcm9iX3BpIDwtIDAuMDUKCkIgPC0gMTAwMDAKCnggPC0gcmJpbm9tKEIsIG4sIHByb2JfcGkpCgp4X2RmIDwtIHRpYmJsZShzaW11bGF0aW9uICw9IDE6QiwgeCA9IHgpCgp4X2RmICU+JSBnZ3Bsb3QoYWVzKHggPSB4KSkgKyBnZW9tX2hpc3RvZ3JhbShiaW53aWR0aCA9IDEpCmBgYAoKYGBge3J9Cm1lYW4oeCkKc2QoeCkKbWVkaWFuKHgpCmBgYAoKCg==