To install and load the package:
install.packages("cosa")
library(cosa)A limited version of BCOSSA is implemented in the shiny app (e.g.,
equal cost, fixed p), along with power and MDES functions.
Live shiny app at:
https://cosa.shinyapps.io/index/
cosa implements bound constrained optimal sample
size allocation (BCOSSA) framework described in Bulus & Dong (2021)
for multilevel regression discontinuity designs (MRDDs) and multilevel
randomized trials (MRTs) with continuous outcomes. It also includes
functions to compute power rate or minimum detectable effect size.
BCOSSA functions are designed to optimize proportion of treatment
allocation (p) and sample size (generically,
n) at one or more levels subject to budget, statistical
power, or effect size constraints along with constraints on
n and p. Constraints on n and
p can be in the form of fixed values or bound constraints
(aka box constraints).
Specifying order = 0 or rhots = 0 produces
result equivalent to the corresponding random assignment design where
also p can be optimized. rhots = 0 means there
is no relationship between the treatment [random] and the score
variable, or order = 0 means no score variable is included
in the correctly specified model, therefore it is equavalent to random
assignment designs. For regression discontinuity at the cluster level,
Bulus (2021) derived expressions assuming that a score variable may take
a linear form (order = 1 &
interaction = FALSE), linear form interacting with the
treatment indicator (order = 0 &
interaction = TRUE), quadratic form (order = 2
& interaction = FALSE), or quadratic form interacting
with the treatment indicator (order = 2 &
interaction = TRUE).
Note: n and p should be omitted (or
specified as NULL) for optimization. At the moment,
p can only be optimized (or bound constrained) in MRTs when
treatment and control units have differing costs. When primary
constraint is placed on a power rate or an effect size, providing
marginal cost information will produce a cost-efficient sample
allocation. When marginal cost information is not provided and two or
more parameters are optimized, different starting values and algorithms
may produce different results because the design is not uniquely
identified. In such cases, by default, constraint p = .50
is placed for MRTs. Comparing several algorithms and trying different
starting values may faciliate decisions regarding sample sizes and
p in such cases. One way is to set starting values at the
expected values, or specify bounds such that they cover expected
values.
# linear form interacting with the treatment
score.obj <- inspect.score(rnorm(1000), cutoff = 0,
order = 1, interaction = TRUE)
## single site (no blocks)
power.crd2(score.obj,
es = .25, rho2 = .20, g2 = 0, r22 = 0,
n1 = 50, n2 = 15)
## multiple sites (10 blocks)
## note that r22 > 0 due to explanatory power of indiciator variables for sites
power.bcrd3f2(score.obj,
es = .25, rho2 = .20, g2 = 0, r22 = .30,
n1 = 50, n2 = 15, n3 = 10)
## minimum required number of level 2 units per site
cosa.bcrd3f2(score.obj,
rho2 = .20, g2 = 0, r22 = .30,
n1 = 50, n2 = NULL, n3 = 10)
# quadratic form interacting with the treatment
score.obj2 <- inspect.score(rnorm(1000), cutoff = 0,
order = 2, interaction = TRUE)
## minimum required number of level 2 units per site
cosa.bcrd3f2(score.obj2,
order = 2, interaction = TRUE,
rho2 = .20, g2 = 0, r22 = .30,
n1 = 50, n2 = NULL, n3 = 10)Suggested citation:
Bulus, M. (2021). Minimum Detectable Effect Size Computations for Cluster-Level Regression Discontinuity: Specifications Beyond Linear Functional Form. Journal of Research on Educational Effectiveness. Advance online publication. https://doi.org/10.1080/19345747.2021.1947425
Bulus, M., & Dong, N. (2021). Bound Constrained Optimization of Sample Sizes Subject to Monetary Restrictions in Planning of Multilevel Randomized Trials and Regression Discontinuity Studies. The Journal of Experimental Education, 89(2), 379-401. https://doi.org/10.1080/00220973.2019.1636197
–o–