Skip to content

Commit 10d1e2b

Browse files
committed
Version 1.0.2.
Update Vignette: add URL to the TBR white paper; include details on experiment periods.
1 parent 59dd157 commit 10d1e2b

6 files changed

+40
-17
lines changed

ChangeLog

+4
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,7 @@
1+
2017-04-04: Google <[email protected]>
2+
* Version 1.0.2
3+
* Update Vignette: add URL to the TBR white paper.
4+
* Update Vignette: include details on experiment periods.
15
2017-03-22: Google <[email protected]>
26
* Version 1.0.1
37
* Update GBR weighting scheme.

DESCRIPTION

+2-2
Original file line numberDiff line numberDiff line change
@@ -15,8 +15,8 @@ Suggests:
1515
testthat (>= 0.10.0),
1616
knitr (>= 1.12.3)
1717
VignetteBuilder: knitr
18-
Date: 2017-03-23
19-
Version: 1.0.1
18+
Date: 2017-04-04
19+
Version: 1.0.2
2020
License: Apache License 2.0 | file LICENSE
2121
Copyright: Copyright (C) 2017 Google, Inc.
2222
RoxygenNote: 5.0.1

README.md

+6-5
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
# R package GeoexperimentsResearch version 1.0.1
1+
# R package GeoexperimentsResearch version 1.0.2
22

33
Copyright (C) 2017 Google, Inc.
44
License: Apache 2.0
@@ -25,8 +25,9 @@ in the source package).
2525

2626
## References
2727

28-
[1] Vaver, J. and Koehler, J.
29-
[Measuring Ad Effectiveness Using Geo Experiments](http://static.googleusercontent.com/media/research.google.com/en//pubs/archive/38355.pdf) 2011.
28+
[1] Vaver, J. and Koehler, J. (2011)
29+
[Measuring Ad Effectiveness Using Geo Experiments](http://static.googleusercontent.com/media/research.google.com/en//pubs/archive/38355.pdf).
30+
31+
[2] Kerman, J., Wang, P. and Vaver, J. (2017)
32+
[Estimating Ad Effectiveness Using Geo Experiments in a Time-Based Regression Framework](https://research.google.com/pubs/pub45950.html).
3033

31-
[2] Kerman, J., Wang, P. and Vaver, J.
32-
Estimating Ad Effectiveness Using Geo Experiments in a Time-Based Regression Framework. 2017.
-2 Bytes
Binary file not shown.
984 Bytes
Binary file not shown.

vignettes/GeoexperimentsResearch-vignette.Rmd

+28-10
Original file line numberDiff line numberDiff line change
@@ -116,8 +116,9 @@ By convention, we number the periods as 0 (Pretest), 1 (Intervention), 2
116116
(Cooldown), but other numbering is allowed provided that the order of the
117117
periods is unchanged.
118118

119-
This information is represented by the *ExperimentPeriods* object class.
120-
119+
This information is represented by the *ExperimentPeriods* object class. The
120+
start dates of each period must be specified, and finally end date of the
121+
experiment. This example has only a pretest period and one intervention period:
121122
```{r message=TRUE, echo=FALSE}
122123
print(ExperimentPeriods(c("2015-01-05", "2015-02-16", "2015-03-15")))
123124
```
@@ -225,8 +226,9 @@ To plot the time series, use the plot method:
225226
plot(obj.gts)
226227
```
227228

228-
For more information of the method, type `?plot.GeoTimeseries`
229-
at the R prompt.
229+
To hide the legend, add `legend=FALSE`. To plot the time series on log scale,
230+
add `log.scale=TRUE`. For more information of the method, type
231+
`?plot.GeoTimeseries` at the R prompt.
230232

231233
## Experiment Periods
232234

@@ -239,6 +241,10 @@ total).
239241
obj.per <- ExperimentPeriods(c("2015-01-05", "2015-02-16", "2015-03-15"))
240242
obj.per
241243
```
244+
To introduce a cooldown period, we would specify one more date.
245+
246+
To learn more about the function, type `?ExperimentPeriods` at the R prompt.
247+
242248

243249
## Geo Assignment
244250

@@ -307,6 +313,10 @@ represents the cost, along with the experiment periods and group numbers.
307313
result
308314
```
309315

316+
Note that in this particular case, there is no `cooldown.period`, hence it is
317+
set to `NULL`. If there was one, we would specify the period number (for
318+
example, `cooldown.period=2`).
319+
310320
The resulting object (a *GBRROASAnalysisFit* object) contains the model fit:
311321
when printed, it shows its summary, which defaults to 90 percent credible
312322
intervals. To recalculate the interval with a different credibility level, we
@@ -413,16 +423,25 @@ bound and the point estimate). We refer to this confidence interval half-width
413423
by _precision_ (which gets better as the confidence interval gets shorter).
414424

415425
The function *DoROASPreanalysis* predicts the precision of the iROAS estimate
416-
based on historical data provided. It simulates experiments with given period
417-
lengths and records the precision from each simulated experiment. We can then
418-
use the *summary* method to compute the precision given an ad spend change, or
419-
find the ad spend change associated with a given precision.
426+
based on historical data provided. It simulates experiments (by resampling) with
427+
given period lengths and records the precision from each simulated
428+
experiment. We can then use the *summary* method to compute the precision given
429+
an ad spend change, or find the ad spend change associated with a given
430+
precision.
431+
432+
For each simulated geo experiment data set, ROAS and its precision is estimated.
433+
The process yields a distribution of the these estimates of precision. The
434+
summary method takes the empirical median as the point estimate. If the data
435+
set does not have strong seasonalities, the variation of this estimate should be
436+
fairly small.
420437

421438
The process runs as follows:
422439

423440
1. Assign geos to treatment groups.
424441
1. Run preanalysis to predict the precision.
425442

443+
444+
426445
## A randomized geo assignment
427446

428447
Randomized geo assignments can be done using `GeoStrata' objects. This object
@@ -501,8 +520,7 @@ assignment, the results are likely to be different.
501520
[Measuring Ad Effectiveness Using Geo Experiments](http://static.googleusercontent.com/media/research.google.com/en//pubs/archive/38355.pdf)
502521

503522
[3] Kerman, J. and Wang, P., and Vaver, J. (2017)
504-
Estimating Ad Effectiveness using Geo Experiments in a
505-
Time-Based Regression Framework.
523+
[Estimating Ad Effectiveness using Geo Experiments in a Time-Based Regression Framework](https://research.google.com/pubs/pub45950.html)
506524

507525
# Disclaimer
508526
This software is not an official Google product. For research purposes only. Copyright 2017 Google, Inc.

0 commit comments

Comments
 (0)