Skip to content

Commit 79320ed

Browse files
SvenKlaassenSvenKlaassen
committed
update did simulation
1 parent dbc092e commit 79320ed

File tree

8 files changed

+102
-100
lines changed

8 files changed

+102
-100
lines changed

‎results/did/did_multi_detailed.csv‎

Lines changed: 24 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -1,25 +1,25 @@
11
Learner g,Learner m,Score,In-sample-norm.,DGP,level,Coverage,CI Length,Bias,Uniform Coverage,Uniform CI Length,repetition
2-
Linear,Linear,experimental,False,1,0.9,0.8770833333333333,0.5957148258014461,0.15382974604923927,0.82,0.9277609206218338,200
3-
Linear,Linear,experimental,False,1,0.95,0.9329166666666667,0.709837996826105,0.15382974604923927,0.9,1.0183441020334203,200
4-
Linear,Linear,experimental,False,4,0.9,0.6683333333333333,1.9698836561519315,0.8284907405553992,0.525,2.863183256412114,200
5-
Linear,Linear,experimental,False,4,0.95,0.7670833333333333,2.347261152317584,0.8284907405553992,0.64,3.1905243140809945,200
6-
Linear,Linear,experimental,False,6,0.9,0.89375,2.012015821768593,0.4972286199594851,0.9,2.910046927597859,200
7-
Linear,Linear,experimental,False,6,0.95,0.9441666666666667,2.3974647241407983,0.4972286199594851,0.935,3.246758702976773,200
8-
Linear,Linear,experimental,True,1,0.9,0.8745833333333333,0.5956334541132615,0.1540676164908103,0.82,0.929071986266196,200
9-
Linear,Linear,experimental,True,1,0.95,0.9333333333333332,0.7097410364792451,0.1540676164908103,0.895,1.0214045871405517,200
10-
Linear,Linear,experimental,True,4,0.9,0.6695833333333333,1.9690878328880732,0.8280711666335188,0.515,2.8592795655154974,200
11-
Linear,Linear,experimental,True,4,0.95,0.7670833333333333,2.346312870409903,0.8280711666335188,0.645,3.184749486936283,200
12-
Linear,Linear,experimental,True,6,0.9,0.8954166666666667,2.012277261422281,0.4972240370172027,0.905,2.910046165626694,200
13-
Linear,Linear,experimental,True,6,0.95,0.9433333333333332,2.3977762487025966,0.4972240370172027,0.93,3.2443247059312212,200
14-
Linear,Linear,observational,False,1,0.9,0.89625,0.686900650227242,0.16556887731250863,0.905,1.0684577495769967,200
15-
Linear,Linear,observational,False,1,0.95,0.9441666666666667,0.8184926083044464,0.16556887731250863,0.93,1.1743444720583638,200
16-
Linear,Linear,observational,False,4,0.9,0.7866666666666667,3.124729480506762,0.9502826142586591,0.735,4.394633218514321,200
17-
Linear,Linear,observational,False,4,0.95,0.8541666666666667,3.7233448270862413,0.9502826142586591,0.8,4.923945197030173,200
18-
Linear,Linear,observational,False,6,0.9,0.8970833333333332,2.773055872422081,0.7355132665655921,0.915,3.9680250024995116,200
19-
Linear,Linear,observational,False,6,0.95,0.9541666666666667,3.304299876906268,0.7355132665655921,0.95,4.437925510709768,200
20-
Linear,Linear,observational,True,1,0.9,0.88875,0.6660387052074566,0.16288234355298709,0.875,1.03599720010251,200
21-
Linear,Linear,observational,True,1,0.95,0.9408333333333333,0.7936340675709367,0.16288234355298709,0.925,1.1385204090656658,200
22-
Linear,Linear,observational,True,4,0.9,0.7770833333333332,2.832512839406202,0.8935845118739927,0.72,4.034877974695546,200
23-
Linear,Linear,observational,True,4,0.95,0.8545833333333333,3.375147222839926,0.8935845118739927,0.78,4.5253801160151035,200
24-
Linear,Linear,observational,True,6,0.9,0.8975,2.5644621837469375,0.675326608841152,0.9,3.688249907793509,200
25-
Linear,Linear,observational,True,6,0.95,0.9470833333333333,3.055745166318817,0.675326608841152,0.94,4.115336505261702,200
2+
Linear,Linear,experimental,False,1,0.9,0.8813333333333334,0.5961686505266492,0.15102133299318632,0.834,0.9296789699097547,1000
3+
Linear,Linear,experimental,False,1,0.95,0.9350833333333334,0.7103787623398975,0.15102133299318632,0.908,1.0206042134000024,1000
4+
Linear,Linear,experimental,False,4,0.9,0.6619166666666666,1.986651429023609,0.8637379841284726,0.52,2.882026229739649,1000
5+
Linear,Linear,experimental,False,4,0.95,0.7520833333333333,2.3672411860366602,0.8637379841284726,0.617,3.2128015018838694,1000
6+
Linear,Linear,experimental,False,6,0.9,0.902,2.00497022725443,0.4810970023674208,0.911,2.9031760219044904,1000
7+
Linear,Linear,experimental,False,6,0.95,0.9528333333333334,2.3890693804633027,0.4810970023674208,0.951,3.238600319213653,1000
8+
Linear,Linear,experimental,True,1,0.9,0.8800833333333333,0.5960959285920073,0.15123045002955704,0.833,0.928366902428871,1000
9+
Linear,Linear,experimental,True,1,0.95,0.9353333333333333,0.7102921088100949,0.15123045002955704,0.913,1.0197692316323934,1000
10+
Linear,Linear,experimental,True,4,0.9,0.6590833333333334,1.9857772419115973,0.8626296646616975,0.52,2.8815675975045956,1000
11+
Linear,Linear,experimental,True,4,0.95,0.7531666666666667,2.3661995278445764,0.8626296646616975,0.619,3.2112254886896605,1000
12+
Linear,Linear,experimental,True,6,0.9,0.9019166666666666,2.004527154284187,0.4808213402748324,0.905,2.9011439332421705,1000
13+
Linear,Linear,experimental,True,6,0.95,0.952,2.3885414264557423,0.4808213402748324,0.949,3.237049999080413,1000
14+
Linear,Linear,observational,False,1,0.9,0.90575,0.6906210074073058,0.16339132921843413,0.897,1.0727694533982786,1000
15+
Linear,Linear,observational,False,1,0.95,0.9518333333333334,0.8229256873110352,0.16339132921843413,0.946,1.1792381527650921,1000
16+
Linear,Linear,observational,False,4,0.9,0.7795,2.9571361297998364,0.9287818108191471,0.691,4.19740184270945,1000
17+
Linear,Linear,observational,False,4,0.95,0.8571666666666666,3.5236450324955486,0.9287818108191471,0.78,4.697698545475343,1000
18+
Linear,Linear,observational,False,6,0.9,0.9076666666666666,2.5544833881976365,0.6416394592068319,0.907,3.6632944671996808,1000
19+
Linear,Linear,observational,False,6,0.95,0.9550833333333334,3.0438546980332184,0.6416394592068319,0.958,4.0959649390037125,1000
20+
Linear,Linear,observational,True,1,0.9,0.8973333333333333,0.668426359641987,0.16249117038954014,0.895,1.038888800002171,1000
21+
Linear,Linear,observational,True,1,0.95,0.9465833333333333,0.7964791333096312,0.16249117038954014,0.939,1.1417719060066087,1000
22+
Linear,Linear,observational,True,4,0.9,0.7675,2.823122727518332,0.9146880810616262,0.686,4.025190417054882,1000
23+
Linear,Linear,observational,True,4,0.95,0.8508333333333333,3.3639582144020532,0.9146880810616262,0.768,4.499697598146944,1000
24+
Linear,Linear,observational,True,6,0.9,0.89775,2.4371258648326704,0.6190705910995143,0.893,3.5036401350107074,1000
25+
Linear,Linear,observational,True,6,0.95,0.9521666666666666,2.9040145837876374,0.6190705910995143,0.955,3.9130910221754434,1000

‎results/did/did_multi_eventstudy.csv‎

Lines changed: 24 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -1,25 +1,25 @@
11
Learner g,Learner m,Score,In-sample-norm.,DGP,level,Coverage,CI Length,Bias,Uniform Coverage,Uniform CI Length,repetition
2-
Linear,Linear,experimental,False,1,0.9,0.8833333333333333,0.42565718743306286,0.10936767904635211,0.835,0.6077012485542163,200
3-
Linear,Linear,experimental,False,1,0.95,0.9358333333333333,0.507201822374698,0.10936767904635211,0.905,0.6747323911476379,200
4-
Linear,Linear,experimental,False,4,0.9,0.6125,1.9569891887347262,0.9196943825351817,0.545,2.5358161709127596,200
5-
Linear,Linear,experimental,False,4,0.95,0.7141666666666667,2.3318964467149415,0.9196943825351817,0.635,2.8827181581319787,200
6-
Linear,Linear,experimental,False,6,0.9,0.8975,2.0153850665398654,0.5111684848078778,0.88,2.5922545970785786,200
7-
Linear,Linear,experimental,False,6,0.95,0.9441666666666667,2.40147942690741,0.5111684848078778,0.94,2.9541718057018187,200
8-
Linear,Linear,experimental,True,1,0.9,0.8791666666666668,0.4255897490005149,0.10926516710603056,0.845,0.6066297468359033,200
9-
Linear,Linear,experimental,True,1,0.95,0.9358333333333333,0.5071214645259496,0.10926516710603056,0.915,0.6750610192677344,200
10-
Linear,Linear,experimental,True,4,0.9,0.605,1.9564893215757844,0.9195779385934096,0.55,2.5307678617965537,200
11-
Linear,Linear,experimental,True,4,0.95,0.7158333333333333,2.3313008182574744,0.9195779385934096,0.65,2.872282262053714,200
12-
Linear,Linear,experimental,True,6,0.9,0.8941666666666667,2.015463986254987,0.5113312788664856,0.89,2.5944084708379807,200
13-
Linear,Linear,experimental,True,6,0.95,0.9466666666666668,2.401573465548158,0.5113312788664856,0.93,2.9505612073229464,200
14-
Linear,Linear,observational,False,1,0.9,0.9083333333333333,0.4882437838128583,0.11428563471509198,0.9,0.6956288268269425,200
15-
Linear,Linear,observational,False,1,0.95,0.9533333333333333,0.5817783517444832,0.11428563471509198,0.945,0.7729973931119418,200
16-
Linear,Linear,observational,False,4,0.9,0.7691666666666667,3.3932130254913604,1.0549489318868936,0.755,4.223665366280769,200
17-
Linear,Linear,observational,False,4,0.95,0.8408333333333333,4.043262703053558,1.0549489318868936,0.81,4.8262642311066015,200
18-
Linear,Linear,observational,False,6,0.9,0.8958333333333333,2.8512971267032157,0.7733310576205062,0.895,3.607707492218858,200
19-
Linear,Linear,observational,False,6,0.95,0.955,3.397530081699918,0.7733310576205062,0.955,4.122679418390554,200
20-
Linear,Linear,observational,True,1,0.9,0.8975,0.4745126476352591,0.11192315736615333,0.895,0.6757224816274575,200
21-
Linear,Linear,observational,True,1,0.95,0.945,0.5654166938231102,0.11192315736615333,0.925,0.7517329711375669,200
22-
Linear,Linear,observational,True,4,0.9,0.7566666666666667,3.005791111628938,0.9858031123253609,0.71,3.794083607223553,200
23-
Linear,Linear,observational,True,4,0.95,0.8341666666666667,3.581621019228321,0.9858031123253609,0.78,4.334336049644241,200
24-
Linear,Linear,observational,True,6,0.9,0.8933333333333333,2.6626861416696204,0.7105550768719945,0.895,3.3880858319786715,200
25-
Linear,Linear,observational,True,6,0.95,0.9433333333333332,3.172786231124224,0.7105550768719945,0.935,3.871664400590925,200
2+
Linear,Linear,experimental,False,1,0.9,0.8746666666666666,0.42536022351351016,0.11129964461197367,0.856,0.6065601425726624,1000
3+
Linear,Linear,experimental,False,1,0.95,0.9343333333333333,0.5068479680392762,0.11129964461197367,0.923,0.6740692167988962,1000
4+
Linear,Linear,experimental,False,4,0.9,0.6018333333333333,1.9789774969843743,0.9612815234569009,0.504,2.557725621904857,1000
5+
Linear,Linear,experimental,False,4,0.95,0.6915,2.3580971320185626,0.9612815234569009,0.606,2.9077454096108863,1000
6+
Linear,Linear,experimental,False,6,0.9,0.9026666666666666,2.0021783896522174,0.475645152957695,0.913,2.5813810385024185,1000
7+
Linear,Linear,experimental,False,6,0.95,0.9546666666666667,2.3857427007749936,0.475645152957695,0.954,2.939126540032628,1000
8+
Linear,Linear,experimental,True,1,0.9,0.8736666666666666,0.4252780101030476,0.11135661295209692,0.855,0.6067206852239997,1000
9+
Linear,Linear,experimental,True,1,0.95,0.9338333333333334,0.50675000471846,0.11135661295209692,0.919,0.6737727543313963,1000
10+
Linear,Linear,experimental,True,4,0.9,0.604,1.9778347169116364,0.9610017220191109,0.506,2.5570866190887442,1000
11+
Linear,Linear,experimental,True,4,0.95,0.69,2.356735425573614,0.9610017220191109,0.614,2.906700104748762,1000
12+
Linear,Linear,experimental,True,6,0.9,0.9028333333333334,2.001368819203873,0.47488976645105485,0.91,2.5788107797213202,1000
13+
Linear,Linear,experimental,True,6,0.95,0.9543333333333334,2.3847780380866523,0.47488976645105485,0.954,2.9346744455419307,1000
14+
Linear,Linear,observational,False,1,0.9,0.9048333333333334,0.4936490463630555,0.11703447731264664,0.911,0.7026803919052239,1000
15+
Linear,Linear,observational,False,1,0.95,0.9523333333333334,0.5882191193312043,0.11703447731264664,0.953,0.7817258159201687,1000
16+
Linear,Linear,observational,False,4,0.9,0.7483333333333334,3.110852841424021,1.0162956359155522,0.691,3.927457336373739,1000
17+
Linear,Linear,observational,False,4,0.95,0.8321666666666666,3.7068097917596994,1.0162956359155522,0.775,4.489588602429944,1000
18+
Linear,Linear,observational,False,6,0.9,0.908,2.6065175455108682,0.657901837298179,0.912,3.319528013865773,1000
19+
Linear,Linear,observational,False,6,0.95,0.9611666666666666,3.1058572207068265,0.657901837298179,0.96,3.78925559700768,1000
20+
Linear,Linear,observational,True,1,0.9,0.8983333333333333,0.478045989951027,0.1165385646041097,0.898,0.6810014878305387,1000
21+
Linear,Linear,observational,True,1,0.95,0.9476666666666667,0.5696269308742887,0.1165385646041097,0.951,0.7570193996194396,1000
22+
Linear,Linear,observational,True,4,0.9,0.7318333333333333,2.961887231450272,1.0118391967276548,0.664,3.755668505865932,1000
23+
Linear,Linear,observational,True,4,0.95,0.8186666666666667,3.5293063192928438,1.0118391967276548,0.771,4.287491165909032,1000
24+
Linear,Linear,observational,True,6,0.9,0.8983333333333333,2.4694251965466845,0.6253200792538618,0.908,3.1600238226116533,1000
25+
Linear,Linear,observational,True,6,0.95,0.9541666666666666,2.9425016113546496,0.6253200792538618,0.955,3.596198019745218,1000

‎results/did/did_multi_group.csv‎

Lines changed: 24 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -1,25 +1,25 @@
11
Learner g,Learner m,Score,In-sample-norm.,DGP,level,Coverage,CI Length,Bias,Uniform Coverage,Uniform CI Length,repetition
2-
Linear,Linear,experimental,False,1,0.9,0.8666666666666667,0.533698038133595,0.14197945807093054,0.85,0.6861047473750901,200
3-
Linear,Linear,experimental,False,1,0.95,0.935,0.6359404364145231,0.14197945807093054,0.9,0.7748893935196418,200
4-
Linear,Linear,experimental,False,4,0.9,0.66,2.1748653096663464,0.9342553462922274,0.525,2.745378335374161,200
5-
Linear,Linear,experimental,False,4,0.95,0.7633333333333333,2.5915118575455782,0.9342553462922274,0.655,3.1210909517446286,200
6-
Linear,Linear,experimental,False,6,0.9,0.8883333333333333,2.217594064950379,0.5525144231877022,0.875,2.791344195057897,200
7-
Linear,Linear,experimental,False,6,0.95,0.9366666666666668,2.642426309803645,0.5525144231877022,0.92,3.170576857891774,200
8-
Linear,Linear,experimental,True,1,0.9,0.87,0.5335807495502426,0.14168060865880763,0.865,0.6849043629713572,200
9-
Linear,Linear,experimental,True,1,0.95,0.9366666666666668,0.6358006784473694,0.14168060865880763,0.89,0.7736693416127448,200
10-
Linear,Linear,experimental,True,4,0.9,0.6633333333333333,2.173005344301668,0.9333928409584715,0.51,2.7419250872101033,200
11-
Linear,Linear,experimental,True,4,0.95,0.76,2.5892955721159634,0.9333928409584715,0.65,3.1048660668399184,200
12-
Linear,Linear,experimental,True,6,0.9,0.8933333333333333,2.2188654092146014,0.5513512630008591,0.85,2.790603998972855,200
13-
Linear,Linear,experimental,True,6,0.95,0.9366666666666668,2.6439412099315343,0.5513512630008591,0.93,3.172214838426176,200
14-
Linear,Linear,observational,False,1,0.9,0.8966666666666667,0.6108816472728611,0.145895094484495,0.87,0.783552984172717,200
15-
Linear,Linear,observational,False,1,0.95,0.9466666666666668,0.7279103792903224,0.145895094484495,0.92,0.8844690424185709,200
16-
Linear,Linear,observational,False,4,0.9,0.78,3.5092375556264455,1.0649254128150685,0.73,4.316704955507763,200
17-
Linear,Linear,observational,False,4,0.95,0.8466666666666667,4.181514457897795,1.0649254128150685,0.82,4.930150821324148,200
18-
Linear,Linear,observational,False,6,0.9,0.895,2.9637734181525097,0.7818480925391569,0.9,3.6693459962202515,200
19-
Linear,Linear,observational,False,6,0.95,0.9483333333333333,3.53155384937329,0.7818480925391569,0.96,4.202951707840176,200
20-
Linear,Linear,observational,True,1,0.9,0.895,0.5920636535297172,0.1408811699533362,0.885,0.7597493231438954,200
21-
Linear,Linear,observational,True,1,0.95,0.945,0.7054873567225215,0.1408811699533362,0.93,0.8582671047974608,200
22-
Linear,Linear,observational,True,4,0.9,0.7633333333333333,3.124012529892269,0.9973634763359689,0.72,3.880323357977367,200
23-
Linear,Linear,observational,True,4,0.95,0.84,3.7224905277370017,0.9973634763359689,0.81,4.430132897406105,200
24-
Linear,Linear,observational,True,6,0.9,0.8966666666666667,2.823741863032981,0.7474950667730065,0.88,3.5108185024043683,200
25-
Linear,Linear,observational,True,6,0.95,0.9466666666666668,3.3646959598709376,0.7474950667730065,0.945,4.0073726417113,200
2+
Linear,Linear,experimental,False,1,0.9,0.876,0.5329948975220807,0.13579236732447947,0.846,0.683878514526821,1000
3+
Linear,Linear,experimental,False,1,0.95,0.9296666666666666,0.6351025926987942,0.13579236732447947,0.917,0.7732276242829601,1000
4+
Linear,Linear,experimental,False,4,0.9,0.658,2.1938722973937375,0.9674173487082218,0.525,2.767821034152252,1000
5+
Linear,Linear,experimental,False,4,0.95,0.746,2.614160080335666,0.9674173487082218,0.619,3.1440243876915375,1000
6+
Linear,Linear,experimental,False,6,0.9,0.9006666666666666,2.211125648458694,0.5338317649415134,0.919,2.783739324710087,1000
7+
Linear,Linear,experimental,False,6,0.95,0.9543333333333334,2.6347187161594587,0.5338317649415134,0.957,3.1662952947465888,1000
8+
Linear,Linear,experimental,True,1,0.9,0.8766666666666666,0.5328699306003187,0.1358281841054489,0.848,0.6847832796423149,1000
9+
Linear,Linear,experimental,True,1,0.95,0.9263333333333333,0.6349536854271081,0.1358281841054489,0.911,0.7727182150404185,1000
10+
Linear,Linear,experimental,True,4,0.9,0.6586666666666666,2.1921756345553276,0.9652578245005206,0.525,2.7628627454822605,1000
11+
Linear,Linear,experimental,True,4,0.95,0.7473333333333334,2.6121383818679704,0.9652578245005206,0.624,3.144606886076096,1000
12+
Linear,Linear,experimental,True,6,0.9,0.8993333333333333,2.2104603719936415,0.5344678450501394,0.912,2.784794352421448,1000
13+
Linear,Linear,experimental,True,6,0.95,0.954,2.6339259903570538,0.5344678450501394,0.957,3.164126890302782,1000
14+
Linear,Linear,observational,False,1,0.9,0.9026666666666666,0.6123404760096205,0.1438612793224918,0.904,0.7860078542582829,1000
15+
Linear,Linear,observational,False,1,0.95,0.9546666666666667,0.7296486809463548,0.1438612793224918,0.952,0.8872672286776676,1000
16+
Linear,Linear,observational,False,4,0.9,0.781,3.3074883394733083,1.0352240102334336,0.719,4.086258476471432,1000
17+
Linear,Linear,observational,False,4,0.95,0.8563333333333334,3.9411154393527843,1.0352240102334336,0.813,4.663160227096469,1000
18+
Linear,Linear,observational,False,6,0.9,0.899,2.789010379110977,0.6998566663431153,0.912,3.4660289192044,1000
19+
Linear,Linear,observational,False,6,0.95,0.9553333333333334,3.323310844197804,0.6998566663431153,0.96,3.9528394153130857,1000
20+
Linear,Linear,observational,True,1,0.9,0.9023333333333333,0.5949231101949434,0.1440501200808088,0.897,0.763308057016272,1000
21+
Linear,Linear,observational,True,1,0.95,0.9486666666666667,0.7088946094940543,0.1440501200808088,0.936,0.8623401634425215,1000
22+
Linear,Linear,observational,True,4,0.9,0.7643333333333334,3.142810509409861,1.0233709921822023,0.706,3.8984668952364427,1000
23+
Linear,Linear,observational,True,4,0.95,0.8463333333333334,3.7448897018841176,1.0233709921822023,0.804,4.447829548666937,1000
24+
Linear,Linear,observational,True,6,0.9,0.8976666666666666,2.6701046408964046,0.6759660173055291,0.902,3.329342240927625,1000
25+
Linear,Linear,observational,True,6,0.95,0.9526666666666667,3.181625918173329,0.6759660173055291,0.953,3.7967419653105576,1000

‎results/did/did_multi_metadata.csv‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
DoubleML Version,Script,Date,Total Runtime (minutes),Python Version,Config File
2-
0.10.dev0,DIDMultiCoverageSimulation,2025-03-19 17:35,27.171297589937847,3.12.9,scripts/did/multi_config.yml
2+
0.10.dev0,DIDMultiCoverageSimulation,2025-03-21 13:02,3.9300304452578225,3.12.9,scripts/did/multi_config.yml

0 commit comments

Comments
 (0)