Skip to content

Commit

Permalink
Added experiments
Browse files Browse the repository at this point in the history
  • Loading branch information
GiorgioMorales committed Mar 31, 2023
1 parent 39d2a5a commit b856d75
Show file tree
Hide file tree
Showing 2,120 changed files with 253 additions and 260 deletions.
6 changes: 3 additions & 3 deletions CVResults/Boston/DualAQD/regression_report-DualAQD-Boston.txt
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
Overall MSE 8.914063 (+/- 3.903600)
Overall PICP 0.950392 (+/- 0.016371)
Overall MPIW 9.990061 (+/- 2.261651)
Overall MSE 8.582197 (+/- 3.414031)
Overall PICP 0.952431 (+/- 0.013356)
Overall MPIW 9.361881 (+/- 1.120965)
Binary file modified CVResults/Boston/DualAQD/validation_MPIW-DualAQD-Boston.npy
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/validation_MSE-DualAQD-Boston.npy
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/validation_PICP-DualAQD-Boston.npy
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-1
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-10
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-1_historyMSE.npy
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-1_validationMSE
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-2
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-2_historyMSE.npy
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-2_validationMSE
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-3
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-3_historyMSE.npy
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-3_validationMSE
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-4
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-4_historyMSE.npy
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-4_validationMSE
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-5
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-5_historyMSE.npy
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-5_validationMSE
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-6
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-6_historyMSE.npy
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-6_validationMSE
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-7
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-7_historyMSE.npy
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-7_validationMSE
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-8
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-8_historyMSE.npy
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-8_validationMSE
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-9
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-9_historyMSE.npy
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/DualAQD/weights-DualAQD-Boston-9_validationMSE
Binary file not shown.
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
Overall MSE 8.944 (+/- 3.869)
Overall PICP 0.960 (+/- 0.009)
Overall MPIW 12.517 (+/- 2.277)
Overall MSE 8.634005 (+/- 3.386545)
Overall PICP 0.956431 (+/- 0.011956)
Overall MPIW 12.300151 (+/- 1.984286)
Binary file modified CVResults/Boston/MCDropout/validation_MPIW-MCDropout-Boston.npy
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/validation_MSE-MCDropout-Boston.npy
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/validation_PICP-MCDropout-Boston.npy
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/weights-MCDropout-Boston-1
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/weights-MCDropout-Boston-10
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/weights-MCDropout-Boston-2
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/weights-MCDropout-Boston-3
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/weights-MCDropout-Boston-4
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/weights-MCDropout-Boston-5
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/weights-MCDropout-Boston-6
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/weights-MCDropout-Boston-7
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/weights-MCDropout-Boston-8
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/MCDropout/weights-MCDropout-Boston-9
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Boston/comparison_MPIW.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified CVResults/Boston/comparison_MSE.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified CVResults/Boston/comparison_PICP.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
18 changes: 9 additions & 9 deletions CVResults/Boston/t-test.txt
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
MPIW
DualAQD vs QD+: t-value = -3.376073. p-value = 0.008177770036262714)
DualAQD vs QD: t-value = -7.361807. p-value = 4.273247386598834e-05)
DualAQD vs MC-Dropout-PI: t-value = -3.263628. p-value = 0.009781836824109835)
DualAQD vs QD+: t-value = -4.671115. p-value = 0.0011667519973737627)
DualAQD vs QD: t-value = -13.204240. p-value = 3.396224038181191e-07)
DualAQD vs MC-Dropout-PI: t-value = -4.200299. p-value = 0.0023056713446747237)
PICP
DualAQD vs QD+: t-value = -0.720308. p-value = 0.48961956155035846)
DualAQD vs QD: t-value = -2.687874. p-value = 0.024883026128369644)
DualAQD vs MC-Dropout-PI: t-value = -1.639006. p-value = 0.13563461095259924)
DualAQD vs QD+: t-value = -0.617387. p-value = 0.5522777761067107)
DualAQD vs QD: t-value = -3.842311. p-value = 0.003952523890967694)
DualAQD vs MC-Dropout-PI: t-value = -0.801784. p-value = 0.44333161563679546)
MSE
DualAQD vs QD+: t-value = -3.325295. p-value = 0.008865242340217034)
DualAQD vs QD: t-value = -3.168531. p-value = 0.011392855526432513)
DualAQD vs MC-Dropout-PI: t-value = -0.362488. p-value = 0.725353477391629)
DualAQD vs QD+: t-value = -3.534201. p-value = 0.00637180005353644)
DualAQD vs QD: t-value = -3.567350. p-value = 0.006049279685891569)
DualAQD vs MC-Dropout-PI: t-value = -0.434043. p-value = 0.6744762158121598)
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
Overall MSE 22.453804 (+/- 4.788954)
Overall PICP 0.940777 (+/- 0.011027)
Overall MPIW 15.882522 (+/- 1.853746)
Overall MSE 22.801886 (+/- 4.917882)
Overall PICP 0.951456 (+/- 0.000000)
Overall MPIW 15.544325 (+/- 1.418343)
Binary file modified CVResults/Concrete/DualAQD/validation_MPIW-DualAQD-Concrete.npy
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/validation_MSE-DualAQD-Concrete.npy
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/validation_PICP-DualAQD-Concrete.npy
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/weights-DualAQD-Concrete-1
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/weights-DualAQD-Concrete-10
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/weights-DualAQD-Concrete-2
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/weights-DualAQD-Concrete-3
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/weights-DualAQD-Concrete-4
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/weights-DualAQD-Concrete-5
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/weights-DualAQD-Concrete-6
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/weights-DualAQD-Concrete-7
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/weights-DualAQD-Concrete-8
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Concrete/DualAQD/weights-DualAQD-Concrete-9
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified CVResults/Concrete/comparison_MPIW.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified CVResults/Concrete/comparison_MSE.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified CVResults/Concrete/comparison_PICP.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
54 changes: 9 additions & 45 deletions CVResults/Concrete/t-test.txt
Original file line number Diff line number Diff line change
@@ -1,48 +1,12 @@
MPIW
DualAQD vs QD+: t-value = -4.055254. p-value = 0.0028622591575628692)
DualAQD vs QD: t-value = -20.993896. p-value = 5.917175199619248e-09)
DualAQD vs MC-Dropout-PI: t-value = -8.180660. p-value = 1.850980234097431e-05)
DualAQD vs QD+: t-value = -6.749805. p-value = 8.366738552242504e-05)
DualAQD vs QD: t-value = -19.039457. p-value = 1.4008796840155841e-08)
DualAQD vs MC-Dropout-PI: t-value = -11.407743. p-value = 1.1836120802872604e-06)
PICP
DualAQD vs QD+: t-value = -2.121322. p-value = 0.06290237489334177)
DualAQD vs QD: t-value = -7.829343. p-value = 2.6285274787210374e-05)
DualAQD vs MC-Dropout-PI: t-value = 0.991553. p-value = 0.3417416177294981414)
DualAQD vs QD+: t-value = -0.230771. p-value = 0.8226530879603213)
DualAQD vs QD: t-value = -5.056210. p-value = 0.000684550574000363)
DualAQD vs MC-Dropout-PI: t-value = -1.500004. p-value = 0.1678495176602826)
MSE
DualAQD vs QD+: t-value = -3.112950. p-value = 0.012459439912513873)
DualAQD vs QD: t-value = -7.703512. p-value = 2.9891728153325954e-05)
DualAQD vs MC-Dropout-PI: t-value = -1.157252. p-value = 0.2769595930460797)
MPIW
DualAQD vs QD+: t-value = -4.932168. p-value = 0.0008109197181903382)
DualAQD vs QD: t-value = -20.505875. p-value = 7.28341251007821e-09)
DualAQD vs MC-Dropout-PI: t-value = -10.864749. p-value = 1.7868282124955514e-06)
PICP
DualAQD vs QD+: t-value = 0.000000. p-value = 1.0)
DualAQD vs QD: t-value = -5.013778. p-value = 0.0007252115306612845)
DualAQD vs MC-Dropout-PI: t-value = -1.245684. p-value = 0.2443326634428257)
MSE
DualAQD vs QD+: t-value = -3.112950. p-value = 0.012459439912513873)
DualAQD vs QD: t-value = -7.703512. p-value = 2.9891728153325954e-05)
DualAQD vs MC-Dropout-PI: t-value = -1.157252. p-value = 0.2769595930460797)
MPIW
DualAQD vs QD+: t-value = -4.932168. p-value = 0.0008109197181903382)
DualAQD vs QD: t-value = -20.505875. p-value = 7.28341251007821e-09)
DualAQD vs MC-Dropout-PI: t-value = -10.864749. p-value = 1.7868282124955514e-06)
PICP
DualAQD vs QD+: t-value = 0.000000. p-value = 1.0)
DualAQD vs QD: t-value = -5.013778. p-value = 0.0007252115306612845)
DualAQD vs MC-Dropout-PI: t-value = -1.245684. p-value = 0.2443326634428257)
MSE
DualAQD vs QD+: t-value = -3.112950. p-value = 0.012459439912513873)
DualAQD vs QD: t-value = -7.703512. p-value = 2.9891728153325954e-05)
DualAQD vs MC-Dropout-PI: t-value = -1.157252. p-value = 0.2769595930460797)
MPIW
DualAQD vs QD+: t-value = -4.932168. p-value = 0.0008109197181903382)
DualAQD vs QD: t-value = -20.505875. p-value = 7.28341251007821e-09)
DualAQD vs MC-Dropout-PI: t-value = -10.864749. p-value = 1.7868282124955514e-06)
PICP
DualAQD vs QD+: t-value = 0.000000. p-value = 1.0)
DualAQD vs QD: t-value = -5.013778. p-value = 0.0007252115306612845)
DualAQD vs MC-Dropout-PI: t-value = -1.245684. p-value = 0.2443326634428257)
MSE
DualAQD vs QD+: t-value = -3.112950. p-value = 0.012459439912513873)
DualAQD vs QD: t-value = -7.703512. p-value = 2.9891728153325954e-05)
DualAQD vs MC-Dropout-PI: t-value = -1.157252. p-value = 0.2769595930460797)
DualAQD vs QD+: t-value = -2.765008. p-value = 0.021931789386910382)
DualAQD vs QD: t-value = -7.789053. p-value = 2.738521617731142e-05)
DualAQD vs MC-Dropout-PI: t-value = 0.404692. p-value = 0.6951531459328688)
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
Overall MSE 14.786893 (+/- 0.404429)
Overall PICP 0.950448 (+/- 0.000746)
Overall MPIW 13.019126 (+/- 0.264994)
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Loading

0 comments on commit b856d75

Please sign in to comment.