TSE_New_Experiment

[WeiFoo]

results of small N data sets(Raw data)

Target       | WPDP  | HDP-JC | HDP-Scipy | HDP-Scipy-IQR | N-50  | N-50-IQR | N-100 | N-100-IQR | N-150 | N-150-IQR | N-200 | N-200-IQR
ar1          | 0.582 | 0.734  | 0.621     | 0.0           | 0.618 | 0.074    | 0.686 | 0.026     | 0.696 | 0.013     | 0.691 | 0.019    
camel-1.0    | 0.55  | 0.639  | 0.556     | 0.0           | 0.657 | 0.041    | 0.654 | 0.005     | 0.626 | 0.047     | 0.617 | 0.056    
ar4          | 0.657 | 0.816  | 0.536     | 0.0           | 0.672 | 0.11     | 0.758 | 0.09      | 0.775 | 0.089     | 0.784 | 0.122    
ar5          | 0.804 | 0.911  | 0.863     | 0.0           | 0.671 | 0.208    | 0.694 | 0.132     | 0.76  | 0.105     | 0.731 | 0.268    
JM1          | 0     | 0      | 0.688     | 0.0           | 0.639 | 0.033    | 0.665 | 0.037     | 0.668 | 0.017     | 0.667 | 0.011    
skarbonka    | 0.569 | 0.694  | 0.696     | 0.0           | 0.673 | 0.043    | 0.695 | 0.031     | 0.674 | 0.039     | 0.685 | 0.023    
poi-1.5      | 0.707 | 0.701  | 0.665     | 0.0           | 0.63  | 0.065    | 0.635 | 0.076     | 0.639 | 0.078     | 0.625 | 0.08     
safe         | 0.706 | 0.818  | 0.589     | 0.0           | 0.589 | 0.034    | 0.641 | 0.058     | 0.645 | 0.082     | 0.599 | 0.069    
PC5          | 0     | 0      | 0.885     | 0.0           | 0.908 | 0.064    | 0.915 | 0.028     | 0.907 | 0.043     | 0.907 | 0.091    
arc          | 0.67  | 0.701  | 0.669     | 0.0           | 0.651 | 0.042    | 0.671 | 0.012     | 0.651 | 0.021     | 0.667 | 0.034    
velocity-1.4 | 0.725 | 0.391  | 0.449     | 0.0           | 0.495 | 0.024    | 0.484 | 0.046     | 0.506 | 0.047     | 0.504 | 0.009    
KC3          | 0     | 0      | 0.648     | 0.0           | 0.617 | 0.054    | 0.649 | 0.018     | 0.657 | 0.015     | 0.659 | 0.009    
apache       | 0.714 | 0.717  | 0.615     | 0.0           | 0.633 | 0.023    | 0.63  | 0.007     | 0.63  | 0.005     | 0.627 | 0.004    
JDT          | 0.795 | 0.767  | 0.692     | 0.0           | 0.64  | 0.072    | 0.657 | 0.036     | 0.663 | 0.032     | 0.655 | 0.035    
PDE          | 0.684 | 0.717  | 0.685     | 0.0           | 0.607 | 0.067    | 0.618 | 0.044     | 0.648 | 0.056     | 0.615 | 0.066    
ant-1.3      | 0.609 | 0.835  | 0.655     | 0.0           | 0.688 | 0.061    | 0.703 | 0.068     | 0.687 | 0.071     | 0.655 | 0.057    
EQ           | 0.583 | 0.783  | 0.669     | 0.0           | 0.734 | 0.059    | 0.735 | 0.062     | 0.724 | 0.063     | 0.679 | 0.067    
MC2          | 0     | 0      | 0.683     | 0.0           | 0.634 | 0.046    | 0.68  | 0.007     | 0.683 | 0.0       | 0.683 | 0.0      
ar6          | 0.654 | 0.64   | 0.44      | 0.0           | 0.596 | 0.039    | 0.655 | 0.055     | 0.642 | 0.044     | 0.622 | 0.044    
MW1          | 0.612 | 0.727  | 0.722     | 0.0           | 0.582 | 0.098    | 0.694 | 0.033     | 0.704 | 0.031     | 0.722 | 0.015    
LC           | 0.575 | 0.655  | 0.629     | 0.0           | 0.623 | 0.071    | 0.629 | 0.048     | 0.619 | 0.044     | 0.601 | 0.06     
tomcat       | 0.778 | 0.818  | 0.766     | 0.0           | 0.712 | 0.063    | 0.738 | 0.034     | 0.726 | 0.096     | 0.679 | 0.089    
PC2          | 0     | 0      | 0.888     | 0.0           | 0.838 | 0.1      | 0.869 | 0.037     | 0.817 | 0.052     | 0.822 | 0.071    
ML           | 0.734 | 0.692  | 0.593     | 0.0           | 0.621 | 0.03     | 0.625 | 0.028     | 0.629 | 0.032     | 0.615 | 0.034    
PC1          | 0.787 | 0.752  | 0.697     | 0.0           | 0.63  | 0.046    | 0.681 | 0.025     | 0.692 | 0.051     | 0.659 | 0.057    
xerces-1.2   | 0.624 | 0.489  | 0.485     | 0.0           | 0.489 | 0.008    | 0.487 | 0.005     | 0.489 | 0.004     | 0.489 | 0.004    
zxing        | 0.605 | 0.65   | 0.634     | 0.0           | 0.58  | 0.034    | 0.599 | 0.026     | 0.603 | 0.036     | 0.605 | 0.026    
PC4          | 0.9   | 0.682  | 0.681     | 0.0           | 0.602 | 0.075    | 0.643 | 0.045     | 0.657 | 0.048     | 0.657 | 0.04     
ar3          | 0.574 | 0.823  | 0.699     | 0.0           | 0.775 | 0.094    | 0.813 | 0.046     | 0.811 | 0.124     | 0.78  | 0.125    
PC3          | 0.794 | 0.738  | 0.728     | 0.0           | 0.635 | 0.054    | 0.66  | 0.058     | 0.661 | 0.074     | 0.689 | 0.054    
xalan-2.4    | 0.755 | 0.751  | 0.645     | 0.0           | 0.663 | 0.041    | 0.673 | 0.021     | 0.665 | 0.024     | 0.665 | 0.039    
redaktor     | 0.744 | 0.537  | 0.513     | 0.0           | 0.514 | 0.021    | 0.515 | 0.016     | 0.514 | 0.02      | 0.518 | 0.02     
CM1          | 0.653 | 0.717  | 0.677     | 0.0           | 0.601 | 0.052    | 0.646 | 0.015     | 0.655 | 0.028     | 0.657 | 0.023    

[WeiFoo]

0711 update with JC's(Small N data set)

Target       | WPDP  | HDP-JC | HDP-Scipy | HDP-Scipy-IQR | N-50  | N-50-IQR | N-100 | N-100-IQR | N-150 | N-150-IQR | N-200 | N-200-IQR
ar1          | 0.582 | 0.727  | 0.73      | 0.0           | 0.643 | 0.066    | 0.7   | 0.011     | 0.703 | 0.01      | 0.716 | 0.026    
camel-1.0    | 0.55  | 0.639  | 0.689     | 0.0           | 0.599 | 0.057    | 0.655 | 0.067     | 0.654 | 0.038     | 0.651 | 0.065    
ar4          | 0.657 | 0.798  | 0.791     | 0.0           | 0.703 | 0.092    | 0.762 | 0.06      | 0.789 | 0.012     | 0.786 | 0.013    
ar5          | 0.804 | 0.902  | 0.901     | 0.0           | 0.691 | 0.159    | 0.781 | 0.123     | 0.794 | 0.168     | 0.882 | 0.052    
JM1          | 0.705 | 0.685  | 0.681     | 0.0           | 0.607 | 0.055    | 0.667 | 0.03      | 0.672 | 0.012     | 0.678 | 0.009    
skarbonka    | 0.569 | 0.688  | 0.694     | 0.0           | 0.644 | 0.06     | 0.653 | 0.036     | 0.671 | 0.016     | 0.679 | 0.004    
poi-1.5      | 0.707 | 0.547  | 0.546     | 0.0           | 0.635 | 0.079    | 0.675 | 0.087     | 0.619 | 0.122     | 0.563 | 0.089    
safe         | 0.706 | 0.652  | 0.711     | 0.0           | 0.638 | 0.109    | 0.698 | 0.017     | 0.698 | 0.014     | 0.702 | 0.035    
PC5          | 0.954 | 0.806  | 0.806     | 0.0           | 0.932 | 0.047    | 0.927 | 0.043     | 0.939 | 0.026     | 0.933 | 0.034    
arc          | 0.67  | 0.701  | 0.7       | 0.0           | 0.641 | 0.063    | 0.659 | 0.027     | 0.669 | 0.012     | 0.671 | 0.037    
velocity-1.4 | 0.725 | 0.476  | 0.504     | 0.0           | 0.485 | 0.042    | 0.461 | 0.041     | 0.477 | 0.051     | 0.488 | 0.041    
KC3          | 0.609 | 0.678  | 0.663     | 0.0           | 0.601 | 0.037    | 0.657 | 0.02      | 0.657 | 0.013     | 0.665 | 0.004    
apache       | 0.714 | 0.664  | 0.646     | 0.0           | 0.634 | 0.013    | 0.637 | 0.03      | 0.637 | 0.015     | 0.645 | 0.024    
JDT          | 0.795 | 0.693  | 0.683     | 0.0           | 0.677 | 0.096    | 0.679 | 0.042     | 0.693 | 0.018     | 0.692 | 0.055    
PDE          | 0.684 | 0.726  | 0.673     | 0.0           | 0.613 | 0.051    | 0.657 | 0.035     | 0.667 | 0.037     | 0.657 | 0.047    
ant-1.3      | 0.609 | 0.675  | 0.758     | 0.0           | 0.657 | 0.107    | 0.684 | 0.048     | 0.724 | 0.04      | 0.735 | 0.03     
EQ           | 0.583 | 0.747  | 0.736     | 0.0           | 0.726 | 0.115    | 0.751 | 0.026     | 0.746 | 0.015     | 0.745 | 0.011    
MC2          | 0.646 | 0.677  | 0.688     | 0.0           | 0.614 | 0.095    | 0.672 | 0.013     | 0.672 | 0.025     | 0.678 | 0.015    
ar6          | 0.654 | 0.667  | 0.647     | 0.0           | 0.589 | 0.065    | 0.614 | 0.028     | 0.623 | 0.009     | 0.632 | 0.019    
MW1          | 0.612 | 0.63   | 0.721     | 0.0           | 0.58  | 0.176    | 0.707 | 0.024     | 0.72  | 0.004     | 0.72  | 0.001    
LC           | 0.575 | 0.638  | 0.642     | 0.0           | 0.603 | 0.07     | 0.641 | 0.01      | 0.642 | 0.007     | 0.643 | 0.01     
tomcat       | 0.778 | 0.756  | 0.756     | 0.0           | 0.651 | 0.131    | 0.732 | 0.031     | 0.738 | 0.033     | 0.764 | 0.02     
PC2          | 0.748 | 0.884  | 0.879     | 0.0           | 0.791 | 0.119    | 0.871 | 0.049     | 0.879 | 0.008     | 0.889 | 0.006    
ML           | 0.734 | 0.651  | 0.692     | 0.0           | 0.619 | 0.044    | 0.635 | 0.028     | 0.643 | 0.028     | 0.653 | 0.04     
PC1          | 0.787 | 0.696  | 0.693     | 0.0           | 0.628 | 0.129    | 0.688 | 0.045     | 0.678 | 0.042     | 0.686 | 0.041    
xerces-1.2   | 0.624 | 0.5    | 0.489     | 0.0           | 0.49  | 0.007    | 0.489 | 0.005     | 0.489 | 0.003     | 0.489 | 0.001    
zxing        | 0.605 | 0.635  | 0.632     | 0.0           | 0.607 | 0.022    | 0.621 | 0.007     | 0.623 | 0.007     | 0.621 | 0.004    
PC4          | 0.9   | 0.668  | 0.684     | 0.0           | 0.615 | 0.077    | 0.674 | 0.023     | 0.669 | 0.016     | 0.673 | 0.025    
ar3          | 0.574 | 0.823  | 0.836     | 0.0           | 0.718 | 0.11     | 0.792 | 0.059     | 0.826 | 0.026     | 0.829 | 0.005    
PC3          | 0.794 | 0.73   | 0.67      | 0.0           | 0.627 | 0.081    | 0.688 | 0.068     | 0.687 | 0.066     | 0.673 | 0.061    
xalan-2.4    | 0.755 | 0.661  | 0.66      | 0.0           | 0.577 | 0.11     | 0.668 | 0.03      | 0.678 | 0.04      | 0.667 | 0.016    
redaktor     | 0.744 | 0.499  | 0.513     | 0.0           | 0.506 | 0.018    | 0.508 | 0.007     | 0.508 | 0.005     | 0.508 | 0.0      
CM1          | 0.653 | 0.704  | 0.653     | 0.0           | 0.605 | 0.088    | 0.652 | 0.022     | 0.655 | 0.017     | 0.657 | 0.027   

[WeiFoo]

0712 Update EPV =10 result

Target       | WPDP  | HDP-JC | HDP-Scipy | HDP-Scipy-IQR | N-50  | N-50-IQR | N-100 | N-100-IQR | N-150 | N-150-IQR | N-200 | N-200-IQR
ar1          | 0.582 | 0.727  | 0.73      | 0.0           | 0.702 | 0.016    | 0.706 | 0.016     | 0.712 | 0.025     | 0.71  | 0.023    
camel-1.0    | 0.55  | 0.639  | 0.689     | 0.0           | 0.666 | 0.019    | 0.667 | 0.034     | 0.669 | 0.038     | 0.655 | 0.044    
ar4          | 0.657 | 0.798  | 0.791     | 0.0           | 0.78  | 0.038    | 0.784 | 0.022     | 0.792 | 0.016     | 0.796 | 0.007    
ar5          | 0.804 | 0.902  | 0.901     | 0.0           | 0.853 | 0.109    | 0.863 | 0.153     | 0.861 | 0.05      | 0.847 | 0.113    
JM1          | 0.705 | 0.685  | 0.681     | 0.0           | 0.665 | 0.02     | 0.673 | 0.013     | 0.675 | 0.008     | 0.672 | 0.01     
skarbonka    | 0.569 | 0.688  | 0.694     | 0.0           | 0.694 | 0.033    | 0.683 | 0.029     | 0.682 | 0.013     | 0.672 | 0.017    
poi-1.5      | 0.707 | 0.547  | 0.546     | 0.0           | 0.708 | 0.024    | 0.702 | 0.063     | 0.673 | 0.131     | 0.556 | 0.088    
safe         | 0.706 | 0.652  | 0.711     | 0.0           | 0.7   | 0.014    | 0.706 | 0.042     | 0.702 | 0.04      | 0.703 | 0.047    
PC5          | 0.954 | 0.806  | 0.806     | 0.0           | 0.948 | 0.012    | 0.946 | 0.021     | 0.944 | 0.034     | 0.926 | 0.041    
arc          | 0.67  | 0.701  | 0.7       | 0.0           | 0.672 | 0.012    | 0.67  | 0.016     | 0.679 | 0.042     | 0.653 | 0.044    
velocity-1.4 | 0.725 | 0.476  | 0.504     | 0.0           | 0.456 | 0.039    | 0.472 | 0.043     | 0.469 | 0.048     | 0.478 | 0.055    
KC3          | 0.609 | 0.678  | 0.663     | 0.0           | 0.635 | 0.054    | 0.657 | 0.018     | 0.661 | 0.015     | 0.659 | 0.013    
apache       | 0.714 | 0.664  | 0.646     | 0.0           | 0.663 | 0.023    | 0.639 | 0.024     | 0.639 | 0.02      | 0.639 | 0.026    
JDT          | 0.795 | 0.693  | 0.683     | 0.0           | 0.724 | 0.055    | 0.714 | 0.058     | 0.72  | 0.052     | 0.724 | 0.065    
PDE          | 0.684 | 0.726  | 0.673     | 0.0           | 0.667 | 0.046    | 0.667 | 0.044     | 0.667 | 0.034     | 0.666 | 0.028    
ant-1.3      | 0.609 | 0.675  | 0.758     | 0.0           | 0.746 | 0.04     | 0.706 | 0.047     | 0.716 | 0.034     | 0.716 | 0.058    
EQ           | 0.583 | 0.747  | 0.736     | 0.0           | 0.762 | 0.021    | 0.766 | 0.014     | 0.749 | 0.007     | 0.749 | 0.01     
MC2          | 0.646 | 0.677  | 0.688     | 0.0           | 0.663 | 0.042    | 0.671 | 0.026     | 0.661 | 0.038     | 0.659 | 0.011    
ar6          | 0.654 | 0.667  | 0.647     | 0.0           | 0.599 | 0.073    | 0.639 | 0.034     | 0.636 | 0.03      | 0.632 | 0.035    
MW1          | 0.612 | 0.63   | 0.721     | 0.0           | 0.702 | 0.03     | 0.705 | 0.021     | 0.711 | 0.015     | 0.718 | 0.012    
LC           | 0.575 | 0.638  | 0.642     | 0.0           | 0.646 | 0.012    | 0.643 | 0.009     | 0.643 | 0.01      | 0.643 | 0.01     
tomcat       | 0.778 | 0.756  | 0.756     | 0.0           | 0.752 | 0.044    | 0.748 | 0.006     | 0.766 | 0.032     | 0.766 | 0.022    
PC2          | 0.748 | 0.884  | 0.879     | 0.0           | 0.808 | 0.049    | 0.874 | 0.012     | 0.879 | 0.019     | 0.877 | 0.031    
ML           | 0.734 | 0.651  | 0.692     | 0.0           | 0.647 | 0.038    | 0.643 | 0.009     | 0.659 | 0.026     | 0.657 | 0.03     
PC1          | 0.787 | 0.696  | 0.693     | 0.0           | 0.669 | 0.059    | 0.682 | 0.048     | 0.683 | 0.024     | 0.683 | 0.02     
xerces-1.2   | 0.624 | 0.5    | 0.489     | 0.0           | 0.482 | 0.003    | 0.484 | 0.007     | 0.489 | 0.004     | 0.489 | 0.006    
zxing        | 0.605 | 0.635  | 0.632     | 0.0           | 0.625 | 0.013    | 0.633 | 0.008     | 0.625 | 0.016     | 0.622 | 0.005    
PC4          | 0.9   | 0.668  | 0.684     | 0.0           | 0.652 | 0.036    | 0.671 | 0.017     | 0.671 | 0.039     | 0.667 | 0.024    
ar3          | 0.574 | 0.823  | 0.836     | 0.0           | 0.821 | 0.043    | 0.828 | 0.007     | 0.831 | 0.011     | 0.832 | 0.007    
PC3          | 0.794 | 0.73   | 0.67      | 0.0           | 0.659 | 0.067    | 0.68  | 0.047     | 0.665 | 0.048     | 0.661 | 0.057    
xalan-2.4    | 0.755 | 0.661  | 0.66      | 0.0           | 0.681 | 0.033    | 0.685 | 0.023     | 0.67  | 0.027     | 0.672 | 0.016    
redaktor     | 0.744 | 0.499  | 0.513     | 0.0           | 0.515 | 0.026    | 0.51  | 0.01      | 0.508 | 0.002     | 0.508 | 0.009    
CM1          | 0.653 | 0.704  | 0.653     | 0.0           | 0.648 | 0.031    | 0.649 | 0.022     | 0.653 | 0.011     | 0.648 | 0.027