ACD | POS | P Value (ACD vs.POS) | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
AUC | 95% CI | PPV | NPV | Sensitivity | Specificity | Accuracy | AUC | 95% CI | PPV | NPV | Sensitivity | Specificity | Accuracy | AUC | PPV | NPV | |
Decision tree | |||||||||||||||||
ASCUS higher | 0.884 | 0.877–0.8902 | 0.826 | 0.825 | 0.828 | 0.822 | 0.825 | 0.831 | 0.8211–0.8401 | 0.814 | 0.742 | 0.974 | 0.775 | 0.875 | 0.249 | 0.046 | 0.004 |
ASC-H higher | 0.856 | 0.8499–0.8622 | 0.822 | 0.921 | 0.941 | 0.771 | 0.861 | 0.893 | 0.8853–0.9 | 0.799 | 0.860 | 0.902 | 0.726 | 0.822 | |||
LSIL higher | 0.881 | 0.8745–0.8864 | 0.831 | 0.943 | 0.957 | 0.785 | 0.875 | 0.824 | 0.815–0.8321 | 0.795 | 0.888 | 0.924 | 0.718 | 0.875 | |||
HSIL higher | 0.875 | 0.8692–0.8799 | 0.813 | 0.967 | 0.974 | 0.775 | 0.875 | 0.814 | 0.8064–0.8224 | 0.755 | 0.919 | 0.940 | 0.688 | 0.816 | |||
Xgboost | |||||||||||||||||
ASCUS higher | 0.915 | 0.9095–0.9205 | 0.838 | 0.826 | 0.826 | 0.838 | 0.832 | 0.860 | 0.8512–0.8687 | 0.815 | 0.750 | 0.725 | 0.834 | 0.779 | 0.005 | 0.005 | < 0.001 |
ASC-H higher | 0.953 | 0.9494–0.9563 | 0.869 | 0.897 | 0.914 | 0.845 | 0.881 | 0.910 | 0.9037–0.917 | 0.829 | 0.822 | 0.858 | 0.788 | 0.826 | |||
LSIL higher | 0.956 | 0.9523–0.9591 | 0.871 | 0.911 | 0.925 | 0.849 | 0.889 | 0.924 | 0.918–0.9291 | 0.841 | 0.833 | 0.863 | 0.807 | 0.779 | |||
HSIL higher | 0.961 | 0.9587–0.9642 | 0.856 | 0.946 | 0.952 | 0.838 | 0.896 | 0.929 | 0.9237–0.934 | 0.814 | 0.874 | 0.889 | 0.793 | 0.841 | |||
Random forest | |||||||||||||||||
ASCUS higher | 0.896 | 0.8895–0.9021 | 0.834 | 0.822 | 0.822 | 0.834 | 0.828 | 0.845 | 0.8354–0.8538 | 0.814 | 0.742 | 0.712 | 0.835 | 0.773 | 0.004 | 0.026 | 0.002 |
ASC-H higher | 0.935 | 0.9304–0.9389 | 0.872 | 0.895 | 0.912 | 0.849 | 0.882 | 0.900 | 0.8926–0.9069 | 0.820 | 0.831 | 0.870 | 0.769 | 0.824 | |||
LSIL higher | 0.938 | 0.9336–0.9422 | 0.868 | 0.914 | 0.927 | 0.845 | 0.888 | 0.907 | 0.9003–0.9131 | 0.823 | 0.849 | 0.884 | 0.776 | 0.773 | |||
HSIL higher | 0.952 | 0.9485–0.955 | 0.845 | 0.952 | 0.959 | 0.823 | 0.891 | 0.920 | 0.9139–0.9253 | 0.825 | 0.857 | 0.868 | 0.811 | 0.840 | |||
SVM | |||||||||||||||||
ASCUS higher | 0.904 | 0.898–0.9099 | 0.904 | 0.727 | 0.656 | 0.929 | 0.791 | 0.852 | 0.8426–0.8608 | 0.883 | 0.796 | 0.771 | 0.897 | 0.834 | 0.003 | 0.045 | 0.449 |
ASC-H higher | 0.943 | 0.9386–0.9467 | 0.917 | 0.771 | 0.756 | 0.923 | 0.835 | 0.901 | 0.8932–0.9077 | 0.899 | 0.705 | 0.684 | 0.908 | 0.786 | |||
LSIL higher | 0.947 | 0.9425–0.9504 | 0.910 | 0.787 | 0.775 | 0.916 | 0.842 | 0.915 | 0.9088–0.9209 | 0.904 | 0.729 | 0.715 | 0.910 | 0.834 | |||
HSIL higher | 0.932 | 0.9272–0.9365 | 0.883 | 0.796 | 0.771 | 0.897 | 0.834 | 0.896 | 0.889–0.9032 | 0.848 | 0.736 | 0.695 | 0.872 | 0.783 | |||
Logistic regression | |||||||||||||||||
ASCUS higher | 0.905 | 0.8987–0.9105 | 0.906 | 0.725 | 0.652 | 0.931 | 0.790 | 0.852 | 0.8426–0.8608 | 0.872 | 0.690 | 0.595 | 0.912 | 0.753 | 0.005 | 0.027 | 0.004 |
ASC-H higher | 0.943 | 0.9393–0.9473 | 0.920 | 0.762 | 0.743 | 0.927 | 0.829 | 0.901 | 0.8942–0.9086 | 0.898 | 0.706 | 0.686 | 0.906 | 0.786 | |||
LSIL higher | 0.947 | 0.9428–0.9506 | 0.913 | 0.779 | 0.763 | 0.920 | 0.838 | 0.916 | 0.9097–0.9217 | 0.904 | 0.729 | 0.715 | 0.910 | 0.753 | |||
HSIL higher | 0.934 | 0.9291–0.938 | 0.888 | 0.778 | 0.744 | 0.905 | 0.824 | 0.903 | 0.8961–0.9093 | 0.851 | 0.712 | 0.651 | 0.883 | 0.766 | |||
Neural net | |||||||||||||||||
ASCUS higher | 0.909 | 0.903–0.9145 | 0.832 | 0.826 | 0.828 | 0.830 | 0.829 | 0.854 | 0.8449–0.8629 | 0.792 | 0.757 | 0.746 | 0.802 | 0.774 | 0.004 | 0.003 | < 0.001 |
ASC-H higher | 0.951 | 0.9471–0.9542 | 0.868 | 0.901 | 0.918 | 0.843 | 0.883 | 0.908 | 0.9015–0.915 | 0.816 | 0.834 | 0.874 | 0.764 | 0.824 | |||
LSIL higher | 0.954 | 0.9501–0.9572 | 0.866 | 0.915 | 0.928 | 0.842 | 0.887 | 0.919 | 0.9135–0.9252 | 0.837 | 0.837 | 0.868 | 0.800 | 0.774 | |||
HSIL higher | 0.959 | 0.9561–0.962 | 0.855 | 0.945 | 0.951 | 0.838 | 0.895 | 0.926 | 0.9203–0.931 | 0.813 | 0.874 | 0.888 | 0.791 | 0.840 |