Analysis of Predictive Accuracy & Segmentation Performance
| Model ID | Segment | Target | Odds? | Test AUC | KS | Accuracy | Actions |
|---|---|---|---|---|---|---|---|
| model_w_no_odds_short_high_HV | short_high_HV | W | No | 0.7778 | 0.7778 | 0.9000 | |
| model_q_no_odds_short_high_HV | short_high_HV | Q | No | 0.8571 | 0.6667 | 0.7000 | |
| model_w_with_odds_short_high_HV | short_high_HV | W | Yes | 0.8889 | 0.8889 | 0.9000 | |
| model_q_with_odds_short_high_HV | short_high_HV | Q | Yes | 1.0000 | 1.0000 | 0.7000 | |
| model_w_no_odds_short_high_ST | short_high_ST | W | No | 0.8222 | 0.7111 | 0.9184 | |
| model_q_no_odds_short_high_ST | short_high_ST | Q | No | 0.5856 | 0.2342 | 0.7551 | |
| model_w_with_odds_short_high_ST | short_high_ST | W | Yes | 0.9583 | 0.8667 | 0.9184 | |
| model_q_with_odds_short_high_ST | short_high_ST | Q | Yes | 0.7140 | 0.4775 | 0.7755 | |
| model_w_no_odds_short_mid_HV | short_mid_HV | W | No | 0.6407 | 0.3074 | 0.9153 | |
| model_q_no_odds_short_mid_HV | short_mid_HV | Q | No | 0.5879 | 0.2621 | 0.7458 | |
| model_w_with_odds_short_mid_HV | short_mid_HV | W | Yes | 0.8130 | 0.6333 | 0.9153 | |
| model_q_with_odds_short_mid_HV | short_mid_HV | Q | Yes | 0.6902 | 0.4106 | 0.7458 | |
| model_w_no_odds_short_mid_ST | short_mid_ST | W | No | 0.5586 | 0.1545 | 0.9167 | |
| model_q_no_odds_short_mid_ST | short_mid_ST | Q | No | 0.6726 | 0.4000 | 0.7500 | |
| model_w_with_odds_short_mid_ST | short_mid_ST | W | Yes | 0.7664 | 0.5364 | 0.9167 | |
| model_q_with_odds_short_mid_ST | short_mid_ST | Q | Yes | 0.8185 | 0.5222 | 0.7500 | |
| model_w_no_odds_short_low_HV | short_low_HV | W | No | 0.5883 | 0.3571 | 0.9157 | |
| model_q_no_odds_short_low_HV | short_low_HV | Q | No | 0.6260 | 0.3710 | 0.7470 | |
| model_w_with_odds_short_low_HV | short_low_HV | W | Yes | 0.7509 | 0.4398 | 0.9157 | |
| model_q_with_odds_short_low_HV | short_low_HV | Q | Yes | 0.8241 | 0.5192 | 0.7470 | |
| model_w_no_odds_short_low_ST | short_low_ST | W | No | 0.6215 | 0.3120 | 0.9255 | |
| model_q_no_odds_short_low_ST | short_low_ST | Q | No | 0.6080 | 0.3581 | 0.7766 | |
| model_w_with_odds_short_low_ST | short_low_ST | W | Yes | 0.9122 | 0.7586 | 0.9255 | |
| model_q_with_odds_short_low_ST | short_low_ST | Q | Yes | 0.8477 | 0.5760 | 0.7979 | |
| model_w_no_odds_mid_high_HV | mid_high_HV | W | No | 0.5784 | 0.4706 | 0.8500 | |
| model_q_no_odds_mid_high_HV | mid_high_HV | Q | No | 0.4881 | 0.3333 | 0.7000 | |
| model_w_with_odds_mid_high_HV | mid_high_HV | W | Yes | 0.3824 | 0.2353 | 0.8500 | |
| model_q_with_odds_mid_high_HV | mid_high_HV | Q | Yes | 0.4524 | 0.2381 | 0.7000 | |
| model_w_no_odds_mid_high_ST | mid_high_ST | W | No | 0.3155 | 0.4724 | 0.9206 | |
| model_q_no_odds_mid_high_ST | mid_high_ST | Q | No | 0.5903 | 0.2542 | 0.7619 | |
| model_w_with_odds_mid_high_ST | mid_high_ST | W | Yes | 0.7017 | 0.5414 | 0.9206 | |
| model_q_with_odds_mid_high_ST | mid_high_ST | Q | Yes | 0.8160 | 0.6792 | 0.7619 | |
| model_w_no_odds_mid_mid_HV | mid_mid_HV | W | No | 0.6212 | 0.3636 | 0.9167 | |
| model_q_no_odds_mid_mid_HV | mid_mid_HV | Q | No | 0.6070 | 0.3704 | 0.7500 | |
| model_w_with_odds_mid_mid_HV | mid_mid_HV | W | Yes | 0.6970 | 0.6061 | 0.9167 | |
| model_q_with_odds_mid_mid_HV | mid_mid_HV | Q | Yes | 0.6914 | 0.4074 | 0.7500 | |
| model_w_no_odds_mid_mid_ST | mid_mid_ST | W | No | 0.5858 | 0.2819 | 0.9273 | |
| model_q_no_odds_mid_mid_ST | mid_mid_ST | Q | No | 0.6279 | 0.2229 | 0.8000 | |
| model_w_with_odds_mid_mid_ST | mid_mid_ST | W | Yes | 0.7322 | 0.4216 | 0.9273 | |
| model_q_with_odds_mid_mid_ST | mid_mid_ST | Q | Yes | 0.7345 | 0.4302 | 0.7727 | |
| model_w_no_odds_mid_low_HV | mid_low_HV | W | No | 0.7155 | 0.3966 | 0.9368 | |
| model_q_no_odds_mid_low_HV | mid_low_HV | Q | No | 0.7224 | 0.4155 | 0.7684 | |
| model_w_with_odds_mid_low_HV | mid_low_HV | W | Yes | 0.8024 | 0.5072 | 0.9158 | |
| model_q_with_odds_mid_low_HV | mid_low_HV | Q | Yes | 0.7424 | 0.5241 | 0.7789 | |
| model_w_no_odds_mid_low_ST | mid_low_ST | W | No | 0.6012 | 0.2952 | 0.9265 | |
| model_q_no_odds_mid_low_ST | mid_low_ST | Q | No | 0.6318 | 0.2811 | 0.7647 | |
| model_w_with_odds_mid_low_ST | mid_low_ST | W | Yes | 0.7420 | 0.4492 | 0.9265 | |
| model_q_with_odds_mid_low_ST | mid_low_ST | Q | Yes | 0.7272 | 0.3623 | 0.7794 | |
| model_w_no_odds_long_high_HV | long_high_HV | W | No | 1.0000 | 1.0000 | 0.9000 | |
| model_q_no_odds_long_high_HV | long_high_HV | Q | No | 0.8095 | 0.7143 | 0.7000 | |
| model_w_with_odds_long_high_HV | long_high_HV | W | Yes | 1.0000 | 1.0000 | 0.9000 | |
| model_q_with_odds_long_high_HV | long_high_HV | Q | Yes | 1.0000 | 1.0000 | 0.7000 | |
| model_w_no_odds_long_high_ST | long_high_ST | W | No | 0.6763 | 0.4103 | 0.9070 | |
| model_q_no_odds_long_high_ST | long_high_ST | Q | No | 0.5215 | 0.2608 | 0.7442 | |
| model_w_with_odds_long_high_ST | long_high_ST | W | Yes | 0.9295 | 0.8205 | 0.9070 | |
| model_q_with_odds_long_high_ST | long_high_ST | Q | Yes | 0.7097 | 0.3898 | 0.6977 | |
| model_w_no_odds_long_mid_HV | long_mid_HV | W | No | 0.2841 | 0.5000 | 0.9167 | |
| model_q_no_odds_long_mid_HV | long_mid_HV | Q | No | 0.3704 | 0.4444 | 0.7500 | |
| model_w_with_odds_long_mid_HV | long_mid_HV | W | Yes | 0.4318 | 0.4545 | 0.9167 | |
| model_q_with_odds_long_mid_HV | long_mid_HV | Q | Yes | 0.7963 | 0.4444 | 0.7500 | |
| model_w_no_odds_long_mid_ST | long_mid_ST | W | No | 0.7300 | 0.5200 | 0.9259 | |
| model_q_no_odds_long_mid_ST | long_mid_ST | Q | No | 0.6746 | 0.4048 | 0.7778 | |
| model_w_with_odds_long_mid_ST | long_mid_ST | W | Yes | 0.6500 | 0.5000 | 0.9259 | |
| model_q_with_odds_long_mid_ST | long_mid_ST | Q | Yes | 0.7738 | 0.5952 | 0.7778 | |
| model_w_no_odds_long_low_HV | long_low_HV | W | No | 0.6779 | 0.3651 | 0.9130 | |
| model_q_no_odds_long_low_HV | long_low_HV | Q | No | 0.7479 | 0.3939 | 0.7464 | |
| model_w_with_odds_long_low_HV | long_low_HV | W | Yes | 0.7444 | 0.4365 | 0.9130 | |
| model_q_with_odds_long_low_HV | long_low_HV | Q | Yes | 0.7606 | 0.3947 | 0.7319 | |
| model_w_no_odds_long_low_ST | long_low_ST | W | No | 0.5354 | 0.1605 | 0.9219 | |
| model_q_no_odds_long_low_ST | long_low_ST | Q | No | 0.6552 | 0.3197 | 0.7500 | |
| model_w_with_odds_long_low_ST | long_low_ST | W | Yes | 0.7812 | 0.6124 | 0.9219 | |
| model_q_with_odds_long_low_ST | long_low_ST | Q | Yes | 0.6919 | 0.3370 | 0.7708 | |
| model_w_no_odds | Global | W | No | 0.6374 | 0.2549 | 0.9115 | |
| model_q_no_odds | Global | Q | No | 0.6707 | 0.2873 | 0.7249 | |
| model_w_with_odds | Global | W | Yes | 0.7693 | 0.4725 | 0.9115 | |
| model_q_with_odds | Global | Q | Yes | 0.7293 | 0.3623 | 0.7488 |