Churn Model Performance Dashboard

Criterion
Count of Subscribers

2,767,960

Scoring Date

9th Apr 2014

Model KPI Refresh

Date

7th Apr 2014

No. Of KPIs

10
Model Summary
Gini
index

Criterion
Out of Time Validation
Data
Current Scoring Data

0.67
0.61

Deciles wise distribution of KPIs-Current

1
2
3
4
5

KPIs

11.991 11.854 12.363 14.416

DREC_STATUS_DIFF_DAILY_COUNT_F4_F6
13.319 13.450 13.278 14.351
116.24
IC_AVG_TOT_CALL_CNT_DAILY_F4F6
75.733 74.074 60.453
2
IC_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6
.054 .169
.138 .098
IC_RATIO_LOC_CALL_DUR_DAILY_F5_F1F6
.166 .157
.161 .183
OG_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6
.041 .223
.154 .093
SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F1_F1F6
.037 .068
.080 .063
SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F5_F1F6
.181 .172
.175 .183
TOT_NUM_RECHARGE_AVG_DAILY_F4F6
9.914 9.371 9.020 13.207
TOT_SERVICES_DIFF_DAILY_F1_F6
-1.371 -.505 -.471 -.553
DREC_STATUS_AVG_DAILY_COUNT_F3F5

Gini index

14.766
13.975
118.87
9
.111
.178
.097
.068
.182
13.295
-.482

10

15.079
14.100
134.53
6
.097
.185
.092
.074
.190
14.454
-.429

15.174
14.266
105.47
6
.112
.180
.116
.073
.181
13.991
-.395

14.853
14.383
181.37
1
.111
.180
.129
.080
.174
15.963
-.375

15.268
14.661
182.79
1
.112
.179
.127
.077
.173
17.166
-.376

15.254
14.146
147.88
5
.116
.183
.109
.081
.175
15.087
-.363

Model KPI Distribution

Descriptive Statistics
KPIs
Input Deviation
TOT_SERVICES_DIFF_DAILY_F1_F6
DREC_STATUS_AVG_DAILY_COUNT_F3F5
TOT_NUM_RECHARGE_AVG_DAILY_F4F6
IC_AVG_TOT_CALL_CNT_DAILY_F4F6
DREC_STATUS_DIFF_DAILY_COUNT_F4_F6
SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F1_F1F6
OG_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6
SMS_RATIO_USAGE_FLAG_DAILY_COUNT_F5_F1F6
IC_RATIO_LOC_CALL_DUR_DAILY_F5_F1F6
IC_RATIO_LOC_CALL_CNT_DAILY_F1_F4F6
Output Deviation
CHURN_PROPENSITY_SCORE
Deviation Index For KPIs

Deviation
Index

-0.29
0.13
-0.10
-0.17
0.21
-0.35
-0.04
-0.02
0.12
-0.04
0.21

Churn Scoring Data (9th Apr 2014)

Case Summaries
Maximum
Gini
0.61

FRACTIONAL RANK OF CHURN_PROPENSITY_SCORE

Case weighted by count

Lorenz Curve

Key Takeaways
Gini index values are consistent across out of time validation data and scoring data indicating no significant deviation in model
performance
Deviation index for Model KPIs as well as Churn Propensity score is with in acceptable threshold limit i.e. (+ or -) 1.25

Segmentation Model Performance Dashboard

Cluster Distribution Summary
Criterion
Count of Subscribers
16,792,258
Scoring Date
03rd Apr 2014
Model KPI Refresh
31st Mar 2014
Date
No. Of KPIs
8
Model Summary
Cluster
Code
Cluster
Cluster
Cluster
Cluster
Cluster
Cluster

Nomenclature
1
2
3
4
5
6

Consistent Users
Onnet Users
Offnet Users
Internet Savvy
VAS Users
SMS Users

Out of Time Validation

Current Scored Base

Cluster Nomenclature
Descriptive Statistics
KPIs

Cluster wise distribution of KPIs-Current

Deviation Index

Input Deviation
RATIO_OG_OFFNET_VOICE_CALL_DUR_M1M3

0.06

RATIO_OG_ROAM_VOICE_CALL_DUR_M1M3

-0.92
0.77
-0.12
-0.81
-0.09
-0.20
-0.02

RATIO_REV_DATA_USAGE_M1M3
RATIO_REV_MMS_USAGE_M1M3
RATIO_REV_MUSIC_USAGE_M1M3
RATIO_REV_OTHER_VAS_USAGE_M1M3
RATIO_REV_SMS_USAGE_M1M3
RATIO_REV_VAS_SUBSCRIPTION_M1M3

Deviation Index For KPIs

KPIs

Cluster 1 Cluster 2 Cluster 3 Cluster 4 Cluster 5 Cluster 6

RATIO_OG_OFFNET_VOICE_CALL_DUR_M1M3

.393

.150

.727

.389

.416

.432

RATIO_OG_ROAM_VOICE_CALL_DUR_M1M3

.000

.000

.000

.000

.000

.000

RATIO_REV_DATA_USAGE_M1M3

.088

.072

.082

.858

.123

.106

RATIO_REV_MMS_USAGE_M1M3

.003

.002

.002

.006

.002

.006

RATIO_REV_MUSIC_USAGE_M1M3

.001

.000

.001

.000

.000

.001

RATIO_REV_OTHER_VAS_USAGE_M1M3

.712

.036

.038

.036

.056

.048

RATIO_REV_SMS_USAGE_M1M3

.048

.026

.045

.030

.036

.760

RATIO_REV_VAS_SUBSCRIPTION_M1M3

.072

.033

.046

.224

.705

.063

Model KPI Distribution

Key Takeaways
Cluster distribution values are consistent across out of time validation data and scoring data indicating no
significant deviation in model performance
Deviation index for Model KPIs is with in acceptable threshold limit i.e. (+ or -) 1.25