Predictive Power Measures for Scoring Models

Warning

This publication doesn't include Institute of Computer Science. It includes Faculty of Science. Official publication website can be found on muni.cz.
Authors

KOLÁČEK Jan ŘEZÁČ Martin

Year of publication 2010
Type Appeared in Conference without Proceedings
MU Faculty or unit

Faculty of Science

Citation
Description Credit scoring models are widely used to predict a probability of an event like client's default. To measure the quality of the scoring models it is possible to use quantitative indexes such as Gini index, K-S statistics, C-statistics and Lift. They are used for comparison of several developed models at the moment of development as well as for monitoring of quality of those models after deployment into real business. The paper deals with mentioned quality indexes, their properties and relationships. The main contribution of the paper is proposition and discussion of indexes and curves based on Lift. Curve of ideal Lift is defined, Lift ratio is proposed as analogy to Gini index. Integrated Relative Lift is defined and discussed. Also the problem of estimation of Information value is mentioned. Commonly it is computed by discretisation of data into bins using deciles. One constraint is required to be met in this case. Number of cases have to be nonzero for all bins. If this constraint is not fulfilled there are numerous practical procedures for preserving finite results. As an alternative method to empirical estimates we can use the kernel smoothing theory. Finally, a new approach to measure power of scoring models is discussed and a new quality index is proposed. A simulation study compares it with other quality indexes.
Related projects:

You are running an old browser version. We recommend updating your browser to its latest version.

More info