Depth-based Classification for Multivariate Data

Ondřej Vencálek


Concept of data depth provides one possible approach to the analysis of multivariate data.
Among other it can be also used for classification purposes. The present paper is an overview of the research in the field of depth-based classification for multivariate data.
It provides a short summary of current state of knowledge in the field of depth-based classification followed by detailed discussion of four main directions in the depth-based classification, namely semiparametric depth-based classifiers, maximal depth classifier, (maximal depth) classifiers which use local depth functions and finally advanced depth-based classifiers.
We do not restrict our attention only on proposed classifiers. The paper rather aims to overview the ideas connected with depth-based classification and problems that were discussed in this context.

Full Text:



Billor N, Abebe A, Turkmen A, Nudurupati SV (2008). Classification Based on Depth Transvariations. Journal of classification, 25(2), 249-260.

Christmann A (2006). Regression Depth and Support Vector Machine. DIMACS series in discrete mathematics and theoretical computer science, 72, 71-86.

Christmann A, Fischer P, Joachims T (2002). Comparison between Various Regression Depth Methods and the Support Vector Machine to Approximate the Minimum Number of Missclassifications. Computational Statistics, 17(2), 273-287.

Christmann A, Rousseeuw PJ (2001). Measuring Overlap in Binary Regression. Computational Statistics & Data Analysis, 37(1), 65-75.

Cui X, Lin L, Yang G (2008). An Extended Projection Data Depth and Its Applications to Discrimination. Communications in Statistics - Theory and Methods, 37(14), 2276-2290.

Dutta S, Ghosh AK (2012). On Robust Classification Using Projection Depth. Annals of the Institute of Statistical Mathematics, 64(3), 657-676.

Dutta S, Ghosh AK (2015). Multi-scale Classification Using Localized Spatial Depth. arXiv preprint arXiv:1504.03804.

Dutta S, Ghosh AK (2016). On Affine Invariant L p Depth Classifiers based on an Adaptive Choice of p. arXiv preprint arXiv:1611.05668.

Ghosh AK, Chaudhuri P (2005a). On Data Depth and Distribution-free Discriminant Analysis Using Separating Surfaces. Bernoulli, pp. 1-27.

Ghosh AK, Chaudhuri P (2005b). On Maximum Depth and Related Classifiers. Scandinavian Journal of Statistics, 32(2), 327-350.

Gilad-Bachrach R, Burges CJ (2013). Classifier Selection Using the Predicate Depth. Journal of Machine Learning Research, 14(1), 3591-3618.

Hall P, Titterington D, Xue JH (2009). Median-Based Classifiers for High-Dimensional Data. Journal of the American Statistical Association, 104(488), 1597-1608.

Hartikainen A, Oja H (2006). On Some Parametric, Nonparametric and Semiparametric Discrimination Rules. DIMACS Series in Discrete Mathematics and Theoretical Computer Science, 72, 61-70.

Hlubinka D, Vencalek O (2013). Depth-based Classification for Distributions with Nonconvex Support. Journal of Probability and Statistics, 2013.

Hubert M, Rousseeuw PJ, Segaert P (2015).Multivariate and Functional Classification Using Depth and Distance. arXiv preprint arXiv:1504.01128.

Hubert M, Van der Veeken S (2010a). Fast and Robust Classifiers Adjusted for Skewness. In Lechevallier, Y., Saporta, G. (Eds.), Proceedings of COMPSTAT 2010, pp. 1135-1142. Physica-Verlag.

Hubert M, Van der Veeken S (2010b). Robust Classification for Skewed Data." Advances in Data Analysis and Classification, 4(4), 239-254.

Jin J, Cui H (2010). Discriminant Analysis Based on Statistical Depth. Journal of Systems Science and Complexity, 23(2), 362-371.

Jörnsten R (2004). Clustering and Classification Based on the L1 Data Depth." Journal of Multivariate Analysis, 90(1), 67-89.

Kosiorowski D (2008). Robust Classification and Clustering Based on the Projection Depth Function. In Brito, P. (Eds.), Proceedings of COMPSTAT 2008, volume II, pp. 209-216. Physica-Verlag.

Kosiorowski D, Bocian M, Bujak A (2014). A Combination of Localdepth and svm Algorithms in Automatic Identification and Prediction of a Market State. In Knowledge-Economy-Society: Contemporary Tools of Organizational Resources Management, pp. 225-237. Cracow University of Economics.

Kumar S, Kumar A, Kumar A, Hegde RM (2015). Hybrid Maximum Depth-kNN Method for Real Time Node Tracking Using Multi-sensor Data. In 2015 IEEE International Conference on Communications (ICC), pp. 6652-6657. IEEE.

Lange T, Mosler K, Mozharovskyi P (2014a). DDα-classification of Asymmetric and Fattailed Data. In Data Analysis, Machine Learning and Knowledge Discovery, pp. 71-78. Springer.

Lange T, Mosler K, Mozharovskyi P (2014b). Fast Nonparametric Classification Based on Data Depth. Statistical Papers, 55(1), 49-69.

Li J, Cuesta-Albertos JA, Liu RY (2012). DD-classifier: Nonparametric Classification Procedure Based on DD-plot. Journal of the American Statistical Association, 107(498), 737-753.

Liu RY (1990). On a Notion of Data Depth Based on Random Simplices. The Annals of Statistics, 18(1), 405-414.

Mosler K, Hoberg R (2006). Data Analysis and Classification with the Zonoid Depth. DIMACS Series in Discrete Mathematics and Theoretical Computer Science, 72, 49-59.

Mozharovskyi P (2015). Contributions to Depth-based Classification and Computation of the Tukey Depth. Ph.D. thesis.

Mozharovskyi P, Mosler K, Lange T (2015). Classifying Real-world Data with the fDDgn Alpha-procedure. Advances in Data Analysis and Classification, 9(3), 287-314.

Paindaveine D, Van Bever G (2013). From Depth to Local Depth: A Focus on Centrality. Journal of the American Statistical Association, 108(503), 1105-1119.

Paindaveine D, Van Bever G (2015). Nonparametrically Consistent Depth-based Classifiers. Bernoulli, 21(1), 62-82.

Pokotylo O, Mosler K (2016). Classification with the Pot-pot Plot. arXiv preprint arXiv:1608.02861.

Pokotylo O, Mozharovskyi P, Dyckerhoff R (2016). Depth and Depth-based Classification with R-package ddalpha." arXiv preprint arXiv:1608.04109.

Vencalek O (2011). Weighted Data Depth and Depth Based Discrimination. Ph.D. thesis, Doctoral Thesis. Charles University. Prague. URL

Vencalek O (2013). New Depth-based Modification of the k-nearest Neighbour Method. SOP Transactions on Statistics and Analysis, 1(2), 131-138.



  • There are currently no refbacks.

@Matthias Templ (using Open Journal Systems) -- see previous editions at