Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Mining Supervised Classification Performance Studies: A Meta-Analytic Investigation

Mining Supervised Classification Performance Studies: A Meta-Analytic Investigation There have been many comparative studies of classification methods in which real datasets are used as a gauge to assess the relative performance of the methods. Since these comparisons often yield inconclusive or limited results on how methods perform, it is often believed that a broader approach combining these studies would shed some light on this difficult question. This paper describes such an attempt: we have sampled the available literature and created a dataset of 5807 classification results. We show that one of the possible ways to analyze the resulting data is an overall assessment of the classification methods, and we present methods for that particular aim. The merits and demerits of such an approach are discussed, and conclusions are drawn which may assist future research: we argue that the current state of the literature hardly allows large-scale investigations. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Journal of Classification Springer Journals

Mining Supervised Classification Performance Studies: A Meta-Analytic Investigation

Journal of Classification , Volume 25 (1) – Jun 26, 2008

Loading next page...
 
/lp/springer-journals/mining-supervised-classification-performance-studies-a-meta-analytic-5KJqo4WzyT

References (38)

Publisher
Springer Journals
Copyright
Copyright © 2008 by Springer Science+Business Media, LLC
Subject
Statistics; Marketing ; Psychometrics; Signal, Image and Speech Processing; Bioinformatics; Pattern Recognition; Statistical Theory and Methods
ISSN
0176-4268
eISSN
1432-1343
DOI
10.1007/s00357-008-9003-y
Publisher site
See Article on Publisher Site

Abstract

There have been many comparative studies of classification methods in which real datasets are used as a gauge to assess the relative performance of the methods. Since these comparisons often yield inconclusive or limited results on how methods perform, it is often believed that a broader approach combining these studies would shed some light on this difficult question. This paper describes such an attempt: we have sampled the available literature and created a dataset of 5807 classification results. We show that one of the possible ways to analyze the resulting data is an overall assessment of the classification methods, and we present methods for that particular aim. The merits and demerits of such an approach are discussed, and conclusions are drawn which may assist future research: we argue that the current state of the literature hardly allows large-scale investigations.

Journal

Journal of ClassificationSpringer Journals

Published: Jun 26, 2008

There are no references for this article.