CAN MULTIPLE MODELS IMPROVE BAYESIAN'S PERFORMANCE? AN INVESTIGATION USING MCNEMAR'S TEST
DOI:
https://doi.org/10.57041/pjs.v67i4.600Keywords:
McNemar’s Test, Naïve Bayes, Boosting, Bagging, Stacking, Performance Evaluation, ClassificationAbstract
Machine learning algorithms have been widely used for classification purposes in a number of research domains; however, very few researches paid any attention to statistically validate the performance of these algorithms for different data. This paper attempted to study the Naïve Bayes algorithm’s performance for dataset of different sizes. Furthermore, a known theory has also been investigated, that building multiple models such as Bagging, Boosting and Stacking tend to improve a classifier’s performance. The analysis has been performed using McNemar’s test; a well known nonparametric statistical test in the medical analysis domain. Results showed that not all ensemble methods work as expected and therefore, needs to be selected carefully. Moreover, the use of McNemar’s test appeared to be simple, but gave statistically valid results.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2015 Pakistan Journal of Science
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
http://creativecommons.org/licenses/by-sa/4.0