2026-06-01T19:13:49Zhttps://riubu.ubu.es/oai/request

oai:riubu.ubu.es:10259/57662022-11-21T12:30:19Zcom_10259_4219com_10259_5086com_10259_2604col_10259_4220

Juez Gil, Mario 747 500 Arnaiz González, Álvar 39 500 0000-0001-6965-0237 Rodríguez Diez, Juan José 477 500 García Osorio, César 212 500 0000-0002-1206-1084 2021-05-14T11:34:01Z 2021-05-14T11:34:01Z 2021-09 1568-4946 http://hdl.handle.net/10259/5766 10.1016/j.asoc.2021.107447 Datasets are growing in size and complexity at a pace never seen before, forming ever larger datasets known as Big Data. A common problem for classification, especially in Big Data, is that the numerous examples of the different classes might not be balanced. Some decades ago, imbalanced classification was therefore introduced, to correct the tendency of classifiers that show bias in favor of the majority class and that ignore the minority one. To date, although the number of imbalanced classification methods have increased, they continue to focus on normal-sized datasets and not on the new reality of Big Data. In this paper, in-depth experimentation with ensemble classifiers is conducted in the context of imbalanced Big Data classification, using two popular ensemble families (Bagging and Boosting) and different resampling methods. All the experimentation was launched in Spark clusters, comparing ensemble performance and execution times with statistical test results, including the newest ones based on the Bayesian approach. One very interesting conclusion from the study was that simpler methods applied to unbalanced datasets in the context of Big Data provided better results than complex methods. The additional complexity of some of the sophisticated methods, which appear necessary to process and to reduce imbalance in normal-sized datasets were not effective for imbalanced Big Data. “la Caixa” Foundation, Spain, under agreement LCF/PR/PR18/51130007. This work was supported by the Junta de Castilla y León, Spain under project BU055P20 (JCyL/FEDER, UE) co-financed through European Union FEDER funds, and by the Consejería de Educación of the Junta de Castilla y León and the European Social Fund, Spain through a pre-doctoral grant (EDU/1100/2017). application/pdf eng Elsevier Applied Soft Computing. 2021, V. 108, 107447 https://doi.org/10.1016/j.asoc.2021.107447 info:eu-repo/grantAgreement/Fundación Bancaria Caixa d'Estalvis i Pensions de Barcelona//LCF%2FPR%2FPR18%2F51130007 info:eu-repo/grantAgreement/Junta de Castilla y León//BU055P20//Métodos y Aplicaciones Industriales del Aprendizaje Semisupervisado Attribution-NonCommercial-NoDerivatives 4.0 Internacional http://creativecommons.org/licenses/by-nc-nd/4.0/ info:eu-repo/semantics/openAccess Unbalance Imbalance Ensemble Resampling Big Data Spark Informática Computer science Experimental evaluation of ensemble classifiers for imbalance in Big Data info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion Applied Soft Computing 108 107447 THUMBNAIL juez-asc_2021.pdf.jpg juez-asc_2021.pdf.jpg IM Thumbnail image/jpeg 5078 https://riubu.ubu.es/bitstream/10259/5766/4/juez-asc_2021.pdf.jpg 8f97d453387ca79a75b421a18d62fa19 MD5 4 LICENSE license.txt license.txt text/plain; charset=utf-8 999 https://riubu.ubu.es/bitstream/10259/5766/3/license.txt b295bcbce42e2caabeb0c623d3860c06 MD5 3 CC-LICENSE license_rdf license_rdf application/rdf+xml; charset=utf-8 805 https://riubu.ubu.es/bitstream/10259/5766/2/license_rdf 4460e5956bc1d1639be9ae6146a50347 MD5 2 ORIGINAL juez-asc_2021.pdf juez-asc_2021.pdf application/pdf 771682 https://riubu.ubu.es/bitstream/10259/5766/1/juez-asc_2021.pdf 03d8e603f3e64a5ba5775bed2ac6733d MD5 1 10259/5766 oai:riubu.ubu.es:10259/5766 2022-11-21 13:30:19.68 Repositorio Institucional de la Universidad de Burgos bubrep@ubu.es RWwgYXV0b3IgY29tbyDDum5pY28gdGl0dWxhciBkZSBsb3MgZGVyZWNob3MgZGUgcHJvcGllZGFkIGludGVsZWN0dWFsIGRlIGxhIG9icmEsIG8gZGlzcG9uaWVuZG8gZGUgbG9zIGRlYmlkb3MgcGVybWlzb3MgZGUgbG9zIG90cm9zIHRpdHVsYXJlcywgc2kgbG9zIGh1YmllcmEsIHkgZW4gdmlydHVkIGRlIGxvcyBkZXJlY2hvcyBxdWUgbGUgY29uZmllcmUgbGEgbGVnaXNsYWNpw7NuIHZpZ2VudGUgc29icmUgcHJvcGllZGFkIGludGVsZWN0dWFsIHkgZGVyZWNob3MgZGUgYXV0b3IsIA0KQVVUT1JJWkEgYSBsYSBVbml2ZXJzaWRhZCBkZSBCdXJnb3MgYSBkaWZ1bmRpciwgZGUgbWFuZXJhIGdyYXR1aXRhLCBlbCBjb250ZW5pZG8gZGUgbG9zIGFyY2hpdm9zIGRpZ2l0YWxlcyBxdWUgY29ycmVzcG9uZGVuIGFsIGRvY3VtZW50byBkZXNjcml0byBhbnRlcmlvcm1lbnRlLCBjb24gY2Fyw6FjdGVyIG5vIGV4Y2x1c2l2byB5IGRlIG1hbmVyYSBww7pibGljYSBlbiBhY2Nlc28gYWJpZXJ0byBhIHRyYXbDqXMgZGUgSW50ZXJuZXQsIHBhcmEgbG8gcXVlIGxhIEJpYmxpb3RlY2EgcHJvY2VkZXLDoSBhIGFyY2hpdmFybG9zIGVuIGVsIFJlcG9zaXRvcmlvIEluc3RpdHVjaW9uYWwuIEFzaW1pc21vIGF1dG9yaXphIGEgbGEgVW5pdmVyc2lkYWQgZGUgQnVyZ29zIGEgcmVhbGl6YXIgbGFzIHRyYW5zZm9ybWFjaW9uZXMgbmVjZXNhcmlhcyBkZSBmb3JtYXRvLCBubyBkZSBjb250ZW5pZG8sIHBhcmEgZ2FyYW50aXphciBsYSBwcmVzZXJ2YWNpw7NuIHkgZWwgYWNjZXNvIGVuIGVsIGZ1dHVyby4NCg0KRWwgYXV0b3IgZGlzcG9uZSwgZW4gdG9kbyBjYXNvLCBkZWwgZGVyZWNobyBhIHJldm9jYXIgZXN0YSBhdXRvcml6YWNpw7NuLg0KDQpMYSBjZXNpw7NuIGRlIGRlcmVjaG9zIGRlIGVzdGEgb2JyYSBzZSBlbmN1ZW50cmEgc3VqZXRhIGEgbGEgbGVnaXNsYWNpw7NuIHZpZ2VudGUgc29icmUgcHJvcGllZGFkIGludGVsZWN0dWFsIHkgZGVyZWNob3MgZGUgYXV0b3Iu