Mostrar registro simples

dc.contributor.authorKuncheva, Ludmila I. .
dc.contributor.authorRodríguez Diez, Juan José 
dc.date.accessioned2018-06-18T11:52:23Z
dc.date.issued2018-09
dc.identifier.issn0031-3203
dc.identifier.urihttp://hdl.handle.net/10259/4814
dc.description.abstractHigh-dimensional data with very few instances are typical in many application domains. Selecting a highly discriminative subset of the original features is often the main interest of the end user. The widely-used feature selection protocol for such type of data consists of two steps. First, features are selected from the data (possibly through cross-validation), and, second, a cross-validation protocol is applied to test a classifier using the selected features. The selected feature set and the testing accuracy are then returned to the user. For the lack of a better option, the same low-sample-size dataset is used in both steps. Questioning the validity of this protocol, we carried out an experiment using 24 high-dimensional datasets, three feature selection methods and five classifier models. We found that the accuracy returned by the above protocol is heavily biased, and therefore propose an alternative protocol which avoids the contamination by including both steps in a single cross-validation loop. Statistical tests verify that the classification accuracy returned by the proper protocol is significantly closer to the true accuracy (estimated from an independent testing set) compared to that returned by the currently favoured protocol.en
dc.description.sponsorshipproject RPG-2015-188 funded by The Leverhulme Trust, UK and by project TIN2015-67534-P (MINECO/FEDER, UE) funded by the Ministerio de Economía y Competitividad of the Spanish Government and European Union FEDER fundsen
dc.format.mimetypeapplication/pdf
dc.language.isoenges
dc.publisherElsevieren
dc.relation.ispartofPattern Recognition. 2018, V. 81, p. 660-673en
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectFeature selectionen
dc.subjectWide datasetsen
dc.subjectExperimental protocoen
dc.subjectTraining/testingen
dc.subjectCross-validationen
dc.subject.otherComputer scienceen
dc.subject.otherInformáticaes
dc.titleOn feature selection protocols for very low-sample-size dataen
dc.typeinfo:eu-repo/semantics/article
dc.date.embargo2020-09
dc.rights.accessRightsinfo:eu-repo/semantics/openAccess
dc.relation.publisherversionhttps://doi.org/10.1016/j.patcog.2018.03.012
dc.identifier.doi10.1016/j.patcog.2018.03.012
dc.relation.projectIDinfo:eu-repo/grantAgreement/MINECO/TIN2015-67534-P
dc.relation.projectIDinfo:eu-repo/grantAgreementThe Leverhulme Trust/RPG-2015-188
dc.type.hasVersioninfo:eu-repo/semantics/acceptedVersionen


Arquivos deste item

Thumbnail

Este item aparece na(s) seguinte(s) coleção(s)

Mostrar registro simples