2026-09-18T19:38:49Zhttps://mro.massey.ac.nz/server/oai/requestoai:mro.massey.ac.nz:10179/42872025-11-12T14:04:51Zcom_10179_294col_10179_296
DSpace at Massey University
author
Anwar, Muhammad Nafees
2013-04-16T01:53:59Z
2013-04-16T01:53:59Z
2012
http://hdl.handle.net/10179/4287
Q112888752
https://www.wikidata.org/wiki/Q112888752
The class imbalance problem is a challenge in the statistical, machine learn-
ing and data mining domains. Examples include fraud/intrusion detection,
medical diagnosis/monitoring, bioinformatics, text categorization, insurance
claims, and target marketing. The problem with imbalanced data sets is that
the conventional classifiers (both statistical and machine learning algorithms)
aim at maximizing overall accuracy, which is often achieved by allocating all,
or almost all, cases to the majority class. Thus there tends to be bias against
the minority class in class imbalance situations.
Despite numerous algorithms and re-sampling techniques proposed in the
last few decades to tackle imbalanced classification problems, there is no
consistent winning strategy for all data sets (neither in terms of sampling, nor
learning algorithm). Special attention needs to be paid to the data in hand.
In doing so, one should take into account several factors simultaneously: the
imbalance rate, the data complexity, the algorithms and their associated
parameters. As suggested in the literature, mining such datasets can only
be improved by algorithms tailored to data characteristics; therefore it is
important and necessary to do data exploratory analysis before deciding on
a learning algorithm or re-sampling techniques.
In this study, we have developed a framework "Complexity Measurement"
(CM) to explore the connection between the imbalanced data problem and
data complexity. Our study shows that CM is an ideal candidate to be
recognized as a "goodness criterion" for various classifiers, re-sampling and
feature selection techniques in the class imbalance framework. We have used
CM as a meta-learner to choose the classifier and under-sampling strategy
that best fits the situation. We design a systematic over-sampling technique, Over-sampling using Complexity Measurement (OSCM) for dealing
with class overlap. Using OSCM, we do not need to search for an optimal
class distribution in order to get favorable accuracy for the minority class,
since the amount of over-sampling is determined by the complexity; ideally
using CM would detect fine structural differences (class-overlap and small
disjunct) between different classes.Existing feature selection techniques were never meant for class imbalanced data. We propose Feature Selection using Complexity Measurement
(FSCM), which can specifically focus on the minority class, hence those
features (and multivariate interactions between predictors) can be selected,
which form a better model for the minority class.
Methods developed have been applied to real datasets. The results from
imbalanced datasets show that CM, OSCM and FSCM are effective as a systematic way of correcting class imbalance/overlap and improving classifier
performance. Highly predictive models were built; discriminating patterns
were discovered, and automated optimization was proposed. The methodology proposed and knowledge discovered will benefit exploratory data analysis for imbalanced datasets. It may be taken as a judging criterion for new
algorithms and re-sampling techniques. Moreover, new data sets may be
evaluated using our CM criterion in order to build a sensible model.
en
The Author
Computational complexity
Class imbalance
Classification
Sampling
Statistics
Complexity measurement for dealing with class imbalance problems in classification modelling : a thesis submitted in fulfilment of the requirements for the degree of Doctor of Philosophy, Massey University, 2012
Thesis
PGgyPkNPUFlSSUdIVDwvaDI+DQo8cD5Db3B5cmlnaHQgcmVzaWRlcyB3aXRoIHRoZSBhdXRob3IsIGFuZCBpcyBnb3Zlcm5lZCBieSB0aGUgQ29weXJpZ2h0IEFjdCAxOTk0LiANCg0KPHA+VW5sZXNzIHlvdSBzdGF0ZSBvdGhlcndpc2UsIHRoZSANCkxpYnJhcnkgbWF5IGNvcHkgYWxsIG9yIHBhcnQgb2YgeW91ciB0aGVzaXMgPGJyPg0KYW5kIHByb3ZpZGUgaXQgdG8gYW5vdGhlciBpbnN0aXR1dGlvbiBmb3IgdGhlIHB1cnBvc2VzIG9mIHJlc2VhcmNoIGFuZCBwcml2YXRlIHN0dWR5LjwvcD4NCg0KPHA+WW91IG1heSBhc3NlcnQgeW91ciBtb3JhbCByaWdodCB0byBiZSBpZGVudGlmaWVkIGFzIHRoZSBhdXRob3Igb2YgdGhlIHdvcmsgaW4gYSBzdGF0ZW1lbnQgdG8gdGhpcyA8YnI+ZWZmZWN0IG9uIA0KdGhlIHZlcnNpb24gb2YgdGhlIHRpdGxlIHBhZ2UuPC9wPg0KDQo8cD5Nb3JlIGluZm9ybWF0aW9uIGNhbiBiZSBvYnRhaW5lZCBmcm9tIE1hc3NleSBVbml2ZXJzaXR5J3MgPGEgIGhyZWY9Imh0dHA6Ly9jb3B5cmlnaHQubWFzc2V5LmFjLm56LyI+Q29weXJpZ2h0IA0KDQpJbmZvcm1hdGlvbjwvYT4gd2ViIHNpdGUuIDwvcD4NCjxwPiBZb3Ugc2hvdWxkIGFsc28gYmUgYXdhcmUgb2YgTWFzc2V5IFVuaXZlcnNpdHkncyA8YSANCg0KaHJlZj0iaHR0cDovL3BvbGljeWd1aWRlLm1hc3NleS5hYy5uei9tYXNzZXkvZm9yL3N0YWZmL3BvbGljeS9wb2xpY2llcy9yZXNlYXJjaC9pbnRlbGxlY3R1YWwtcHJvcGVydHktDQoNCnBvbGljeS5jZm0iPkludGVsbGVjdHVhbCBQcm9wZXJ0eSBQb2xpY3k8L2E+LiA8L3A+
URL
https://mro.massey.ac.nz/bitstreams/37f1ea9b-7f14-4f4e-898b-ecd21e0908e2/download
File
MD5
46a7ed4f109d233f6cd53c37c6c4c17a
967966
application/pdf
02_whole.pdf
URL
https://mro.massey.ac.nz/bitstreams/51dc6c31-e9c3-4608-bd84-2ddcd35cd718/download
File
MD5
4a7ef3ab91b9f4f6790a8ba8436c49b5
81820
application/pdf
01_front.pdf
URL
https://mro.massey.ac.nz/bitstreams/870957ed-0971-4a43-8b95-ce0730e90f94/download
File
MD5
abc132c2524998f3b5666f5e8ef1dab8
448543
text/plain
02_whole.pdf.txt
URL
https://mro.massey.ac.nz/bitstreams/ee9ce0f9-3ea0-40a6-85be-4b91ea1c17ac/download
File
MD5
9097c6a1cd7991f5605e817ad9e78edf
24275
text/plain
01_front.pdf.txt