Institute of Natural and Mathematical Sciences

Browse

Now showing 1 - 2 of 2

Dealing with missing data
(Massey University, 2002) Scheffer, Judi
What is done with missing data? Does the missingness mechanism matter? Is it a good idea to just use the default options in the major statistical packages? Even some highly trained statisticians do this, so can the non-statistician analysing their own data cope with some of the better techniques for handling missing data? This paper shows how the mean and standard deviation are affected by different methods of imputation, given different missingness mechanisms. Better options than the standard default options are available in the major statistical software, offering the chance to 'do the right thing' to the statistical and non-statistical community alike.
Data mining in the survey setting: why do children go off the rails?
(Massey University, 2002) Scheffer, Judi
Data Mining is relatively new in the field of statistics, although widely used elsewhere. Is it a good idea to discard the model-based methods in favour of Data Driven methods? Data driven methods produce a high degree of accuracy, but very little interpretability. Model based methods are interpretable, but lack accuracy. Data mining techniques are commonly used where the data collection has been automated. I will show these methods are also useful in the large survey setting.