Ensembles of neural networks for language modeling : a thesis presented in partial fulfilment of the requirements for the degree of Master of Philosophy in Information Technology at Massey University, Auckland, New Zealand

Simple item page
dc.contributor.authorXiao, Yujie
dc.date.accessioned2020-02-28T00:37:04Z
dc.date.available2020-02-28T00:37:04Z
dc.date.issued2018
dc.description.abstractLanguage modeling has been widely used in the application of natural language processing, and therefore gained a significant amount of following in recent years. The objective of language modeling is to simulate the probability distribution for different linguistic units, e.g., characters, words, phrases and sentences etc, using traditional statistical methods or modern machine learning approach. In this thesis, we first systematically studied the language model, including traditional discrete space based language model and latest continuous space based neural network based language model. Then, we focus on the modern continuous space based language model, which embed elements of language into a continuous-space, aim at finding out a proper word presentation for the given dataset. Mapping the vocabulary space into a continuous space, the deep learning model can predict the possibility of the future words based on the historical presence of vocabulary more efficiently than traditional models. However, they still suffer from various drawbacks, so we studied a series of variants of latest architecture of neural networks and proposed a modified recurrent neural network for language modeling. Experimental results show that our modified model can achieve competitive performance in comparison with existing state-of-the-art models with a significant reduction of the training time.en_US
dc.identifier.urihttp://hdl.handle.net/10179/15230
dc.language.isoenen_US
dc.publisherMassey Universityen_US
dc.rightsThe Authoren_US
dc.subjectLinguistic modelsen_US
dc.subjectData processingen_US
dc.subjectNeural networks (Computer science)en_US
dc.subjectNatural language processing (Computer science)en_US
dc.titleEnsembles of neural networks for language modeling : a thesis presented in partial fulfilment of the requirements for the degree of Master of Philosophy in Information Technology at Massey University, Auckland, New Zealanden_US
dc.typeThesisen_US
massey.contributor.authorXiao, Yujie
thesis.degree.disciplineInformation Technologyen_US
thesis.degree.levelMastersen_US
thesis.degree.nameMaster of Philosophy (MPhil)en_US
Files
Original bundle
Now showing 1 - 2 of 2
Thumbnail Image
Name:
01_front.pdf
Size:
82.5 KB
Format:
Adobe Portable Document Format
Description:
Download
Thumbnail Image
Name:
02_whole.pdf
Size:
1010.16 KB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
3.32 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Theses and Dissertations