Date of Award


Degree Name

Master of Science


Computer Science

First Advisor

Rekabdar, Banafsheh


Tensor2Tensor is a library of deep learning models and datasets developed by the Google Brain team. The transformer models of this library are implemented using stacked self-attention layers instead of containing recurrent layers. Two of these transformer models have been chosen along with a few hyperparameter sets for analyzing the Internet Movie Database (IMDB). The runtime and accuracy of these models are then compared to themselves as well as the accuracy of previously known models.




This thesis is only available for download to the SIUC community. Current SIUC affiliates may also access this paper off campus by searching Dissertations & Theses @ Southern Illinois University Carbondale from ProQuest. Others should contact the interlibrary loan department of your local library or contact ProQuest's Dissertation Express service.