Given the growing complexity of tasks and data in NLP there are limited unsupervised learning methods to tackle the problems. In this paper we will look into novel approach to one of the problems as representing sentences in latent space using Recurrent Neural Network (RNN) and Variational Auto Encoder. Combining VAE-LSTM approach we will repharase (and generate similar and meaningful) sentences from given sentence. An our assumption same architecture can also be applied to language modeling problem. We will give results on using single layer encoder as well as 2 layer encoder for our VAE.
{"title":"Generating Semantic Sentences","authors":"Manish Periwal","doi":"10.2139/ssrn.2951669","DOIUrl":"https://doi.org/10.2139/ssrn.2951669","url":null,"abstract":"Given the growing complexity of tasks and data in NLP there are limited unsupervised learning methods to tackle the problems. In this paper we will look into novel approach to one of the problems as representing sentences in latent space using Recurrent Neural Network (RNN) and Variational Auto Encoder. Combining VAE-LSTM approach we will repharase (and generate similar and meaningful) sentences from given sentence. An our assumption same architecture can also be applied to language modeling problem. We will give results on using single layer encoder as well as 2 layer encoder for our VAE.","PeriodicalId":246368,"journal":{"name":"RCRN: Other Writing Technologies (Topic)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124855979","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}