Speaker:Amulya Gupta

Neural Topic Modeling via Discrete Variational Inference

Topic models extract commonly occurring latent topics from textual data. Statistical models such as Latent Dirichlet Allocation (LDA) do not produce dense topic embeddings readily integratable into neural architectures, whereas earlier neural topic models are yet to fully take advantage of the discrete nature of the topic space. To bridge this gap, we propose a novel neural topic model, Discrete-Variational-Inference-based Topic Model (DVITM), which learns dense topic embeddings homomorphic to word embeddings via discrete variational inference. The model also views words as mixtures of topics and digests embedded input text. Quantitative and qualitative evaluations empirically demonstrate the superior performance of DVITM compared to important baseline models. In the end, case studies on text generation from a discrete space and aspect-aware item recommendation are presented to further illustrate the power of our model in downstream tasks.

Committee: Zhu Zhang (major professor), Bao Sheng, Qi Li, Jin Tian, and Wallapak Tavanapong

Join on Zoom: https://iastate.zoom.us/j/93815861978 or, go to https://iastate.zoom.us/join and enter meeting ID: 938 1586 1978