Authors:Amal Bouraoui;Salma Jamoussi andAbdelmajid Ben Hamadou
Affiliation:Multimedia InfoRmation systems and Advanced Computing Laboratory MIRACL, Sfax University, Technopole of Sfax, Av.Tunis Km 10 B.P. 242, Sfax, 3021, Tunisia
Keyword(s):Deep Learning, Word Embedding, Word Semantic, Recursive Auto-encoders.
Abstract:The meaning of a word depends heavily on the context in which it is embedded. Deep neural network have recorded recently a great success in representing the words’ meaning. Among them, auto-encoders based models have proven their robustness in representing the internal structure of several data. Thus, in this paper, we present a novel deep model to represent words meanings using auto-encoders and considering the left/right contexts around the word of interest. Our proposal, referred to as Bi-Recursive Auto-Encoders (Bi-RAE ), consists in modeling the meaning of a word as an evolved vector and learning its semantic features over its set of contexts.