Study in IRLAB

Opening The Vocabulary of Neural Language Models with Character-Level Word Representations

Posted on | In

Opening The Vocabulary of Neural Language Models with Character-Level Word Representations

a opening-vocabulary neural language model by Matthieu Labeau and Alexandre Allauzen in LIMSI-CNRS / Orsay, France

  • Goal: an open-vocabulary neural language model
  • Advantage: can consider any word, that is the model can build representations of unknown words.
  • Experiment: gain up tp 0.7 BLEU point.