Text Tutorials

These tutorials will help you learn how to create and use models that work with text and other natural language processing tasks.

Word Embedding

Pre-trained Word Embeddingshttps://gluon-nlp.mxnet.io/examples/word_embedding/word_embedding.html

Basics on how to use word embedding with vocab in GluonNLP and apply it on word similarity and analogy problems.

Word Embeddings Training and Evaluationhttps://gluon-nlp.mxnet.io/examples/word_embedding/word_embedding_training.html

Learn how to train fastText and word2vec embeddings on your own dataset, and determine embedding quality through intrinsic evaluation.

Language Model

LSTM-based Language Modelshttps://gluon-nlp.mxnet.io/examples/language_model/language_model.html

Learn what a language model is, what it can do, and how to train a word-level language model with truncated back-propagation-through-time (BPTT).

Machine Translation

Google Neural Machine Translationhttps://gluon-nlp.mxnet.io/examples/machine_translation/gnmt.html

Learn how to train Google Neural Machine Translation, a seq2seq with attention model.

Machine Translation with Transformerhttps://gluon-nlp.mxnet.io/examples/machine_translation/transformer.html

Learn how to use a pre-trained transformer translation model for English to German translation.

Sentence Embedding

ELMo: Deep Contextualized Word Representationshttps://gluon-nlp.mxnet.io/examples/sentence_embedding/elmo_sentence_representation.html

See how to use GluonNLP’s model API to automatically download the pre-trained ELMo model from NAACL2018 best paper, and extract features with it.

A Structured Self-attentive Sentence Embeddinghttps://gluon-nlp.mxnet.io/examples/sentence_embedding/self_attentive_sentence_embedding.html

See how to use GluonNLP to build more advanced model structure for extracting sentence embeddings to predict Yelp review rating.

BERT: Bidirectional Encoder Representations from Transformershttps://gluon-nlp.mxnet.io/examples/sentence_embedding/bert.html

See how to use GluonNLP to fine-tune a sentence pair classification model with pre-trained BERT parameters.

Sentiment Analysis

Sentiment Analysis by Fine-tuning Word Language Modelhttps://gluon-nlp.mxnet.io/examples/sentiment_analysis/sentiment_analysis.html

See how to fine-tune a pre-trained language model to perform sentiment analysis on movie reviews.

Sequence Sampling