Index
search
Quick search
edit
Edit on Github
Install
API
Community
Contribute
GitHub
Table Of Contents
Model Zoo
Model Catalog
Word Embedding
Language Model
Machine Translation
Text Classification
Sentiment Analysis
Natural Language Inference
Text Generation
Dependency Parsing
BERT
Named Entity Recognition
Intent Classification and Slot Labeling
Model Conversion Tools
Tutorials
Data Loading and Vocabularies
Data Loading API
Vocabulary and Embedding API
Representation Learning
Using Pre-trained Word Embeddings
Word Embeddings Training and Evaluation
Extracting Sentence Features with Pre-trained ELMo
Fine-tuning Pre-trained BERT Models
Language Modeling
Using Pre-trained Language Model
Train your own LSTM based Language Model
Machine Translation
Training GNMT on IWSLT 2015 Dataset
Using Pre-trained Transformer
Sentiment Analysis
Fine-tuning LSTM-based Language Model
Training Structured Self-attentive Sentence Embedding
Text Generation
Sequence Generation with Beam Search Sampler and Sequence Sampler
API Documentation
gluonnlp.vocab
gluonnlp.embedding
gluonnlp.data
gluonnlp.data.batchify
gluonnlp.model
gluonnlp.model.train
gluonnlp.loss
gluonnlp.initializer
gluonnlp.optimizer
gluonnlp.utils
Community
Contribution Guideline
Git Workflow Howtos
Release Checklist
Preview GluonNLP Website Locally
Index
Table Of Contents
Model Zoo
Model Catalog
Word Embedding
Language Model
Machine Translation
Text Classification
Sentiment Analysis
Natural Language Inference
Text Generation
Dependency Parsing
BERT
Named Entity Recognition
Intent Classification and Slot Labeling
Model Conversion Tools
Tutorials
Data Loading and Vocabularies
Data Loading API
Vocabulary and Embedding API
Representation Learning
Using Pre-trained Word Embeddings
Word Embeddings Training and Evaluation
Extracting Sentence Features with Pre-trained ELMo
Fine-tuning Pre-trained BERT Models
Language Modeling
Using Pre-trained Language Model
Train your own LSTM based Language Model
Machine Translation
Training GNMT on IWSLT 2015 Dataset
Using Pre-trained Transformer
Sentiment Analysis
Fine-tuning LSTM-based Language Model
Training Structured Self-attentive Sentence Embedding
Text Generation
Sequence Generation with Beam Search Sampler and Sequence Sampler
API Documentation
gluonnlp.vocab
gluonnlp.embedding
gluonnlp.data
gluonnlp.data.batchify
gluonnlp.model
gluonnlp.model.train
gluonnlp.loss
gluonnlp.initializer
gluonnlp.optimizer
gluonnlp.utils
Community
Contribution Guideline
Git Workflow Howtos
Release Checklist
Preview GluonNLP Website Locally
Index
Index
_
|
A
|
B
|
C
|
D
|
E
|
F
|
G
|
H
|
I
|
J
|
L
|
M
|
N
|
P
|
Q
|
R
|
S
|
T
|
U
|
V
|
W
|
X
|
Y
_
__call__() (gluonnlp.data.batchify.CorpusBatchify method)
(gluonnlp.data.batchify.CorpusBPTTBatchify method)
(gluonnlp.data.batchify.Dict method)
(gluonnlp.data.batchify.EmbeddingCenterContextBatchify method)
(gluonnlp.data.batchify.List method)
(gluonnlp.data.batchify.NamedTuple method)
(gluonnlp.data.batchify.Pad method)
(gluonnlp.data.batchify.Stack method)
(gluonnlp.data.batchify.StreamBPTTBatchify method)
(gluonnlp.data.batchify.Tuple method)
(gluonnlp.data.BERTBasicTokenizer method)
(gluonnlp.data.BERTSentenceTransform method)
(gluonnlp.data.BERTSPTokenizer method)
(gluonnlp.data.BERTTokenizer method)
(gluonnlp.data.ClipSequence method)
(gluonnlp.data.ConstWidthBucket method)
(gluonnlp.data.ExpWidthBucket method)
(gluonnlp.data.GPT2BPEDetokenizer method)
(gluonnlp.data.GPT2BPETokenizer method)
(gluonnlp.data.JiebaTokenizer method)
(gluonnlp.data.LinearWidthBucket method)
(gluonnlp.data.NLTKStanfordSegmenter method)
(gluonnlp.data.PadSequence method)
(gluonnlp.data.SacreMosesDetokenizer method)
(gluonnlp.data.SacreMosesTokenizer method)
(gluonnlp.data.SentencepieceDetokenizer method)
(gluonnlp.data.SentencepieceTokenizer method)
(gluonnlp.data.SpacyTokenizer method)
(gluonnlp.data.Splitter method)
(gluonnlp.Vocab method)
(gluonnlp.vocab.ByteSubwords method)
(gluonnlp.vocab.ELMoCharVocab method)
(gluonnlp.vocab.NGramHashes method)
(gluonnlp.vocab.SubwordFunction method)
__contains__() (gluonnlp.embedding.TokenEmbedding method)
__getitem__() (gluonnlp.embedding.TokenEmbedding method)
__iter__() (gluonnlp.data.DatasetStream method)
(gluonnlp.data.DataStream method)
(gluonnlp.data.PrefetchingStream method)
(gluonnlp.data.SimpleDatasetStream method)
(gluonnlp.data.SimpleDataStream method)
__len__() (gluonnlp.vocab.ByteSubwords method)
(gluonnlp.vocab.NGramHashes method)
(gluonnlp.vocab.SubwordFunction method)
__setitem__() (gluonnlp.embedding.TokenEmbedding method)
A
ActivationRegularizationLoss (class in gluonnlp.loss)
align_position2doc_spans() (in module gluonnlp.data)
allow_extend() (gluonnlp.embedding.TokenEmbedding property)
apply_weight_drop() (in module gluonnlp.model)
ATISDataset (class in gluonnlp.data)
AttentionCell (class in gluonnlp.model)
awd_lstm_lm_1150() (in module gluonnlp.model)
awd_lstm_lm_600() (in module gluonnlp.model)
AWDRNN (class in gluonnlp.model)
(class in gluonnlp.model.train)
B
BaiduErnieChnSentiCorp (class in gluonnlp.data)
BaiduErnieLCQMC (class in gluonnlp.data)
BaiduErnieXNLI (class in gluonnlp.data)
BakerVerb143 (class in gluonnlp.data)
BeamSearchSampler (class in gluonnlp.model)
BeamSearchScorer (class in gluonnlp.model)
begin_state() (gluonnlp.model.train.CacheCell method)
bert_12_768_12() (in module gluonnlp.model)
bert_24_1024_16() (in module gluonnlp.model)
BERTAdam (class in gluonnlp.optimizer)
BERTBasicTokenizer (class in gluonnlp.data)
BERTClassifier (class in gluonnlp.model)
BERTEncoder (class in gluonnlp.model)
BERTModel (class in gluonnlp.model)
BERTSentenceTransform (class in gluonnlp.data)
BERTSPTokenizer (class in gluonnlp.data)
BERTTokenizer (class in gluonnlp.data)
BERTVocab (class in gluonnlp.vocab)
big_rnn_lm_2048_512() (in module gluonnlp.model)
BiggerAnalogyTestSet (class in gluonnlp.data)
BigRNN (class in gluonnlp.model)
(class in gluonnlp.model.train)
BiLMEncoder (class in gluonnlp.model)
ByteSubwords (class in gluonnlp.vocab)
C
CacheCell (class in gluonnlp.model.train)
cast() (gluonnlp.model.AttentionCell method)
check_is_max_context() (in module gluonnlp.data)
check_version() (in module gluonnlp.utils)
clip_grad_global_norm() (in module gluonnlp.utils)
ClipSequence (class in gluonnlp.data)
CoLATask (class in gluonnlp.data)
concat_sequence() (in module gluonnlp.data)
concat_sequences() (in module gluonnlp.data)
ConcatDataset (class in gluonnlp.data)
CoNLL2000 (class in gluonnlp.data)
CoNLL2001 (class in gluonnlp.data)
CoNLL2002 (class in gluonnlp.data)
CoNLL2004 (class in gluonnlp.data)
ConstWidthBucket (class in gluonnlp.data)
convert_index() (in module gluonnlp.data)
convert_squad_examples() (in module gluonnlp.data)
convert_tokens_to_ids() (gluonnlp.data.BERTSPTokenizer method)
(gluonnlp.data.BERTTokenizer method)
ConvolutionalEncoder (class in gluonnlp.model)
CorpusBatchify (class in gluonnlp.data.batchify)
CorpusBPTTBatchify (class in gluonnlp.data.batchify)
CorpusDataset (class in gluonnlp.data)
CosineSimilarity (class in gluonnlp.embedding.evaluation)
count_tokens() (in module gluonnlp.data)
Counter (class in gluonnlp.data)
CR (class in gluonnlp.data)
create() (in module gluonnlp.data)
(in module gluonnlp.embedding)
(in module gluonnlp.embedding.evaluation)
create_state() (gluonnlp.optimizer.BERTAdam method)
create_state_multi_precision() (gluonnlp.optimizer.BERTAdam method)
create_subword_function() (in module gluonnlp.vocab)
CSREmbeddingModel (class in gluonnlp.model.train)
D
data() (gluonnlp.model.WeightDropParameter method)
dataset_dev() (gluonnlp.data.MNLITask method)
dataset_test() (gluonnlp.data.MNLITask method)
DatasetLoader (class in gluonnlp.data)
DatasetStream (class in gluonnlp.data)
DataStream (class in gluonnlp.data)
deserialize() (gluonnlp.embedding.TokenEmbedding static method)
Dict (class in gluonnlp.data.batchify)
discard() (gluonnlp.data.Counter method)
distilbert_6_768_12() (in module gluonnlp.model)
DistilBERTModel (class in gluonnlp.model)
DotProductAttentionCell (class in gluonnlp.model)
E
elmo_2x1024_128_2048cnn_1xhighway() (in module gluonnlp.model)
elmo_2x2048_256_2048cnn_1xhighway() (in module gluonnlp.model)
elmo_2x4096_512_2048cnn_2xhighway() (in module gluonnlp.model)
ELMoBiLM (class in gluonnlp.model)
ELMoCharacterEncoder (class in gluonnlp.model)
ELMoCharVocab (class in gluonnlp.vocab)
EmbeddingCenterContextBatchify (class in gluonnlp.data.batchify)
EmbeddingModel (class in gluonnlp.model.train)
Enwik8 (class in gluonnlp.data)
ernie_12_768_12() (in module gluonnlp.model)
ExpWidthBucket (class in gluonnlp.data)
F
FastText (class in gluonnlp.embedding)
FasttextEmbeddingModel (class in gluonnlp.model.train)
Fil9 (class in gluonnlp.data)
FixedBucketSampler (class in gluonnlp.data)
forward() (gluonnlp.model.BigRNN method)
(gluonnlp.model.RNNCellLayer method)
(gluonnlp.model.Seq2SeqEncoder method)
(gluonnlp.model.train.BigRNN method)
forward_backward() (gluonnlp.utils.Parallelizable method)
from_file() (gluonnlp.embedding.TokenEmbedding static method)
from_json() (gluonnlp.Vocab class method)
(gluonnlp.vocab.BERTVocab class method)
from_sentencepiece() (gluonnlp.vocab.BERTVocab class method)
from_w2v_binary() (gluonnlp.embedding.Word2Vec class method)
G
GBWStream (class in gluonnlp.data)
GELU (class in gluonnlp.model)
get() (gluonnlp.utils.Parallel method)
get_bpe_subword() (gluonnlp.data.GPT2BPETokenizer method)
get_cache_model() (in module gluonnlp.model.train)
get_dataset() (gluonnlp.data.CoLATask method)
(gluonnlp.data.MNLITask method)
(gluonnlp.data.MRPCTask method)
(gluonnlp.data.QNLITask method)
(gluonnlp.data.QQPTask method)
(gluonnlp.data.RTETask method)
(gluonnlp.data.SSTTask method)
(gluonnlp.data.STSBTask method)
(gluonnlp.data.WNLITask method)
(gluonnlp.data.XNLITask method)
get_doc_spans() (in module gluonnlp.data)
get_field() (gluonnlp.data.NumpyDataset method)
get_model() (in module gluonnlp.model)
get_task() (in module gluonnlp.data)
get_tokenizer() (in module gluonnlp.data)
glob() (in module gluonnlp.utils)
GloVe (class in gluonnlp.embedding)
GlueCoLA (class in gluonnlp.data)
GlueMNLI (class in gluonnlp.data)
GlueMRPC (class in gluonnlp.data)
GlueQNLI (class in gluonnlp.data)
GlueQQP (class in gluonnlp.data)
GlueRTE (class in gluonnlp.data)
GlueSST2 (class in gluonnlp.data)
GlueSTSB (class in gluonnlp.data)
GlueWNLI (class in gluonnlp.data)
gluonnlp (module)
gluonnlp.data (module)
gluonnlp.data.batchify (module)
gluonnlp.embedding (module)
gluonnlp.embedding.evaluation (module)
gluonnlp.initializer (module)
gluonnlp.loss (module)
gluonnlp.model (module)
gluonnlp.model.train (module)
gluonnlp.optimizer (module)
gluonnlp.utils (module)
gluonnlp.vocab (module)
GoogleAnalogyTestSet (class in gluonnlp.data)
GPT2BPEDetokenizer (class in gluonnlp.data)
GPT2BPETokenizer (class in gluonnlp.data)
grad_global_norm() (in module gluonnlp.utils)
H
Highway (class in gluonnlp.model)
HighwayBias (class in gluonnlp.initializer)
hybrid_forward() (gluonnlp.data.UnigramCandidateSampler method)
(gluonnlp.embedding.evaluation.CosineSimilarity method)
(gluonnlp.embedding.evaluation.ThreeCosAdd method)
(gluonnlp.embedding.evaluation.ThreeCosMul method)
(gluonnlp.embedding.evaluation.WordEmbeddingAnalogy method)
(gluonnlp.embedding.evaluation.WordEmbeddingSimilarity method)
(gluonnlp.loss.ActivationRegularizationLoss method)
(gluonnlp.loss.LabelSmoothing method)
(gluonnlp.loss.MaskedSoftmaxCrossEntropyLoss method)
(gluonnlp.loss.TemporalActivationRegularizationLoss method)
(gluonnlp.model.AttentionCell method)
(gluonnlp.model.AWDRNN method)
(gluonnlp.model.BeamSearchScorer method)
(gluonnlp.model.BERTClassifier method)
(gluonnlp.model.BERTEncoder method)
(gluonnlp.model.BERTModel method)
(gluonnlp.model.BiLMEncoder method)
(gluonnlp.model.ConvolutionalEncoder method)
(gluonnlp.model.ELMoBiLM method)
(gluonnlp.model.ELMoCharacterEncoder method)
(gluonnlp.model.GELU method)
(gluonnlp.model.Highway method)
(gluonnlp.model.HybridBeamSearchSampler method)
(gluonnlp.model.L2Normalization method)
(gluonnlp.model.LSTMPCellWithClip method)
(gluonnlp.model.PositionwiseFFN method)
(gluonnlp.model.RoBERTaClassifier method)
(gluonnlp.model.StandardRNN method)
(gluonnlp.model.train.AWDRNN method)
(gluonnlp.model.train.CacheCell method)
(gluonnlp.model.train.CSREmbeddingModel method)
(gluonnlp.model.train.FasttextEmbeddingModel method)
(gluonnlp.model.train.StandardRNN method)
(gluonnlp.model.TransformerEncoder method)
(gluonnlp.model.TransformerEncoderCell method)
HybridBeamSearchSampler (class in gluonnlp.model)
I
idx_to_token() (gluonnlp.embedding.TokenEmbedding property)
idx_to_vec() (gluonnlp.embedding.TokenEmbedding property)
IMDB (class in gluonnlp.data)
improve_answer_span() (in module gluonnlp.data)
indices_to_subwords() (gluonnlp.vocab.ByteSubwords method)
(gluonnlp.vocab.NGramHashes method)
(gluonnlp.vocab.SubwordFunction method)
is_first_subword() (gluonnlp.data.BERTSPTokenizer static method)
(gluonnlp.data.BERTTokenizer static method)
ISDense (class in gluonnlp.model)
IWSLT2015 (class in gluonnlp.data)
J
JiebaTokenizer (class in gluonnlp.data)
L
L2Normalization (class in gluonnlp.model)
LabelSmoothing (class in gluonnlp.loss)
lcs_match() (in module gluonnlp.data)
line_splitter() (in module gluonnlp.data)
LinearWidthBucket (class in gluonnlp.data)
List (class in gluonnlp.data.batchify)
list_datasets() (in module gluonnlp.data)
list_evaluation_functions() (in module gluonnlp.embedding.evaluation)
list_models() (in module gluonnlp.model)
list_sources() (in module gluonnlp.embedding)
list_subword_functions() (in module gluonnlp.vocab)
load_fasttext_format() (gluonnlp.model.train.FasttextEmbeddingModel class method)
load_parameters() (gluonnlp.model.train.CacheCell method)
(in module gluonnlp.utils)
load_states() (in module gluonnlp.utils)
LSTMPCellWithClip (class in gluonnlp.model)
M
MaskedSoftmaxCELoss (in module gluonnlp.loss)
MaskedSoftmaxCrossEntropyLoss (class in gluonnlp.loss)
MEN (class in gluonnlp.data)
mkdir() (in module gluonnlp.utils)
MLPAttentionCell (class in gluonnlp.model)
MNLITask (class in gluonnlp.data)
MPQA (class in gluonnlp.data)
MR (class in gluonnlp.data)
MRPCTask (class in gluonnlp.data)
MultiHeadAttentionCell (class in gluonnlp.model)
N
NamedTuple (class in gluonnlp.data.batchify)
NCEDense (class in gluonnlp.model)
NGramHashes (class in gluonnlp.vocab)
NLTKStanfordSegmenter (class in gluonnlp.data)
NumpyDataset (class in gluonnlp.data)
P
Pad (class in gluonnlp.data.batchify)
PadSequence (class in gluonnlp.data)
Parallel (class in gluonnlp.utils)
Parallelizable (class in gluonnlp.utils)
PositionwiseFFN (class in gluonnlp.model)
PrefetchingStream (class in gluonnlp.data)
put() (gluonnlp.utils.Parallel method)
Q
QNLITask (class in gluonnlp.data)
QQPTask (class in gluonnlp.data)
R
RadinskyMTurk (class in gluonnlp.data)
RareWords (class in gluonnlp.data)
register() (in module gluonnlp.data)
(in module gluonnlp.embedding)
(in module gluonnlp.embedding.evaluation)
register_subword_function() (in module gluonnlp.vocab)
remove() (in module gluonnlp.utils)
RNNCellLayer (class in gluonnlp.model)
roberta_12_768_12() (in module gluonnlp.model)
roberta_24_1024_16() (in module gluonnlp.model)
RoBERTaClassifier (class in gluonnlp.model)
RoBERTaModel (class in gluonnlp.model)
RTETask (class in gluonnlp.data)
S
SacreMosesDetokenizer (class in gluonnlp.data)
SacreMosesTokenizer (class in gluonnlp.data)
save_parameters() (gluonnlp.model.train.CacheCell method)
(in module gluonnlp.utils)
save_states() (in module gluonnlp.utils)
SemEval17Task2 (class in gluonnlp.data)
SentencepieceDetokenizer (class in gluonnlp.data)
SentencepieceTokenizer (class in gluonnlp.data)
Seq2SeqEncoder (class in gluonnlp.model)
SequenceSampler (class in gluonnlp.model)
serialize() (gluonnlp.embedding.TokenEmbedding method)
set_embedding() (gluonnlp.Vocab method)
set_seed() (in module gluonnlp.utils)
ShardedDataLoader (class in gluonnlp.data)
SimLex999 (class in gluonnlp.data)
SimpleDatasetStream (class in gluonnlp.data)
SimpleDataStream (class in gluonnlp.data)
SimVerb3500 (class in gluonnlp.data)
slice_sequence() (in module gluonnlp.data)
SNIPSDataset (class in gluonnlp.data)
SortedBucketSampler (class in gluonnlp.data)
SortedSampler (class in gluonnlp.data)
SpacyTokenizer (class in gluonnlp.data)
SparseISDense (class in gluonnlp.model)
SparseNCEDense (class in gluonnlp.model)
SplitSampler (class in gluonnlp.data)
Splitter (class in gluonnlp.data)
SQuAD (class in gluonnlp.data)
SST_1 (class in gluonnlp.data)
SST_2 (class in gluonnlp.data)
SSTTask (class in gluonnlp.data)
Stack (class in gluonnlp.data.batchify)
standard_lstm_lm_1500() (in module gluonnlp.model)
standard_lstm_lm_200() (in module gluonnlp.model)
standard_lstm_lm_650() (in module gluonnlp.model)
StandardRNN (class in gluonnlp.model)
(class in gluonnlp.model.train)
stats() (gluonnlp.data.FixedBucketSampler method)
StreamBPTTBatchify (class in gluonnlp.data.batchify)
STSBTask (class in gluonnlp.data)
SUBJ (class in gluonnlp.data)
SubwordFunction (class in gluonnlp.vocab)
subwords_to_indices() (gluonnlp.vocab.ByteSubwords method)
(gluonnlp.vocab.NGramHashes method)
(gluonnlp.vocab.SubwordFunction method)
SuperGlueAXb (class in gluonnlp.data)
SuperGlueAXg (class in gluonnlp.data)
SuperGlueBoolQ (class in gluonnlp.data)
SuperGlueCB (class in gluonnlp.data)
SuperGlueCOPA (class in gluonnlp.data)
SuperGlueMultiRC (class in gluonnlp.data)
SuperGlueReCoRD (class in gluonnlp.data)
SuperGlueRTE (class in gluonnlp.data)
SuperGlueWiC (class in gluonnlp.data)
SuperGlueWSC (class in gluonnlp.data)
T
TemporalActivationRegularizationLoss (class in gluonnlp.loss)
Text8 (class in gluonnlp.data)
TextLineDataset (class in gluonnlp.data)
ThreeCosAdd (class in gluonnlp.embedding.evaluation)
ThreeCosMul (class in gluonnlp.embedding.evaluation)
to_indices() (gluonnlp.Vocab method)
to_json() (gluonnlp.Vocab method)
to_tokens() (gluonnlp.Vocab method)
token_to_idx() (gluonnlp.embedding.TokenEmbedding property)
TokenEmbedding (class in gluonnlp.embedding)
tokenize_and_align_positions() (in module gluonnlp.data)
train_valid_split() (in module gluonnlp.data)
transform() (gluonnlp.data.DataStream method)
transformer_en_de_512() (in module gluonnlp.model)
TransformerEncoder (class in gluonnlp.model)
TransformerEncoderCell (class in gluonnlp.model)
TREC (class in gluonnlp.data)
truncate_seqs_equal() (in module gluonnlp.data)
TruncNorm (class in gluonnlp.initializer)
TSVDataset (class in gluonnlp.data)
Tuple (class in gluonnlp.data.batchify)
U
UnigramCandidateSampler (class in gluonnlp.data)
UniversalDependencies21 (class in gluonnlp.data)
unknown_lookup() (gluonnlp.embedding.TokenEmbedding property)
unknown_token() (gluonnlp.embedding.TokenEmbedding property)
update() (gluonnlp.optimizer.BERTAdam method)
update_multi_precision() (gluonnlp.optimizer.BERTAdam method)
V
Vocab (class in gluonnlp)
W
WeightDropParameter (class in gluonnlp.model)
whitespace_splitter() (in module gluonnlp.data)
WikiText103 (class in gluonnlp.data)
WikiText103Raw (class in gluonnlp.data)
WikiText2 (class in gluonnlp.data)
WikiText2Raw (class in gluonnlp.data)
WMT2014 (class in gluonnlp.data)
WMT2014BPE (class in gluonnlp.data)
WMT2016 (class in gluonnlp.data)
WMT2016BPE (class in gluonnlp.data)
WNLITask (class in gluonnlp.data)
Word2Vec (class in gluonnlp.embedding)
WordAnalogyEvaluationDataset (class in gluonnlp.data)
WordEmbeddingAnalogy (class in gluonnlp.embedding.evaluation)
WordEmbeddingAnalogyFunction (class in gluonnlp.embedding.evaluation)
WordEmbeddingSimilarity (class in gluonnlp.embedding.evaluation)
WordEmbeddingSimilarityFunction (class in gluonnlp.embedding.evaluation)
WordSim353 (class in gluonnlp.data)
WordSimilarityEvaluationDataset (class in gluonnlp.data)
X
XNLITask (class in gluonnlp.data)
Y
YangPowersVerb130 (class in gluonnlp.data)
