#
bert
Here are 1,078 public repositories matching this topic...
Mapping a variable-length sentence to a fixed-length vector using BERT model
nlp
machine-learning
natural-language-processing
deep-neural-networks
ai
deep-learning
tensorflow
bert
natural-language-understanding
word-embedding
sentence-encoding
-
Updated
Oct 11, 2020 - Python
Natural Language Processing Tutorial for Deep Learning Researchers
-
Updated
Oct 3, 2020 - Jupyter Notebook
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
nlp
news
wiki
text-classification
word2vec
corpus
dataset
question-answering
chinese
chinese-nlp
language-model
bert
chinese-corpus
pretrain
chinese-dataset
-
Updated
Dec 1, 2019
Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）
-
Updated
Sep 23, 2020 - Python
-
Updated
Oct 19, 2020 - Rust
Open
chooses 15% of token
1
makcedward
commented
Feb 22, 2019
From paper, it mentioned
Instead, the training data generator chooses 15% of tokens at random, e.g., in the sentence my
dog is hairy it chooses hairy.
It means that 15% of token will be choose for sure.
From https://github.com/codertimo/BERT-pytorch/blob/master/bert_pytorch/dataset/dataset.py#L68,
for every single token, it has 15% of chance that go though the followup procedure.
Open
PositionalEmbedding
3
4
An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools)
-
Updated
Oct 14, 2020 - Python
Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services
-
Updated
Oct 16, 2020 - Python
A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型
-
Updated
Apr 20, 2020 - Python
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
-
Updated
Oct 16, 2020 - Python
Tutorials on getting started with PyTorch and TorchText for sentiment analysis.
nlp
natural-language-processing
tutorial
sentiment-analysis
word-embeddings
transformers
cnn
pytorch
recurrent-neural-networks
lstm
rnn
fasttext
bert
sentiment-classification
pytorch-tutorial
pytorch-tutorials
cnn-text-classification
lstm-sentiment-analysis
pytorch-nlp
torchtext
-
Updated
Oct 13, 2020 - Jupyter Notebook
Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)
-
Updated
May 9, 2020 - Jupyter Notebook
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow
python
machine-learning
natural-language-processing
deep-learning
tensorflow
machine-translation
text-generation
data-processing
bert
text-data
dialog-systems
gpt-2
texar
xlnet
-
Updated
Sep 17, 2020 - Python
Implementation of BERT that could load official pre-trained models for feature extraction and prediction
-
Updated
Jul 28, 2020 - Python
Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.
nlp
machine-learning
text-classification
named-entity-recognition
seq2seq
transfer-learning
ner
bert
sequence-labeling
nlp-framework
bert-model
text-labeling
gpt-2
-
Updated
Sep 20, 2020 - Python
pycorrector is a toolkit for text error correction. It was developed to facilitate the designing, comparing, and sharing of deep text error correction models.
bert
spelling-errors
electra
error-detection
deep-learning-models
kenlm
error-correction
pycorrector
seq2seq-attention
-
Updated
Sep 11, 2020 - Python
A curated list of pretrained sentence and word embedding models
nlp
awesome
encoder
paper
natural-language
word-embeddings
evaluation
awesome-list
pretrained-models
unsupervised-learning
embedding-models
language-model
bert
embedded-models
cross-lingual
wordembedding
encoders
sentence-embeddings
pretrained-embedding
sentence-representations
contextualized-representation
vector-map
pooling-methods
pretrained-language-model
subword-models
-
Updated
Aug 4, 2020 - Python
State of the Art Natural Language Processing
nlp
natural-language-processing
spark
sentiment-analysis
tensorflow
transformers
language-detection
pyspark
named-entity-recognition
lemmatizer
spell-checker
language-model
albert
bert
part-of-speech-tagger
entity-extraction
natural-language-understanding
spark-ml
xlnet
tf-hub-models
-
Updated
Oct 18, 2020 - Scala
bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目
-
Updated
Oct 23, 2019
Super easy library for BERT based NLP models
-
Updated
Oct 17, 2020 - Python
RoBERTa中文预训练模型: RoBERTa for Chinese
-
Updated
Jun 29, 2020 - Python
中文语言理解基准测评 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
benchmark
tensorflow
nlu
glue
corpus
transformers
pytorch
dataset
chinese
pretrained-models
language-model
albert
bert
roberta
chineseglue
-
Updated
Oct 14, 2020 - Python
Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
-
Updated
Mar 1, 2020 - Python
Datasets, tools, and benchmarks for representation learning of code.
python
nlp
data-science
data
machine-learning
natural-language-processing
deep-learning
tensorflow
ml
cnn
open-data
neural-networks
rnn
datasets
representation-learning
nlp-machine-learning
bert
programming-language-theory
self-attention
machine-learning-on-source-code
-
Updated
Sep 18, 2020 - Jupyter Notebook
-
Updated
Oct 12, 2020 - Erlang
Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.
tensorflow
svm
word2vec
crf
keras
similarity
classification
attention
gensim
lda
fasttext
ner
embedding
bert
elmo
-
Updated
Aug 6, 2020 - Python
The jiant toolkit for general-purpose text understanding models
-
Updated
Oct 18, 2020 - Python
chrome-extension
tensorflow
natural-language
question-answering
semantic-search
bert
unpacked-extension
tensorflowjs
-
Updated
Sep 1, 2020 - JavaScript
nlp
deep-learning
pytorch
question-answering
transfer-learning
pretrained-models
language-models
ner
nlp-library
bert
nlp-framework
roberta
xlnet-pytorch
germanbert
-
Updated
Oct 16, 2020 - Python
Improve this page
Add a description, image, and links to the bert topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the bert topic, visit your repo's landing page and select "manage topics."
The architecture
GPT2ForSequenceClassificationwas added in #7501 in PyTorch. It would be great to have it in TensorFlow (cf. issues #7622), but it would also be great to have it for other causal models:OpenAI GPT, CTRL, TransfoXLCurrently working on OpenAI GPT: @fmcurti(done)Below is a list of items to follow to make sure the integration of such an architect