#

transformer-encoder

Here are 26 public repositories matching this topic...

brightmart / bert_language_understanding

Star

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

nlp text-classification question-answering document-classification transfer-learning fasttext language-model textcnn attention-is-all-you-need self-attention transformer-encoder bert-model pre-training language-understanding

Updated Jan 1, 2019
Python

lilianweng / transformer-tensorflow

Star

Implementation of Transformer Model in Tensorflow

transformer tensorflow-models transformer-encoder attention-is

Updated Sep 30, 2020
Python

microsoft / DeBERTa

Star

The implementation of DeBERTa

deeplearning representation-learning language-model bert natural-language-understanding self-attention roberta transformer-encoder

Updated Oct 19, 2020
Python

zhongkaifu / Seq2SeqSharp

Star

Seq2SeqSharp is a tensor based fast & flexible encoder-decoder deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, many different types of encoders/decoders(Transformer, LSTM, BiLSTM and so on), multi-GPUs supported and so on.

translation deep-learning neural-network gpu machine-translation cuda transformer lstm seq2seq sequence-to-sequence tensor encoder-decoder attention-model transformer-encoder transformer-architecture

Updated Sep 10, 2020
C#

ApurbaSengupta / Lyrics-Generation-using-BERT

Star

Generating English Rock lyrics using BERT

jupyter-notebook songs transformer bert rhyming lyrics-generator pronouncing transformer-encoder bert-model

Updated May 10, 2019
Jupyter Notebook

heartcored98 / transformer_anatomy

Star

Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020

interpretability interpretable-deep-learning transformer-encoder attention-head

Updated Jul 11, 2020
Python

declare-lab / MIME

Star

This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.

natural-language-processing dialogue-systems conversational-bots transformer-encoder empathetic-responses empathetic-dialogues

Updated Oct 27, 2020
Python

brainsqueeze / text2vec

Star

Contextual embedding for text blobs.

nlp tensorflow text-summarization sequence-to-sequence text-embedding attention-model transformer-encoder

Updated Oct 27, 2020
Python

JinLi711 / UTGN

Star

Universal Transforming Geometric Network for protein structure prediction.

deep-learning protein-structure transformer-encoder

Updated Jul 28, 2020
Python

lucylow / En_francais_si_vous_plait-

Star

French English Machine Translation. Natural language processing (NLP) transformer model from "Attention Is All You Need" paper

machine-learning translation cnn pytorch neural-networks attention french sequence-to-sequence convolutional-neural-network language-translation-service sequence-models attention-model attention-is-all-you-need fairseq french-nlp transformer-encoder french-english wmt-14

Updated Jan 13, 2020
Python

Shikhar-S / EvolvedTransformer

Star

Contains pytorch implementation of Transformer and EvolvedTransformer architectures. WIP

attention-is-all-you-need classification-model gated-linear-unit transformer-encoder evolved-transformer

Updated Apr 8, 2020
Jupyter Notebook

lordzuko / Transformer-Stance-Detection

Star

python deep-learning pytorch implementation stance-detection transformer-encoder

Updated Sep 20, 2018
Python

yashkim77 / Document-Similarity

Star

Semantic Textual Similarity between two document

python nlp tensorflow plotly jupyter-notebook cosine-similarity tensorflow-hub universal-sentence-encoder transformer-encoder

Updated Dec 25, 2019
Jupyter Notebook

utahnlp / therapist-observer

Star

Code for the ACL 2019 paper "Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes"

dialog attention hierarchical-attention-networks focal-loss psychotherapy elmo transformer-encoder acl2019 behavior-coding

Updated Jul 3, 2019
Python

chenjun2hao / transformerOcr

Star

use transformer as the decoder model for OCR

ocr transformer-encoder

Updated Mar 26, 2019

DwaraknathT / NABU

Star

Code for the paper "NABU - Multilingual Graph-based Neural RDF Verbalizer"

graph transformer attention natural-language-generation graph-attention-networks transformer-encoder nabu

Updated Sep 8, 2020
Python

samrat-halder / personality-detection-with-BERT-RoBERT

Star

Detection of MBTI-type personality with NLP and Deep Learning

nlp embeddings classification attention-mechanism robert transformer-encoder bert-model

Updated May 17, 2020
Python

OumaimaHourrane / TopicTransformer

Star

A Pytorch implementation of TopicTransformer for language modeling (the original paper is under journal review and coming soon)

text-generation transformer topic-modeling language-model attention-mechanism transformer-encoder

Updated Oct 13, 2020
Python

young-zonglin / yangzl-deep-text-matching

Star

Text matching using several deep models.

text-matching deep-model multi-head-attention transformer-encoder rnmt-plus-encoder deep-lstms

Updated Jan 28, 2019
Python

OumaimaHourrane / Bert_LDA_Combo

Star

Topic mediling using BERT and LDA combination.

transformer topic-modeling lda bert transformer-encoder bert-model bert-embeddings

Updated Oct 12, 2020
Jupyter Notebook

brainsqueeze / SequenceModels.jl

Star

Julia experimentation using sequence-based NLP models

nlp machine-learning julia text-embedding transformer-encoder

Updated Aug 28, 2019
Julia

Suchetaaa / TransformerbasedRL

Star

CS747 - Foundations Of Intelligent Learning Agents (FILA) Course Project

deep-reinforcement-learning recurrent-neural-networks convolutional-neural-networks lstm-neural-networks atari-games transformer-encoder

Updated Dec 10, 2019
Jupyter Notebook

liacov / homework3_transformer

Star

Repository for the Homework 3 - Neural Networks and Deep Learning course @ UniPD. Second version. Transformer for text generation.

text-generation attention-mechanism transformer-encoder

Updated Sep 13, 2020
Jupyter Notebook

vasisthasinghal / DL_4

Star

Deep Learning Course Assignment

cnn lstm attention-mechanism transformer-encoder transformer-pytorch

Updated Oct 11, 2020
Jupyter Notebook

yurayli / jigsaw-toxic-bias-reduction

Star

unbiased toxicity detection from comments

nlp lstm bert bias-reduction toxic-comment-classification transformer-encoder gpt-2

Updated Nov 6, 2020
Jupyter Notebook

aayux / fitfast

Star

Quickly fine-tune language models for your downstream NLP tasks.

natural-language-processing transfer-learning language-model transformer-encoder ulmfit

Updated Jun 1, 2019
Python

Improve this page

Add a description, image, and links to the transformer-encoder topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the transformer-encoder topic, visit your repo's landing page and select "manage topics."

You can’t perform that action at this time.