Skip to content
#

nlp-library

Star

Here are 205 public repositories matching this topic...

Language: All
Filter by language
All 205 Python 102 Jupyter Notebook 26 Java 17 JavaScript 9 HTML 7 C++ 4 TypeScript 4 C# 3 Go 3 Ruby 3
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
transformers

huggingface / transformers

Star
Open

Improve PyTorch examples for FP16

sgugger
sgugger commented Jan 22, 2021

To get the full speed-up of FP16 training, every tensor passed through the model should have all its dimensions be a multiple of 8. In the new PyTorch examples, when using dynamic padding, the tensors are padded to the length of the biggest sentence of the batch, but that number is not necessarily a multiple of 8.

The examples should be improved to pass along the option pad_to_multiple_of=8 w

Read more
Good First Issue
Find more good first issues →

proycon / pynlpl

Star

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

python nlp machine-learning natural-language-processing library linguistics computational-linguistics text-processing nlp-library search-algorithms evaluation-metrics folia language-modelling
  • Updated Mar 13, 2019
  • Python

cbaziotis / ekphrasis

Star

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

nlp tokenizer text-processing semeval nlp-library word-segmentation spelling-correction tokenization text-segmentation spell-corrector word-normalization
  • Updated Aug 13, 2020
  • Python

neomatrix369 / nlp_profiler

Sponsor Star
Open

[FEATURE] Automate library release process to GitHub and PyPi

neomatrix369
neomatrix369 commented Oct 25, 2020

Missing functionality

Currently, the release process (to GitHub and PyPi) is done manually, it's prone to errors, and the two scripts used work best in happy-path use-case scenarios while edge-case even though less to worry about are not taken care of, as well as they could have been.

The release to PyPi should be fail-safe as there is no way to revert if a mistake is made.

**Proposed

Read more
2. medium-priority Release enhancement good first issue

Improve this page

Add a description, image, and links to the nlp-library topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the nlp-library topic, visit your repo's landing page and select "manage topics."

Learn more