SymSpell: 1 million times faster through Symmetric Delete spelling correction algorithm

文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、句法分析等），无监督或弱监督（种子词）方法

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

Python port of SymSpell

A collection of resources (including the papers and datasets) of OCR (Optical Character Recognition).

A sentence segmenter that actually works!

Implementation of the paper: Text Segmentation as a Supervised Learning Task

(yet another not really) awesome topic/text segmentation list

Fast Word Segmentation with Triangular Matrix

Mandarin Chinese text segmentation and mobile dictionary Android app (中文分词)

Word Segmentation with Dynamic Programming

Spelling correction and string segmentation written in Go

Unicode text segmentation (tr29)

Text segmentation into separate words using a simple unigram model and the Viterbi algorithm

Uses GloVe embeddings and greedy sequence segmentation to semantically segment a text document into any number of k segments.

Language processing interface: some tools to process different natural languages

Data for the ACL 2020 paper - Improving Segmentation for Technical Support Problems

Perl wrapper for CppJieba (Chinese text segmentation)

Image operator learning with CNNs

一些容易被分词工具被分错的句子。

Using Otsu's thresholding for text segmentation on images of sticky notes.

How to add user dictionary to MeCab

Neural and nonneural text segmentation methods.

Program that allows to detect and classify the segments of medieval royal charters according to their diplomatic formulae.

Line and ligature segmentation with corpus

OSS Text Segmentation library.

Improve Text Segmentation using Latent Semantic Analysis