Skip to content
#

openai

Here are 159 public repositories matching this topic...

gpt-2-simple
lamthuy
lamthuy commented Apr 1, 2020

Hi,
When we try to tokenize the following sentence:

If we use spacy

a = spacy.load('en_core_web_lg')

doc = a("I like the link http://www.idph.iowa.gov/ohds/oral-health-center/coordinator")

list(doc)

We got

[I, like, the, link, http://www.idph.iowa.gov, /, ohds, /, oral, -, health, -, center, /, coordinator]

But if we use the Spacy transformer tokenizer:

wkirgsn
wkirgsn commented Apr 27, 2020

Currently the ConsolePrinter spams states, references and reward information step by step, but this is no useful visualization.

A more readable and descriptive concept must be elaborated.

Moreover, documentation is missing for the ConsolePrinter.

bug

Improve this page

Add a description, image, and links to the openai topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the openai topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.