module documentation

Language Model Vocabulary

Function _ Look up a sequence of words in the vocabulary.
Function _dispatched_lookup Undocumented
Function _string_lookup Looks up one word in the vocabulary.
@_dispatched_lookup.register(Iterable)
def _(words, vocab): (source)

Look up a sequence of words in the vocabulary.

Returns an iterator over looked up words.

@singledispatch
def _dispatched_lookup(words, vocab): (source)

Undocumented

@_dispatched_lookup.register(str)
def _string_lookup(word, vocab): (source)

Looks up one word in the vocabulary.