nltk.tokenize.destructive

module documentation
(source)

Undocumented

Class MacIntyreContractions List of contractions adapted from Robert MacIntyre's tokenizer.
Class NLTKWordTokenizer The NLTK tokenizer that has improved upon the TreebankWordTokenizer.