Module regexp
Classes
BlanklineTokenizer
RegexpTokenizer
WordPunctTokenizer
WordTokenizer
Functions
blankline_tokenize
regexp_tokenize
word_tokenize
wordpunct_tokenize
[
hide private
]