Home | Trees | Indices | Help |
|
---|
|
object --+ | api.TokenizerI --+ | RegexpTokenizer --+ | BlanklineTokenizer
A tokenizer that divides a string into substrings by treating any
sequence of blank lines as a separator. Blank lines are defined as lines
containing no characters, or containing only space (' '
) or
tab (' '
) characters.
|
|||
|
|||
Inherited from Inherited from Inherited from |
|
|||
Inherited from |
|
|||
Inherited from |
|
Construct a new tokenizer that splits strings using the given regular
expression
|
Home | Trees | Indices | Help |
|
---|
Generated by Epydoc 3.0beta1 on Wed Aug 27 15:08:58 2008 | http://epydoc.sourceforge.net |