Package nltk :: Package tokenize :: Module punkt :: Class PunktWordTokenizer

Class PunktWordTokenizer

    object --+    
             |    
api.TokenizerI --+
                 |
                PunktWordTokenizer

Instance Methods

[hide private]

tokenize(self, text)
Divide the given string into a list of substrings.

source code

Inherited from api.TokenizerI: batch_tokenize

Inherited from object: __delattr__, __getattribute__, __hash__, __init__, __new__, __reduce__, __reduce_ex__, __repr__, __setattr__, __str__

Properties

[hide private]

Inherited from object: __class__

Method Details

[hide private]

tokenize(self, text)

source code

Divide the given string into a list of substrings.

Returns:: list of str
Overrides: api.TokenizerI.tokenize: (inherited documentation)