new TokenizerBuilder(option)
TokenizerBuilder create Tokenizer instance.
Parameters:
Name | Type | Description | ||||||
---|---|---|---|---|---|---|---|---|
option |
Object | JSON object which have key-value pairs settings Properties
|
Methods
-
build(callback)
-
Build Tokenizer instance by asynchronous manner
Parameters:
Name Type Description callback
TokenizerBuilder~onLoad Callback function
Type Definitions
-
onLoad(err, tokenizer)
-
Callback used by build
Parameters:
Name Type Description err
Object Error object
tokenizer
Tokenizer Prepared Tokenizer