User Guide:
User API:
Developer API:
Full API:
Bases: object
object
Simple Tokenizer for text input
Methods
bpe
decode
encode