towhee.models.clip4clip.utils.tokenize

towhee.models.clip4clip.utils.tokenize(text: str) → List[source]

Use SimpleTokenizer to tokenize text. :param text: Text to tokenize :type text: str

Returns:

Tokenized infos.