sentencepiece
SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training.
SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training.
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
linux-64/sentencepiece-0.1.99-py312hdb19cb5_0.tar.bz2 | conda | 0.1.99 | linux-64 | py312 | Sep 8, 2023, 02:40 AM | 8.43 MB | 2 | |
linux-64/sentencepiece-0.1.99-py312hdb19cb5_0.conda | conda | 0.1.99 | linux-64 | py312 | Sep 8, 2023, 02:40 AM | 3.3 MB | 3 |