sentencepiece

Community

SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training.

win-64/sentencepiece-0.2.0-1.conda

conda

0.2.0

win-64

prereleasemain

Sep 19, 2025, 02:38 AM

13.85 KB

1.5K

linux-64/sentencepiece-0.1.91-py38h6bb024c_0.tar.bz2

conda

0.1.91

linux-64

main

Nov 11, 2020, 10:49 PM

2.15 MB

386

linux-64/sentencepiece-0.1.91-py37h6bb024c_0.tar.bz2

conda

0.1.91

linux-64

main

Nov 11, 2020, 10:49 PM

2.15 MB

454

linux-64/sentencepiece-0.1.91-py36h6bb024c_0.tar.bz2

conda

0.1.91

linux-64

main

Nov 11, 2020, 10:49 PM

2.15 MB

322

win-64/sentencepiece-0.1.91-py38h74a9793_0.tar.bz2

conda

0.1.91

win-64

main

Nov 11, 2020, 10:49 PM

1.05 MB

324

win-64/sentencepiece-0.1.91-py37h74a9793_0.tar.bz2

conda

0.1.91

win-64

main

Nov 11, 2020, 10:49 PM

1.05 MB

9.1K

win-64/sentencepiece-0.1.91-py36h74a9793_0.tar.bz2

conda

0.1.91

win-64

main

Nov 11, 2020, 10:49 PM

1.04 MB

269

Filters