sentencepiece
SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training.
SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training.
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
linux-ppc64le/sentencepiece-0.1.92-py37h6bb024c_0.tar.bz2 | conda | 0.1.92 | linux-ppc64le | main | Sep 30, 2020, 06:31 PM | 2.47 MB | 2 |