tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
| Name | Type | Version | Platform | Labels | Updated | Size | Actions |
|---|
win-64/tokenizers-0.13.2-py38_0.tar.bz2 | conda | 0.13.2 | win-64 | main | Dec 19, 2022, 11:44 AM | 2.98 MB | |
win-64/tokenizers-0.13.2-py310_0.tar.bz2 | conda | 0.13.2 | win-64 | main | Dec 19, 2022, 11:43 AM | 2.96 MB | |
win-64/tokenizers-0.13.2-py37_0.tar.bz2 | conda | 0.13.2 | win-64 | main | Dec 19, 2022, 11:41 AM | 2.96 MB | |
osx-64/tokenizers-0.13.2-py310_0.tar.bz2 | conda | 0.13.2 | macOS-64 | main | Dec 19, 2022, 11:40 AM | 3.26 MB | |
osx-64/tokenizers-0.13.2-py37_0.tar.bz2 | conda | 0.13.2 | macOS-64 | main | Dec 19, 2022, 11:39 AM | 3.28 MB | |
win-64/tokenizers-0.13.2-py39_0.tar.bz2 | conda | 0.13.2 | win-64 | main | Dec 19, 2022, 11:37 AM | 2.96 MB | |
osx-64/tokenizers-0.13.2-py39_0.tar.bz2 | conda | 0.13.2 | macOS-64 | main | Dec 19, 2022, 11:36 AM | 3.3 MB | |
osx-64/tokenizers-0.13.2-py38_0.tar.bz2 | conda | 0.13.2 | macOS-64 | main | Dec 19, 2022, 11:36 AM | 3.27 MB | |
linux-64/tokenizers-0.13.2-py38_0.tar.bz2 | conda | 0.13.2 | linux-64 | main | Dec 19, 2022, 11:32 AM | 4.47 MB | |
linux-64/tokenizers-0.13.2-py37_0.tar.bz2 | conda | 0.13.2 | linux-64 | main | Dec 19, 2022, 11:30 AM | 4.47 MB | |
linux-64/tokenizers-0.13.2-py39_0.tar.bz2 | conda | 0.13.2 | linux-64 | main | Dec 19, 2022, 11:30 AM | 4.46 MB | |
osx-64/tokenizers-0.13.1-py38_0.tar.bz2 | conda | 0.13.1 | macOS-64 | main | Oct 6, 2022, 12:50 PM | 3.3 MB | |
osx-64/tokenizers-0.13.1-py37_0.tar.bz2 | conda | 0.13.1 | macOS-64 | main | Oct 6, 2022, 12:50 PM | 3.3 MB | |
win-64/tokenizers-0.13.1-py38_0.tar.bz2 | conda | 0.13.1 | win-64 | main | Oct 6, 2022, 12:48 PM | 2.97 MB | |
win-64/tokenizers-0.13.1-py39_0.tar.bz2 | conda | 0.13.1 | win-64 | main | Oct 6, 2022, 12:48 PM | 2.97 MB | |
win-64/tokenizers-0.13.1-py37_0.tar.bz2 | conda | 0.13.1 | win-64 | main | Oct 6, 2022, 12:46 PM | 2.96 MB | |
osx-64/tokenizers-0.13.1-py39_0.tar.bz2 | conda | 0.13.1 | macOS-64 | main | Oct 6, 2022, 12:45 PM | 3.3 MB | |
linux-64/tokenizers-0.13.1-py37_0.tar.bz2 | conda | 0.13.1 | linux-64 | main | Oct 6, 2022, 12:43 PM | 4.49 MB | |
linux-64/tokenizers-0.13.1-py38_0.tar.bz2 | conda | 0.13.1 | linux-64 | main | Oct 6, 2022, 12:41 PM | 4.51 MB | |
linux-64/tokenizers-0.13.1-py39_0.tar.bz2 | conda | 0.13.1 | linux-64 | main | Oct 6, 2022, 12:41 PM | 4.49 MB | |
win-64/tokenizers-0.13.0-py37_0.tar.bz2 | conda | 0.13.0 | win-64 | main | Sep 21, 2022, 10:38 AM | 2.98 MB | |
osx-64/tokenizers-0.13.0-py39_0.tar.bz2 | conda | 0.13.0 | macOS-64 | main | Sep 21, 2022, 10:37 AM | 3.3 MB | |
osx-64/tokenizers-0.13.0-py38_0.tar.bz2 | conda | 0.13.0 | macOS-64 | main | Sep 21, 2022, 10:37 AM | 3.3 MB | |
win-64/tokenizers-0.13.0-py39_0.tar.bz2 | conda | 0.13.0 | win-64 | main | Sep 21, 2022, 10:36 AM | 2.96 MB | |
win-64/tokenizers-0.13.0-py38_0.tar.bz2 | conda | 0.13.0 | win-64 | main | Sep 21, 2022, 10:34 AM | 2.97 MB |