tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models
tiktoken is a fast BPE tokeniser for use with OpenAI's models
| Name | Type | Version | Platform | Labels | Updated | Size | Downloads | Actions |
|---|
linux-ppc64le/tiktoken-0.6.0-py311h7fa3d89_0.conda | conda | 0.6.0 | linux-ppc64le | rocketce-1.11.6 | May 19, 2025, 12:00 PM | 873.39 KB | 2 |