tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models
- Overview
- Files 4
- Labels 4
- Badges
Installation
To install this package, run one of the following:
Usage Tracking
0.6.0
1 / 8 versions selected
Total downloads: 0
About
Summary
tiktoken is a fast BPE tokeniser for use with OpenAI's models
Information Last Updated
Aug 20, 2025 at 15:50
License
MIT
Total Downloads
57
Platforms
Linux ppc64le Version: 0.6.0