tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models
Installation
To install this package, run one of the following:
Installation commands are not available for this package.
Usage Tracking
0 / 8 versions selected
Downloads (Last 6 months): 0
About
Summary
tiktoken is a fast BPE tokeniser for use with OpenAI's models
Last Updated
Nov 25, 2025 at 00:47
License
MIT
Total Downloads
0
GitHub Repository
https://github.com/openai/tiktoken