Tiktoken | Anaconda.org

sfe1ed40 / packages / tiktoken 0.5.1

0

tiktoken is a fast BPE tokeniser for use with OpenAI's models

License: MIT
Home: https://github.com/openai/tiktoken
Development: https://github.com/openai/tiktoken
Documentation: https://github.com/openai/tiktoken
10320 total downloads
Last upload: 1 month and 12 days ago

Installers

linux-s390x v0.5.1
linux-64 v0.5.1
linux-aarch64 v0.5.1
osx-arm64 v0.5.1
osx-64 v0.5.1
win-64 v0.5.1
linux-ppc64le v0.5.1

conda install

To install this package run one of the following:
conda install sfe1ed40::tiktoken

Description

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

© 2025 Anaconda, Inc. All Rights Reserved. (v4.0.6) Legal | Privacy Policy