About Anaconda Help Download Anaconda

tiktoken is a fast BPE tokeniser for use with OpenAI's models

copied from cf-staging / tiktoken
Label Latest Version
main 0.8.0

© 2024 Anaconda, Inc. All Rights Reserved. (v4.0.6) Legal | Privacy Policy