rocketce / packages / tiktoken

• 0

tiktoken is a fast BPE tokeniser for use with OpenAI's models

• Conda
• Files
• Labels
• Badges