gptcache
GPTCache is a project dedicated to building a semantic cache for storing LLM responses.
GPTCache is a project dedicated to building a semantic cache for storing LLM responses.
To install this package, run one of the following:
GPTCache is a powerful caching library that can be used to speed up and lower the cost of chat applications that rely on the LLM service. GPTCache works as a memcache for AIGC applications, similar to how Redis works for traditional applications
Summary
GPTCache is a project dedicated to building a semantic cache for storing LLM responses.
Last Updated
Nov 21, 2025 at 11:53
License
MIT
Total Downloads
1.1K
Supported Platforms
Unsupported Platforms
GitHub Repository
https://github.com/zilliztech/GPTCacheDocumentation
https://gptcache.readthedocs.io