GPTCache, a powerful caching library that can be used to speed up and lower the cost of chat applications that rely on the LLM service. GPTCache works as a memcache for AIGC applications, similar to how Redis works for traditional applications.
copied from cf-staging / gptcache| Label | Latest Version |
|---|---|
| main | 0.1.44 |
