Caching single shot prompt in more detail #617
adityakavalur
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
It looks like there are 2 types of caching in sgpt.
CHAT_CACHE_PATH
which stores the complete conversation in a manner that it can be stopped and restartedCACHE_PATH
that stores information from single shot prompts. These I presume can be useful when users ask the same question again and dont have the--no-cache
flag. However, I noticed that sgpt only stores the response and not the question in this use case.I have 2 questions:
Beta Was this translation helpful? Give feedback.
All reactions