Semantic instruction for Q&A Response
Right now, we can edit Q&A's to have the bot respond to a specific question with a specific response. Example: "what are your working hours" --> "our working hours are 9 to 5" , and the bot will give that exact answer every time.
It would be great if we could guide the bot on HOW to respond to specific questions instead of WHAT to respond. For example, for question "what are you working hours" the answer we set would be the instruction: "check in your knowledge database and reply with our working hours."
The reason for this would be to address multiple imperfect replies to multiple questions that are closely related.. instead of correcting the bot on every single question that is closely related. In other words, it serves the same function as Q&A current feature, but groups Qs and As in groups instead of a specific Q for each specific A.
Log in to comment and vote
Comments3
jadehoj1
May 29, 2024
Real life example we're currently facing:
USER: i'm looking for document A
BOT: here's a link to document B
USER: that's not document A, that's document B, which is closely related to document A, but not what I'm looking for.
BOT: apologies for the confusion, here's document C
USER: once again, doc C is closely related to document A, but not what I'm looking for.
--> So instead of modifying an "exact Q&A response" and have the bot say: "We do not have document A, but here are links to closely related documents: Document B and Document C"
We could instead have an "instruction response" telling the bot that whenever someone asks for document A, answer that you do not have that exact document, but also provide a list of related documents we have.
In the future we plan on having documents D, E, F, etc... that are related to document A, and like this the bot automatically updates his dynamic response instead of us having to edit the Q&A response every time we add a document to the knowledge database.
Hoping for a reply if this is feasaible.
Thanks
Bhanu (Founder @ SiteGPT)
May 29, 2024
@jadehoj1 Why can't you put these instructions directly in the prompt itself? That's what prompt is for, right?
jadehoj1
May 29, 2024
@Bhanu (Founder @ SiteGPT) You mean the main prompt?
We have tried adding something in the lines of "if you can't find the exact document the user is looking for, apologize and provide a list of closely related documents". But then the tool started missing out on document it does have in the database, which it was properly fetching before adding that line, and suggesting closely related documents instead (listing the exact document as a closely related document).
So as a middle-ground solution, I was wondering if we can have targeted prompts as Q&A instead of specific text responses, like this the main prompt remains untouched (as it was working great as is), and we can have targeting additional prompt instructions triggered by specific user inputs (such as someone looking for document A specifically).
PS: or did you mean to add all these specific targeted prompts in the main prompt itself, like "if someone asks for document A specifically, answer that you do not have that exact document, but also provide a list of related documents we have." In this case, that one main prompt could become very very long with time (we have over 1k documents lol) so not sure if this is ideal.