User interface in case of delayed messages

[Shruti3004]

Description

The problem statement is that several of the prompts in the chatbot typically take a long time to acquire a response from the backend, affecting the user experience.
Note: Particularly the Odia prompts

Current Apporach

To address the aforementioned problem statement, we have inserted the loader till we receive the result to that specific question.

current-approach.mp4

Suggestions for Approaches

Approach 1

• Display the same loader but with a custom message post x seconds ( say 30 ) of the delayed response which states:
  Due to excessive demand, we are now nearing the account limitations.
  

Approach 2

• Displaying the streaming of data which character or word by word same as ChatGPT does.

suggested.approach.mp4

@rahul101001000 @ChakshuGautam please let me know your thoughts on the same?

[rahul101001000]

If word by word can appear instantly nothing like it. There is a magical experience in seeing it appear word by word. The feeling you get is that the other person is carefully thinking what they are saying.

That said, if it takes more than 10 seconds to even get the first word, then some message like the limit one or equivalent is good, as transparently as possible reflecting the error and saying what the next step could be.

Another thing to do is caching and offering those cached questions as prompts on the main screen. Most people are going to try it out for the first time, they just need something to get started. OpenAI does that as well.