when chatting with local docs using API server, it is not aware of what the previous question was is there any fix?

[hamza-shaukat]

i use my own frontend and chat with the local docs
if i ask about anything it answers
when i ask next question like "tell me more"
it dosnt tell me about what we were talking about it takes it as a separate question
but it works perfectly when i query from the application itself

[JamesGai]

Yes, I have the same issue, can someone please answer this asap? Thanks a lot. @hamza-shaukat have you solved this issue?

[hamza-shaukat]

this is an issue with the application .
it has one more major issue ie. you cant run multiple instances for different users so they have their own chat .
i am now using gpt4all sdk and jinja2 template for llama 3.1 . it is working better

[JamesGai595]

Sounds good, so you are using gpt4all SDK and problem got resolved (local docs history can be preserved)?