Skip to content
This repository has been archived by the owner on Sep 30, 2023. It is now read-only.

use WebSocket for Real-time reception #31

Open
czkoko opened this issue Jun 14, 2023 · 0 comments
Open

use WebSocket for Real-time reception #31

czkoko opened this issue Jun 14, 2023 · 0 comments

Comments

@czkoko
Copy link

czkoko commented Jun 14, 2023

Due to the influence of computer performance and model size, the waiting time may be a little long. Can we use WebSocket to communicate to get real-time line-by-line display code?

Although the total time of code generation will not change, it can improve the user experience. At the same time, the relevant code of vscode-fauxpilot also needs to be modified.

Here is an example of using WS for ggml model in c++.
https://github.com/monatis/llm-api

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant