Performance/lag when interacting with long chats #411
Description
I came across this project whilst searching for a native (non-web) solution for chatgpt. The driver of this search was that the web based chatgpt struggles when conversations become very long. When chats get long the browser becomes slow/laggy due to poor state management. Unfortunately, I noticed the same behaviour with Noi.
Actual
As chats get longer, response speed decreases, scroll speed is laggy, typing lags.
Expected
As chats get longer, browser remains snappy. ie. Chat length does not impact UX.
Details
Browser: chrome 142.0.7444.59 (Official Build) (64-bit)
OS: Ubuntu 20.04
Model: ChatGpt
Chat/context size: I've initiated an exported so I can run some analysis on this, will provide when it complets.