Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE_REQUEST] Install cURL, git, nvm, nodejs inside miniconda #74

Open
ParthKolekar opened this issue Sep 12, 2024 · 4 comments
Open
Labels
🦄 Feature Request [ISSUE] Suggestion for new feature, update or change 🐧 Linux

Comments

@ParthKolekar
Copy link

Have you searched for similar requests?

Yes

Is your feature request related to a problem? If so, please describe.

The launcher and installer scripts require sudo to install a bunch of dependencies. On a steam-deck, while the rootfs can be unlocked and written to, the fs is immutable and so the rootfs gets wiped every steam update.

Describe the solution you'd like

In order to fully isolate SillyTavern from the rest of the system, we could simply install all the required binaries inside miniconda itself.

This negates the need to install anything on the system side. And everything is neatly packed up inside the conda environment.

Describe alternatives you've considered

No response

Additional context

No response

Priority

Low (Nice-to-have)

Is this something you would be keen to implement?

Maybe

@ParthKolekar ParthKolekar added the 🦄 Feature Request [ISSUE] Suggestion for new feature, update or change label Sep 12, 2024
@jfmherokiller
Copy link

jfmherokiller commented Jan 3, 2025

i do ask why you are trying to run this on steamdeck? are you doing this with an accompanying textgen api or as a way to bring your collection with you?

But at the same time this is a good idea because it keeps the main system clean

@ParthKolekar
Copy link
Author

I don't have any other computer. The SteamDeck is my daily driver.

@jfmherokiller
Copy link

if you are, can i ask how the performance of cuda is on it? eg using oogabooga textgen?

@ParthKolekar
Copy link
Author

The SteamDeck ships with an AMD APU. So cuda doesn't run. I set up LLMs using ollama (Vulcan based GPU acceleration) or CPU (anything that doesn't have support).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🦄 Feature Request [ISSUE] Suggestion for new feature, update or change 🐧 Linux
Projects
None yet
Development

No branches or pull requests

3 participants