Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changing the model interactively #4

Open
mrgick opened this issue Jul 21, 2024 · 2 comments
Open

Changing the model interactively #4

mrgick opened this issue Jul 21, 2024 · 2 comments

Comments

@mrgick
Copy link
Owner

mrgick commented Jul 21, 2024

Add a command /model to change model
Send all history in first prompt to new model

Maybe a `/model name´ could be nice, but I don't think it's possible because DDG is cleaning the conversation when changing the model.

/model can only be implemented with clearing the chat, though... We could collect the conversation history into one first prompt and send it into a new model

idea from PR#3

@Jonas004
Copy link

Jonas004 commented Oct 23, 2024

First off all: nice work. The Python package is amazingly simple to use.
Unfortunately you can't switch the used model. In model/model_type.py there are four models listed. Is there a reason why in api.py Line 19 the ModelType is set to ModelType.Claude?

@Jonas004
Copy link

Jonas004 commented Oct 25, 2024

For anyone who is also interesed.
You can change the AI model used by the python package by changing the Model in the source code and installing the package from source:

  1. pip uninstall duck-chat
  2. Download the source code from github, open duck_chat/api.py and replace Claude in Line 19 with your choice of model. All possible models are listed in duck_chat/models/model_type.py. Curently there are:
  • GPT4o = "gpt-4o-mini"
  • Claude = "claude-3-haiku-20240307"
  • Llama = "meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo"
  • Mixtral = "mistralai/Mixtral-8x7B-Instruct-v0.1"
  1. Save and install the edited package by pip install -U .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants