How to use OpenAI's O1-Preview model ？

[lam584]

I added the o1-preview model to the .env file, but I got an error when using it:

[danny-avila]

https://x.com/LibreChatAI/status/1834560654285373520

[lam584]

I made sure that LibreChat v0.7.5 was installed correctly in docker and that the other models worked fine as well, but I couldn't use the O1-Preview model.

[danny-avila]

It should work if you follow my instructions but you also need to be API tier 5:
https://platform.openai.com/settings/organization/limits

And if you do:
https://community.openai.com/t/were-tier-5-usage-but-dont-have-access-to-o1-models/937904/4
"""
OpenAI confirmed that we should have access this afternoon, Pacific time.
"""

[fbaeumer]

Same problem for us. We have Tier-5 but in OpenAI the o1-mini model is listed and the others are listed as text models. Is that the problem? We get the same error message.

OPENAI_MODELS=gpt-3.5-turbo,gpt-4,gpt-4-turbo,gpt-4o,gpt-4o-mini,o1-preview,o1-mini,o1-mini-2024-09-12
DEBUG_OPENAI=true
# TITLE_CONVO=false
# OPENAI_TITLE_MODEL=gpt-3.5-turbo
OPENAI_SUMMARIZE=true
OPENAI_SUMMARY_MODEL=gpt-3.5-turbo
# OPENAI_FORCE_PROMPT=true
# OPENAI_REVERSE_PROXY=

Version is Librechat 7.5.-rc2

[SharpLu]

Hi @fbaeumer Yes , it worked for me for LibreChat v0.7.5-rc2,
i believe you have to delete the old repo and do it again follow https://www.librechat.ai/docs/local/docker
don't forget to update your env variables.

[fbaeumer]

Can you further explain the "don't forget to update your env variables." part?
I already tried all the tricks Danny mentioned in the other thread.

[SharpLu]

I have included those parameters inside the .env file under docker image librechat folder.
OPENAI_API_KEY=xxxxx
OPENAI_MODELS=gpt-4o,chatgpt-4o-latest,o1-preview,o1-preview,o1-mini,o1-mini-2024-09-12,o1-preview-2024-09-12

[fbaeumer]

Yes, thank you. I have of course set these. The models are also displayed.
I think I'm making a stupid mistake somewhere. I'll just wait until it arrives in another version, if necessary....

[Odrec]

We're having the same issue.

[SharpLu]

Hi @danny-avila again,
I have tried to use the chatgpt o1-preview and o1-mini, i got the error

Something went wrong. Here's the specific error message we encountered: Failed to send message. HTTP 404 - { "error": { "message": "This is a chat model and not supported in the v1/completions endpoint. Did you mean to use v1/chat/completions?", "type": "invalid_request_error", "param": "model", "code": null } }

a.) The version i'm used [LibreChat v0.7.5-rc2] helm chart deployed on kubernates
b.)The deployment worked with chatgpt 4o and other models.
c.)the OPENAI_API_KEY are configured on my environment

---

But it worked for the docker image on my local, any suggestions? or is a bug we have to wait for new releases? Thank you

[jmrobles]

I guess the problem is that the API uses a old version of "node-openai". This version does not include the new models, so it tries to use the completion endpoints instead of the chat completion endpoint.

v4.47.1 => https://github.com/openai/openai-node/blob/d7d5610d91573740d7e3c27e4afde5650ee6e349/src/resources/chat/chat.ts

latest =>https://github.com/openai/openai-node/blob/master/src/resources/chat/chat.ts

[Odrec]

If this is the issue, how come the latest librechat version is still using the old openai API and why do the new models work for some people and not for others?

[danny-avila]

Not everyone has access, that could also be the issue.

I would like to cut a new release today, which should make o1 more available to those not on the dev build.

[Odrec]

Our organisation is tier 5 and I can use the o1 models on the Playground or with curl so we have access. But we get this error when trying them on librechat. But that's good to know that you're doing a new release! Hopefully that solves the issue.

[Odrec]

So one person in our team found the issue. We were doing this in the docker container:

image: ghcr.io/danny-avila/librechat:{{librechat_version}}

Which loaded the 0.75-rc2 version but not the dev one apparently. So when they changed it to the dev branch:

image: ghcr.io/danny-avila/librechat-dev:latest

It finally worked. Hopefully this helps someone having a similar problem.

[danny-avila]

v0.7.5 is now live which includes the o1 updates. If you are seeing a green icon and an error, you're using an older version of LibreChat.

At the time of writing, the docker image for releases is still building, but should be done momentarily.

https://www.librechat.ai/changelog/v0.7.5