Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Extract out AutoGPTQ dependency #38

Closed
fabianlim opened this issue Jun 22, 2024 · 3 comments
Closed

Extract out AutoGPTQ dependency #38

fabianlim opened this issue Jun 22, 2024 · 3 comments

Comments

@fabianlim
Copy link
Contributor

The AutoGPTQ repo looks like it hasnt had any releases since Mar 1, 2024. While it is still a dependency of major frameworks such as huggingface and vllm, it is concerning that it might get deprecated. Maybe we can consider to extract out the relevant code since it is on an MIT license
@raghukiran1224
Copy link

My suggestion is to do what inference team is doing. We can switch when they do. Thoughts?

@fabianlim
Copy link
Contributor Author

@raghukiran1224 thanks for the suggestion. let me go find out more.

@achew010 achew010 mentioned this issue Jul 18, 2024
Merged
@fabianlim
Copy link
Contributor Author

this is closed in #48

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@raghukiran1224 @fabianlim