-
Notifications
You must be signed in to change notification settings - Fork 493
Issues: pytorch/torchtune
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Qlora uses more memory than regular lora
triaged
This issue has been assigned an owner and appropriate label
#2255
opened Jan 11, 2025 by
AndrewMead10
Lora and Dora finetuning produces identical results
bug
Something isn't working
high-priority
#2250
opened Jan 10, 2025 by
AndrewMead10
Finetuning Llama 3.1 8B Base Model on ChatML Format Dataset – Loss Reaches NaN After 2000 Steps
triaged
This issue has been assigned an owner and appropriate label
#2246
opened Jan 10, 2025 by
abdul-456
Overriding kv cache entries in torchtune models
discussion
Start a discussion
triaged
This issue has been assigned an owner and appropriate label
#2241
opened Jan 9, 2025 by
telgamal-1
packed errors
bug
Something isn't working
triaged
This issue has been assigned an owner and appropriate label
#2218
opened Dec 31, 2024 by
chg0901
hotw to estimate gpu memory needed for knowledge distillation?
discussion
Start a discussion
triaged
This issue has been assigned an owner and appropriate label
#2213
opened Dec 30, 2024 by
chuangzhidan
Query on Gradient accumulation
discussion
Start a discussion
#2134
opened Dec 9, 2024 by
Vattikondadheeraj
[RFC] Unify activation checkpointing APIs
rfc
Request for comments
#2114
opened Dec 5, 2024 by
ebsmothers
Model merging scripts?
enhancement
New feature or request
#1179
opened Jul 15, 2024 by
suraj-srinivas
safe_torch_load failed when resume from checkpoint
bug
Something isn't working
#1142
opened Jul 3, 2024 by
ScottHoang
Validation and early stopping during training
community help wanted
We would love the community's help completing this issue
enhancement
New feature or request
high-priority
#883
opened Apr 26, 2024 by
kinggongzilla
Running LoRA + QLoRA on Colab Notebooks
enhancement
New feature or request
#828
opened Apr 21, 2024 by
kartikayk
e2e torchtune tutorial example
enhancement
New feature or request
#825
opened Apr 20, 2024 by
seyeint
ProTip!
Follow long discussions with comments:>50.