Skip to content

Issues: pytorch/torchtune

v0.6.0 tracker
#2232 opened Jan 6, 2025 by joecummings
Open
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Qlora uses more memory than regular lora triaged This issue has been assigned an owner and appropriate label
#2255 opened Jan 11, 2025 by AndrewMead10
Finetuning Llama 3.1 8B Base Model on ChatML Format Dataset – Loss Reaches NaN After 2000 Steps triaged This issue has been assigned an owner and appropriate label
#2246 opened Jan 10, 2025 by abdul-456
Overriding kv cache entries in torchtune models discussion Start a discussion triaged This issue has been assigned an owner and appropriate label
#2241 opened Jan 9, 2025 by telgamal-1
packed errors bug Something isn't working triaged This issue has been assigned an owner and appropriate label
#2218 opened Dec 31, 2024 by chg0901
hotw to estimate gpu memory needed for knowledge distillation? discussion Start a discussion triaged This issue has been assigned an owner and appropriate label
#2213 opened Dec 30, 2024 by chuangzhidan
Query on Gradient accumulation discussion Start a discussion
#2134 opened Dec 9, 2024 by Vattikondadheeraj
[RFC] Unify activation checkpointing APIs rfc Request for comments
#2114 opened Dec 5, 2024 by ebsmothers
Model merging scripts? enhancement New feature or request
#1179 opened Jul 15, 2024 by suraj-srinivas
Resize token embedding. discussion Start a discussion
#1145 opened Jul 7, 2024 by hungphongtrn
safe_torch_load failed when resume from checkpoint bug Something isn't working
#1142 opened Jul 3, 2024 by ScottHoang
QLoRA Inference
#1020 opened May 25, 2024 by jeff52415
Validation and early stopping during training community help wanted We would love the community's help completing this issue enhancement New feature or request high-priority
#883 opened Apr 26, 2024 by kinggongzilla
Running LoRA + QLoRA on Colab Notebooks enhancement New feature or request
#828 opened Apr 21, 2024 by kartikayk
e2e torchtune tutorial example enhancement New feature or request
#825 opened Apr 20, 2024 by seyeint
ProTip! Follow long discussions with comments:>50.