Skip to content

Commit

Permalink
Link to LitGPT for the Thunder example (#20)
Browse files Browse the repository at this point in the history
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
  • Loading branch information
carmocca and pre-commit-ci[bot] authored Mar 21, 2024
1 parent f0e57ed commit 164160f
Show file tree
Hide file tree
Showing 12 changed files with 99 additions and 1,434 deletions.
14 changes: 1 addition & 13 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -125,19 +125,7 @@ Thunder is in its early stages and should not be used for production runs yet.

However, it can already deliver outstanding performance on LLM model supported by [LitGPT](https://github.com/Lightning-AI/lit-gpt), such as Mistral, Llama 2, Gemma, Falcon, and others.

Run training loop for Llama, single-GPU:

```bash
python examples/lit-gpt/train.py
```

Run training loop for Llama, multi-GPU, using FSDP:

```bash
python examples/lit-gpt/train_fsdp.py
```

See [README.md](examples/lit-gpt/README.md) for details on running LitGPT with Thunder.
Check out [the LitGPT integration](https://github.com/Lightning-AI/litgpt/tree/main/extensions/thunder) to learn about running LitGPT and Thunder together.

## Features

Expand Down
4 changes: 0 additions & 4 deletions examples/lit-gpt/.gitignore

This file was deleted.

57 changes: 0 additions & 57 deletions examples/lit-gpt/1_forward.py

This file was deleted.

93 changes: 0 additions & 93 deletions examples/lit-gpt/README.md

This file was deleted.

Loading

0 comments on commit 164160f

Please sign in to comment.