From e575b9546d2519bfabc47090bf770c61ad3f9af7 Mon Sep 17 00:00:00 2001 From: Mark Saroufim Date: Tue, 26 Nov 2024 20:43:57 -0800 Subject: [PATCH 1/2] non expiring discord link --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 0b87515e..ef387f91 100644 --- a/README.md +++ b/README.md @@ -25,7 +25,7 @@ ThunderKittens is built around three key principles: Flash Attention 3, but with kittens! -Join us on Discord to get involved: [ThunderKittens channel @ GPU Mode Discord](https://discord.com/channels/1189498204333543425/1300872762163728550)!!!! Here is the invite link to GPU mode: https://discord.gg/W7CUhN5w +Join us on Discord to get involved: [ThunderKittens channel @ GPU Mode Discord](https://discord.com/channels/1189498204333543425/1300872762163728550)!!!! Here is the invite link to GPU mode: https://discord.gg/gpumode ThunderKittens is built from the hardware up -- we do what the silicon tells us. And modern GPUs tell us that they want to work with fairly small tiles of data. A GPU is not really a 1000x1000 matrix multiply machine (even if it is often used as such); it’s a manycore processor where each core can efficiently run ~16x16 matrix multiplies. Consequently, ThunderKittens is built around manipulating tiles of data no smaller than 16x16 values. From 1ff7227f6e4c8cd83f857264d642466edacfcd2a Mon Sep 17 00:00:00 2001 From: Mark Saroufim Date: Tue, 26 Nov 2024 20:45:13 -0800 Subject: [PATCH 2/2] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index ef387f91..bd08a690 100644 --- a/README.md +++ b/README.md @@ -246,5 +246,5 @@ Learn more about ThunderKittens and how GPUs work by checking out: - [Easier, Better, Faster, Cuter Blogpost, Oct. 2024](https://hazyresearch.stanford.edu/blog/2024-10-29-tk2) - [GPUs Go Brrr Blogpost, May 2024](https://hazyresearch.stanford.edu/blog/2024-05-12-tk) -Join us and get involved at the [ThunderKittens channel @ GPU Mode Discord](https://discord.com/channels/1189498204333543425/1300872762163728550)!!!! Here is the invite link to GPU mode: https://discord.gg/W7CUhN5w +Join us and get involved at the [ThunderKittens channel @ GPU Mode Discord](https://discord.com/channels/1189498204333543425/1300872762163728550)!!!! Here is the invite link to GPU mode: https://discord.gg/gpumode