Code

Add Mamba (minimal)#918

Code

Closed

swfsql wants to merge 27 commits intocoreylowman:maincoreylowman/dfdx:mainfrom swfsql:mamba-minimalswfsql/dfdx:mamba-minimalCopy head branch name to clipboard

+2,792-95

Commits

Commits on Jan 26, 2024

• remove deprecated ftz intrinsics

  rainiwu

  committed
  5c532ec

  Copy full SHA for 5c532ec

• suppress spurious cargo clippy warning

  rainiwu

  committed
  fb91f13

  Copy full SHA for fb91f13

Commits on Feb 1, 2024

• Update safetensors module and naming

  Show description for a832f51
  swfsql

  committed
  a832f51

  Copy full SHA for a832f51

• impl core::ops::Sub for Dim types

  swfsql

  committed
  901cfe4

  Copy full SHA for 901cfe4

• add SiLU activation function

  swfsql

  committed
  a14b40b

  Copy full SHA for a14b40b

• add RMS normalization

  Show description for b52932c
  swfsql

  committed
  b52932c

  Copy full SHA for b52932c

• Add split_tensor_along method

  Show description for 693b699
  swfsql

  committed
  693b699

  Copy full SHA for 693b699

• rm unrelated derive

  swfsql

  committed
  de55567

  Copy full SHA for de55567

Commits on Feb 2, 2024

• Merge branch 'silu' into mamba-minimal

  swfsql

  committed
  3122f78

  Copy full SHA for 3122f78

• Merge branch 'split-tensor-along' into mamba-minimal

  swfsql

  committed
  ace3808

  Copy full SHA for ace3808

• Merge branch 'rms-norm' into mamba-minimal

  swfsql

  committed
  f6d06e0

  Copy full SHA for f6d06e0

Commits on Feb 6, 2024

• Added TryUnstack for tensors.

  Show description for ea424c3
  swfsql

  committed
  ea424c3

  Copy full SHA for ea424c3

• fix wgpu signature

  swfsql

  committed
  5994ac5

  Copy full SHA for 5994ac5

Commits on Feb 7, 2024

• Merge pull request #1 from rainiwu/remove-ftz

  Show description for 24a8593
  swfsql

  authored
  24a8593

  Copy full SHA for 24a8593

Commits on Feb 8, 2024

• add continuity requirement for unstack

  swfsql

  committed
  5ffff2d

  Copy full SHA for 5ffff2d

Commits on Feb 9, 2024

• Added {load/read/save/write}_safetensor_with methods

  Show description for e883b28
  swfsql

  committed
  e883b28

  Copy full SHA for e883b28

• unstack fixes

  swfsql

  committed
  c695a15

  Copy full SHA for c695a15

• Merge branch 'unstack' into mamba-root

  swfsql

  committed
  4141e06

  Copy full SHA for 4141e06

• Merge branch 'safetensors-change' into mamba-root

  swfsql

  committed
  8202b20

  Copy full SHA for 8202b20

• Merge remote-tracking branch 'origin/avoid-ci-errors' into mamba-root

  swfsql

  committed
  34234e2

  Copy full SHA for 34234e2

Commits on Feb 20, 2024

• silu: fix cpu df

  swfsql

  committed
  93202ad

  Copy full SHA for 93202ad

• allow to load safetensors from a byte array

  swfsql

  committed
  eb70a88

  Copy full SHA for eb70a88

• avoid conv1d bound for cudnn

  swfsql

  committed
  fde7a40

  Copy full SHA for fde7a40

• bump gemm

  swfsql

  committed
  75d63cd

  Copy full SHA for 75d63cd

• clippy fix

  swfsql

  committed
  f0bcb9a

  Copy full SHA for f0bcb9a

• Add mamba-minimal

  Show description for cac2f33
  swfsql

  committed
  cac2f33

  Copy full SHA for cac2f33

• add nightly requirement for mamba-minimal

  swfsql

  committed
  bff1b65

  Copy full SHA for bff1b65