Code

Gradient Starvation#35

Code

Open

MichielStock wants to merge 49 commits intoMichielStock:masterMichielStock/STMOZOO:masterfrom ppm1337:masterppm1337/GradientStarvation:masterCopy head branch name to clipboard

+2,012-326

Commits

Commits on Jan 4, 2022

• update gitignore for vs code

  ppm1337

  committed
  3d0935d

• clean up repo, add dependencies

  ppm1337

  committed
  318780c

• provide example data from project website

  ppm1337

  committed
  be359f0

Commits on Jan 5, 2022

• first working/trainable version of neural network

  ppm1337

  committed
  55afea1

• implement moon generator using ScikitLearn;

  Show description for 5bac4f2
  ppm1337

  committed
  5bac4f2

Commits on Jan 7, 2022

• first working version of decision boundary plot

  ppm1337

  committed
  e48d009

• improve contour plot, minor refactorings

  ppm1337

  committed
  254b510

Commits on Jan 12, 2022

• fix data offset function

  ppm1337

  committed
  fc4f416

• adjust custom color scale

  ppm1337

  committed
  f67c3f0

• simplify training; train and test on generated data; some other tweaks

  ppm1337

  committed
  6d4cb81

Commits on Jan 13, 2022

• WIP: spectral decoupling

  ppm1337

  committed
  02a5623

• adjust moon position after rotation; optionally show plots

  ppm1337

  committed
  b8a1890

• use ProgressMeter for training; train with SD

  ppm1337

  committed
  2f80f58

• indicate WIP status in README

  ppm1337

  committed
  2e857c6

• add stochastic gradient descent optimizer

  ppm1337

  committed
  075a750

Commits on Jan 16, 2022

• add transformation features to moons from publication; refactor method names

  ppm1337

  committed
  35af33b

• refactor: better separation of NN and data, improve configurability of training

  ppm1337

  committed
  bd8bd4f

• WIP: notebook

  ppm1337

  committed
  ccf0bcc

• fix args; create example pipeline running multiple NNs; start documenting

  ppm1337

  committed
  6dc7d94

Commits on Jan 29, 2022

• add Experiment struct, move structs to one file

  ppm1337

  committed
  6732558

• move plots to dedicated file, simplify data loaders, plot loss and

  Show description for 7a65f4a
  ppm1337

  committed
  7a65f4a

• adjust plots for better readability

  ppm1337

  committed
  eca1fff

• implement function to run experiments on nn

  ppm1337

  committed
  f51272b

• add plots from first experiment

  ppm1337

  committed
  05262bd

Commits on Jan 30, 2022

• fix plot naming; make background transparent

  ppm1337

  committed
  d0d53f7

• attempt to visualize features

  ppm1337

  committed
  c95ed73

• clean up other alternative of feature vis

  ppm1337

  committed
  ed78589

• moon creation: propagte seed param to exported methods

  ppm1337

  committed
  3ef07ed

• create module for special figures

  ppm1337

  committed
  0667dfe

• move plot resolution method to plotutils

  ppm1337

  committed
  ce676c2

• allow run_experiments save subplots

  ppm1337

  committed
  7a9bcf9

• refactor plot_train_and_test_data to plotlyjs

  ppm1337

  committed
  1cf78d5

• update args with wd param, fix progress bar

  ppm1337

  committed
  e1794c8

• WIP: notebook

  ppm1337

  committed
  85b7908

• update plots

  ppm1337

  committed
  b4212d2

• manually edit figure 1

  ppm1337

  committed
  9506042

• update notebook

  ppm1337

  committed
  3bf644b

• fix 10000 epochs graph

  ppm1337

  committed
  c34df54

• update readme

  ppm1337

  committed
  a4d8351

• final version of main module

  ppm1337

  committed
  edc9504

• update documentation

  ppm1337

  committed
  2550101

• add static version of notebook

  ppm1337

  committed
  e9c80ec

Commits on Jan 31, 2022

• test Resource instead of LocalResource

  ppm1337

  committed
  f1ef680

• add author to notebook, fix usage of local resources

  ppm1337

  committed
  8754891

• fix typo in readme

  ppm1337

  committed
  150123f

• make instructions more clear

  ppm1337

  committed
  1eac1f5

• remove static html version

  ppm1337

  committed
  0f855a5

• fixes suggested by review

  ppm1337

  committed
  5881d1c

• update package documentation

  ppm1337

  committed
  fcc1a5c