Code

[Feature] Distillation enhancement#463

Code

Open

HIT-cwh wants to merge 17 commits intoopen-mmlab:mainopen-mmlab/mmrazor:mainfrom HIT-cwh:distillation_enhancementHIT-cwh/mmrazor:distillation_enhancementCopy head branch name to clipboard

+688-35

Commits

Commits on Feb 10, 2023

• support distillation early stop

  HIT-cwh

  committed
  10fdd62

• add norm arg to ChannelWiseDivergence

  HIT-cwh

  committed
  a2e029d

• add norm connector and support a list of connectors

  HIT-cwh

  committed
  5e95f07

• delete useless codes in cwd because of the usage of the norm connector

  HIT-cwh

  committed
  b978ad3

Commits on Feb 13, 2023

• fix fpn distill

  HIT-cwh

  committed
  019c527

Commits on Feb 14, 2023

• add fgd

  HIT-cwh

  committed
  a1c9426

Commits on Feb 15, 2023

• fix bugs when resuming

  HIT-cwh

  committed
  2a6dd39

• WIP: support ppyoloe distillation

  HIT-cwh

  committed
  c2abf94

Commits on Feb 16, 2023

• deepcopy output/input in deliveries

  HIT-cwh

  committed
  e52c0fc

Commits on Feb 23, 2023

• kl divergence enhancement

  HIT-cwh

  committed
  45d47c5

• set _is_init private attribute of the teacher model to True after loading checkpoint

  HIT-cwh

  committed
  3651289

• fix model registry

  HIT-cwh

  committed
  9ccfc84

• fix the got multiple values for argument bug in kl div

  HIT-cwh

  committed
  7bb3c97

• add docstring and pytest for fgd

  HIT-cwh

  committed
  eb66681

• copy codes from mmyolo for pytest

  HIT-cwh

  committed
  d787fe9

• adapt to the lower pytorch version

  HIT-cwh

  committed
  b9c83f2

• fix bugs in fgd

  HIT-cwh

  committed
  b479dc5