Skip to content

InternEvo-v0.3.2dev20240313

Compare
Choose a tag to compare
@sunpengsdu sunpengsdu released this 13 Mar 07:32
fb6a587

What's Changed

  • Delete .github/workflows/stale.yml by @del-zhenwu in #66
  • Fix (unitest, interleaved pp and other bugs): re-adapt unitest for isp and adapt interleaved pp for no flash_attention by @li126com in #52
  • feat(model/linear.py): support norm head for model internlm2 by @huangting4201 in #68
  • feat(modeling_internlm2.py): update model type to INTERNLM2_PUBLIC by @huangting4201 in #69
  • feat(ckpt): optimize model checkpointing in Volc and Ali by @zigzagcai in #65
  • fix(communication/isp.py): fix redundant callback and remove head embed hook by @huangting4201 in #72
  • (feat/demo) add internlm2 1.8b config by @00INDEX in #73
  • Feat(QA): temp no fa by @li126com in #75

New Contributors

Full Changelog: v0.3.1dev20240229...v0.3.2dev20240313