InternEvo-v0.3.3dev20240315

What's Changed

• remove dependency of flash_attn when use_flash_attn is set to false by @sallyjunjun in #20
• fix(transformers): fix parameter error of safe_open in revert scripts by @x54-729 in #74
• Update version.txt by @sunpengsdu in #81
• fix(embedding.py): fix flash attn error of llama and internlm2 by @sallyjunjun in #83
• fix(ckpt): fix load funcs when loading llama & hf_llama by @gaoyang07 in #79
• Fix missing requirments for NUMA by @Godricly in #80
• test(workflow): add workflow for norm_weight_test by @kkscilife in #70
• feat(moe): impl moe with megablock kernel by @blankde in #76

New Contributors

• @Godricly made their first contribution in #80

Full Changelog: v0.3.2dev20240313...v0.3.3dev20240315