Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

训练超参数相关问题 #51

Open
jwang1993 opened this issue Mar 26, 2024 · 1 comment
Open

训练超参数相关问题 #51

jwang1993 opened this issue Mar 26, 2024 · 1 comment

Comments

@jwang1993
Copy link

关于训练有几个问题想请教一下,
1、在预训练和微调阶段,SpecAugment Policy 是LibriSpeech Basic是什么含义呢
2、在预训练阶段,单独设置了Audio encoder learning rate decay为0.95,这是只针对audio encoder的还是预训练阶段所有可训练参数(audio encoder+adapter)呢
3、在预训练阶段采用多少台机器,总共训练了多长时间

@SaraAlthubaiti
Copy link

Could you please point me to their training code? I didn't find it and there was no description about it in the README, @jwang1993

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants