Training Reward Model: AttributeError: 'Namespace' object has no attribute 'residual_dropout_lima'. Did you mean: 'residual_dropout'?

[RylanSchaeffer]

I'm trying to train a reward model using the given default configurations but I hit an odd error:

Command:

accelerate launch --config_file configs/accelerate_config.yaml src/reward_modeling/training/trainer_rm.py --configs defaults_rm rm-pythia-44m

Error:

Traceback (most recent call last):
  File "src/reward_modeling/training/trainer_rm.py", line 351, in <module>
    main()
  File "src/reward_modeling/training/trainer_rm.py", line 209, in main
    model = get_model(training_conf, tokenizer)
  File "miniconda3/envs/reward_modeling_env/lib/python3.10/site-packages/model_training/utils/utils.py", line 354, in get_model
    residual_dropout_lima=conf.residual_dropout_lima,
AttributeError: 'Namespace' object has no attribute 'residual_dropout_lima'. Did you mean: 'residual_dropout'?

[RylanSchaeffer]

It might be a bug with Open Assistant: LAION-AI/Open-Assistant#3690

[RylanSchaeffer]

I found I needed to add residual_dropout_lima: false to defaults_rm inside config_rm.yaml

[sheikhshafayat]

Thanks your solution worked for me!