Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

setting done as False in robomimic #32

Open
lakshitadodeja opened this issue Jan 7, 2025 · 2 comments
Open

setting done as False in robomimic #32

lakshitadodeja opened this issue Jan 7, 2025 · 2 comments

Comments

@lakshitadodeja
Copy link

Hi,

I see that in robomimic wrapper. the done value is being automatically set as False. If we want to change it to its true value, is returning the actual done value enough ? Or are there some other changes in the training code that we need to handle for trajectories that terminate early ?

@allenzren
Copy link
Member

Hi! I am not sure exactly right now. Could you give a try and see if the done value from robosuite corresponds to termination?

@lakshitadodeja
Copy link
Author

I tried to check if the task for successful from robomimic and passed done as -

truncated = self.env.env._check_success()
done = terminated or truncated

The success rate from the evaluation increased with that (the one with true done is the one with changes) -
dppo

Though the number of eval episodes also increased, probably because some episodes ended early ?
W B Chart 1_8_2025, 8_10_31 PM

Is this expected ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants