Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

about mean and std #51

Open
hanguniverse opened this issue Sep 5, 2023 · 3 comments
Open

about mean and std #51

hanguniverse opened this issue Sep 5, 2023 · 3 comments
Labels
about score About the score of ImageReward

Comments

@hanguniverse
Copy link

Thanks for your wonderful work, I have a question that in ImageReward.py l80-81 set the self.mean=0.167 and self.std=1.033,
How did you get these two numbers?

@xujz18
Copy link
Member

xujz18 commented Sep 5, 2023

Thanks for your attention! You can refer #7

@xujz18 xujz18 added the about score About the score of ImageReward label Sep 5, 2023
@hanguniverse
Copy link
Author

@xujz18 thanks for your reply! I have another question that when I evaluate the reward model on a new dataset, I want to let the reward score in [0,1], How can I do that? thank you!

@xujz18
Copy link
Member

xujz18 commented Sep 10, 2023

Very happy to discuss this with you. I think you can get the scores for the whole dataset after normalizing them based on the mean and variance of the new dataset.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
about score About the score of ImageReward
Projects
None yet
Development

No branches or pull requests

2 participants