Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LGBM Ranker scores space #6684

Open
sh0tcall3r opened this issue Oct 17, 2024 · 2 comments
Open

LGBM Ranker scores space #6684

sh0tcall3r opened this issue Oct 17, 2024 · 2 comments
Labels

Comments

@sh0tcall3r
Copy link

sh0tcall3r commented Oct 17, 2024

Hi,
faced with interesting question, answer for which I don't have. When training LGBM Ranker it's necessary to provide a group array, which helps the model to distinct sessions and compare only those elements, which belong to the same group. So while training the model doesn't know that there are other groups when it compares documents from a given one. But while prediction we do not provide the model with group array and scores are not depended on the group. That's a little bit confusing. My question is - are the ranker scores for different groups in the same space or in other words - are scores for different groups comparable?

@sh0tcall3r
Copy link
Author

sh0tcall3r commented Oct 23, 2024

Could anybody help me here please?
@jameslamb ? Just don't know who else could I tag

@AlexKC99
Copy link

I would pass the groups in iteratively during inference. So if I have 3 groups I want to predict ranks for, I would pass each one in one by one to the predict() method. If you pass all 3 at once, then you will get the model ranks for all rows in all 3 groups.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants