-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add time graph for annotator contributions #8
Comments
I think this is in fact useful. The ranking is computed in the compute_annotators_ranking function. For every user, the total number of contributions is the sum of To plot a graph showing, you should filter the above queries by the To actually plot it you can use any javascript graph plotting library. In Audio Commons mediator we use CanvasJS. See that example: http://canvasjs.com/editor/?id=http://canvasjs.com/example/gallery/line/site_traffic/ is quite easy. |
I came across this project: https://github.com/wa0x6e/cal-heatmap and I thought that maybe we could use something like this in Freesound datasets to see recent contributions to a dataset. |
I also think these visualizations are useful in our case - IMO these can be seen as a gamification. But just highlighting number of contributions, might be dangerous since some workers focus on going "fast" rather than getting "good" annotations. In order to acknowledge "good" workes, I propose including some sort of quality weighting to these curves which can be based on the quality estimate discussed in #31. To this end, we could either weight the proposed curve, or show two rankings: i) # of contributions or ii) quality. |
It is a good idea to use quality to weight the contribution graph. |
It would be nice to have a graph to visualize annotators contributions across time in the contribute page with "Annotators' ranking".
Not so useful, but could maybe motivate people in their progression...
The text was updated successfully, but these errors were encountered: