Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dataset download #42

Open
siccovansas opened this issue Sep 22, 2022 · 2 comments
Open

Add dataset download #42

siccovansas opened this issue Sep 22, 2022 · 2 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@siccovansas
Copy link
Member

It would be great if we can make an export of the dataset and allow visitors to download it.

@Jonakemon
Copy link
Collaborator

Nice! Few questions:

  • If we offer good documentation for the API, is this feature still required?
  • Is a JSON file good enough?
  • Can we do a cron scheduled export every night and only offer the 'latest' export file? That would prevent having to do a heavy query whenever someone clicks the export button.
  • Can the file be written to public downloads folder? Or do you guys use an S3 bucket or something similar for these kind of (larger) downloads?

@siccovansas
Copy link
Member Author

Offering the data as JSON via a well documented API is always good. It would also be nice to offer the dataset as a CSV for people who can't use JSON/API's. The data is nested so I would break it up by creating one row for each function of a judge. So for example Aalderink would have 8 rows in the CSV. See this example CSV I made (it contains only the first 5 rows, but should make clear how I think it should look).

A daily cronjob to generate the CSV is fine! We can host it on our own server.

@Jonakemon Jonakemon added enhancement New feature or request help wanted Extra attention is needed labels May 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants