Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a toy problem #2

Open
vitskvara opened this issue Jan 26, 2021 · 2 comments
Open

Add a toy problem #2

vitskvara opened this issue Jan 26, 2021 · 2 comments

Comments

@vitskvara
Copy link
Collaborator

Add a toy dataset on which we can benchmark methods. Ideally, a working detector should have (almost) perfect prediction accuracy on it.

@masenka31
Copy link
Member

I really like the toy problem from Model-Based Learning for Point Pattern Data (Figure 7) to test for cardinality influence on detection: http://prntscr.com/10zwlwf
Neural Statistician was able to score AUC=1 for all 3 cases with some score functions.

The toy problem from One-Class Support Measure Machines for Group Anomaly Detection (or a modification of such toy problem) looks good for "semantic" anomaly detection: http://prntscr.com/10zwmd2. It can be also modified to have different cardinalities as well.

@vitskvara
Copy link
Collaborator Author

Nice, I like both problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants