Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crash due to zscore not initialised error when using the Azure generator as DAN probes are skipped #1082

Open
samisouabni opened this issue Jan 16, 2025 · 2 comments
Labels
bug Something isn't working

Comments

@samisouabni
Copy link

Steps to reproduce

How'd you do it?

  1. Select Azure generator and run DAN probes and any other(s)
  2. Setting config show_z to true
  3. Skips DAN probes and crashes saying that zscore not initialised

Were you following a specific guide/tutorial or reading documentation?

No.

Expected behavior

The z score would be shown in the report, no error would be thrown by the application.

Current behavior

An error is thrown by the application and it stops.

garak version

0.10.1

Additional Information

  1. Mac OSx and Windows
  2. 3.12.8
  3. direct repository checkout with git
  4. The error is at garak/evaluators/base.py, line 174 should be duplicated into the else statement, after line 182.
  5. Config provided below:
  verbose: 0
  parallel_requests: false
  parallel_attempts: false
  show_z: true
  1. Any relevant hardware or resource information
@samisouabni samisouabni added the bug Something isn't working label Jan 16, 2025
@leondz
Copy link
Collaborator

leondz commented Jan 16, 2025

Thanks. Will take a look.

@leondz
Copy link
Collaborator

leondz commented Jan 16, 2025

Can you paste the exception trace here? It may be in the log file. Then we'll be able to confirm that we're fixing the bug that you're reporting.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants