-
Notifications
You must be signed in to change notification settings - Fork 130
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Prompt Crafter json loads fix for numbers #1527
Conversation
assets/aml-benchmark/components/src/prompt_crafter/package/prompt_factory.py
Show resolved
Hide resolved
@SamGos93 Can you point me to the checksum test pipeline? Tried to find it in the checks but couldn't find it. I am assuming this would be breaking for this test. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
prompt_factory line 327 to 332 would be breaking for the screenshoted case I put in the issue
@mercerchen : I have updated the logic. Can you please check? |
@SamGos93 Can you tell me thne name of the test pipeline? the code looks good just want to see the tests passing |
It is probably this https://github.com/Azure/azureml-assets/actions/runs/6592757956/job/17914044989?pr=1527. We would know once it completes/ fails. |
Fix the failure when output pattern has a number and the json loads fails.
Removing the try/except logic for json loads as for chat models, we would always need the role to be added.