-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
need to compile your own version of ONNXRuntime #1
Comments
As you know that there are flutter packages for onnx using ffi, such as : I suppose that they cannot be used here, but who knows.. |
For the example app, you can use the precompiled versions of the
ONNXRuntime in my flutter_onnx repository - I just added you as a
collaborator. Just clone the repository into the parent folder for the
flutter_sherpa_onnx repository and it should work straight away.
However, this has been compiled to support the operators from the specific
sherpa-onnx model I use (as well as some other ORT models). It probably
won't work for any other model (e.g. one you train yourself from sherpa, or
a different pretrained sherpa model). That's why I suggested starting with
compiling the ONNXRuntime, because eventually you're probably going to have
to be able to do that.
…On Sun, Nov 19, 2023 at 3:38 AM Flutter Painter ***@***.***> wrote:
Hi Nick,
Thank you for inviting me here and providing precious guidelines.
I am stuck at compiling ONNXRuntime
I gathered that it must be fetched here :
https://github.com/microsoft/onnxruntime
And the built using the script.
But it failed both for ios and android for me. I don't doubt that
persistence and issue opening will solve this.
Yet I fail to understand why we needs to compile our own versions.
Wouldn't it be possible to use the same runtimes as yours ?
If they are too heavy for git, how about hugging face or a good old gdrive
?
—
Reply to this email directly, view it on GitHub
<#1>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ABXHHMUINL7WUJJT3TI5O3LYFEFDRAVCNFSM6AAAAAA7RFT53SVHI2DSMVQWIX3LMV43ASLTON2WKOZSGAYDANJVGE3TSMQ>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
|
Hi Nick, Cloning flutter_onnx repository fixed it indeed, no more complaints about the missing ONNX runtime. Yet now I get "undefined symbol" error from xcode. Any ideas on how to solve them ? |
What version of Xcode are you using?
…On Mon, Nov 20, 2023 at 7:34 AM Flutter Painter ***@***.***> wrote:
Hi Nick,
Thank you for the quick reply,
Understood, I understand this will be needed eventually, but for now stick
to running the example.
Cloning flutter_onnx repository fixed it indeed, no more complaints about
the missing ONNX runtime.
Note I just had to edit the framework path in
*ios/flutter_sherpa_onnx.podspec* with
"FRAMEWORK_SEARCH_PATHS" => '"${PODS_ROOT}/../../../flutter_onnx/ios/lib"
"$(inherited)"',
Yet now I get "undefined symbol" error from xcode.
Hundreds of error on a real device, like :
Undefined symbol: std::__1::basic_string<char, std::__1::char_traits,
std::__1::allocator >::find(char, unsigned long) const
Only that one on the emulator : Undefined symbol: ___gxx_personality_v0
Any ideas on how to solve them ?
Will pursue test on android later this week..
—
Reply to this email directly, view it on GitHub
<#1 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ABXHHMXNI2KRCKKVAQJBOTLYFKJR3AVCNFSM6AAAAAA7RFT53SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMJYGAYTKNBQGA>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
Version 13.2.1 (13C100), I presume it is too low... |
Yes, the precompiled ONNXRuntime I gave was compiled with 14.3.1, so you probably need to build the Flutter project with that version. I strongly suggest you figure out how to build your own ONNXRuntime, that would also solve your problem. |
Hi Nick, Sorry for the delay in my reply, |
I pulled all the required repos and followed @flutter-painter changes as welll and getting an error when trying to run the example (when tapping CreateRecognizer)
I'm using Version 15.2. Do you have any suggestions on how to solve it? |
@dkjazz you probably need to turn off dead code stripping and/or change "Strip Style" to "Non-global symbols". Does the example project work? |
Hi Nick,
Thank you for inviting me here and providing precious guidelines.
I am stuck at compiling ONNXRuntime
I gathered that it must be fetched here : https://github.com/microsoft/onnxruntime
And the built using the script.
But it failed both for ios and android for me. I don't doubt that persistence and issue opening will solve this.
Yet I fail to understand why we needs to compile our own versions.
Wouldn't it be possible to use the same runtimes as yours ?
If they are too heavy for git, how about hugging face or a good old gdrive ?
The text was updated successfully, but these errors were encountered: