357 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
1
vote
0
answers
83
views
OnnxRuntime with ACL Execution Provider on RK3588 (Mali-G610): Nodes assigned to ACL but GPU load remains 0%
[Goal & Problem]
I am trying to accelerate ONNX model inference on an RK3588 (Orange Pi 5) board using the Mali-G610 GPU. I have built OnnxRuntime (ORT) with the ACL (Compute Library) Execution ...
0
votes
1
answer
76
views
Fail to Run OnnxRuntime Session in C# with CUDA Device
I created a YOLO v11 DL model using a given dataset and both the train and prediction modules work fine in PyCharm.
However, after exporting the model file to ONNX format and running the prediction ...
0
votes
0
answers
41
views
onnxruntime-node native binding not found when packaging with pkg — need official way to load from custom path
I'm trying to bundle a Node.js CLI tool that uses @xenova/transformers into a single executable using pkg.
The build works fine, but when I run the packaged executable, I get this error:
Error: Cannot ...
0
votes
0
answers
123
views
Could not find a version that satisfies the requirement onnxruntime-gpu==1.22.0
currently using both python and typescript for the motia based project (https://github.com/MotiaDev/motia), python mainly for working with onnxruntime-gpu.
The OS environment is ubuntu 20.04.
firstly ...
1
vote
0
answers
112
views
Unable to load onnxruntime.dll error 0x8007045A (ERROR_DLL_INIT_FAILED)
I am having trouble using onnxruntime.dll in ML.NET.
My code works on one PC but not another. Clearly there is a mismatch between versions of some native DLLs, but I can't figure it out.
The error is:...
0
votes
1
answer
208
views
In old version (v1.18.1) of onnx web runtime, how do I specify custom location for the `.js` files (like `ort-wasm-threaded.js`)?
I have a website that runs an onnx model (pre-optimized to .ort format) on the client via ONNX's web runtime.
I must also stick to an old version of onnx (before 1.19.0), because the support for non-...
2
votes
1
answer
273
views
How to make a python package that can have two different version of a dependency?
It is now not uncommon to have a python package that is distributed in a multitude of different "flavors". This happens often with machine learning packages, e.g. onnxruntime has many "...
0
votes
0
answers
46
views
Unable to run inference in onnxruntime-web (wasm backend) proxy mode with multi-threading enabled
Has anyone had any success running ort-web on a wasm backend with the proxy option (ort.env.wasm.proxy) set and multi-threading enabled?
This is all the javascript I'm running:
// alt.ts
import * as ...
0
votes
2
answers
1k
views
Running labelme in VS Code terminal gets ImportError: DLL load failed while importing onnxruntime_pybind11_state [...]
I'm following along with this YouTube video.
I've already run the command
pip install labelme opencv-python tensorflow matplotlib albumentations
in the VS Code powershell terminal and successfully ...
0
votes
0
answers
215
views
How to load onnxruntime.dll in C++ project from application directory instead of system?
I am trying to use ONNX Runtime 1.22.0 which is in my application directory. I have added Include Directories, Library Directories, Linker, and command to copy dll to application directory under Pre-...
0
votes
0
answers
96
views
Unable to get onnxruntime-web working in content.js in Chrome Extension
My file structure to show what files are produced in dist when building the project:
.
├── dist
│ ├── 97d8ed7170daf34c90d5.wasm
│ ├── content.js
│ ├── content.js.LICENSE.txt
│ ├── content.js....
1
vote
1
answer
517
views
The docling_core library (with smoldocling) fails to export to markdown
I'm trying to extract a table from a jpeg image using Smoldocling.
The result is great in 'doctags' format, but I can't export it : I don't have any warning nor error message, only an empty output.
I ...
0
votes
1
answer
3k
views
ONNXRuntime cannot load `cudnn64_9.dll` in .NET
I want to use Microsoft.ML.OnnxRuntime.Gpu version 1.20.1 on this tutorial on the ONNX website in dotnet 9.0.300. the tutorial uses CPU but I want to modify it to the GPU. However my modified code is ...
2
votes
3
answers
453
views
onnxruntime with java and spring boot cannot load onnxruntime.dll
I need to use the onnxruntime with Java and spring boot to work with mkask detection model. but I have the below exception when calling OrtEnvironment env = OrtEnvironment.getEnvironment()
I tried to ...
0
votes
0
answers
127
views
Post-processing Segmentation Mask from ONNX Model in Web (ONNX Runtime JS)
I'm currently working on running my custom ONNX segmentation model directly in the browser using ONNX Runtime for Web with HTML and JavaScript. The model is loading and running inference successfully. ...