Linux version includes both libonnxruntime.so and onnxruntime.dll files, resulting in larger package size

[Izumiko]

After investigating the Docker image build process, I found that the Linux version of the server package (from the GitHub Actions artifacts) contains both libonnxruntime.so and onnxruntime.dll files, as well as onnxruntime_providers_* files. This results in the Linux package being around 500MB larger than the Windows package.

Are the onnxruntime.dll and onnxruntime_providers_*.dll necessary in the Linux version?

[Webreaper]

They're required for the ONNX AI stuff to work, as far as I'm aware. Whether it's possible to trim any of them, I'm unsure - it would take some time-consuming experimentation to work it out, and TBH, I'm not sure it's worth the time at the moment.

They only reason they're not required on Windows is that Windows has the ONNX runtime included by default.

[Izumiko]

Yes, I know Windows could have the runtime.

I mean, the Linux package contains both the Windows onnx runtime onnxruntime*.dll and the Linux onnxruntime libonnxruntime*.so. But the Windows package only contains the Windows onnx runtime onnxruntime*.dll (not use the runtime from the system).

So it may be a packaging error. if the windows version onnxruntime is removed, the package size will be reduced from 1.6G to 1.1G.

[Izumiko]

I found the bug reported at microsoft/onnxruntime-genai#1135, there is a workaround in it.
BTW, it also affects the mac version.

[Webreaper]

Ah, sorry, completely missed the fact that it's including both the windows and Linux DLLs. I get it now. Nice find! Thanks, I'll track this, and if I have time apply the workaround.

…

On Mon, 30 Dec 2024, 15:23 OxO, ***@***.***> wrote: I found the bug reported at microsoft/onnxruntime-genai#1135 <microsoft/onnxruntime-genai#1135>, there is a workaround in it. BTW, it also affects the mac version. — Reply to this email directly, view it on GitHub <#546 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABFMR3SFGNIIB3VGK7GMUWT2IFQOVAVCNFSM6AAAAABUMDHKTSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNRVGYYTOOJYGM> . You are receiving this because you commented.Message ID: ***@***.***>

[Webreaper]

Tagging this issue so it's linked to the MSFT one: microsoft/onnxruntime#23077

[Webreaper]

Tried the workaround, but no joy - it doesn't work for single-file publishing. :(

Hopefully MSFT will fix it soon in the new year!

[Izumiko]

Tried the workaround, but no joy - it doesn't work for single-file publishing. :(

Perhaps you could try deleting these DLLs for the Linux and macOS platforms in the makeserver.sh file before zipping the $outputdir.

And I noticed the Emgu.CV.runtime.ubuntu.20.04-x64 package. If we upgrade the base image to 24.04, will the Emgu runtime need to be upgraded as well?

[Webreaper]

The EMGUCV stuff isn't used any more, so I'll look at cleaning that up....

[Izumiko]

There is a typo in

Damselfly/scripts/makeserver.sh

Line 58 in 51bb3d2

linux | max | m1)

[Webreaper]

Are you stalking me? 😄

Fixed. It's looking much better now - image size down from 1.2GB to 721MB. 😮

Thanks for your input with this, it's much appreciated. I'll do some testing today, and if nothing has broken, so a proper release sometime later today or tomorrow.