make use of nativeaot static linking feature #9503

ivanjx · 2022-11-21T16:04:11Z

Is your feature request related to a problem? Please describe.
it is now possible to static link native libraries inside the main binary so it should be possible to do that to the 2 native dlls from avalonia's native aot output, namely libHarfBuzzSharp.dll and libSkiaSharp.dll.

Describe the solution you'd like
include the static library files of those 2 dlls instead and use DirectPInvoke and NativeLibrary.

Additional context
https://github.com/dotnet/runtimelab/blob/feature/NativeAOT/docs/using-nativeaot/interop.md#linking

The text was updated successfully, but these errors were encountered:

maxkatz6 · 2022-11-21T16:25:00Z

It should be optional, as it works only with native AOT.
I suppose ideal plan would be something like:

Include lib/a files into our nuget packages. Including Skia and Angle
Add new msbuild option to enable avalonia libs static linking
In the msbuild targets files include and DirectPInvoke items if avalonia static linking is enabled
Exclude dll/so files from the output if avalonia static linking is enabled

ivanjx · 2022-11-21T16:51:13Z

no need for another static linking configuration in the csproj. DirectPInvoke and NativeLibrary is smart enough to ignore themselves if it is not being published. native aot will only kick in dotnet publish command.

ivanjx · 2022-11-22T04:48:52Z

@maxkatz6 are there any static library files .lib for those 2 dlls? if there arent how to create one? thanks

maxkatz6 · 2022-11-22T04:53:59Z

you will need to look for them here, possibly compile Skia manually
https://github.com/mono/SkiaSharp

danielmayost · 2023-02-06T05:53:23Z

Is there a workaround to achieve this?

My software is distributed as singlefile, it is quite impractical to use AOT when 3 more dlls are added on the side.

maxkatz6 · 2023-02-08T04:28:07Z

For the SingleFile deployment it's possible to include native dependencies: https://learn.microsoft.com/en-us/dotnet/core/deploying/single-file/overview?tabs=cli#include-native-libraries

I don't think it's applicable for the NativeAOT, that's more a question to the .NET runtime team.

danielmayost · 2023-02-08T04:49:42Z

yes, i know, meant for NativeAOT.

it's not works.

ivanjx · 2023-02-08T05:24:28Z

deploying native aot avalonia apps is possible with single exe as long as you have the static libs mentioned above. i have compiled those and works fine

danielmayost · 2023-02-08T05:28:40Z

@ivanjx static lib, Where did you get them? So you successfully create a single AOT file?

ivanjx · 2023-02-08T05:29:56Z

@danielmayost yes. you need to compile skia and harfbuzz urself. my hands are full right now so cant explain the details but u can search on how to do those.

ivanjx · 2023-02-18T07:25:55Z

here is my compiled required libs for avalonia on windows x64 platform if anyone is interested.
https://mega.nz/file/z34V3bSZ#boItQx_nLBRGu-biDL3PbKSSG_Ti87JL7KNY7qz2Li8

ivanjx · 2023-02-18T07:32:44Z

you can build skia for other platforms if you look inside the cake files. here is the ones for windows that i use as reference: https://github.com/mono/SkiaSharp/blob/main/native/windows/build.cake

for harfbuzz you can use this and open in visual studio. there is some settings to change to enable static build but i forgot which: https://github.com/mono/SkiaSharp/tree/main/native/windows/libHarfBuzzSharp

reference about the build commands: https://github.com/mono/SkiaSharp/wiki/Building-on-Linux

Cubody · 2023-03-17T15:31:15Z

@ivanjx
I downloaded your x64 win native libs and wrote static linking in .csproj:

    <ItemGroup>
        <DirectPInvoke Include="libHarfBuzzSharp" />
        <NativeLibrary Include="native\libHarfBuzzSharp.lib" Condition="$(RuntimeIdentifier.StartsWith('win'))" />
        <DirectPInvoke Include="libSkiaSharp" />
        <NativeLibrary Include="native\libSkiaSharp.lib" Condition="$(RuntimeIdentifier.StartsWith('win'))" />
    </ItemGroup>

But I'm getting strange errors that I can't understand. Can you help me?

libHarfBuzzSharp.lib(hb-face.obj) : found .netmodule MSIL or a module compiled with the /GL parameter; the layout is restarted with the /LTCG parameter; add /LTCG to the command line of the layout to improve the performance of the linker
EXEC : fatal error C1900: IL mismatch between "P1", version "20220715" and "P2", version "20220421"
LINK : fatal error LNK1257: failed to generate code
C:\Users\green\.nuget\packages\microsoft.dotnet.ilcompiler\8.0.0-preview.1.23110.8\build\Microsoft.NETCore.Native.targets(354,5): error MSB3073: exiting the "" commandC:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\
MSVC\14.33.31629\bin\Hostx64\x64\link.exe " @"obj\Release\net8.0\win-x64\native\link.rsp"" with code 1257.

ivanjx · 2023-03-17T16:09:23Z

@Cubody
i only tested this with net 7.0. maybe try to use that. or you can try to build the static libs with your current visual studio installation.

Cubody · 2023-03-17T16:25:53Z

@ivanjx
I also tried with .NET 7.0, but SDK is 8.0.
I will be very grateful if you can enlighten a little more in compiling native libraries, because I have never met with this before.
The feeling is that the error says that the nuget package(both Skia and second) is a different version instead of that's natives. I am using Avalonia 11 preview 5.

I'm also using Rider and can not download Visual Studio due to stupid region restriction :/

ivanjx · 2023-03-17T16:54:08Z

i believe avalonia version is not the problem here as i am using nightly.
try the 7.0 sdk

ivanjx · 2023-03-17T16:56:38Z

for compiling without visual studio i dont think it is possible as the compilers came from the visual studio installation. maybe you can install the compilers manually but idk how

Cubody · 2023-03-17T17:05:29Z

SDK 7.0 didn't help me =(
I will try to install VS, but how to compile natives?
Can you provide full instruction for these two libraries if it's not hard for you?
I think I can deal with .cake if I'll read docs but it's not clear about HarfBuzzSharp.

ivanjx · 2023-03-17T17:22:13Z

in general this is what you have to do at first:

install LLVM
clone https://github.com/mono/SkiaSharp
git submodule update --init --recursive
cd externals\skia
python .\tools\git-sync-deps

with skiasharp, you can follow these commands with a few adjustments (it has been a while but it is very similar). for the args required it is all mentioned in the .cake file for windows.

with harfbuzzsharp it is actually a lot easier. just need to open the .sln file inside the folder, re-target to latest if prompted, change the configuration type to static library, then build with Release configuration.

in your case @Cubody, i think the problem is only with the harfbuzz static library. so hopefully you can just build that yourself without rebuilding the skiasharp.

ivanjx · 2023-03-17T18:20:46Z

so here is the full command that i use for compiling skiasharp

..\depot_tools\gn gen 'out/windows/x64' --args='target_os=\"win\" target_cpu=\"x64\" is_static_skiasharp=true skia_enable_fontmgr_win_gdi=false skia_use_dng_sdk=true skia_use_icu=false skia_use_piex=true skia_use_sfntly=false skia_use_system_expat=false skia_use_system_libjpeg_turbo=false skia_use_system_libpng=false skia_use_system_libwebp=false skia_use_system_zlib=false skia_enable_skottie=true skia_use_vulkan=true skia_enable_gpu=true clang_win=\"C:\Program Files\LLVM\" extra_cflags=[ \"-DSKIA_C_DLL\", \"/MT\", \"/EHsc\", \"/Z7\", \"-D_HAS_AUTO_PTR_ETC=1\" ]'
..\depot_tools\ninja 'SkiaSharp' -C 'out/windows/x64'
open developer powershell for vs 2022. change directory to externals\skia\out\windows\x64
lib.exe /OUT:libSkiaSharp.lib *.lib

the first 2 commands are run inside the externals\skia folder.
beware that the 2nd command will use a lot of your cpu!

note: if you encounter issues when running gn, go inside your python installation path, copy python.exe into python3.exe

Cubody · 2023-03-26T17:05:56Z

@ivanjx Thanks a lot! I'll try it.

Cubody · 2023-04-02T13:02:37Z

I just tried one more time with your libs and it works as expected! I deleted all .NET packages and installed just .NET 8 preview. Now it's fine.

KieranDevvs · 2023-05-19T11:02:33Z

Its not clear to me where the issue lies, which one(s) of the following is making this occour?

A) SkiaSharp & HarfBuzzSharp don't package static libraries in their NuGet packages so there's nothing to statically link.
B) The NativeAOT compilation process in .NET doesn't support automatically statically linking 3rd party libs.
C) Both A & B are false and something else is blocking it from building a true published single executable

While its nice that there's a work around of building your own static libraries and configuring your project to use it, I don't consider that to be a fix for the problem. The goal should be that it works out of the box.

danielmayost · 2023-05-19T11:25:01Z

If I understand correctly A is the problem.
It's really frustrating not being able to publish a single AOT file, try as I might, I couldn't build SkiaSharp by myself.

ivanjx · 2023-05-19T11:42:44Z

i think including the static lib in the nuget wont be ideal for skiasharp as it is very big even for a single platform. imagine adding other platforms as well.

KieranDevvs · 2023-05-19T13:42:18Z

It doesn't have to be in the same NuGet package, they can split it out into:

SkiaSharp (All platforms with dynamic libs)
SkiaSharp.Static (All platforms without dynamic libraries)
SkiaSharp.x64Linux.Static (Specific platform)
etc

And then end users can configure their projects to include the relevant packages for specific builds i.e

<ItemGroup>
    <PackageReference Include="SkiaSharp.x64Linux.Static" Condition="$(TargetPlatform) = '...'" />
</ItemGroup>

danielmayost · 2023-06-05T03:46:17Z

Maybe someone would be so kind as to share the static libraries they managed to create (av_libglesv2 and libSkiaSharp) for the benefit of those who haven't managed to do it yet.

ivanjx · 2023-06-05T06:51:51Z

@danielmayost do you have any issues compiling the native libraries by yourself? please try follow this #9503 (comment)

MichalStrehovsky · 2023-06-20T06:00:45Z

If you see found .netmodule MSIL or a module compiled with the /GL parameter; the layout is restarted with the /LTCG parameter that means that something in the LIB was compiled with the /GL parameter passed to the C++ compiler ("Whole program optimization"). Whole program C++ optimizations require that all the LIB files, link.exe, etc. have a matching version. You'd need to match the version of the C++ compiler used to compile the native parts of the .NET runtime. That might work sometimes, but fail other times. The fix is to not pass /GL when building your LIB.

ivanjx · 2023-06-20T10:09:32Z

@MichalStrehovsky if it works on compile time with wont crash on runtime correct? thank you for the info.

danielmayost · 2023-07-02T18:33:16Z

@ivanjx I finally succeeded to compile SkiaSharp (according to the commands you wrote), the final file I received is about 1GB and in the files you sent it is about 400MB, do you have any idea?

ivanjx · 2023-07-03T01:41:06Z

@danielmayost you dont have to worry about the lib size since you dont have to ship it with your application. in my case the output exe is only around 60 MB.

my latest output size of the lib file is also 1 GB. maybe there are some differences between the linker command i used the first time with what i wrote here. forgot what i used the first time.

edit:
i got ~400MB size because i use LLVM.

ivanjx · 2023-10-25T09:31:43Z

updated build steps for windows

requirements:

vs2022 with desktop development with c++
LLVM (optional)

libSkiaSharp:

git clone https://github.com/mono/SkiaSharp.git
git checkout release/2.88.6 (or pick according the skiasharp version in the nuget list)
git submodule update --init --recursive
cd external/skia
python .\tools\git-sync-deps

python ..\depot_tools\gn.py args .\out\windows\x64\
this is what i put (according to this)

target_os="win"
target_cpu="x64"
is_static_skiasharp=true
skia_enable_fontmgr_win_gdi=false
skia_use_dng_sdk=true
skia_use_icu=false
skia_use_piex=true
skia_use_sfntly=false
skia_use_system_expat=false
skia_use_system_libjpeg_turbo=false
skia_use_system_libpng=false
skia_use_system_libwebp=false
skia_use_system_zlib=false
skia_use_vulkan=true
skia_use_angle=true
skia_enable_skottie=true
skia_enable_gpu=true
clang_win="C:\Program Files\LLVM"    <<=== REMOVE IF YOU DONT HAVE LLVM
extra_cflags=[ "-DSKIA_C_DLL", "/MT", "/EHsc", "/Z7", "-D_HAS_AUTO_PTR_ETC=1" ]

..\depot_tools\ninja -C .\out\windows\x64\ SkiaSharp
cd .\out\windows\x64\
lib.exe /OUT:libSkiaSharp.lib *.lib

note:

run all those commands in the Developer Powershell for VS 2022.
if you get an error after gn.py args go to C:\Program Files\LLVM\lib\clang and rename the folder to be full version (eg: 16.0.0 instead of just 16).
later versions of SkiaSharp may need to change the 7th step command to: python ..\depot_tools\ninja.py -C .\out\windows\x64\ SkiaSharp

libHarfBuzzSharp

open native\windows\libHarfBuzzSharp\libHarfBuzzSharp.sln.
on retarget projects window, click ok.
change configuration Debug to Release.
open project properties (alt + enter).
change Configuration Type to Static library.
go to c/c++ -> All Options.
find Whole Program Optimization. change to No.
go to c/c++ -> Command Line. add /bigobj.
save & build.
the lib file should be in native\windows\libHarfBuzzSharp\bin\x64\Release.

peaceshi · 2023-11-18T15:24:00Z

I have created two github actions to build these static libs.

libSkiaSharp and libHarfBuzzSharp
https://github.com/2ndlab/SkiaSharp.Static

ANGLE static
https://github.com/2ndlab/ANGLE.Static

Cubody · 2023-11-20T19:19:02Z

@peaceshi

Have you made Avalonia single file native aot to work with static ANGLE? It doesn't work for me. I have a black background instead of transparent - the Avalonia UI uses software rendering.

I made
<NativeLibrary Include="Native\av_libglesv2.lib" />
in csproj

To undestand if it works or no you can add options to Build app:

BuildAvaloniaApp()
                .With(new Win32PlatformOptions
                    {RenderingMode = new[] {Win32RenderingMode.AngleEgl}})
                .StartWithClassicDesktopLifetime(args);

If it'll not find ANGLE lib it'll crash.

Also Avalonia uses it's own fork of ANGLE with some fixes.

peaceshi · 2023-11-21T13:18:48Z

You can try to build this for yourself.
https://github.com/AvaloniaUI/angle/tree/avalonia-fork-master

Cubody · 2023-11-21T17:32:59Z

Btw have you made Avalonia single file native aot to work with this? I already built but it doesn't help.
Thats why Katz says that it's main problem to build angle as static library with all needable dependencies.

peaceshi · 2023-11-21T17:45:03Z

Emm, what is the all needable dependencies? Can you explain it further?

Cubody · 2023-11-21T17:53:33Z

I mean if I'll build just angle it'll not work because .dll itself uses many functions from other libs that angle bulk builds.

peaceshi · 2023-11-21T17:58:17Z

No. I think it is just a static lib bug of ANGLE.

Cubody · 2023-11-21T18:33:01Z

Here is old thread about static lib
https://groups.google.com/g/angleproject/c/xKmUgKZFpgY

peaceshi · 2023-11-22T07:17:46Z

I have linked all missing symbols. It is working now.
Download av_libglesv2.7z from https://github.com/2ndlab/ANGLE.Static/releases

Cubody · 2023-11-22T07:33:18Z

Nice work, appreciate it! Can you add these instructions to pipeline? It'll be easier for Avalonia to make its own Nuget.

Also I want to ask, is here any way to make my application size smaller? (I'm using some compilation flags) Now it's 70mb.

 <PropertyGroup>
        <IlcOptimizationPreference>Size</IlcOptimizationPreference>
        <AutoreleasePoolSupport>false</AutoreleasePoolSupport>
        <EnableUnsafeBinaryFormatterSerialization>false</EnableUnsafeBinaryFormatterSerialization>
        <EnableUnsafeUTF7Encoding>false</EnableUnsafeUTF7Encoding>
        <EventSourceSupport>false</EventSourceSupport>
        <HttpActivityPropagationSupport>false</HttpActivityPropagationSupport>
        <MetadataUpdaterSupport>false</MetadataUpdaterSupport>
        <UseSystemResourceKeys>true</UseSystemResourceKeys>
        <IlcGenerateStackTraceData>false</IlcGenerateStackTraceData>
        <IlcTrimMetadata>true</IlcTrimMetadata>
        <!-- <IlcDisableReflection>true</IlcDisableReflection> -->
        <IlcFoldIdenticalMethodBodies>true</IlcFoldIdenticalMethodBodies>
    </PropertyGroup>

    <PropertyGroup>
        <!--These can help when debugging weird exceptions especially when reflection is involved. See https://github.com/dotnet/corert/blob/master/Documentation/using-corert/optimizing-corert.md -->
        <!--RootAllApplicationAssemblies: False -> TrimMode:link See https://github.com/dotnet/runtimelab/issues/597 and https://github.com/dotnet/runtimelab/blob/feature/NativeAOT/docs/using-nativeaot/optimizing.md -->
        <IlcGenerateCompleteTypeMetadata>false</IlcGenerateCompleteTypeMetadata>
        <IlcDisableUnhandledExceptionExperience>true</IlcDisableUnhandledExceptionExperience>
    </PropertyGroup>

peaceshi · 2023-11-22T07:56:53Z

I will add these files to actions later.
About the file size, you can use upx or sfx to compress it. But for the build trimming, all we can do is wait for .NET team creating a better trimming or other optimizations.

peaceshi · 2023-11-23T13:17:49Z

https://github.com/2ndlab/ANGLE.Static/releases/tag/v1.1.0

Everything works well now.

NCLnclNCL · 2023-11-27T17:08:37Z

Good

amakvana · 2024-02-01T18:47:37Z

@ivanjx sorry to piggyback off this. I've download all 3 .libs: av_libglesv2.lib, libHarfBuzzSharp.lib and libSkiaSharp.lib. Imported them into my project and referenced them inside the .csproj. However, when Publishing, the 3 .dll files still get copied over.

Any idea what I am doing wrong? Cheers

maxkatz6 · 2024-02-01T20:59:55Z

If libs were successfully statically linked into your executable, you can safely delete remaining dll files.

ALIENQuake · 2024-03-04T12:26:22Z

@peaceshi I'm assuming that all ibs must be compiled at the specific platform to have the same outcome. Can you add Linux/macOS versions of those libs?

peaceshi · 2024-03-04T12:55:14Z

From #8130 (reply in thread).
Never. You can not static link glibc.
I can not imagine how many files you need to rewrite if you build with musl. 😆

ALIENQuake · 2024-03-05T10:23:17Z

@Cubody

For Avalonia apps, how feasible is it to use peaceshi libs that come from the official repository instead of Avalonia ANGLE fork? If the official repo doesn't have Avalonia fixes I'm assuming it could be a problem.

peaceshi · 2024-03-05T10:41:12Z

you can patch it manually by yourself just be like vcpkg done.

ivanjx added the enhancement label Nov 21, 2022

danielmayost mentioned this issue May 19, 2023

[FEATURE] publish .lib packages mono/SkiaSharp#2464

Open

timunie mentioned this issue Aug 15, 2023

High CPU usage on macOS? #11070

Closed

ivanjx mentioned this issue Nov 20, 2023

using static instead of dynamic library on supported platforms homov/LibMpv#7

Closed

ivanjx mentioned this issue Dec 4, 2023

not working with native aot: Common Language Runtime detected an invalid program MartinKuschnik/WmiLight#12

Closed

latop2604 mentioned this issue May 2, 2024

Avalonia version xM4ddy/OFGB#7

Closed

qwqcode mentioned this issue Jun 23, 2024

编译错误：fatal error LNK1181 qwqcode/SubRenamer#46

Closed

Numpsy mentioned this issue Aug 6, 2024

Support for arm32 and arm64 danipen/TextMateSharp#40

Closed

make use of nativeaot static linking feature #9503

make use of nativeaot static linking feature #9503

Comments

ivanjx commented Nov 21, 2022

maxkatz6 commented Nov 21, 2022

ivanjx commented Nov 21, 2022

ivanjx commented Nov 22, 2022

maxkatz6 commented Nov 22, 2022

danielmayost commented Feb 6, 2023 • edited Loading

maxkatz6 commented Feb 8, 2023

danielmayost commented Feb 8, 2023

ivanjx commented Feb 8, 2023

danielmayost commented Feb 8, 2023

ivanjx commented Feb 8, 2023

ivanjx commented Feb 18, 2023

ivanjx commented Feb 18, 2023 • edited Loading

Cubody commented Mar 17, 2023

ivanjx commented Mar 17, 2023

Cubody commented Mar 17, 2023 • edited Loading

ivanjx commented Mar 17, 2023 • edited Loading

ivanjx commented Mar 17, 2023

Cubody commented Mar 17, 2023

ivanjx commented Mar 17, 2023 • edited Loading

ivanjx commented Mar 17, 2023 • edited Loading

Cubody commented Mar 26, 2023

Cubody commented Apr 2, 2023

KieranDevvs commented May 19, 2023 • edited Loading

danielmayost commented May 19, 2023 • edited Loading

ivanjx commented May 19, 2023

KieranDevvs commented May 19, 2023 • edited Loading

danielmayost commented Jun 5, 2023 • edited Loading

ivanjx commented Jun 5, 2023

MichalStrehovsky commented Jun 20, 2023

ivanjx commented Jun 20, 2023

danielmayost commented Jul 2, 2023 • edited Loading

ivanjx commented Jul 3, 2023 • edited Loading

ivanjx commented Oct 25, 2023

peaceshi commented Nov 18, 2023

Cubody commented Nov 20, 2023 • edited Loading

peaceshi commented Nov 21, 2023

Cubody commented Nov 21, 2023

peaceshi commented Nov 21, 2023

Cubody commented Nov 21, 2023

peaceshi commented Nov 21, 2023

Cubody commented Nov 21, 2023

peaceshi commented Nov 22, 2023

Cubody commented Nov 22, 2023

peaceshi commented Nov 22, 2023

peaceshi commented Nov 23, 2023

NCLnclNCL commented Nov 27, 2023

amakvana commented Feb 1, 2024

maxkatz6 commented Feb 1, 2024

ALIENQuake commented Mar 4, 2024

peaceshi commented Mar 4, 2024 • edited Loading

ALIENQuake commented Mar 5, 2024

peaceshi commented Mar 5, 2024

danielmayost commented Feb 6, 2023 •

edited

Loading

ivanjx commented Feb 18, 2023 •

edited

Loading

Cubody commented Mar 17, 2023 •

edited

Loading

ivanjx commented Mar 17, 2023 •

edited

Loading

ivanjx commented Mar 17, 2023 •

edited

Loading

ivanjx commented Mar 17, 2023 •

edited

Loading

KieranDevvs commented May 19, 2023 •

edited

Loading

danielmayost commented May 19, 2023 •

edited

Loading

KieranDevvs commented May 19, 2023 •

edited

Loading

danielmayost commented Jun 5, 2023 •

edited

Loading

danielmayost commented Jul 2, 2023 •

edited

Loading

ivanjx commented Jul 3, 2023 •

edited

Loading

Cubody commented Nov 20, 2023 •

edited

Loading

peaceshi commented Mar 4, 2024 •

edited

Loading