Missing HEVC and H264 encoders host by macOS with GPU 6600XT #9990

Atom2004 · 2024-11-20T13:02:39Z

Atom2004
Nov 20, 2024

Bug Description

When using RustDesk 1.3.2 on macOS with only AMD Radeon RX 6600 XT GPU, the hardware encoders (HEVC and H264) are not being detected. I could't find hevc and h264 encoder in the codec selection .The RustDesk_hwcodec.toml configuration file only shows decoder configurations but no encoder configurations, despite the system having VideoToolbox hardware encoding capability.

content of RustDesk_hwcodec.toml

config = '''
{
  "signature": *****,
  "ram_encode": [],
  "ram_decode": [
    {
      "name": "hevc",
      "format": "H265",
      "priority": 0,
      "hwdevice": "AV_HWDEVICE_TYPE_VIDEOTOOLBOX"
    },
    {
      "name": "h264",
      "format": "H264",
      "priority": 0,
      "hwdevice": "AV_HWDEVICE_TYPE_VIDEOTOOLBOX"
    },
    {
      "name": "h264",
      "format": "H264",
      "priority": 3,
      "hwdevice": "AV_HWDEVICE_TYPE_NONE"
    },
    {
      "name": "hevc",
      "format": "H265",
      "priority": 3,
      "hwdevice": "AV_HWDEVICE_TYPE_NONE"
    }
  ]
}'''

logs of "~/Library/Logs/RustDesk/check-hwcodec-config/RustDesk_rCURRENT.log"

[2024-11-20 16:29:27.950334 +08:00] INFO [src/core_main.rs:140] main start args: ["--check-hwcodec-config"], env: Args { inner: ["/Applications/RustDesk.app/Contents/MacOS/RustDesk", "--check-hwcodec-config"] }
[2024-11-20 16:29:28.739206 +08:00] DEBUG [/Users/runner/.cargo/git/checkouts/hwcodec-74796a7f8f16bbb9/8bbd05b/src/ffmpeg_ram/encode.rs:322] prepare yuv 1.132091ms
[2024-11-20 16:29:28.797861 +08:00] DEBUG [/Users/runner/.cargo/git/checkouts/hwcodec-74796a7f8f16bbb9/8bbd05b/src/ffmpeg_ram/encode.rs:341] hevc_videotoolbox new 58.436282ms
[2024-11-20 16:29:28.822113 +08:00] DEBUG [/Users/runner/.cargo/git/checkouts/hwcodec-74796a7f8f16bbb9/8bbd05b/src/ffmpeg_ram/encode.rs:347] hevc_videotoolbox encode failed 24.043519ms
[2024-11-20 16:29:29.347489 +08:00] DEBUG [libs/scrap/src/common/hwcodec.rs:706] HwCodecConfig { signature: 16843009, ram_encode: [], ram_decode: [CodecInfo { name: "hevc", mc_name: None, format: H265, priority: 0, hwdevice: AV_HWDEVICE_TYPE_VIDEOTOOLBOX }, CodecInfo { name: "h264", mc_name: None, format: H264, priority: 0, hwdevice: AV_HWDEVICE_TYPE_VIDEOTOOLBOX }, CodecInfo { name: "h264", mc_name: None, format: H264, priority: 3, hwdevice: AV_HWDEVICE_TYPE_NONE }, CodecInfo { name: "hevc", mc_name: None, format: H265, priority: 3, hwdevice: AV_HWDEVICE_TYPE_NONE }] }
[2024-11-20 16:29:29.347913 +08:00] INFO [src/ipc.rs:1230] send ok

I've verified that VideoToolbox hardware encoding works properly with other applications (like VideoProc Converter) and ffmpeg on the same system.

The output of ffmpeg command below:

ffmpeg -i ./SL_MO_VID_20170903_192532.mp4 -c:v hevc_videotoolbox -b:v 5000k ./output.mp4
ffmpeg version 7.1 Copyright (c) 2000-2024 the FFmpeg developers
  built with Apple clang version 16.0.0 (clang-1600.0.26.4)
  configuration: --prefix=/usr/local/Cellar/ffmpeg/7.1_3 --enable-shared --enable-pthreads --enable-version3 --cc=clang --host-cflags= --host-ldflags='-Wl,-ld_classic' --enable-ffplay --enable-gnutls --enable-gpl --enable-libaom --enable-libaribb24 --enable-libbluray --enable-libdav1d --enable-libharfbuzz --enable-libjxl --enable-libmp3lame --enable-libopus --enable-librav1e --enable-librist --enable-librubberband --enable-libsnappy --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtesseract --enable-libtheora --enable-libvidstab --enable-libvmaf --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libxvid --enable-lzma --enable-libfontconfig --enable-libfreetype --enable-frei0r --enable-libass --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libspeex --enable-libsoxr --enable-libzmq --enable-libzimg --disable-libjack --disable-indev=jack --enable-videotoolbox --enable-audiotoolbox
  libavutil      59. 39.100 / 59. 39.100
  libavcodec     61. 19.100 / 61. 19.100
  libavformat    61.  7.100 / 61.  7.100
  libavdevice    61.  3.100 / 61.  3.100
  libavfilter    10.  4.100 / 10.  4.100
  libswscale      8.  3.100 /  8.  3.100
  libswresample   5.  3.100 /  5.  3.100
  libpostproc    58.  3.100 / 58.  3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from './SL_MO_VID_20170903_192532.mp4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2017-09-03T11:25:32.000000Z
    com.android.version: 7.0
  Duration: 00:00:49.86, start: 0.000000, bitrate: 41025 kb/s
  Stream #0:0[0x1](eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuv420p(tv, bt709, progressive), 1280x720, 40820 kb/s, SAR 1:1 DAR 16:9, 119.22 fps, 240 tbr, 90k tbn (default)
      Metadata:
        creation_time   : 2017-09-03T11:25:32.000000Z
        handler_name    : VideoHandle
        vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 192 kb/s (default)
      Metadata:
        creation_time   : 2017-09-03T11:25:32.000000Z
        handler_name    : SoundHandle
        vendor_id       : [0][0][0][0]
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> hevc (hevc_videotoolbox))
  Stream #0:1 -> #0:1 (aac (native) -> aac (native))
Press [q] to stop, [?] for help
Output #0, mp4, to './output.mp4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    com.android.version: 7.0
    encoder         : Lavf61.7.100
  Stream #0:0(eng): Video: hevc (hev1 / 0x31766568), yuv420p(tv, bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 5000 kb/s, 120 fps, 15360 tbn (default)
      Metadata:
        creation_time   : 2017-09-03T11:25:32.000000Z
        handler_name    : VideoHandle
        vendor_id       : [0][0][0][0]
        encoder         : Lavc61.19.100 hevc_videotoolbox
  Stream #0:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s (default)
      Metadata:
        creation_time   : 2017-09-03T11:25:32.000000Z
        handler_name    : SoundHandle
        vendor_id       : [0][0][0][0]
        encoder         : Lavc61.19.100 aac
[out#0/mp4 @ 0x7fd88cf06cc0] video:30686KiB audio:782KiB subtitle:0KiB other streams:0KiB global headers:0KiB muxing overhead: 0.248816%
frame= 5930 fps=312 q=-0.0 Lsize=   31546KiB time=00:00:49.77 bitrate=5192.4kbits/s dup=0 drop=14 speed=2.62x    
[aac @ 0x7fd88cfabc80] Qavg: 435.165

How to Reproduce

Install RustDesk 1.3.2 on macOS only with AMD Radeon RX 6600 XT (without any other GPU).
Connect the macOS with IP address from windows 11.
Check ~/Library/Preferences/com.carriez.RustDesk/RustDesk_hwcodec.toml
Observe that ram_encode array is empty while ram_decode array has configurations

Expected Behavior

I could select HEVC or H264 codecs and enable hardware encoding.

Operating system(s) on local (controlling) side and remote (controlled) side

Windows 11 -> macOS

RustDesk Version(s) on local (controlling) side and remote (controlled) side

1.3.2 -> 1.3.2

Screenshots

codec selection on macos

macOS version

rustdesk config on macos.

Additional Context

No response

lixiaoliu666 · 2024-12-19T09:39:20Z

21pages · 2024-12-19T10:04:49Z

21pages
Dec 19, 2024
Collaborator

Only one frame is encoded during testing; subsequent frames may be successfully encoded, but this is the current testing method.

0 replies

lixiaoliu666 · 2024-12-24T01:44:09Z

lixiaoliu666
Dec 24, 2024

2 replies

21pages Dec 24, 2024
Collaborator

I have noticed this, please stop pushing.

rustdesk Dec 24, 2024
Maintainer

I will block you if you continue push

lixiaoliu666 · 2025-03-25T11:54:40Z

lixiaoliu666
Mar 25, 2025

oh I cant't fix this problem！

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Missing HEVC and H264 encoders host by macOS with GPU 6600XT #9990

Uh oh!

{{title}}

Uh oh!

Replies: 4 comments 4 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{editor}}'s edit

{{editor}}'s edit

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Uh oh!

Missing HEVC and H264 encoders host by macOS with GPU 6600XT #9990

Uh oh!

Atom2004 Nov 20, 2024

Bug Description

How to Reproduce

Expected Behavior

Operating system(s) on local (controlling) side and remote (controlled) side

RustDesk Version(s) on local (controlling) side and remote (controlled) side

Screenshots

Additional Context

Replies: 4 comments · 4 replies

Uh oh!

lixiaoliu666 Dec 19, 2024

Uh oh!

sleechengn Dec 20, 2024

Uh oh!

lixiaoliu666 Apr 21, 2025

Uh oh!

21pages Dec 19, 2024 Collaborator

Uh oh!

lixiaoliu666 Dec 24, 2024

Uh oh!

21pages Dec 24, 2024 Collaborator

Uh oh!

Uh oh!

rustdesk Dec 24, 2024 Maintainer

Uh oh!

lixiaoliu666 Mar 25, 2025

Atom2004
Nov 20, 2024

Replies: 4 comments 4 replies

lixiaoliu666
Dec 19, 2024

21pages
Dec 19, 2024
Collaborator

lixiaoliu666
Dec 24, 2024

21pages Dec 24, 2024
Collaborator

rustdesk Dec 24, 2024
Maintainer

lixiaoliu666
Mar 25, 2025