Skip to content

[LLM] bug: installation failure on arm, nixl-cu12 not available on arm #61880

@thomasdhc

Description

@thomasdhc

What happened + What you expected to happen

nixl-cu12 is only available on platform manylinux_2_28_x86_64, attempts to install on aarch64 fails.

Versions / Dependencies

ray[llm]==2.54.0

Reproduction script

Attempt pip install ray[llm]==2.54.0 on aarch64

Issue Severity

None

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething that is supposed to be working; but isn'tcommunity-backlogcoreIssues that should be addressed in Ray CorellmserveRay Serve Related IssuestabilitytriageNeeds triage (eg: priority, bug/not-bug, and owning component)usability

    Type

    No type

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions