Skip to content

Jetson Offload Rendering Client#456

Open
Jebbly wants to merge 11 commits intomasterfrom
jetson_offload_fix
Open

Jetson Offload Rendering Client#456
Jebbly wants to merge 11 commits intomasterfrom
jetson_offload_fix

Conversation

@Jebbly
Copy link
Contributor

@Jebbly Jebbly commented May 21, 2025

Introduces an offloading rendering client plugin for the Jetson, and some minor QOL fixes to the server-side encoder.

shg8 and others added 8 commits April 28, 2025 23:07
- Introduced the `offload_rendering_client_jetson` plugin, which handles video decoding and pose synchronization using the Jetson Multimedia API.
- Updated `plugins.yaml` to include the new Jetson client and added a dedicated profile for it.
- Removed the `needs_monado` function from `plugin.hpp` as it is no longer necessary.
- Added CMake configuration and source files for the Jetson client, including video decoding capabilities and Vulkan integration.
- Updated documentation to reflect the new plugin and its usage.

This commit enhances the offloading capabilities for rendering on Jetson devices, improving performance and flexibility in handling video streams.
- Removed the `openwarp_vk.cpp` and `openwarp_vk.hpp` files, consolidating their functionality into `plugin.cpp` and `plugin.hpp`.
- Updated CMake configuration to streamline shader processing and ensure proper dependencies.
- Enhanced the `openwarp_vk` class with additional utility functions for distortion mesh generation and HMD handling.
- Improved shader code by cleaning up commented sections and optimizing variable usage.
- Added new utility functions for HMD-related calculations in `utils/hmd.cpp` and `utils/hmd.hpp`.

These changes enhance the maintainability and performance of the OpenWarp plugin, ensuring better integration with the Vulkan rendering pipeline.
- Updated `plugins.yaml` to replace `timewarp_vk` with `openwarp_vk` in the Jetson offload rendering client profile.
- Introduced new `openwarp_vk` class with comprehensive functionality for rendering and distortion correction.
- Enhanced CMake configuration for better shader management and added support for Vulkan.
- Removed obsolete utility functions and files related to HMD handling, streamlining the codebase.

These changes improve the structure and performance of the OpenWarp plugin, ensuring better integration with the Vulkan rendering pipeline.
RAC_ERRNO_MSG("runtime_impl before creating the dynamic library");
return dynamic_lib::create(so_path);
});
for (auto& i : libraries_) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

enable_monado is defaulted to false now, and it will not work for the server side where the display is provided by monado.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants