KhaosT/Cloud Gaming on Apple Vision Pro.md

Last active January 1, 2025 17:08

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/KhaosT/a4d90479e3cb0aae959ad55b08cd8358.js"></script>
Save KhaosT/a4d90479e3cb0aae959ad55b08cd8358 to your computer and use it in GitHub Desktop.

Download ZIP

Guide for clouding gaming on Apple Vision Pro

Raw

Cloud Gaming on Apple Vision Pro.md

Cloud Gaming on Apple Vision Pro

Cloud Gaming is a great way to enjoy graphically demanding games on Apple Vision Pro.

Since Safari on visionOS does not support PWA mode, here is how you can access cloud gaming services on Apple Vision Pro.

What’s needed

A compatible game controller
- visionOS supports game controller from Xbox, PlayStation, and Nintendo Switch.
- visionOS is really opinionated on where to send game controller events so if your controller is not working with the service you're using, try tap the center of the view and that should inform visionOS that this app should receive the game controller events.
Nexus⁺ app
- Disclosure - I made this because I wanted to access these services myself. Some other apps may also available.

Using GeForce Now

GeForce Now is the ideal cloud gaming service to use on Apple Vision Pro. With 4K resolution support (GeForce Now Ultimate membership required), the visual quality of the games is stunning.

After pairing the game controller with Apple Vision Pro, you can access GeForce Now from the bookmarks.

Before starting your first game session, make sure you go to GeForce Now settings and adjust the picture quality for higher resolution streaming, as the default option may not be optimal for a large canvas. (Due to the lack of H.265 support in Safari's WebRTC implementation, you may experience visual glitch streaming in 4K 120FPS configuration. In that case try switch back to 4K 60FPS instead.)

If you run into issue starting the game session, try turn off Turbo mode from the edit menu.

Using Xbox Cloud Gaming

Xbox Cloud Gaming is also available and offers a wide range of console games that might be interesting to explore. The service currently only supports streaming up to 1080p.

You can access Xbox Cloud Gaming from your bookmarks.

The app also includes an option to use Better xCloud with the website. Better xCloud enables Remote Play from your Xbox console and offers a wide range of options you can tweak. You can enable the script by long-tapping on the bookmark option to open the context menu, select Edit, and enable Better xCloud.

To update the Better xCloud script, long-tap on the row to show the context menu and select Update to download the latest script.

#AppleVisionPro #visionOS

Author

KhaosT commented Jun 26, 2024

@justinreeves00 Try set the user agent to Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.3 Safari/605.1.15, last time I think it worked for me.

jnrosemas commented Jun 29, 2024

It’s running smoothly for me on Vision OS 2 (beta 2) with H.265 enabled and 75Mbps/4K/120fps. Given that the Vision Pro is only capable of 90hz, does it make sense to enable vsync within the game? It doesn’t seem to be an issue, but was wondering if that would make things as smooth as possible. Really hoping for HDR one of these days if Nvidia will allow it! Thanks for all your hard work on this app. The experience is amazing and so immersive on such a large screen.

gschaiderd commented Jul 13, 2024

@KhaosT would it be possible to play with GeForce now in the movie mode in the environments like we can do now in visionOS 2.0 for every Safari video? As I assume Safari handles GeForce Now like a stream this should be feasible? Cheers, David

Author

KhaosT commented Jul 13, 2024

@gschaiderd not really. Video player environment integration is currently only available for HLS stream, which has a much higher latency than WebRTC so none of the cloud gaming platform is doing HLS for streaming.

gschaiderd commented Jul 13, 2024

@KhaosT thanks for the insights. Another question: Do you see any possibility to improve the sound in games? Today I played Fortnite since months and recognized that the 3D audio is much better.
Also: Any new possibilities with visionOS to bring vibrations to the AVP? 😊

Harisselimovic commented Jul 31, 2024

Hey. Great app but I am having trouble making my ps5 controller work on GeForce now and Xbox cloud. The controller is paired with the headset but it’s not showing or working on either cloud. When you say tap the center do you mean just poke the screen with my finger? I been trying non stop for 2 days to make it work and it’s been frustrating. Works fine on my iPad and iPhone.

Author

KhaosT commented Aug 1, 2024

Hey. Great app but I am having trouble making my ps5 controller work on GeForce now and Xbox cloud. The controller is paired with the headset but it’s not showing or working on either cloud. When you say tap the center do you mean just poke the screen with my finger? I been trying non stop for 2 days to make it work and it’s been frustrating. Works fine on my iPad and iPhone.

Try connect the controller to the Vision Pro first before starting the app? Some times visionOS won't forward the controller to the app if it's connected after the app is launched...

enjihn commented Aug 2, 2024 •

edited

Loading

How would I change the icons to the correct ones in the title bar above the window like in the screenshots?

Also, I created a new bookmark for YouTube TV. Is there anyway to add that option that the GeForce Now bookmark has for 4K? I have the 4K plan on YouTube TV for the Olympics and trying to watch on AVP.

Great app by the way though. Cool to get GFN and Xbox on AVP.

Author

KhaosT commented Aug 3, 2024

How would I change the icons to the correct ones in the title bar above the window like in the screenshots?

Apple don't let me default to that icon... If you go edit the bookmark, rename it to GeForce Now, it should show the correct icon.

I don't plan to optimize for YouTube as their thing changes too often that will likely to break a lot.

enjihn commented Aug 3, 2024

How would I change the icons to the correct ones in the title bar above the window like in the screenshots?

Apple don't let me default to that icon... If you go edit the bookmark, rename it to GeForce Now, it should show the correct icon.

I don't plan to optimize for YouTube as their thing changes too often that will likely to break a lot.

Ah, I had already renamed the bookmarks and they never changed. That’s when I came here to ask. Not a big deal if they won’t change though.

Author

KhaosT commented Aug 3, 2024 •

edited

Loading

Ah, I had already renamed the bookmarks and they never changed.

Oh can you try one thing? Focus the URL field, type a thing at the end and then remove the thing you typed. The logic to determine the icon only runs when the URL changes, I forgot that 😅

Author

KhaosT commented Aug 9, 2024

Yeah Nvidia changed something on the GFN side that no longer let the browser to stream 4K over WebRTC + WS

gschaiderd commented Aug 10, 2024

@KhaosT is there anything you can do? These’re has been the same issues many weeks ago. Cheers

Author

KhaosT commented Aug 10, 2024

@gschaiderd update the app to v1.1.1 and it should be working

gschaiderd commented Aug 17, 2024

Since today I get the following error message
403 ERROR

The request could not be satisfied.

Request blocked. We can't connect to the server for this app or website at this time. There might be too much traffic or a configuration error. Try again later, or contact the app or website owner.
If you provide content to customers through CloudFront, you can find steps to troubleshoot and help prevent this error by reviewing the CloudFront documentation.
Generated by cloudfront (CloudFront)
Request ID: n04v5YItG67t09QsONjsgFfdIDcpleLU--ZnD6FTEV0SuYwRPo5hIA==

@KhaosT

Author

KhaosT commented Aug 17, 2024

@gschaiderd it still works for me. Based on the error it seems you hit the CloudFront's protection thing. Can you try a different IP address and see if that works?

gschaiderd commented Aug 17, 2024

My bad, had VPN on. 😒
Since the last update I can’t set the bit Rate to 75 MBps anymore (50 max). Also it is not possible to set high resolution wide screen formats anymore as well as max FPS is 60 instead of 120. But I assume that this is on NVIDIA side a restriction now?

Author

KhaosT commented Aug 17, 2024

@gschaiderd yeah it's on Nvidia. I had to set it to pretend to be a TV to get back the 4K options. If you need ultra wide options, you can select Menu -> Mode and select Desktop to get the other options. Unfortunately with the desktop mode you only have up to 1440p options.

gschaiderd commented Sep 2, 2024

@KhaosT since some time there dark areas are displayed badly. It seems like the color/grey spectrum is very limited as you can see in the following picture. I am aware that the browser version of GeforceNow does not support HDR, but this is also far from SDR. There is basically no detailed gradient anymore. Just very rough grey to black drops.

Do you have any idea how this could be solved? It is there in every game I tried (Cyberpunk 2077, Avatar, Diablo, etc.).

Author

KhaosT commented Sep 2, 2024

I think that's just how video compression works? You can try bump up the bitrate and see if it looks better...

alex-titarenko commented Sep 2, 2024

Ah, I had already renamed the bookmarks and they never changed.

Oh can you try one thing? Focus the URL field, type a thing at the end and then remove the thing you typed. The logic to determine the icon only runs when the URL changes, I forgot that 😅

As of right now, changing the URL does not change the icon...