Not really useful as-is, but I was wondering how WindowServer worked internally and apparently this embedded GNUstep reincarnation can provide some answers ....

https://www.illumenos.com/os/mgstep/

On the other hand I remember quite a saga about pixmap management between X/GL and GPU devices and I suspect accelerated drawing will require quite a lot of work ....

Good luck with this!