Hi, thanks for providing a great benchmark framework.
I was wondering how can we load GGUF model? Right now, the easiest way is to serve GGUF and use litellm. However, we have no log likelihood function implemented for litellm, unable to run some task.
Thank you.