Skip to content

Instantly share code, notes, and snippets.

View pavp-git's full-sized avatar

pa-vp pavp-git

View GitHub Profile
@pavp-git
pavp-git / merge_qlora_with_quantized_model.py
Created October 25, 2023 05:59 — forked from ChrisHayduk/merge_qlora_with_quantized_model.py
Merging QLoRA weights with quantized model
"""
The code below combines approaches published by both @eugene-yh and @jinyongyoo on Github.
Thanks for the contributions guys!
"""
import torch
import peft