Personal Academic Page for pprp

A pytorch Quantization Toolkit

SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models

PyTorch native quantization and sparsity for training and inference

Inference Code of Meissonic

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image …

🔊 Text-Prompted Generative Audio Model

Evolution of Heuristics

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"

Code for Discovering Preference Optimization Algorithms with and for Large Language Models

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.

GPT based autonomous agent that does online comprehensive research on any given topic

Official code implementation of Vary-toy (Small Language Model Meets with Reinforced Vision Vocabulary)

Code Repository of Evaluating Quantized Large Language Models