Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Nahush26 authored May 30, 2024
1 parent 4712867 commit 77e6b1c
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,12 @@ This repository contains the code to reproduce our results by following the step
{Need to add comments regarding specific library dependencies here}

To be able to run the evaluation functions present in our repository it is neccessary to pull the master branch from the llm-evaluation-harness: https://github.com/EleutherAI/lm-evaluation-harness/tree/master and run the command 'pip install -e' from inside the pulled repository.

## Key Features :
- [x] **Efficient** : This is a Zero Shot compression algorithm requiring no training steps, thus there is no need for large GPU resources.
- [x] **Targeted Compression** : Allows compression in a task specific as well as task agnostic (perplexity based) way.
- [x] **Compression Control** : The Surgical Rank Search process results in a more fine-grained control over the compressed models' budgets.
- [x] **Bias Reduction** : Compressed models showcase reduced stereotype biases and undergo significant unlearning-learning which are added benefits of this method.
## Supported Models

[LLaMa - HuggingFace](https://huggingface.co/huggyllama/llama-7b)
Expand Down

0 comments on commit 77e6b1c

Please sign in to comment.