Skip to content

Commit

Permalink
added citation
Browse files Browse the repository at this point in the history
  • Loading branch information
Arnav0400 committed May 31, 2024
1 parent 3ed61e0 commit ded01db
Showing 1 changed file with 13 additions and 0 deletions.
13 changes: 13 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -455,6 +455,19 @@ python3 surgical.py --layers o_proj,q_proj,v_proj,k_proj,gate_proj,up_proj,down_
#### To run rank search based on perplexity:
Run the perplexity_test.py script providing the path of the checkpoint from Step 1 as an argument. Logs will be created and evaluation on common sense reasoning tasks will be done on the entire test dataset.

## Citation
If you use SFSD-LLM in your research, kindly cite!

```bibtext
@article{chavan2024surgical,
title={Surgical Feature-Space Decomposition of LLMs: Why, When and How?},
author={Chavan, Arnav and Lele, Nahush and Gupta, Deepak},
journal={arXiv preprint arXiv:2405.13039},
year={2024}
}
```





0 comments on commit ded01db

Please sign in to comment.