Skip to content
/ SoCo Public

Optimizing Singular Spectrum for Large Language Model Compression

License

Notifications You must be signed in to change notification settings

ldengjie/SoCo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

conda create --name soco python=3.10

conda activate soco

pip install torch==2.5.1 transformers==4.43.2 lm_eval==0.4.7 accelerate==1.2.1 sentencepiece==0.2.0 protobuf==3.19.6

python infer.py

python eval.py

About

Optimizing Singular Spectrum for Large Language Model Compression

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages