Thanks for your helpful project,could you give us model checkpoint as shown in figure

[LiZhangMing]

[xxw11]

Hi, You can use the code from the auto_gptq example to set the appropriate parameters and generate a checkpoint like this. If you have any questions or run into any issues, please feel free to reach out.

[LiZhangMing]

did you use this code as shown in Figure，or you use other project to generate the Quantized Model？ 清风 ***@***.***  

…

------------------ 原始邮件 ------------------ 发件人: "yuhuixu1993/qa-lora" ***@***.***>; 发送时间: 2024年5月28日(星期二) 下午4:16 ***@***.***>; ***@***.******@***.***>; 主题: Re: [yuhuixu1993/qa-lora] Thanks for your helpful project,could you give us model checkpoint as shown in figure (Issue #33) Hi, You can use the code from the auto_gptq example to set the appropriate parameters and generate a checkpoint like this. If you have any questions or run into any issues, please feel free to reach out. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>