Other models

[Mugariya]

Hello,

Can we use models other than Vicuna and ChatGPT?

[l-salewski]

Hello @Mugariya,

yes, our evaluation code can be used with other models as well!

As a starting point I would recommend looking here for the configurations of the LLMs that we used. Similarly, you will find their implementations here.

Once you implemented the model that you would like to study, you should be able to override the hydra config of the model.llm key.

Best,
Leonard