Does exllamav2 support p104-100 8g graphics card

[lugangqi]

Problem

My platform is cpu2666v3 x99 motherboard with 4060ti 16g graphics card and a p104-100 8g graphics card. Can I run your exllamav2 together?

Solution

My platform is cpu2666v3 x99 motherboard with 4060ti 16g graphics card and a p104-100 8g graphics card. Can I run your exllamav2 together?

Alternatives

No response

Explanation

My platform is cpu2666v3 x99 motherboard with 4060ti 16g graphics card and a p104-100 8g graphics card. Can I run your exllamav2 together?

Examples

No response

Additional context

No response

Acknowledgements

• I have looked for similar requests before submitting this one.
• I understand that the developers have lives and my issue will be answered when possible.
• I understand the developers of this program are human, and I will make my requests politely.

[Ristellise]

https://tryitands.ee/

[askmyteapot]

The answer is yes... however that P104-100 card only has 4GB of VRAM and has severely gimped fp16 performance (1:64). IF you want to use it, you will need to use a llama.cpp based backend (like koboldcpp or ollama etc)

Also, dont spam issues. Raise one and be patient.

[mindkrypted]

This is not an issue, please close it.
There are "help wanted" and "question" tags available.