Does vLLM aim to place one expert entirely on a single device?

[Imagium719]

Hi there! I have a question regarding the behavior of vLLM during multi-GPU inference for MoE models. Specifically, does vLLM aim to place each expert entirely on a single device as much as possible, or does it slice experts and distribute them across multiple devices (using tensor parallelism)? I think this is important because the former approach has minimal requirements for GPU interconnect bandwidth, while the latter would require significantly higher bandwidth. Thanks in advance for your insights!