vllm.v1.worker.gpu.model_states ¶
Modules:
-
default– -
encoder_decoder– -
encoder_only– -
interface– -
mamba_hybrid– -
mm_pruning– -
prompt_embeds– -
recoverssm–
vllm.v1.worker.gpu.model_states ¶Modules:
default – encoder_decoder – encoder_only – interface – mamba_hybrid – mm_pruning – prompt_embeds – recoverssm –