vllm.models.kimi_k3.nvidia.ops.cute_dsl ¶
Modules:
-
gemm_rs_ar–SM100 BF16 GEMM with fused tensor-parallel reduce-scatter/all-reduce.
-
latent_moe_tail–CuTe DSL kernels for KimiK3LatentMoETailOp.
vllm.models.kimi_k3.nvidia.ops.cute_dsl ¶Modules:
gemm_rs_ar – SM100 BF16 GEMM with fused tensor-parallel reduce-scatter/all-reduce.
latent_moe_tail – CuTe DSL kernels for KimiK3LatentMoETailOp.