vllm.entrypoints.serve ¶

Modules:

• dev –
• elastic_ep –
• engine –
• exception_handling –
• fault_tolerance –
• instrumentator –
• middleware –
• sagemaker –

  SageMaker-specific integration for vLLM.

• tokenize –
• utils –