vllm.entrypoints.serve.utils ¶

Modules:

• api_utils –
• fingerprint –

  Build the system_fingerprint string returned by the OpenAI-compatible

• orca_metrics –

  Utility functions that create ORCA endpoint load report response headers.

• tool_calls_utils –