Skip to content

vllm.utils.mistral

Provides lazy import of the vllm.tokenizers.mistral module.

Functions:

is_mistral_tokenizer(obj)

Return true if the tokenizer is a MistralTokenizer instance.

Source code in vllm/utils/mistral.py 
19
20
21
22
23
24
25
26
27
28
def is_mistral_tokenizer(obj: TokenizerLike | None) -> TypeGuard[mt.MistralTokenizer]:
    """Return true if the tokenizer is a MistralTokenizer instance."""
    cls = type(obj)
    # Check for special class attribute, this avoids importing the class to
    # do an isinstance() check.  If the attribute is True, do an isinstance
    # check to be sure we have the correct type.
    return bool(
        getattr(cls, "IS_MISTRAL_TOKENIZER", False)
        and isinstance(obj, mt.MistralTokenizer)
    )

is_mistral_tool_parser(cls)

Return true if cls carries the IS_MISTRAL_TOOL_PARSER marker.

The marker is set on the engine-adapter subclass registered under the "mistral" tool-parser key. No import of the parser module is required.

Source code in vllm/utils/mistral.py 
31
32
33
34
35
36
37
38
def is_mistral_tool_parser(cls: type | None) -> bool:
    """Return true if *cls* carries the ``IS_MISTRAL_TOOL_PARSER`` marker.

    The marker is set on the engine-adapter subclass registered under the
    ``"mistral"`` tool-parser key.  No import of the parser module is
    required.
    """
    return bool(getattr(cls, "IS_MISTRAL_TOOL_PARSER", False))