Skip to content

DeepInfer: High-performance, large-scale inference framework for DeepSeek models

Python
262 B
Raw Blame
from deepinfer.model_executor.input_metadata.input_metadata import (
    InputMetadata,
    InputMetadataV4,
    InputMetadataV4VL,
    InputMetadataVL,
)

__all__ = [
    "InputMetadata",
    "InputMetadataV4",
    "InputMetadataV4VL",
    "InputMetadataVL",
]