autointent.configs.VllmEmbeddingConfig

class autointent.configs.VllmEmbeddingConfig(/, **data)

Bases: BaseEmbedderConfig

Configuration for vLLM-based embeddings.

Parameters:

data (Any)

model_name: str = None

batch_size: int = None

max_model_len: int | None = None

gpu_memory_utilization: float = None

dtype: str = None

trust_remote_code: bool = None

extra_init_kwargs: dict[str, Any] = None

extra_encode_kwargs: dict[str, Any] = None