autointent.configs.EmbedderConfig

class autointent.configs.EmbedderConfig

Configuration for the embedder.

The embedder is used to embed the data before training the model. These parameters will be applied to the embedder used in the optimization process in vector db. Only one model can be used globally.

batch_size: int = 32

Batch size for the embedder

max_length: int | None = None

Max length for the embedder. If None, the max length will be taken from model config

use_cache: bool = False

Flag indicating whether to cache embeddings for reuse, improving performance in repeated operations.

device: str = 'cpu'

Device to use for the vector index. Can be ‘cpu’, ‘cuda’, ‘cuda:0’, ‘mps’, etc.