LLM Utils.#

The Utils module contains functions for converting Chatsky’s objects to an LLM_API and langchain compatible versions.

async message_to_langchain(message, ctx, source='human', max_size=5000)[source]#

Create a langchain message from a Message object.

Parameters:

  • message (Message) – Chatsky Message to convert to Langchain Message.

  • ctx (Context) – Current dialog context.

  • source (Literal['human', 'ai', 'system']) – Source of the message [human, ai, system]. Defaults to “human”.

  • max_size (int) – Maximum size of the message measured in characters. If a message exceeds the limit it will not be sent to the LLM and a warning will be produced

Return type:

Union[HumanMessage, AIMessage, SystemMessage]

async context_to_history(ctx, length, filter_func, llm_model_name, max_size)[source]#

Convert context to list of langchain messages.

Parameters:

  • ctx (Context) – Current dialog context.

  • length (int) – Amount of turns to include in history. Set to -1 to include all context.

  • filter_func (BaseHistoryFilter) – Function to filter the context.

  • llm_model_name (str) – name of the model from the pipeline.

  • max_size (int) – Maximum size of the message in symbols.

Return type:

list[Union[HumanMessage, AIMessage, SystemMessage]]

Returns:

List of Langchain message objects.

async get_langchain_context(system_prompt, ctx, call_prompt, prompt_misc_filter='prompt', position_config=PositionConfig(system_prompt=0, history=1, misc_prompt=2, call_prompt=3, last_turn=4), **history_args)[source]#

Get a list of Langchain messages using the context and prompts.

Parameters:

  • system_prompt (Message) – System message to be included in the context.

  • ctx (Context) – Current dialog context.

  • call_prompt (Prompt) – Prompt to be used for the current call.

  • prompt_misc_filter (str) – Regex pattern to filter miscellaneous prompts from context. Defaults to r”prompt”.

  • position_config (PositionConfig) – Configuration for positioning different parts of the context. Defaults to default PositionConfig().

  • history_args – Additional arguments to be passed to context_to_history function.

Return type:

list[Union[HumanMessage, AIMessage, SystemMessage]]

Returns:

List of Langchain message objects ordered by their position values.