LLM Slots#

Warning! This is an experimental feature.

This module contains Slots based on LLMs structured outputs, that can easily extract requested information from an unstructured user’s request.

class LLMSlot(caption, llm_model_name='')[source]#

LLMSlot is a slot type that extracts information described in caption parameter using LLM.

async extract_value(ctx)[source]#

Return value extracted from context.

Return SlotNotExtracted to mark extraction as unsuccessful.

Raising exceptions is also allowed and will result in an unsuccessful extraction as well.

class LLMGroupSlot(allow_partial_extraction=False, *, llm_model_name: str, **kwargs)[source]#

LLMSlots based GroupSlot implementation. Fetches data for all LLMSlots in a single API request contrary to GroupSlot.

async get_value(ctx)[source]#

Extract slot value from Context and return an instance of ExtractedSlot.

_dict_to_extracted_slots(d)[source]#: Convert nested dictionary of ExtractedValueSlots into an ExtractedGroupSlot.

_flatten_llm_group_slot(slot, parent_key='')[source]#

Convert potentially nested group slot into a dictionary with flat keys. Nested keys are flattened as concatenations via “.”.

As such, values in the returned dictionary are only of type LLMSlot.